Vehicle noise reduction method, electronic device, system, medium, program product and vehicle

Abstract

The invention relates to a vehicle noise reduction method, an electronic device, a system, a medium, a program product and a vehicle, driving environment information of the vehicle is obtained, and the driving environment information comprises vehicle window vibration information of the vehicle; and according to the driving environment information, noise spread into the vehicle is subjected to noise reduction processing. The invention aims to improve the noise reduction effect of the vehicle and improve the user experience.

Description

Technical Field

[0001] This application relates to the field of vehicle noise reduction, and more particularly to a vehicle noise reduction method, electronic device, system, medium, program product, and vehicle. Background Technology

[0002] In-vehicle noise is a crucial indicator of passenger comfort. To reduce vehicle noise, some models use microphones to collect interior noise data for noise reduction processing. However, because the microphones are located inside the vehicle, using them to collect noise and then perform noise reduction introduces significant latency, resulting in poor noise reduction performance. Summary of the Invention

[0003] This application provides a vehicle noise reduction method, electronic device, system, medium, program product, and vehicle, which improves the vehicle noise reduction effect and at least partially solves the above-mentioned technical problems.

[0004] To achieve the above objectives, according to a first aspect of this application, a vehicle noise reduction method is provided, the vehicle noise reduction method comprising:

[0005] Obtain vehicle driving environment information, including vehicle window vibration information;

[0006] Based on the driving environment information, noise transmitted into the vehicle is reduced.

[0007] According to a second aspect of this application, an electronic device is provided, comprising:

[0008] The transceiver module is used to acquire vehicle driving environment information, including vehicle window vibration information.

[0009] The control module is used to reduce noise transmitted into the vehicle based on the driving environment information.

[0010] According to a third aspect of this application, an electronic device is also provided, including a processor connected to a memory storing a computer program, the processor being configured to run the computer program in the memory to perform any of the above-described vehicle noise reduction methods.

[0011] According to a fourth aspect of this application, a vehicle noise reduction system is provided, the vehicle noise reduction system comprising:

[0012] A driving environment information acquisition device is used to collect driving environment information of a vehicle. The driving environment information acquisition unit includes a window vibration sensor, and the driving environment information includes window vibration information collected by the window vibration sensor.

[0013] A noise reduction device is used to reduce noise transmitted into the vehicle based on the driving environment information.

[0014] According to a fifth aspect of this application, a computer-readable storage medium is provided, the computer-readable storage medium storing a computer program, which, when executed by a processor, is any of the above-described vehicle noise reduction methods.

[0015] According to a sixth aspect of this application, a computer program product is provided, comprising a computer program that is executed by a processor to implement any of the above-described vehicle noise reduction methods.

[0016] According to a seventh aspect of this application, a vehicle is provided, including the vehicle noise reduction system as described above, or including the electronic device as described above.

[0017] The vehicle noise reduction method provided in this application acquires vehicle driving environment information, including vehicle window vibration information; and performs noise reduction processing on noise propagating into the vehicle based on the driving environment information. Acquiring driving environment information, including window vibration information, for noise reduction processing is equivalent to pre-collecting noise that will propagate into the vehicle, making the noise reduction processing more synchronized with the in-vehicle noise, thereby reducing noise reduction delay and effectively improving the vehicle's noise reduction effect and user experience.

[0018] Other features and advantages of this application will be described in detail in the following detailed description section. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings, wherein the same reference numerals in the following description denote the same parts.

[0021] Figure 1 This is a flowchart illustrating one embodiment of the vehicle noise reduction method provided in this invention.

[0022] Figure 2 This is a schematic diagram of the vehicle noise reduction process provided in the embodiments of the present invention;

[0023] Figure 3 This is a schematic diagram of the vehicle noise reduction system provided in an embodiment of the present invention;

[0024] Figure 4 This is a partial structural schematic diagram of the noise reduction device in the vehicle noise reduction system provided in this embodiment of the invention;

[0025] Figure 5 This is a schematic diagram of the structure of the electronic device provided in the embodiments of the present invention;

[0026] Figure 6 This is a schematic diagram of the structure of the electronic device provided in the embodiments of the present invention. Detailed Implementation

[0027] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0028] During a car ride, we hear various noises inside the vehicle. Some of these are generated by the car itself while it is in motion, while the rest are external noises transmitted into the cabin. In-vehicle noise mainly includes the following types:

[0029] Engine / Motor Noise: The vehicle engine / motor is a major source of noise, and its noise generation varies depending on the engine / motor speed (mainly generated and transmitted through the front fenders, hood, firewall, and exhaust pipe).

[0030] Road noise: Some road noise is generated by wind shearing in when the vehicle is traveling at high speed, as well as by the vibration of the chassis caused by driving, and by sand and gravel hitting the chassis on the road. Another part of road noise is the noise generated by other vehicles driving and being transmitted into the car.

[0031] Tire noise: Tire noise is generated by the friction between the tires and the road surface when a vehicle is traveling at high speed. The level of tire noise depends on the road conditions and the condition of the vehicle; the worse the road conditions, the greater the tire noise. Different types of road paving will also produce significant differences in tire noise.

[0032] Wind noise: Wind noise refers to the noise generated when the pressure of the oncoming wind exceeds the sealing resistance of the doors and enters the car when the car is traveling at high speed.

[0033] Resonance noise and other noises: The vehicle body itself is like a box, and sound itself has the property of folding and overlapping. When sound enters the car, if there are no sound-absorbing and sound-insulating materials to absorb and block it, the noise will be constantly refracted and overlapped, forming resonance noise.

[0034] These noises significantly impact the comfort of the ride.

[0035] The inventors discovered that some car models employ active noise cancellation technology to reduce in-vehicle noise. Current active noise cancellation systems use accelerometers to collect vehicle vibration information and microphones to collect in-vehicle audio information. However, because the microphones are deployed inside the vehicle, the processing of noise data using microphones introduces significant latency. The greater the latency, the greater the difference between the original noise and the reduced noise generated after processing by the noise cancellation system, resulting in poor noise reduction performance.

[0036] To address the aforementioned issues, this application proposes a vehicle noise reduction method, electronic device, system, medium, program product, and vehicle. This application process obtains external noise characteristics based on the vehicle's driving environment information, and then performs noise reduction processing on the noise transmitted into the vehicle based on these external noise characteristics, thereby reducing noise reduction latency and improving noise reduction effectiveness.

[0037] Specifically, the vehicle noise reduction method in this application can be applied to electronic devices. The subject executing the vehicle noise reduction method can be an electronic device, which can be a vehicle, such as a car, an electric vehicle, or a hybrid vehicle.

[0038] The following section will take the example of an electronic device being the main implementer of a vehicle noise reduction method to provide a detailed description of each embodiment.

[0039] Correspondingly, such as Figure 1 As shown, a vehicle noise reduction method may include the following steps:

[0040] S10. Obtain vehicle driving environment information, including vehicle window vibration information;

[0041] In this embodiment, the vehicle's driving environment information refers to the information about the environment in which the vehicle is located while driving. Specifically, it can include environmental information outside the vehicle's interior area, such as window vibration information and road surface information ahead of the vehicle. The vehicle's driving environment is a factor that directly affects in-vehicle noise and is a precursor factor affecting in-vehicle noise.

[0042] In this embodiment, the driving environment information includes window vibration information, which is data related to the vibration of the window and can characterize the noise at the window.

[0043] The inventors discovered that because car window glass is relatively thin, it becomes a major pathway for external noise to enter the vehicle, and noise at the window can comprehensively and completely reflect external environmental noise. Therefore, this invention can use car window vibration information as one of the driving environment information.

[0044] By adding a window vibration data acquisition unit, such as a window vibration sensor, to the vehicle, data can be collected before noise reaches the interior of the vehicle, even though it travels through the window—the main transmission path.

[0045] S20. Based on the driving environment information, noise transmitted into the vehicle is reduced.

[0046] In this embodiment, the vehicle's driving environment is a precursor to in-vehicle noise. Therefore, based on the vehicle's driving environment information, the in-vehicle noise generated after the driving environment information affects the in-vehicle environment can be determined. This is equivalent to being able to determine the vehicle's in-vehicle noise in advance through driving environment information.

[0047] After obtaining the vehicle's driving environment information, noise transmitted into the vehicle can be immediately reduced using this information. Since the transmission and processing of driving environment information takes time, the actual noise reduction time will be close to the time of the noise inside the vehicle, thus reducing the noise reduction delay.

[0048] In the technical solution disclosed in this embodiment, noise reduction processing is performed by acquiring driving environment information, including window vibration information. This is equivalent to collecting noise that will propagate into the vehicle in advance, making the noise reduction process more synchronized with the noise inside the vehicle, thereby reducing noise reduction delay and effectively improving the noise reduction effect of the vehicle and enhancing the user experience.

[0049] Optionally, the window vibration information is acquired before the time it takes for the noise to propagate into the vehicle.

[0050] In this embodiment, the window vibration information is acquired before the noise propagates into the vehicle. The acquisition time refers to the time of data collection. After the data collection time, the noise near the window, as represented by the window vibration information, continues to propagate into the vehicle. Since transmitting and processing driving environment information, including window vibration information, is time-consuming, the noise reduction process targets the in-vehicle noise after the window vibration information acquisition time. This in-vehicle noise is similar to the noise near the window, as represented by the window vibration information, thereby reducing noise reduction latency and effectively improving the vehicle's noise reduction performance.

[0051] Optionally, based on the driving environment information, noise reduction processing is performed on the noise transmitted into the vehicle, including:

[0052] Based on the driving environment information, determine the external noise characteristics corresponding to the driving environment information;

[0053] Based on the characteristics of the external noise, noise transmitted into the vehicle is reduced.

[0054] In this embodiment, feature extraction is performed on driving environment information, including window vibration information, to obtain external noise features. These external noise features characterize the external noise generated by the driving environment information. External noise is transmitted into the vehicle interior, and the external noise features obtained here essentially provide early characteristics of the interior noise.

[0055] After obtaining the external noise characteristics, noise reduction processing is performed using these characteristics as a reference. During this process, the external noise characteristics are transmitted and processed through the system via communication lines, resulting in a certain time delay. Only then is noise reduction processing applied to the noise propagating into the vehicle. At this point, the noise inside the vehicle is precisely based on the previously obtained external noise characteristics. Therefore, since the noise reduction processing is based on external noise characteristics, the time difference between the noise reduction processing and the noise inside the vehicle is smaller, resulting in better noise reduction performance compared to directly collecting the current noise inside the vehicle to obtain real-time noise characteristics.

[0056] By determining the external noise characteristics corresponding to the driving environment information based on this information, and then using these characteristics to reduce noise transmitted into the vehicle, the noise reduction delay can be reduced, effectively improving the noise reduction effect of the vehicle.

[0057] Optionally, the exterior noise features include window noise features, which are extracted from the filtered window vibration information based on a preset window noise feature extraction algorithm after filtering the window vibration information.

[0058] In this embodiment, the driving environment information includes window vibration information, so the obtained external noise features can include window noise features. The window noise features represent the time when the window vibration information is obtained, the noise near the window, and the noise that will also be transmitted to the vehicle interior and disturb the user. This noise is considered external noise, and the external noise features can include window noise features.

[0059] In this embodiment, after collecting the window vibration information, it is necessary to preprocess the information to extract window noise features. Preprocessing includes filtering and feature extraction. Filtering removes noise from the window vibration information. Specifically, the filtering module corresponding to the window vibration information can be used to filter out noise, thus obtaining accurate window vibration information that accurately represents the window vibration and consequently, accurately representing external noise. Filtering can be low-pass filtering, median filtering, moving average filtering, etc., to remove random noise, impulse noise, etc., from the window vibration information.

[0060] Based on a pre-defined window noise feature extraction algorithm, window noise features are extracted from the clutter-filtered window vibration information. These window noise features can characterize noise near the window. The window noise feature extraction algorithm can be a deep learning algorithm, utilizing convolutional neural networks (CNNs) or recurrent neural networks (RNNs) to automatically learn complex features from vehicle vibration information as window noise features. Alternatively, the algorithm can be a time-domain feature extraction algorithm, calculating statistical quantities of vehicle vibration information, such as mean, variance, root mean square value, peak value, skewness, and kurtosis, or performing time-domain waveform analysis of the vibration signal, such as the periodicity and regularity of the waveform, to obtain information as window noise features.

[0061] It is understandable that after a certain period of time, the noise represented by the window noise feature will be transmitted into the vehicle and become the vehicle interior noise. Therefore, the window noise feature can represent the current real-time window noise as well as the interior noise in the subsequent time.

[0062] By filtering out noise from the vibration information of the car window, the information is transmitted to the corresponding window noise feature extraction module, which accurately obtains the window noise features that can be used as external noise features, thereby further improving the vehicle noise reduction effect.

[0063] Optionally, the driving environment information also includes information about the road surface ahead of the vehicle.

[0064] In this embodiment, the driving environment information may further include road surface information ahead of the vehicle. Road surface information refers to relevant information about the road surface ahead of the vehicle, specifically road surface images, road surface point cloud data, etc. The road surface ahead of the vehicle refers to the road surface the vehicle will pass through but has not yet traversed; for example, a road surface ten meters ahead of the vehicle that the vehicle will pass through in n seconds. The road surface conditions are also a significant factor contributing to in-vehicle noise. This embodiment, by acquiring road surface information ahead of the vehicle, effectively obtains the road surface conditions in advance, which can be used to analyze in-vehicle noise in advance.

[0065] In this embodiment, an image acquisition device such as a forward-looking binocular camera can be used to collect road surface information in front of the vehicle. Based on the road surface information, noise transmitted into the vehicle is processed for noise reduction. Since the transmission and processing of driving environment information takes time, the actual noise reduction time will be close to the time it takes for the vehicle to pass through the road surface corresponding to the driving environment information and cause noise in the vehicle. This can reduce the noise reduction delay. Acquiring driving environment information for noise reduction processing can also further improve the accuracy of noise reduction processing and further improve the vehicle noise reduction effect.

[0066] Furthermore, the external noise features include road surface noise features, which are extracted from the enhanced road surface information based on a preset road surface noise feature extraction algorithm after data augmentation processing of the road surface information.

[0067] In this embodiment, by analyzing and calculating the road surface information in front of the vehicle, the road noise characteristics when the vehicle passes through the road surface can be obtained. The road noise characteristics characterize the in-vehicle noise generated when the vehicle passes through the corresponding road surface. When collecting road driving information, the vehicle has not passed through the corresponding road surface, and the noise generated by the road surface in the vehicle is not actually transmitted to the vehicle. Therefore, the external noise characteristics can include the road noise characteristics.

[0068] In this embodiment, if the driving environment information includes road surface information, then the obtained external noise features may include road surface noise features.

[0069] After acquiring road surface information, it needs to be preprocessed to extract road noise features. Preprocessing of road surface information can include data augmentation and feature extraction. Data augmentation enhances the road surface information to accurately represent the road conditions ahead of the vehicle. Specifically, the road surface information can be a road surface image, and data augmentation processing can be performed on the image using IPS (Image Signal Processing), which may include cropping, image optimization (e.g., black level correction, white balance, depigmentation, noise reduction, sharpening, etc.).

[0070] This algorithm extracts road noise features from data-augmented road surface information based on a pre-defined road noise feature extraction algorithm. The algorithm can be an image feature extraction algorithm, such as deep learning algorithms or machine learning feature extraction.

[0071] By performing data augmentation on the road surface information and then using the corresponding road surface noise feature extraction algorithm, the road surface noise features that can be used as external noise features can be accurately obtained, thereby further improving the vehicle noise reduction effect.

[0072] Optionally, the exterior noise characteristics include a fusion of road noise characteristics and window noise characteristics.

[0073] Based on the above, it can be seen that vehicles can collect window vibration information through sensors such as window vibration sensors, and simultaneously collect road surface information ahead of the vehicle through devices such as forward-facing binocular cameras. Therefore, driving environment information can include at least one of window vibration information and driving environment information. For driving environment information, after filtering, window noise features can be extracted using a preset window noise feature extraction algorithm. For driving environment information, after data augmentation, road noise features can be extracted using a preset road noise feature extraction algorithm.

[0074] In some embodiments, the external noise features may include at least one of road noise features and window noise features, and noise reduction processing may be performed based on the road noise features and window noise features respectively.

[0075] In some embodiments, refer to Figure 2 After obtaining the road noise features and the window noise features, the road noise features and the window noise features can be fused to obtain the fused features of the road noise features and the window noise features. Then, noise reduction processing can be performed based on the external noise features.

[0076] In some embodiments, the external noise features may further include at least one of road noise features, window noise features, and the above-mentioned fused features, and then noise reduction processing is performed based on the road noise features, window noise features, and the above-mentioned fused features, respectively.

[0077] Optionally, after preprocessing the window vibration information and the road surface information separately, road noise features and window noise features can be obtained. Then, these two noise features are fused to obtain a unified fused noise feature as the external noise feature, which can then be used for noise reduction processing.

[0078] In some embodiments, both road noise features and window noise features are feature vectors extracted using deep learning algorithms. Therefore, feature vector data fusion can be performed to retain as much original information as possible. In some embodiments, an adaptive fusion algorithm can be used to fuse road noise features and window noise features, thereby enhancing the ability to represent external noise that will be transmitted to the vehicle's interior.

[0079] In this way, on the one hand, the fusion can reduce the types and number of noise features that need to be referenced in the noise reduction process, thereby improving the noise reduction efficiency. On the other hand, since all the noise features are collected in advance, the fusion can improve the accuracy and further improve the vehicle noise reduction effect.

[0080] Optionally, based on the external noise characteristics, noise reduction processing is performed on the noise transmitted into the vehicle, including:

[0081] Determine the noise reduction parameters corresponding to the external noise characteristics;

[0082] Based on the noise reduction parameters, the noise reduction device of the vehicle is controlled to perform noise reduction processing on the noise transmitted into the vehicle.

[0083] In this embodiment, the vehicle includes a noise reduction device that performs noise reduction processing based on noise reduction parameters. Vehicle noise characteristics can represent the characteristics of noise propagating into the vehicle interior. Noise reduction parameters corresponding to the external noise characteristics can be determined with reference to external noise characteristics. In some embodiments, the corresponding noise reduction parameters can be determined based on external noise characteristics and a preset mapping relationship, thereby controlling the electronic device to perform noise reduction processing on the vehicle interior.

[0084] By controlling the noise reduction parameters corresponding to the characteristics of external noise, the vehicle's noise reduction device can be controlled to reduce the noise transmitted into the vehicle, thus achieving precise noise reduction and improving the vehicle's noise reduction effect with low noise reduction latency.

[0085] Furthermore, the noise reduction device includes the vehicle's speakers, the noise reduction parameters include noise reduction frequencies, and the step of controlling the vehicle's noise reduction device to perform noise reduction processing on noise propagating into the vehicle based on the noise reduction parameters includes:

[0086] Based on the noise reduction frequency, the vehicle's speakers are controlled to emit sound, and the sound emitted by the speakers completely or partially cancels out the noise.

[0087] In this embodiment, the vehicle noise reduction device includes a vehicle speaker, which can be installed inside the vehicle to emit sound within the vehicle. Based on the characteristics of external noise representing relevant information about the noise that will be transmitted into the vehicle, a noise-reducing frequency that is opposite to the external noise signal can be generated using the external noise characteristics as a noise reduction parameter. This parameter is then used to control the vehicle speaker to emit sound, so that the noise-reducing frequency plays and completely or partially cancels out the noise propagating into the vehicle, thereby achieving noise reduction processing of the noise propagating into the vehicle.

[0088] By using the vehicle's speakers to emit noise-reducing frequencies, the noise emitted by the speakers can be completely or partially canceled out, thus achieving a better vehicle noise reduction effect.

[0089] Optionally, the noise reduction frequency is generated based on the external noise characteristics and an adaptive noise reduction algorithm.

[0090] In this embodiment, noise reduction is achieved through an adaptive noise reduction algorithm. This algorithm adaptively processes the external noise characteristics to obtain the reduced noise frequency. The external noise characteristics can be used as input to the adaptive noise reduction algorithm, which outputs the reduced noise frequency. For example, in some embodiments, the external noise characteristics can be directly input to the adaptive noise reduction algorithm. The algorithm can then output noise audio based on the external noise characteristics, and after reverse processing, the reduced noise frequency corresponding to the external noise characteristics is obtained.

[0091] Furthermore, adjustment parameters corresponding to the characteristics of external vehicle noise can be obtained to adjust the adaptive noise reduction algorithm, thereby enabling the adaptive noise reduction algorithm to output the corresponding noise reduction frequency. In this way, by adaptively generating noise reduction frequencies through external vehicle noise characteristics and the adaptive noise reduction algorithm, the noise reduction device can be controlled efficiently and accurately to reduce noise, thereby further improving the vehicle noise reduction effect.

[0092] Optionally, the noise reduction frequency is generated by adjusting the filter order and convergence factor of the adaptive noise reduction algorithm based on the adjustment parameters corresponding to the vehicle exterior noise characteristics.

[0093] In this embodiment, the adaptive noise reduction module can output a default noise reduction frequency, which can be adjusted by the filter order and convergence factor to output different noise reduction frequencies. After collecting the external noise features, the adjustment parameters corresponding to the external noise features can be obtained. These adjustment parameters are the parameters for adjusting the filter order and convergence factor in the adaptive noise reduction module. After adjusting the adaptive noise reduction module based on the adjustment parameters, the noise reduction frequency output by the adaptive noise reduction module can be adjusted. The noise reduction frequency corresponding to the external noise features output by the adjusted adaptive noise reduction module can be obtained for noise reduction. This quickly obtains the noise reduction frequency corresponding to the external noise features, further reducing noise reduction latency and improving noise reduction effect.

[0094] Optionally, the vehicle includes at least two speakers, and controlling the speakers of the vehicle to emit sound based on the noise reduction frequency includes:

[0095] Based on the arrangement information of the at least two speakers and the noise reduction frequency, a spatial noise reduction frequency for the at least two speakers is generated;

[0096] Control at least one of the speakers to emit sound based on its corresponding spatial noise reduction frequency in order to reduce noise propagating to the vehicle interior space where the corresponding speaker is located.

[0097] In this embodiment, since there is a certain space inside the vehicle, the noise reduction frequency effect heard at different locations within that space varies. Therefore, in this embodiment, at least two speakers can be installed inside the vehicle to play the noise reduction frequency, and these speakers can be installed in different locations. After the adaptive noise reduction module generates and outputs the noise reduction frequency, at least two spatial noise reduction frequencies for the speakers can be generated based on the arrangement information of the at least two speakers. The arrangement information refers to the installation position information of the speakers within the vehicle. When each speaker plays the spatial noise reduction frequency, it can achieve a better noise reduction effect near the speaker. This allows at least one speaker to be controlled to emit sound based on its corresponding spatial noise reduction frequency, so as to reduce the noise propagating to the noise in the vehicle space where the corresponding speaker is located, thereby further improving the noise reduction effect.

[0098] Optionally, based on any of the above embodiments, in another embodiment of the vehicle noise reduction method of the present invention, the method further includes:

[0099] Step 30: Obtain the real-time noise information of the vehicle;

[0100] Step 40: Based on the real-time noise information, perform noise reduction processing on the real-time noise inside the vehicle.

[0101] In this embodiment, real-time noise information of the vehicle can also be collected using real-time noise acquisition devices. This real-time noise information characterizes the real-time noise inside the vehicle. Noise reduction processing is then performed on the noise inside the vehicle based on this real-time noise information.

[0102] In the technical solution disclosed in this embodiment, in addition to performing noise reduction processing on the noise transmitted into the vehicle based on driving environment information, noise reduction processing can also be performed on the real-time noise inside the vehicle based on real-time noise information, thereby reducing residual noise and further improving the vehicle noise reduction effect.

[0103] Optionally, real-time noise information includes in-vehicle audio information.

[0104] In this embodiment, in-vehicle audio information can be collected by a sound acquisition device installed in the vehicle. The sound acquisition device can be a microphone or the like. The sound acquisition device can collect in-vehicle audio information in real time, so as to obtain in-vehicle audio information as real-time noise information.

[0105] Optionally, real-time noise information includes vehicle body vibration data.

[0106] In this embodiment, vehicle vibration data can be collected using one or more of a vehicle vibration sensor and an acceleration sensor installed inside the vehicle. This vehicle vibration data represents the real-time vibration caused by the vehicle body, which is related to the real-time noise inside the vehicle, and thus represents the real-time noise level inside the vehicle. By using one or more of the vehicle vibration sensor and acceleration sensor, vehicle vibration data can be collected in real time, thereby obtaining real-time vehicle vibration data as real-time noise information.

[0107] Optionally, based on the real-time noise information, noise reduction processing is performed on the real-time noise inside the vehicle, including:

[0108] Based on the real-time noise information, determine the real-time noise features corresponding to the real-time noise information;

[0109] Based on the real-time noise characteristics, noise reduction processing is performed on the real-time noise inside the vehicle.

[0110] In this embodiment, real-time noise features can be extracted from real-time noise information. Based on the real-time noise features, noise reduction processing is performed on the real-time noise inside the vehicle. The real-time noise features and the external noise features can be the same type of data. The specific noise reduction method can refer to the above-mentioned noise reduction processing based on external noise features.

[0111] For example, by determining the noise reduction frequency corresponding to the real-time noise characteristics, and based on this noise reduction frequency, the speakers in the vehicle's noise reduction device are controlled to emit sound to completely or partially cancel out the real-time noise inside the vehicle, thus achieving noise reduction processing of the real-time noise inside the vehicle. The noise reduction frequency corresponding to the real-time noise characteristics can be generated based on the real-time noise characteristics and an adaptive noise reduction algorithm. After adjusting the filtering order and convergence factor of the adaptive noise reduction algorithm based on the adjustment parameters corresponding to the real-time noise characteristics, the adaptive noise reduction algorithm generates and outputs the noise reduction frequency corresponding to the real-time noise characteristics.

[0112] By performing real-time noise feature processing based on real-time noise information, the noise reduction process inside the vehicle can be further improved by removing residual noise and enhancing the vehicle's noise reduction effect.

[0113] Optionally, the vehicle is also equipped with an optical network, and the method further includes:

[0114] Data is transmitted via the optical network.

[0115] In this embodiment, an optical network bus is used instead of the conventional A2B / CAN communication bus to transmit a large amount of system data, including at least one of the following: driving environment information, external noise characteristics, and noise reduction frequency. By utilizing the high bandwidth and high speed data transmission characteristics of optical network communication, the transmission delay of a large amount of data is greatly reduced, thereby further eliminating the noise reduction delay problem caused by transmission delay and processing delay, and further improving the noise reduction effect.

[0116] This embodiment also provides a vehicle noise reduction system, which can be integrated into a vehicle. The electronic device may include:

[0117] A driving environment information acquisition device is used to collect driving environment information of a vehicle. The driving environment information acquisition unit also includes a window vibration sensor. The driving environment information includes window vibration information collected by the window vibration sensor.

[0118] The noise reduction device is used to reduce noise transmitted into the vehicle based on driving environment information, and can be used to perform the steps of any of the methods in the above embodiments.

[0119] Optionally, refer to Figure 3 The vehicle noise reduction system collects driving environment information, including window vibration sensors and image acquisition devices. The image acquisition devices can be forward-looking binocular cameras. The driving environment information can also include road surface information in front of the vehicle. The image acquisition devices are used to collect this road surface information.

[0120] Reference Figure 3 The vehicle noise reduction system also includes a drive circuit for a window vibration sensor array and a drive circuit for a forward-looking binocular camera. The window vibration sensor and its drive circuit can collect window vibration information and transmit it to the noise reduction device to perform vehicle noise reduction methods. The forward-looking binocular camera and its drive circuit can collect road surface information in front of the vehicle and transmit the collected road surface information to the noise reduction device. The noise reduction device uses the road surface information and window vibration information to process the noise transmitted into the vehicle, which can effectively reduce noise reduction delay and improve the vehicle's noise reduction effect.

[0121] Optionally, the driving environment information acquisition device may also include one or more of the following: a sound acquisition device, a vehicle vibration sensor, and an acceleration sensor;

[0122] The sound acquisition device is used to collect in-vehicle audio information.

[0123] The acceleration sensor and the vehicle vibration sensor are used to collect vehicle vibration data.

[0124] In this embodiment, refer to Figure 3 The vehicle noise reduction system may also include a real-time noise acquisition device, which may include one or more of a sound acquisition device, a vehicle body vibration sensor, and an acceleration sensor. For example, the sound acquisition device may be an in-vehicle microphone, and the real-time noise acquisition device includes an in-vehicle microphone and an acceleration sensor. The in-vehicle microphone and its driving circuit can acquire real-time in-vehicle audio information and transmit it to the noise reduction device, enabling it to perform noise reduction processing on the real-time noise inside the vehicle based on the in-vehicle audio information. The acceleration sensor and its driving circuit can acquire real-time vehicle body vibration data and transmit it to the noise reduction device, enabling it to perform noise reduction processing on the real-time noise inside the vehicle based on the in-vehicle audio information. Based on noise reduction using driving environment information, residual noise can be effectively removed, further improving the vehicle's noise reduction effect.

[0125] Optionally, refer to Figure 3 The noise reduction device also includes a playback unit, which includes a speaker and a speaker driver circuit. In this way, the noise reduction device can generate noise reduction frequencies based on one or more real-time noise information, including in-vehicle audio information and vehicle vibration data, to control the speaker to produce sound and achieve adaptive noise reduction function.

[0126] Optionally, the entire system may also include an optical network, using an optical network bus to replace the conventional A2B / CAN communication bus for the transmission of large amounts of system data. This utilizes the high bandwidth and high speed data transmission characteristics of optical network communication to greatly reduce the transmission latency of large amounts of data, thereby further eliminating the noise reduction latency problems caused by transmission latency and processing latency, and further improving the noise reduction effect.

[0127] Optionally, refer to Figure 4 The noise reduction device of the aforementioned vehicle noise reduction system may further include a TSN Gateway optical network module, a preprocessing module, a clutter filtering module, an ISP module, a window noise feature extraction module, a road noise feature extraction module, a fusion module, an adaptive noise reduction module, and a spatial audio module. The TSN Gateway module is used to receive information from the sound acquisition device, accelerometer, window vibration sensor, and image acquisition device transmitted from the optical network, and send the processed data to the optical network.

[0128] The preprocessing module filters and converts data collected by at least one of the sound acquisition device, accelerometer, and vehicle vibration sensor into real-time noise features. It then generates adjustment parameters for the adaptive noise reduction module based on these real-time noise features. The filtering module removes noise from the window vibration information collected by the window vibration sensor. This information is then passed to the window noise feature extraction module, which converts the information into corresponding window noise features, extracting the noise characteristics near the window—the noise characteristics that will be transmitted to the vehicle's interior. The ISP module performs data enhancement processing on the road surface information collected by the image acquisition device. This road surface information can be an image of the road surface. The image enhancement is then passed to the road surface noise feature extraction module, which converts the road surface information into corresponding road surface noise features, thus pre-extracting the noise characteristics generated by the vehicle when passing over this road surface. The fusion processing module fuses the road surface noise features and window noise features to obtain fused exterior noise features. These fused exterior noise features are then converted into adjustment parameters for the adaptive noise reduction module. The adaptive noise reduction module receives these adjustment parameters. The adaptive noise reduction module adaptively adjusts its filter order and convergence factor based on the adjustment parameters, and generates a noise-reduced frequency after algorithm processing. The spatial audio module then sends the processed noise-reduced frequency to each speaker for playback based on the speaker layout information in the vehicle, thus achieving vehicle noise reduction.

[0129] This embodiment also provides an electronic device that can be integrated into a vehicle, for example, such as... Figure 5 As shown, the electronic device may include:

[0130] The transceiver module 1001 is used to acquire vehicle driving environment information, including vehicle window vibration information.

[0131] The control module 1002 is used to perform noise reduction processing on the noise transmitted into the vehicle based on the driving environment information.

[0132] Optionally, the window vibration information is acquired before the time it takes for the noise to propagate into the vehicle.

[0133] Optionally, the control module 1002 is also used for,

[0134] Based on the driving environment information, determine the external noise characteristics corresponding to the driving environment information;

[0135] Based on the characteristics of the external noise, noise transmitted into the vehicle is reduced.

[0136] Optionally, the exterior noise features include window noise features, which are extracted from the filtered window vibration information based on a preset window noise feature extraction algorithm after filtering the window vibration information.

[0137] Optionally, the driving environment information may also include information about the road surface ahead of the vehicle.

[0138] Optionally, the external noise features include road surface noise features, which are extracted from the enhanced road surface information based on a preset road surface noise feature extraction algorithm after data augmentation processing of the road surface information.

[0139] Optionally, the external noise characteristics include a fusion of road noise characteristics and window noise characteristics.

[0140] Optionally, the control module 1002 is also used for,

[0141] Determine the noise reduction parameters corresponding to the external noise characteristics;

[0142] Based on the noise reduction parameters, the noise reduction device of the vehicle is controlled to perform noise reduction processing on the noise transmitted into the vehicle.

[0143] Optionally, the noise reduction device includes the vehicle's speakers, the noise reduction parameters include the noise reduction frequency, and the control module 1002 is further configured to...

[0144] Based on the noise reduction frequency, the vehicle's speakers are controlled to emit sound, and the sound emitted by the speakers completely or partially cancels out the noise.

[0145] Optionally, the noise reduction frequency is generated based on the external noise characteristics and an adaptive noise reduction algorithm.

[0146] Optionally, the noise reduction frequency is generated by adjusting the filter order and convergence factor of the adaptive noise reduction algorithm based on the adjustment parameters corresponding to the vehicle exterior noise characteristics.

[0147] Optionally, the vehicle includes at least two speakers, and the control module 1002 is further used for,

[0148] Based on the arrangement information of the at least two speakers and the noise reduction frequency, a spatial noise reduction frequency for the at least two speakers is generated;

[0149] Control at least one of the speakers to emit sound based on its corresponding spatial noise reduction frequency in order to reduce noise propagating to the vehicle interior space where the corresponding speaker is located.

[0150] Optionally, the transceiver module 1001 is further configured to acquire real-time noise information of the vehicle;

[0151] The control module 1002 is also used to perform noise reduction processing on the real-time noise inside the vehicle based on the real-time noise information.

[0152] Optionally, the real-time noise information includes in-vehicle audio information.

[0153] Optionally, the real-time noise information includes vehicle body vibration data.

[0154] Optionally, the control module 1002 is further configured to determine the real-time noise characteristics corresponding to the real-time noise information based on the real-time noise information;

[0155] Based on the real-time noise characteristics, noise reduction processing is performed on the real-time noise inside the vehicle.

[0156] Optionally, the vehicle includes an optical network through which data is transmitted.

[0157] This embodiment acquires driving environment information, including window vibration information, for noise reduction processing. This is equivalent to collecting noise that will propagate into the vehicle in advance, making the noise reduction processing more synchronized with the noise inside the vehicle, thereby reducing noise reduction delay and effectively improving the vehicle's noise reduction effect and enhancing the user experience.

[0158] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0159] Accordingly, embodiments of this application also provide an electronic device, such as... Figure 6 As shown, Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device 1100 may be equipped with any of the noise reduction systems described in the above embodiments. The electronic device 1100 also includes a processor 1101 with one or more processing cores, a memory 1102 with one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 and the memory 1102 are electrically connected. Those skilled in the art will understand that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0160] The processor 1101 is the control center of the electronic device 1100. It connects various parts of the electronic device 1100 via various interfaces and lines. By running or loading software programs and / or units stored in the memory 1102, and by calling data stored in the memory 1102, it executes various functions of the electronic device 1100 and processes data, thereby providing overall monitoring of the electronic device 1100. The processor 1101 can be a CPU, GPU, network processor (NP), etc., and can implement or execute the methods, steps, and logic diagrams disclosed in the embodiments of this application.

[0161] In this embodiment, the processor 1101 in the electronic device 1100 loads the instructions corresponding to the processes of one or more applications into the memory 1102 according to the following steps, and the processor 1101 runs the applications stored in the memory 1102 to realize various functions, such as:

[0162] Obtain vehicle driving environment information, including vehicle window vibration information;

[0163] Based on the driving environment information, noise transmitted into the vehicle is reduced.

[0164] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0165] Optional, such as Figure 6 As shown, the electronic device 1100 also includes: a touch display screen 1103, a radio frequency circuit 1104, an audio circuit 1105, an input unit 1106, and a power supply 1107. The processor 1101 is electrically connected to the touch display screen 1103, the radio frequency circuit 1104, the audio circuit 1105, the input unit 1106, and the power supply 1107. Those skilled in the art will understand that... Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0166] The touch display screen 1103 can be used to display a graphical user interface (GUI) and receive operation commands generated by the user interacting with the GUI. The touch display screen 1103 may include a display panel and a touch panel. The display panel can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the electronic device. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Optionally, the display panel can be configured using a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other similar devices. The touch panel can be used to collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel), generate corresponding operation commands, and execute the corresponding program according to the operation commands. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch location and the signal generated by the touch operation, transmitting the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 1101. It can also receive and execute commands from the processor 1101. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it transmits the information to the processor 1101 to determine the type of touch event. Subsequently, the processor 1101 provides corresponding visual output on the display panel based on the type of touch event. In this embodiment, the touch panel and the display panel can be integrated into the touch display screen 1103 to achieve input and output functions. However, in some embodiments, the touch panel and the touch display screen 1103 can be used as two independent components to achieve input and output functions. That is, the touch display screen 1103 can also be used as part of the input unit 1106 to achieve input functions.

[0167] The radio frequency circuit 1104 can be used to transmit and receive radio frequency signals to establish wireless communication with networked medical devices or other electronic devices, and to transmit and receive signals with networked medical devices or other electronic devices.

[0168] Audio circuit 1105 can be used to provide an audio interface between a user and an electronic device via a speaker and a microphone. Audio circuit 1105 can convert received audio data into electrical signals and transmit them to the speaker, where the speaker converts them into sound signals for output. Conversely, the microphone converts the collected sound signals into electrical signals, which are then received by audio circuit 1105, converted back into audio data, and then processed by processor 1101 before being transmitted via radio frequency circuit 1104 to, for example, another electronic device, or output to memory 1102 for further processing. Audio circuit 1105 may also include an earphone jack to provide communication between peripheral headphones and electronic devices.

[0169] The input unit 1106 can be used to receive input numbers, characters, or user characteristic information (such as fingerprints, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0170] Power supply 1107 is used to supply power to the various components of electronic device 1100. Optionally, power supply 1107 can be logically connected to processor 1101 through a power management device, thereby enabling functions such as charging, discharging, and power consumption management through the power management device. Power supply 1107 may also include one or more DC or AC power supplies, recharging devices, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0171] although Figure 6 As not shown in the diagram, the electronic device 1100 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0172] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0173] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0174] Therefore, embodiments of this application provide a computer-readable storage medium storing multiple computer programs. These computer programs can be loaded by a processor to execute any of the vehicle noise reduction methods provided in this application. The computer program can execute the following steps of the vehicle noise reduction method:

[0175] Obtain vehicle driving environment information, including vehicle window vibration information;

[0176] Based on the driving environment information, noise transmitted into the vehicle is reduced.

[0177] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0178] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0179] Since the computer-readable storage medium contains a computer program that can implement any of the vehicle noise reduction methods provided in the embodiments of this application, it can execute any of the vehicle noise reduction methods provided in the embodiments of this application. Therefore, the effects are detailed in the preceding embodiments and will not be repeated here.

[0180] In the above descriptions of vehicle noise reduction methods, electronic devices, vehicle noise reduction systems, vehicles, computer-readable storage media, and computer program products, each embodiment has its own emphasis. Parts not detailed in a particular embodiment can be referred to in the relevant descriptions of other embodiments. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes and beneficial effects of the above-described electronic devices, vehicles, computer-readable storage media, computer program products, and their corresponding units can be referred to the description of the vehicle noise reduction method in the above embodiments, and will not be repeated here.

[0181] The present application provides a detailed description of a vehicle noise reduction method, apparatus, vehicle, computer-readable storage medium, and computer program product. Specific examples have been used to illustrate the principles and implementation methods of the present application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present application. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of the present application. Therefore, the content of this specification should not be construed as a limitation of the present application.

Claims

1. A vehicle noise reduction method, characterized by, The vehicle noise reduction method comprises: obtaining driving environment information of the vehicle, the driving environment information comprising window vibration information of the vehicle; performing noise reduction processing on noise propagating into the vehicle according to the driving environment information.

2. The vehicle noise reduction method of claim 1, wherein, The time of obtaining the window vibration information is before the time of the noise propagating into the vehicle.

3. The vehicle noise reduction method according to claim 1 or 2, characterized by, The noise reduction processing according to the driving environment information comprises: determining noise characteristics outside the vehicle corresponding to the driving environment information according to the driving environment information; performing noise reduction processing on noise propagating into the vehicle according to the noise characteristics outside the vehicle.

4. The vehicle noise reduction method of claim 3, wherein, The noise characteristics outside the vehicle comprise window noise characteristics, which are extracted from the window vibration information after filtering processing of the window vibration information based on a preset window noise characteristic extraction algorithm.

5. The vehicle noise reduction method of claim 3, wherein, The driving environment information further comprises road surface information in front of the vehicle.

6. The vehicle noise reduction method of claim 5, wherein, The noise characteristics outside the vehicle comprise road surface noise characteristics, which are extracted from the road surface information after data enhancement processing of the road surface information based on a preset road surface noise characteristic extraction algorithm.

7. The vehicle noise reduction method of claim 3, wherein, The noise characteristics outside the vehicle comprise fusion characteristics of the road surface noise characteristics and the window noise characteristics.

8. The vehicle noise reduction method of claim 3, wherein, The noise reduction processing according to the noise characteristics outside the vehicle comprises: determining noise reduction parameters corresponding to the noise characteristics outside the vehicle; controlling a noise reduction device of the vehicle to perform noise reduction processing on noise propagating into the vehicle based on the noise reduction parameters.

9. The vehicle noise reduction method of claim 8, wherein, The noise reduction device comprises a speaker of the vehicle, and the noise reduction parameters comprise noise reduction audio. The noise reduction audio is generated based on the noise characteristics outside the vehicle and an adaptive noise reduction algorithm.

10. The vehicle noise reduction method of claim 9, wherein, The noise reduction audio is generated by adjusting filter order and convergence factor of the adaptive noise reduction algorithm based on adjustment parameters corresponding to the noise characteristics outside the vehicle.

11. The vehicle noise reduction method of claim 10, wherein, The vehicle comprises at least two speakers.

12. The vehicle noise reduction method of claim 9, wherein, The method further comprises: obtaining real-time noise information of the vehicle; performing noise reduction processing on real-time noise in the vehicle according to the real-time noise information.

13. The vehicle noise reduction method of any one of claims 1-12, wherein, The real-time noise information comprises in-vehicle audio information. The real-time noise information comprises vehicle body vibration data. The noise reduction processing according to the real-time noise information comprises:

14. The vehicle noise reduction method of claim 13, wherein, ​ 15. The vehicle noise reduction method of claim 13, wherein, ​ 16. The vehicle noise reduction method of claim 13, wherein, ​ According to the real-time noise information, a real-time noise feature corresponding to the real-time noise information is determined; According to the real-time noise feature, a real-time noise in the vehicle is processed.

17. The vehicle noise reduction method of any one of claims 1-16, wherein, The vehicle comprises an optical network, and the method further comprises: Data is transmitted through the optical network.

18. An electronic device, comprising: Comprise: A transceiver module is configured to acquire driving environment information of the vehicle, wherein the driving environment information comprises window vibration information of the vehicle; A control module is configured to process noise propagating into the vehicle according to the driving environment information.

19. An electronic device, comprising: The vehicle comprises a processor connected to a memory, wherein the memory stores a computer program, and the processor is configured to run the computer program in the memory to execute the vehicle noise reduction method according to any one of claims 1 to 17.

20. A vehicle noise reduction system, characterized by, The vehicle noise reduction system comprises: A driving environment information acquisition device is configured to acquire driving environment information of the vehicle, wherein the driving environment information acquisition unit comprises a window vibration sensor, and the driving environment information comprises window vibration information acquired by the window vibration sensor; A noise reduction device is configured to process noise propagating into the vehicle according to the driving environment information.

21. The vehicle noise reduction system of claim 20, wherein, The environment information acquisition device further comprises an image acquisition device; The image acquisition device is configured to acquire driving road surface information in front of the vehicle included in the driving environment information.

22. The vehicle noise reduction system of claim 20, wherein, The vehicle noise reduction system further comprises: An optical network is configured to communicate data in the vehicle noise reduction system.

23. The vehicle noise reduction system of claim 20, wherein, The driving environment information acquisition device further comprises one or more of a sound acquisition device, a vehicle body vibration sensor and an acceleration sensor; The sound acquisition device is configured to acquire in-vehicle audio information; The acceleration sensor and the vehicle body vibration sensor are configured to acquire vehicle body vibration data; The noise reduction device is further configured to process real-time noise in the vehicle according to one or more of the in-vehicle audio information and the vehicle body vibration data.

24. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the vehicle noise reduction method according to any one of claims 1 to 17.

25. A computer program product, characterised in that, The computer program is executed by the processor to implement the vehicle noise reduction method according to any one of claims 1 to 17.

26. A vehicle characterized by The vehicle noise reduction system comprises the vehicle noise reduction system according to any one of claims 20 to 23, or the electronic device according to claim 18 or claim 19.

Images