Out-vehicle horn processing method and related equipment

Through preprocessing of the outside horn sound and the use of multimodal data fusion model, intelligently identifying and filtering of unreasonable horn sounds, the interference problem of noisy outside horn sounds on the driver is solved, and driving safety and comfort are improved.

CN119091899AActive Publication Date: 2024-12-06DONGFENG MOTOR GRP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411062025.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-12-06
Estimated Expiration
2044-08-05

AI Technical Summary

Technical Problem

The prior art cannot effectively identify and filter the sound of outside the vehicle horns that are unreasonable when there is no safety risk, resulting in noisy horns that interfere with drivers and affect driving concentration and safety.

Method used

By obtaining the optimized audio signals outside the target vehicle, preprocessing and supporting vector machine classification, combining the vehicle environment and its own state, using Kalman filtering and deep learning to build a multimodal data fusion model, intelligently identify and filter unreasonable horn sounds.

Benefits of technology

It realizes automatic identification and filtering of unreasonable horn sounds outside the vehicle, reduces interference to the driver, and ensures safety and comfort of the driving process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119091899A_ABST
    Figure CN119091899A_ABST
Patent Text Reader

Abstract

The invention discloses an out-of-vehicle horn processing method and related equipment, relates to the field of vehicle control, and mainly aims to solve the problem that a corresponding processing method for out-of-vehicle noisy horns is lacked at present. The method comprises the steps that an optimized audio signal outside a target vehicle is acquired, and the optimized audio signal is determined by preprocessing based on an initial audio signal; classifying the optimized audio signal based on a support vector machine to obtain an audio classification result; and combining the audio classification result with the environment outside the target vehicle and the own state to determine an audio filtering operation outside the target vehicle. The method is used for the horn sound processing process outside the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle control, and in particular to a method for processing an external horn sound of a vehicle and related equipment. Background Art

[0002] As urban traffic density increases, the driving environment becomes more and more complex. In busy traffic, horn sounds have become an important means of communication and reminder. However, frequent and unreasonable horn sounds often disturb drivers, affecting their mood and driving concentration, and sometimes even leading to unsafe driving behavior. Although existing vehicle noise control technologies can reduce the impact of external noise to a certain extent, these technologies often cannot specifically identify and filter potentially disruptive horn sounds, especially those that are made unreasonably when there is no safety risk. Therefore, there is currently a lack of corresponding methods for dealing with noisy horn sounds outside the vehicle. Summary of the invention

[0003] In view of the above problems, the present invention provides a method for processing external horn sounds of a vehicle and related equipment, the main purpose of which is to solve the problem that there is currently a lack of corresponding processing methods for noisy horn sounds outside the vehicle.

[0004] In order to solve at least one of the above technical problems, in a first aspect, the present invention provides a method for processing an external horn sound of a vehicle, the method comprising:

[0005] Acquire an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal;

[0006] Classifying the optimized audio signal based on a support vector machine to obtain an audio classification result;

[0007] The audio classification result is combined with the environment outside the target vehicle and the vehicle's own state to determine an audio filtering operation outside the target vehicle.

[0008] Optionally, the above method further includes:

[0009] Acquire an initial audio signal outside the target vehicle;

[0010] The initial audio signal is preprocessed to obtain the optimized audio signal, wherein the preprocessing includes pre-emphasis processing, framing and windowing processing, fast Fourier transform processing, Mel filter bank processing and discrete cosine transform processing.

[0011] Optionally, the preprocessing the initial audio signal to obtain the optimized audio signal includes:

[0012] The pre-emphasis processing is performed on the initial audio signal based on the following formula to obtain a second audio signal:

[0013] s′[n]=s[n]-αs[n-1]

[0014] Wherein, s′[n] is the second audio signal, s[n] is the initial audio signal, and the value range of α is 0.9-0.97;

[0015] The second audio signal is subjected to the framing and windowing process based on the following formula to obtain a third audio signal:

[0016] xi[n]=s′[n+iH]w[n]

[0017] Wherein, xi[n] is the third audio signal, indicating the audio signal of the i-th frame, H is the frame shift, and w[n] is the window function.

[0018] Optionally, the preprocessing the initial audio signal to obtain the optimized audio signal includes:

[0019] Performing the fast Fourier transform process on the third audio signal to obtain a fourth audio signal;

[0020] The Mel filter bank is performed on the fourth audio signal based on the following formula to obtain a fifth audio signal:

[0021] E i [m] = ∑ k |X i [k]M m [k]| 2

[0022] Among them, E i [m] is the fifth audio signal, representing the Mel spectrum energy of the i-th frame, X i [k] is the fourth audio signal, representing the frequency spectrum, and m is the index of the Mel filter bank;

[0023] The fifth audio signal is subjected to the discrete cosine transform process based on the following formula to obtain the optimized audio signal:

[0024]

[0025] Among them, c i [n] is the optimized audio signal, representing the nth Mel frequency cepstrum coefficient of the i-th frame, and M is the number of Mel filters.

[0026] Optionally, classifying the optimized audio signal based on a support vector machine to obtain an audio classification result includes:

[0027] Inputting the optimized audio signal as a feature vector into the support vector machine;

[0028] Training the support vector machine to determine a classification hyperplane to minimize the classification error of the optimized audio signal;

[0029] The optimized audio signal is classified based on the support vector machine to obtain a classification result, wherein the classification result includes urgent audio and irrational audio.

[0030] Optionally, combining the audio classification result with the environment outside the target vehicle and the target vehicle's own state to determine the audio filtering operation outside the target vehicle includes:

[0031] Construct a multimodal data fusion model based on Kalman filtering and deep learning;

[0032] The audio classification result is combined with the environment outside the target vehicle and the target vehicle's own state through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle.

[0033] Optionally, combining the audio classification result with the environment outside the target vehicle and the state thereof through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle includes:

[0034] Determine the external environment and the state of the target vehicle based on Kalman filtering technology; and,

[0035] Visual information and time series data of the target vehicle are determined based on deep learning.

[0036] In a second aspect, an embodiment of the present invention further provides a vehicle external horn sound processing device, comprising:

[0037] An acquisition unit, configured to acquire an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal;

[0038] A classification unit, configured to classify the optimized audio signal using a support vector machine to obtain an audio classification result;

[0039] A determination unit is used to combine the audio classification result with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle.

[0040] In order to achieve the above object, according to a third aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium includes a stored program, wherein when the program is executed by a processor, the steps of the above-mentioned method for processing external vehicle horn sound are implemented.

[0041] In order to achieve the above-mentioned purpose, according to the fourth aspect of the present invention, there is provided an electronic device, comprising at least one processor and at least one memory connected to the processor; wherein the above-mentioned processor is used to call the program instructions in the above-mentioned memory to execute the steps of the above-mentioned method for processing the external vehicle horn sound.

[0042] By means of the above technical scheme, the method and related equipment for processing the horn sound outside the vehicle provided by the present invention solves the problem that there is currently a lack of corresponding processing methods for the noisy horn sound outside the vehicle. The present invention obtains an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal; the optimized audio signal is classified based on a support vector machine to obtain an audio classification result; the audio classification result is combined with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle. In the above scheme, the horn sound outside the vehicle is identified and its characteristics (such as frequency, intensity, duration, etc.) are analyzed, and the road and vehicle condition information collected by sensors such as vehicle-mounted cameras is combined to determine whether these horn sounds represent actual safety risks through intelligent algorithms. When the system determines that the horn sound is an unreasonable interference, it can automatically adjust the audio system in the car to reduce or filter out these horn sounds, thereby protecting the driver from interference and ensuring the safety of the driving process.

[0043] Correspondingly, the external vehicle horn sound processing device, equipment and computer-readable storage medium provided by the embodiments of the present invention also have the above-mentioned technical effects.

[0044] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0046] Figure 1 A schematic diagram of a process of processing a vehicle external horn sound provided by an embodiment of the present invention is shown;

[0047] Figure 2 A schematic block diagram showing the composition of a vehicle external horn sound processing device provided by an embodiment of the present invention is shown;

[0048] Figure 3A schematic block diagram of the composition of an electronic device for processing horn sound outside a vehicle provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0049] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0050] In order to solve the problem that there is currently a lack of corresponding processing methods for noisy horn sounds outside the vehicle, an embodiment of the present invention provides a method for processing horn sounds outside the vehicle, such as Figure 1 As shown, the method includes:

[0051] S101, obtaining an optimized audio signal outside a target vehicle, wherein the optimized audio signal is determined by preprocessing an initial audio signal;

[0052] The above step S101 also includes S1011, S1012 and S1013:

[0053] S1011, obtaining an initial audio signal outside the target vehicle;

[0054] The initial audio signal is preprocessed to obtain the optimized audio signal, wherein the preprocessing includes pre-emphasis processing, framing and windowing processing, fast Fourier transform processing, Mel filter bank processing and discrete cosine transform processing.

[0055] Exemplarily, the present application uses a microphone array outside the vehicle to collect surrounding sound signals. High dynamic range audio processing technology is used to ensure accurate capture of sound, including low-frequency to high-frequency horn sounds. A sound recognition algorithm is applied to analyze the collected audio signals, identify the characteristics of the horn sound (including frequency, intensity, duration, etc.), and use machine learning technology to train the model to distinguish between emergency horn sounds and unreasonable horn sounds, while considering factors such as the source direction and relative speed of the sound.

[0056] S1012, performing the pre-emphasis processing on the initial audio signal based on the following formula to obtain a second audio signal:

[0057] s′[n]=s[n]-αs[n-1]

[0058] Wherein, s′[n] is the second audio signal, s[n] is the initial audio signal, and the value range of α is 0.9-0.97;

[0059] The second audio signal is subjected to the framing and windowing process based on the following formula to obtain a third audio signal:

[0060] xi[n]=s′[n+iH]w[n]

[0061] Wherein, xi[n] is the third audio signal, indicating the audio signal of the i-th frame, H is the frame shift, and w[n] is the window function.

[0062] S1013, performing the fast Fourier transform process on the third audio signal to obtain a fourth audio signal;

[0063] The Mel filter bank is performed on the fourth audio signal based on the following formula to obtain a fifth audio signal:

[0064] E i [m] = ∑ k |X i [k]M m [k]| 2

[0065] Among them, E i [m] is the fifth audio signal, representing the Mel spectrum energy of the i-th frame, X i [k] is the fourth audio signal, representing the frequency spectrum, and m is the index of the Mel filter bank;

[0066] The fifth audio signal is subjected to the discrete cosine transform process based on the following formula to obtain the optimized audio signal:

[0067]

[0068] Among them, c i [n] is the optimized audio signal, representing the nth Mel frequency cepstrum coefficient of the i-th frame, and M is the number of Mel filters.

[0069] Specifically, the present application first preprocesses the collected initial audio signal, including denoising, standardization and feature extraction. In the feature extraction stage, Mel-frequency cepstral coefficients (MFCC) can be used as the feature representation of the sound, and MFCC can effectively capture the basic properties of the sound. Its feature extraction process can be simplified into the following steps:

[0070] Pre-emphasis processing: pre-emphasize the initial audio signal s[n] to enhance the high-frequency components;

[0071] Framing and windowing: divide s′[n] into overlapping frames and add windows to each frame;

[0072] The purpose of the above-mentioned pre-emphasis and frame windowing is to enhance the features in the signal that are important for horn sound recognition, while reducing the influence of background noise.

[0073] Fast Fourier transform processing (FFT): Perform FFT on each frame signal xi[n] to obtain the spectrum X i [k];

[0074] Mel filter bank processing: Apply a set of Mel filters M[k] to X i [k], calculate the Mel spectrum energy of each frame;

[0075] Discrete cosine transform (DCT): Mel spectrum energy E for each frame i [m] Perform DCT and obtain MFCC.

[0076] S102, classifying the optimized audio signal based on a support vector machine to obtain an audio classification result;

[0077] The above step S102 further includes S1021:

[0078] S1021. Input the optimized audio signal as a feature vector into the support vector machine; train the support vector machine to determine a classification hyperplane to minimize the classification error of the optimized audio signal; classify the optimized audio signal based on the support vector machine to obtain a classification result, wherein the classification result includes urgent audio and irrational audio.

[0079] Exemplarily, after the above preprocessing of the initial audio signal, a support vector machine (SVM) is used to classify the horn sound. The goal of the SVM is to find a hyperplane that maximizes the margin between data points of different categories.

[0080] Specifically, first extract the MFCC c i [n] is input into SVM as a feature vector. Then, the SVM model is trained to find the classification hyperplane that minimizes the classification error:

[0081]

[0082] Requirements:

[0083]

[0084] in, and b define the hyperplane, C is the penalty parameter, ξi is the slack variable, φ(xi) is the function that maps the data to a higher dimensional space, and y i is the category label.

[0085] Then, the horn sound classification is performed. For the new horn sound feature vector, the trained SVM model is used to classify it to determine whether it is an emergency horn sound or an unreasonable horn sound, that is, the emergency audio and unreasonable audio mentioned above.

[0086] The audio classification results of the above output will directly affect the input of the following step of "combining the audio classification results with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle", where the audio classification results will be combined with the vehicle's environment and state information for a more in-depth analysis. Through this integration, the present application is able to evaluate the urgency and relevance of the horn sound in a wider context, thereby improving the accuracy of the final decision. In addition, the classification results of the horn sound will also guide the audio filtering operation outside the target vehicle and the in-car audio control operation, determining whether and how to adjust the in-car audio system to ensure that the driver is only alerted by important warning sounds.

[0087] S103: Combining the audio classification result with the environment outside the target vehicle and the target vehicle's own state to determine an audio filtering operation outside the target vehicle.

[0088] The above step S103 also includes S1031 and S1032:

[0089] S1031. Constructing a multimodal data fusion model based on Kalman filtering and deep learning;

[0090] The audio classification result is combined with the environment outside the target vehicle and the target vehicle's own state through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle.

[0091] Exemplarily, the present application collects real-time road and vehicle condition information through on-board cameras, radars and other sensors. The horn sound data and environmental data are comprehensively analyzed, and the relevance and urgency of the horn sound are evaluated using a deep learning algorithm. Through advanced data fusion technology, the data collected from different sources are comprehensively processed and analyzed, including the above-mentioned horn data and environmental and vehicle condition data collected by on-board sensors (such as cameras and radars). The core of this step is to use a data fusion algorithm to synthesize and analyze the information, so as to accurately evaluate the urgency and relevance of the horn sound.

[0092] Furthermore, in order to achieve effective data fusion, multimodal data fusion technology is used here, especially the fusion model based on Kalman filtering and deep learning technology. Kalman filtering technology has significant advantages in processing dynamic system state estimation with noise, and is suitable for real-time updating and predicting vehicle status. Deep learning technology, especially convolutional neural network (CNN) and long short-term memory network (LSTM), can effectively process and analyze visual information and time series data.

[0093] Based on the above solution, advanced audio processing technology, environmental perception capabilities and deep learning algorithms are used to intelligently identify and filter out irrelevant horn sounds outside the car, while ensuring that emergency and related warning sounds can be noticed by the driver in a timely manner.

[0094] The above step S1031 further includes S10311:

[0095] S10311. Determine the external environment and the state of the target vehicle based on Kalman filtering technology; and determine the visual information and time series data of the target vehicle based on deep learning.

[0096] The specific steps are as follows:

[0097] Preprocessing: First, the various collected data (horn sound data, video stream, radar signal, etc.) are preprocessed, including denoising, standardization and feature extraction to ensure data quality and consistency.

[0098] Feature fusion: The pre-processed data features are fused through a deep learning model. For example, CNN is used to process the image data captured by the vehicle camera to extract environmental features, and LSTM is used to process the horn sound features captured by the microphone and the time series features of the vehicle's motion state.

[0099] Kalman filter state estimation: Kalman filter technology is used to estimate and predict the current state of the vehicle and the state of the environment, integrating information from different sensors to obtain a more accurate representation of the vehicle and environment states.

[0100] Urgency and relevance assessment: Based on the fused features and state estimates, the SVM model trained in the previous step is used to further assess the urgency and relevance of the horn sound. The model can learn to identify when the horn sound has an urgent impact on safety and when the horn sound can be considered insignificant.

[0101] Decision support output: Based on the urgency and relevance assessment results of the horn sound, the system provides decision support information to guide the subsequent horn sound intelligent filtering and in-car audio control modules to take corresponding actions.

[0102] After completing the preliminary horn sound classification based on SVM, the above step of "combining the audio classification result with the environment outside the target vehicle and the vehicle's own state through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle" is specifically as follows:

[0103] Contextual Verification: Verify the horn classification result using the vehicle’s current environment and state information, such as vehicle speed, distance to surrounding vehicles, weather conditions, etc. For example, if a horn is detected in dense traffic and the vehicle’s speed suddenly slows down, this may indicate that the detected horn has a high urgency.

[0104] Adjustment of classification results: Based on environmental and vehicle condition data, the system may adjust the confidence of the initial classification results. For example, if the system classifies a horn as "unreasonable" based on sound characteristics, but subsequent environmental analysis shows that a pedestrian is suddenly crossing the road ahead, the system may increase the score of the horn as "urgent".

[0105] Composite decision making: The system can combine the sound classification results with the environment and vehicle condition data, and use decision fusion algorithms (such as decision trees, Bayesian networks, or ensemble learning methods) to make the final response decision. This may include determining whether to filter a certain horn sound and how to adjust the in-car audio system to respond to the horn sound.

[0106] It should be noted that this application considers the following scenario: A driver is driving in busy city traffic, and the system captures a strong horn sound through an external microphone array. It is initially identified as non-emergency by the "horn sound recognition and analysis module". However, at the same time, the "environmental and vehicle condition data integration analysis module" analyzes the real-time video stream from the on-board camera and finds that a child suddenly ran towards the road in front. Combined with this environmental information, the system re-evaluates the horn sound as high urgency and chooses not to filter the sound, ensuring that the driver can receive timely warnings and take necessary avoidance measures. This example shows how the system can make more accurate judgments in complex actual driving environments by comprehensively analyzing data from different sources.

[0107] It should be noted that this application decides whether to filter a specific horn sound or adjust its perceived intensity in the car based on the analysis results of the horn sound and the environmental assessment. Through the intelligent adjustment of the vehicle's audio system or other noise adjustment systems in the car, the horn sound determined to be unreasonable interference is reduced or completely filtered out, while ensuring that important warning sounds are not affected.

[0108] Furthermore, the present application provides a user interface that allows the driver to set the sensitivity and parameters of the horn sound filtering according to personal preferences, and supports the driver to make quick adjustments and settings through voice commands or a touch screen.

[0109] Based on the above solution, the user's personalized settings are also taken into account, allowing the driver to adjust the sensitivity and range of the horn sound filtering according to personal preferences. Through real-time road and vehicle condition data analysis, the system can provide the driver with a more peaceful and focused driving environment while ensuring safety, effectively improving driving comfort and satisfaction.

[0110] By means of the above technical scheme, the method for processing the horn sound outside the vehicle provided by the present invention solves the problem that there is no corresponding processing method for the noisy horn sound outside the vehicle. The present invention obtains the optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal; classifies the optimized audio signal based on the support vector machine to obtain the audio classification result; and combines the audio classification result with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle. In the above scheme, the intelligent recognition, urgency assessment and filtering of the horn sound outside the vehicle are realized through the audio processing and environmental perception technology built into the vehicle. The data collected by sensors such as advanced audio recognition algorithms and vehicle-mounted cameras are used to comprehensively analyze the source, frequency, duration and relationship with the current road conditions and vehicle conditions of the horn sound, and intelligently judge whether the horn sound has actual safety warning significance. For the horn sound that is identified as unreasonable abuse and has no substantial help to the driver, the system will automatically adjust the in-vehicle audio system to reduce or completely filter these sounds, reduce unnecessary interference to the driver, and thus improve driving safety and driving experience.

[0111] Furthermore, as a response to the above Figure 1 In order to realize the method shown in the figure, the embodiment of the present invention also provides a vehicle external horn sound processing device for Figure 1 The device embodiment corresponds to the aforementioned method embodiment. For ease of reading, this device embodiment will not repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in this embodiment can correspond to all the contents of the aforementioned method embodiment. Figure 2 As shown, the device includes: an acquisition unit 21, a classification unit 22, and a determination unit 23, wherein

[0112] An acquisition unit 21 is used to acquire an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal;

[0113] A classification unit 22, configured to classify the optimized audio signal using a support vector machine to obtain an audio classification result;

[0114] The determination unit 23 is used to combine the audio classification result with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle.

[0115] The processor includes a kernel, and the kernel calls the corresponding program unit from the memory. One or more kernels can be set, and a method for processing the horn sound outside the vehicle is implemented by adjusting the kernel parameters, which can solve the problem of lack of a corresponding method for processing the noisy horn sound outside the vehicle.

[0116] An embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, and when the program is executed by a processor, the method for processing an external vehicle horn sound is implemented.

[0117] An embodiment of the present invention provides a processor, which is used to run a program, wherein the method for processing an external vehicle horn sound is executed when the program is run.

[0118] An embodiment of the present invention provides an electronic device, the electronic device comprising at least one processor and at least one memory connected to the processor; wherein the processor is used to call program instructions in the memory to execute the above-mentioned vehicle external horn sound processing method

[0119] An embodiment of the present invention provides an electronic device 30, such as Figure 3 As shown, the electronic device includes at least one processor 301, and at least one memory 302 and a bus 303 connected to the processor; wherein the processor 301 and the memory 302 communicate with each other via the bus 303; the processor 301 is used to call the program instructions in the memory to execute the above-mentioned vehicle external horn sound processing method.

[0120] The intelligent electronic devices in this article can be PCs, PADs, mobile phones, etc.

[0121] The present application also provides a computer program product, which, when executed on a process management electronic device, is suitable for executing a program initialized with the steps of the above-mentioned vehicle external horn sound processing method.

[0122] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0123] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0124] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0125] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0126] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0127] The present application also provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device is caused to execute the following Figure 1 This corresponds to the flow of control of the memory in the embodiment.

[0128] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.

[0129] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0130] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0131] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0132] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0133] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0134] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some of the technical features therein by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for processing an external horn sound of a vehicle, characterized in that: include: Acquire an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal; Classifying the optimized audio signal based on a support vector machine to obtain an audio classification result; The audio classification result is combined with the environment outside the target vehicle and the vehicle's own state to determine an audio filtering operation outside the target vehicle.

2. The method according to claim 1, characterized in that Also includes: Acquire an initial audio signal outside the target vehicle; The initial audio signal is preprocessed to obtain the optimized audio signal, wherein the preprocessing includes pre-emphasis processing, framing and windowing processing, fast Fourier transform processing, Mel filter bank processing and discrete cosine transform processing.

3. The method according to claim 2, characterized in that The preprocessing of the initial audio signal to obtain the optimized audio signal comprises: The pre-emphasis processing is performed on the initial audio signal based on the following formula to obtain a second audio signal: s′[n]=s[n]-αs[n-1] Wherein, s′[n] is the second audio signal, s[n] is the initial audio signal, and the value range of α is 0.9-0.97; The second audio signal is subjected to the framing and windowing process based on the following formula to obtain a third audio signal: xi[n]=s′[n+iH]w[n] Wherein, xi[n] is the third audio signal, indicating the audio signal of the i-th frame, H is the frame shift, and w[n] is the window function.

4. The method according to claim 3, characterized in that The preprocessing of the initial audio signal to obtain the optimized audio signal includes: Performing the fast Fourier transform process on the third audio signal to obtain a fourth audio signal; The Mel filter bank is performed on the fourth audio signal based on the following formula to obtain a fifth audio signal: E i [m]=∑ k |X i [k]M m [k]| 2 Among them, E i [m] is the fifth audio signal, representing the Mel spectrum energy of the i-th frame, X i [k] is the fourth audio signal, representing the frequency spectrum, and m is the index of the Mel filter bank; The fifth audio signal is subjected to the discrete cosine transform process based on the following formula to obtain the optimized audio signal: Among them, c i [n] is the optimized audio signal, representing the nth Mel frequency cepstral coefficient of the i-th frame, and M is the number of Mel filters.

5. The method according to claim 4, characterized in that The step of classifying the optimized audio signal based on a support vector machine to obtain an audio classification result includes: Inputting the optimized audio signal as a feature vector into the support vector machine; Training the support vector machine to determine a classification hyperplane to minimize the classification error of the optimized audio signal; The optimized audio signal is classified based on the support vector machine to obtain a classification result, wherein the classification result includes urgent audio and irrational audio.

6. The method according to claim 1, characterized in that The step of combining the audio classification result with the environment outside the target vehicle and the vehicle's own state to determine the audio filtering operation outside the target vehicle includes: Construct a multimodal data fusion model based on Kalman filtering and deep learning; The audio classification result is combined with the environment outside the target vehicle and the target vehicle's own state through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle.

7. The method according to claim 6, characterized in that The step of combining the audio classification result with the environment outside the target vehicle and the vehicle's own state through the multimodal data fusion model to determine the audio filtering operation outside the target vehicle includes: Determine the external environment and the state of the target vehicle based on Kalman filtering technology; and, Visual information and time series data of the target vehicle are determined based on deep learning.

8. A vehicle external horn sound processing device, characterized in that: Also includes: An acquisition unit, configured to acquire an optimized audio signal outside the target vehicle, wherein the optimized audio signal is determined by preprocessing the initial audio signal; A classification unit, configured to classify the optimized audio signal using a support vector machine to obtain an audio classification result; A determination unit is used to combine the audio classification result with the environment outside the target vehicle and its own state to determine the audio filtering operation outside the target vehicle.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed by a processor, the steps of the method for processing an external horn sound of a vehicle according to any one of claims 1 to 7 are implemented.

10. An electronic device, characterized in that: The electronic device includes at least one processor and at least one memory connected to the processor; wherein the processor is used to call program instructions in the memory to execute the steps of the vehicle external horn sound processing method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • The invention discloses an aAutomobile whistling classification method based on a support vector machine

    CN109614887A

  • Warning method, device and equipment for vehicle driver, medium and vehicle

    CN116161051A

  • Vehicle''s external sound output system and method

    KR1020160039951A

  • Method for providing sound detection information, apparatus detecting sound around vehicle, and vehicle including the same

    KR1020170061407A

  • Using classified sounds and localized sound sources to operate an autonomous vehicle

    US20200241552A1