Method and system for identifying and displaying whistling sound of vehicle and vehicle

By collecting, processing and displaying whistle sound signals in vehicles, using sound cloud maps and positioning algorithms, the problem that the vehicle whistle sound is difficult to perceive in noisy environments is solved, and the accurate judgment of the source and intensity of the whistle sound is achieved, reducing the Traffic accident risk.

CN119007743APending Publication Date: 2024-11-22CHINA FAW CO LTD +1

Patent Information

Application Number
CN202411121428.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-15
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In the prior art, the sound of a vehicle horn is difficult to be effectively perceived by the driver in a noisy environment, resulting in the inability to accurately judge the source and intensity of the horn, increasing the risk of traffic accidents.

Method used

Through the steps of signal acquisition, signal processing and dynamic display, the microphone array is used to collect the sound signal of the horn, extract the sound characteristics of the horn, filter out the interference factors, generate the sound cloud map, and locate the sound source based on the sound positioning algorithm to display the source of the horn sound. Direction and strength.

Benefits of technology

Effectively enhance the driver's perception of the whistle sound, accurately judge the source and intensity of the whistle sound, and reduce traffic hazards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119007743A_ABST
    Figure CN119007743A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of vehicles, and discloses a method and system for recognizing and displaying vehicle whistling sound, electronic equipment, a storage medium and a vehicle, and the method comprises the steps: receiving and collecting a whistling sound signal in the surrounding environment of the vehicle; processing the whistling sound signal, including extracting horn sound features, filtering interference factors and generating a sound cloud picture, and positioning a sound source based on a sound positioning algorithm to obtain sound source position information; generating and displaying a dynamic image of the direction and intensity of the source of the whistling sound signal based on the sound cloud picture, the sound source position information and the intensity information of the sound source; and detecting the surrounding environment of the vehicle, identifying specific environment characteristics, and realizing echo cancellation, sound source separation and sound source positioning functions through a signal processing algorithm, so that the vehicle identifies and displays the whistling sound signal under various environment conditions. According to the invention, a driver can effectively perceive whistling sound, the source and intensity of the whistling sound are accurately judged, and traffic hidden dangers are reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method, system, electronic equipment, storage medium and vehicle for identifying and displaying vehicle whistle sounds. Background Art

[0002] At present, in the existing traffic environment, vehicle horns are a common warning method that mainly relies on acoustic signals to alert surrounding vehicles and pedestrians. However, when vehicles are driving on noisy city streets or highways or when loud music is playing in the car, traditional acoustic horn signals are often difficult for drivers to effectively perceive. In this case, the warning effect of horns is greatly reduced, increasing the risk of traffic accidents.

[0003] In addition, based on acoustic signals alone, it is often difficult for drivers to quickly and accurately determine the specific source and intensity of the horn sound, making it difficult for them to make timely avoidance or response measures. This may pose a major safety hazard, especially for novice drivers or drivers in high-intensity driving situations.

[0004] Therefore, the present application provides a method for identifying and displaying vehicle horn sounds to solve the above technical problems. Summary of the invention

[0005] The purpose of the present invention is to provide a method, system, electronic device, storage medium and vehicle for identifying and displaying vehicle horn sounds, so as to solve the technical problem in the prior art that drivers cannot effectively perceive the horn sounds, cannot accurately determine the source of the horn sounds, and easily cause traffic hazards.

[0006] In order to solve the above technical problems, the present invention provides a method for identifying and displaying vehicle horn sounds, comprising:

[0007] The signal collection step includes receiving and collecting the whistle sound signal in the surrounding environment of the vehicle;

[0008] The signal processing step includes processing the horn sound signal, extracting the horn sound characteristics, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source position information;

[0009] The dynamic display step includes generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information;

[0010] The environmental adaptation step includes detecting the vehicle's surrounding environment, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

[0011] In some specific embodiments, the signal collection step includes receiving and collecting a whistle sound signal in the surrounding environment of the vehicle, and further includes:

[0012] Receiving the whistle sound signal in the vehicle surrounding environment in real time;

[0013] Preprocessing the whistle sound signal, including preliminary amplification and filtering of the whistle sound signal to enhance signal strength and remove some high-frequency or low-frequency noise;

[0014] The whistle sound signal is digitized and stored.

[0015] In some specific embodiments, the signal processing step includes processing the horn sound signal, including extracting the horn sound characteristics, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source location information, and further includes:

[0016] Analyzing the horn sound signal based on voiceprint recognition to extract the horn sound features, including frequency distribution and duration;

[0017] Filter out interference factors of the whistle sound signal, including human voice, music and engine noise, to improve the signal-to-noise ratio of the whistle sound signal;

[0018] Converting the processed whistle sound signal into a visual sound cloud map, wherein the sound cloud map represents the intensity and distribution of the whistle sound signal through visual elements of color and brightness;

[0019] The sound localization algorithm includes a TDOA algorithm, and the sound source position information is calculated based on the TDOA algorithm according to the speaker sound characteristics and time information.

[0020] In some specific embodiments, the dynamic display step includes generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the intensity information of the sound source, and further includes:

[0021] Based on the sound source position information and the sound source intensity information, generating a dynamic image symbol corresponding to the direction and intensity of the sound source;

[0022] The generated dynamic image symbol is combined with the sound cloud map for real-time display, and the display content is dynamically updated to provide continuous warning and prompting effects.

[0023] In some specific embodiments, the environmental adaptation step includes detecting the vehicle's surrounding environment, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the horn sound signal under various environmental conditions, and further includes:

[0024] Detecting environmental characteristics of the vehicle's surroundings, including space size and echo strength;

[0025] The specific environmental feature includes a high echo environment. When the identified environmental feature is the high echo environment, the influence of the echo on the whistle sound signal is eliminated by a signal processing algorithm, wherein the signal processing algorithm includes AEC adaptive filtering;

[0026] The sound source position information is optimized based on the TDOA algorithm, including sound source separation and sound source localization.

[0027] In some specific embodiments, the dynamic display step further includes:

[0028] Calculating the distance from the sound source position information to the vehicle;

[0029] According to a preset mapping rule, the distance from the sound source position information to the vehicle is converted into a sound source intensity representation;

[0030] According to the change of the sound source position information, updating the sound source position information and the intensity information of the sound source in real time;

[0031] Based on a preset warning range, when the sound source location information exceeds the warning range, the sound source intensity is not displayed or the display intensity is reduced.

[0032] Based on the same concept, the present invention also provides a system for identifying and displaying vehicle horn sounds, comprising:

[0033] A signal acquisition module, configured to receive and collect horn sound signals in the surrounding environment of the vehicle;

[0034] A signal processing module is configured to process the horn sound signal, including extracting horn sound features, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain sound source location information;

[0035] A dynamic display module, configured to generate and display a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information;

[0036] The environmental adaptation module is configured to detect the vehicle's surrounding environment, identify specific environmental features, and implement echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

[0037] Based on the same concept, the present invention also provides an electronic device, including: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method for identifying and displaying vehicle horn sounds.

[0038] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the method for identifying and displaying vehicle horn sounds.

[0039] Based on the same concept, the present invention also provides a vehicle, wherein the vehicle is provided with the system for identifying and displaying the vehicle horn sound as described above.

[0040] Compared with the prior art, the invention has the following beneficial effects:

[0041] The present invention discloses a method, system, electronic device, storage medium and vehicle for identifying and displaying vehicle horn sounds, which can enable the driver to effectively perceive the horn sounds, accurately determine the source and intensity of the horn sounds, and reduce traffic hazards. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a flow chart of a method for identifying and displaying vehicle horn sounds in some specific embodiments of the present invention;

[0043] Figure 2 It is a flowchart of a method for identifying and displaying vehicle horn sounds in some applications of the present invention;

[0044] Figure 3 It is a schematic diagram of the warning range of a method for identifying and displaying vehicle horn sounds in some applications of the present invention;

[0045] Figure 4 It is a schematic diagram of the display effect of a method for identifying and displaying vehicle horn sounds in some applications of the present invention;

[0046] Figure 5 It is a schematic diagram of the structure of a system for identifying and displaying vehicle horn sounds in some specific embodiments of the present invention;

[0047] Figure 6It is a schematic diagram of the structure of an electronic device in some specific embodiments of the present invention. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0049] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two.

[0050] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0051] It should be understood that although the terms first, second, third, etc. may be used to describe in the embodiments of the present application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first.

[0052] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0053] It should also be noted that the term "includes", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that a commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the commodity or device including the elements.

[0054] It should be particularly noted that any symbols and / or numbers in the specification that are not marked in the accompanying drawings are not drawing marks.

[0055] Reference Figure 1 , a method for identifying and displaying a vehicle horn sound, comprising:

[0056] S101, a signal collection step, including receiving and collecting a whistle sound signal in the surrounding environment of the vehicle;

[0057] It is understandable that a dedicated microphone array system can be installed on the vehicle. The system consists of multiple high-sensitivity, low-noise microphones distributed in key locations such as the front, side and top of the vehicle to ensure that sound signals in the surrounding environment can be received in all directions and without blind spots. For example, six microphones can be installed, located on the front bumper of the vehicle, under the left and right rearview mirrors, and on the front and rear sides of the roof. The spacing between each microphone is optimized according to the size of the vehicle and the requirements of the sound positioning algorithm. Continuously monitor and receive sound signals in the surrounding environment, including vehicle horns, traffic noise, pedestrian conversations, wind and other sound sources. In the received sound signals, distinguish between vehicle horns and other types of sounds.

[0058] In some of the applications, the signal acquisition step includes receiving and collecting whistle sound signals in the vehicle's surrounding environment, receiving whistle sound signals in the vehicle's surrounding environment in real time; preprocessing the whistle sound signals, including preliminary amplification and filtering of the whistle sound signals to enhance signal strength and remove some high-frequency or low-frequency noise; digitizing and storing the whistle sound signals.

[0059] It is understood that the received sound signal is first amplified by the preamplifier to improve the signal-to-noise ratio. The amplification factor is dynamically adjusted according to the sensitivity of the microphone and the strength of the sound signal to avoid signal distortion or saturation. For example, when the whistle signal is detected to be weak, the amplification factor is automatically increased; when the signal is strong, the amplification factor is appropriately reduced.

[0060] In order to remove some high-frequency or low-frequency noise, a digital filter is used to filter the amplified sound signal. The filter takes into account the spectral characteristics of the vehicle horn sound and sets a bandpass filter to allow the signal within the frequency range of the vehicle horn sound (such as 200Hz to 1kHz) to pass through, while suppressing noise of other frequencies. For example, the passband width of the filter can be set to 800Hz (from 200Hz to 1000Hz) to ensure that the main energy of the horn sound is retained.

[0061] The pre-processed sound signal is sent to the analog-to-digital converter (ADC) for digitization. The sampling rate and quantization bit number of the ADC are selected according to the system requirements to ensure that the digitized signal can accurately reflect the characteristics of the original sound signal. For example, a 16-bit quantization bit number and a 44.1kHz sampling rate can be selected for digitization, which can retain sufficient audio details while avoiding excessive computational complexity.

[0062] The digitized whistle sound signal is stored in the system memory for subsequent positioning, intensity calculation and display processing. The storage method can be a circular buffer or a fixed-size array, etc., depending on the system's memory size and real-time requirements.

[0063] S102, a signal processing step, comprising processing the horn sound signal, including extracting horn sound features, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain sound source location information;

[0064] It is understandable that the pre-processed whistle sound signal is subjected to feature extraction. The purpose of feature extraction is to abstract key parameters that can represent the sound characteristics of the horn from the signal, such as frequency, energy, duration, etc., for subsequent sound source identification and positioning. In this embodiment, methods such as short-time Fourier transform (STFT) or wavelet transform can be used to perform time-frequency analysis on the signal to obtain its spectral characteristics; at the same time, the time domain characteristics such as the short-time energy and zero-crossing rate of the signal are calculated to reflect the dynamic changes of the sound signal.

[0065] For example, the main frequency of a whistle sound signal extracted is 800 Hz, the duration is 0.5 seconds, and the short-time energy peak is -10 dBFS.

[0066] After the horn sound features are extracted, the interference factors in the signal are filtered out. Interference factors include environmental noise, horns of other vehicles, wind noise, etc. In order to improve the accuracy of sound source positioning, effective filtering and noise suppression techniques are used to reduce the impact of these interference factors. In this embodiment, the signal is further processed using an adaptive filtering algorithm or a deep learning model to remove noise components that are not related to the horn sound.

[0067] For example, through adaptive filtering, the background noise was successfully reduced by 15dB, significantly improving the signal-to-noise ratio.

[0068] In order to more intuitively display the distribution of the whistle sound signal, a sound cloud map is generated. Sound cloud map is a technology that represents the intensity or energy of a sound signal in the form of a two-dimensional image, which can help users quickly identify the location and intensity distribution of the sound source. In this embodiment, the sound intensity or energy value at each sampling point is calculated based on the spectral characteristics and time domain characteristics of the sound signal, and is mapped onto a two-dimensional plane to form a sound cloud map.

[0069] For example, in the generated sound cloud map, the location of the vehicle horn sound source appears as an obvious bright spot, indicating that the sound intensity at that location is relatively high; while the surrounding area is relatively dim, indicating that the sound intensity is relatively low.

[0070] Finally, the sound localization algorithm is used to locate the sound source of the whistle sound signal. The sound localization algorithm estimates the position of the sound source based on parameters such as the time difference (TDOA), phase difference (PDOA) or sound pressure level difference (SPL) of the signal arriving at different microphones. In this embodiment, the TDOA (Time Difference of Arrival) algorithm is selected as the main positioning method, and the distance and direction between the sound source and the microphone are estimated by calculating the time difference of the sound signal arriving at different microphones. At the same time, combined with the information provided by the sound cloud map, the accuracy and reliability of sound source positioning can be further improved.

[0071] For example, the TDOA algorithm calculates that the horn sound source is located about 10 meters in front of the left side of the vehicle, and the angle between the direction and the vehicle's driving direction is 30 degrees. This coincides with the position of the bright spot on the sound cloud map, verifying the accuracy of the positioning result.

[0072] In some of the applications, the signal processing step includes processing the whistle sound signal, including extracting the horn sound characteristics, filtering out interference factors and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source location information, analyzing the whistle sound signal based on voiceprint recognition, and extracting the horn sound characteristics, including frequency distribution and duration; filtering out interference factors of the whistle sound signal, including human voice, music and engine noise, to improve the signal-to-noise ratio of the whistle sound signal; converting the processed whistle sound signal into a visual sound cloud map, which represents the intensity and distribution of the whistle sound signal through visual elements of color and brightness; the sound localization algorithm includes a TDOA algorithm, which calculates the sound source location information based on the TDOA algorithm according to the horn sound characteristics and time information.

[0073] It is understandable that voiceprint recognition is used to analyze the received horn sound signal. Voiceprint recognition compares the pre-stored horn sound samples with the real-time signal to identify the horn sound signal. During the analysis process, attention is paid to the frequency distribution and duration of the signal;

[0074] Frequency distribution: By using methods such as Fast Fourier Transform (FFT) or Short-time Fourier Transform (STFT), the time domain signal is converted to the frequency domain to extract the frequency distribution characteristics of the signal. For common vehicle horn sounds, their main frequencies are usually concentrated in a certain range, such as 800Hz to 1.2kHz.

[0075] Duration: Records the duration of the whistle segment in the signal, distinguishing between short whistles and continuous noise.

[0076] For example, the frequency distribution of a whistle sound signal is mainly concentrated between 900 Hz and 1 kHz, and the duration is 0.3 seconds.

[0077] In order to improve the signal-to-noise ratio of the whistle sound signal, interference factors including human voice, music and engine noise are filtered out.

[0078] Filtering of human voice and music: Utilize the difference between the spectral characteristics of human voice and music and the sound of vehicle horns to filter them out through a band-stop filter or an adaptive filter.

[0079] Engine noise suppression: Engine noise has low frequency and stable spectrum characteristics, which can be suppressed by techniques such as bandpass filter or spectral subtraction.

[0080] The processed whistle sound signal is converted into a visual sound cloud map. The sound cloud map uses different colors and brightness to represent the intensity and distribution of the sound signal, allowing users to intuitively understand the location and intensity information of the sound source.

[0081] Color mapping: According to the intensity value of the sound signal, it is mapped to different colors. Generally, the higher the intensity, the brighter the color.

[0082] Brightness representation: Brightness changes reflect the dynamic changes of sound signals, such as the rise and fall and attenuation of sound.

[0083] For example, in the sound cloud map, the location of the vehicle horn sound source appears as a bright red area, indicating that the sound intensity at this location is the highest; while the surrounding area gradually becomes darker, indicating that the sound intensity gradually decreases.

[0084] The TDOA algorithm is used to locate the whistle sound signal. The TDOA algorithm estimates the location of the sound source by measuring the time difference between the sound signal arriving at different microphones.

[0085] Time information acquisition: record the timestamp when the sound signal arrives at each microphone.

[0086] Position calculation: Based on the time difference and the known microphone position, the position coordinates of the sound source are calculated using geometric methods or optimization algorithms.

[0087] S103, a dynamic display step, comprising generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information;

[0088] It is understandable that the sound cloud map, the sound source location information and the sound source intensity information are integrated into a unified data structure. The data structure can accurately represent the position, direction and corresponding sound intensity of each sound source in two-dimensional or three-dimensional space.

[0089] Sound cloud map: As a background layer, it shows the intensity and distribution of sound signals in the entire monitoring area.

[0090] Sound source position information: contains the coordinates of the sound source in space.

[0091] Sound source intensity information: indicates the intensity of the sound signal emitted by the sound source, in decibels (dB).

[0092] For example, the sound cloud map is displayed in two dimensions, covering an area of ​​10 meters x 10 meters. The sound source location information shows that there is a whistle sound source located at the position (5 meters, 3 meters) in the area. The sound source intensity information is 90dB, indicating that the sound signal emitted by the sound source is strong.

[0093] Based on the integrated data, dynamic images are generated. The dynamic images are updated in real time to reflect changes in the location, direction and intensity of the sound source.

[0094] Direction: Use graphic elements such as arrows or lines to indicate the direction of the sound source. The direction of the arrow corresponds to the actual location of the sound source, and the length or thickness of the arrow can indicate the intensity of the sound.

[0095] Intensity representation: Visually display the intensity of the sound through color, brightness, or size of graphic elements. For example, you can use a gradient from blue to red to represent the change of sound intensity from low to high, where red represents the strongest sound signal.

[0096] Dynamic update: The dynamic image can change in real time as the sound cloud map and sound source location information are updated.

[0097] The generated dynamic image is displayed on a user interface, which may be a vehicle-mounted display screen.

[0098] In some of the applications, the dynamic display step includes generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information; generating corresponding dynamic image symbols representing the direction and intensity of the sound source based on the sound source location information and the sound source intensity information; and displaying the generated dynamic image symbols in real time in combination with the sound cloud map, and dynamically updating the display content to provide continuous warnings and prompts.

[0099] It is understood that the direction of the sound source relative to the user or monitoring device is calculated based on the sound source location information. Arrows, pointers or other graphic elements can be used to indicate the direction of the sound source. The head of the arrow points to the sound source location, and the tail is located at the preset reference point of the user or monitoring device. By changing the color, brightness, size or texture of the arrow or other graphic elements, the intensity information of the sound source is mapped to the dynamic image symbol. For example, a gradient from blue (low intensity) to red (high intensity) can be used to indicate changes in sound intensity.

[0100] The sound cloud map is rendered as a background layer to show the intensity and distribution of sound signals in the entire monitoring area. The sound cloud map can intuitively reflect the strength and location of the sound through visual elements such as color and brightness.

[0101] The generated dynamic image symbol is superimposed on the sound cloud map to ensure that the position of the symbol corresponds to the actual position of the sound source. With the guidance of the dynamic image symbol, the user can quickly locate the direction and approximate intensity of the sound source.

[0102] Establish a real-time update mechanism to ensure that sound cloud maps and dynamic image symbols can be dynamically updated as the sound source location information and intensity information changes.

[0103] The prominence of dynamic image symbols and the intuitiveness of sound cloud maps provide users with strong visual warnings. When users see that the dynamic image symbol points in a certain direction and is brightly colored, they can immediately realize that there is a strong sound signal in that direction. The real-time update of dynamic image symbols and sound cloud maps ensures that users can continuously obtain the latest sound source information. This helps users stay alert and make appropriate responses or decisions.

[0104] S104, an environmental adaptation step, includes detecting the vehicle's surrounding environment, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

[0105] In some of the applications, the environmental adaptation step includes detecting the vehicle's surroundings, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through signal processing algorithms, so that the vehicle can identify and display the horn sound signal under various environmental conditions. The environmental features of the vehicle's surroundings are detected, including the size of the space and the echo intensity; the specific environmental features include a high-echo environment. When the identified environmental features are a high-echo environment, the impact of the echo on the horn sound signal is eliminated through a signal processing algorithm, and the signal processing algorithm includes AEC adaptive filtering; the sound source position information is optimized based on the TDOA algorithm, including sound source separation and sound source localization.

[0106] It is understandable that a comprehensive detection is performed on the vehicle's surroundings, including the size of the space and the echo intensity.

[0107] Space size: By measuring the distance between the vehicle and surrounding obstacles and using the image information captured by the camera, the approximate size of the space where the vehicle is located is estimated.

[0108] Echo strength: The microphone array uses the sound signal received to analyze the echo components contained in it, and evaluates the echo strength by comparing the amplitude and phase difference between the direct sound and the echo.

[0109] For example, in a spacious parking lot, the space size is estimated to be 50m x 50m, and the echo intensity is low. In a narrow tunnel, the space size is limited, and due to the smooth walls, the echo intensity is high, and there is a clear echo component in the sound signal.

[0110] Based on the collected environmental feature data, it is identified whether the current environment is one of the specific environmental features, such as a high echo environment. When the echo intensity exceeds a preset threshold, the current environment is determined to be a high echo environment.

[0111] For example, the preset echo intensity threshold is -30dB. If the detected echo intensity is -25dB, the current environment is determined to be a high echo environment.

[0112] In a high-echo environment, the AEC (Adaptive Echo Cancellation) algorithm is used to process the sound signal received by the microphone. The AEC algorithm estimates and subtracts the echo component to eliminate the impact of the echo on the original sound signal.

[0113] Combining multi-channel signal processing technology and blind source separation algorithm (such as ICA independent component analysis), the whistle sound signal and other background noise are separated from the mixed sound signal.

[0114] After completing echo cancellation and sound source separation, the TDOA algorithm is used to accurately locate the whistle sound signal. By optimizing the TDOA algorithm and considering environmental factors (such as the change of sound propagation speed with temperature and humidity), the accuracy of the sound source location information is further improved.

[0115] In some of these applications, the dynamic display step further includes calculating the distance from the sound source location information to the vehicle; converting the distance from the sound source location information to the vehicle into a sound source intensity representation according to a preset mapping rule; updating the sound source location information and the sound source intensity information in real time according to changes in the sound source location information; based on a preset warning range, when the sound source location information exceeds the warning range, not displaying it or reducing the display intensity of the sound source intensity.

[0116] It can be understood that the precise position coordinates of the sound source in three-dimensional space (X_s, Y_s, Z_s) are obtained, and the position coordinates of the vehicle itself (X_v, Y_v, Z_v) are obtained at the same time. Then, according to the distance formula between two points, the distance D from the sound source to the vehicle is calculated:

[0117] D=(Xs-Xv)2+(YS-Yv)2+(Zs-Zv)2

[0118] For example, the coordinates of the sound source position are (100, 200, 0.5) (unit: meter), and the coordinates of the vehicle position are (50, 150, 0) (unit: meter). Then the distance D from the sound source to the vehicle is calculated to be (100-50)2+(200-150)2+(0.5-0)2≈50.02 meters.

[0119] According to the preset mapping rules, the calculated distance D is converted into the intensity representation of the sound source on the display interface. The mapping rules can be set according to actual needs, for example, an inverse relationship is adopted, that is, the closer the distance, the higher the intensity representation of the sound source (such as brighter colors, higher brightness or larger graphic elements).

[0120] For example, the preset mapping rule is: the relationship between the distance D (unit: meter) and the sound source intensity S (assuming it is expressed in brightness percentage) is S = 100-DmaxD×50, where Dmax is the preset maximum effective distance (such as 100 meters). For D = 50.02 meters in the above example, the sound source intensity S is approximately 100-10050.02×50≈75%.

[0121] Establish a real-time update mechanism, such as using a timer or event trigger mechanism, to recalculate the distance from the sound source to the vehicle periodically or when the sound source location changes, and update the intensity representation of the sound source based on the new distance. At the same time, ensure that dynamic graphic symbols or other display elements can accurately reflect changes in the sound source location.

[0122] Preset one or more warning ranges, and control the display intensity of the sound source based on whether the sound source location information exceeds these ranges. For example, you can set a "safe range" and display the sound source at normal intensity when it is within this range; when the sound source exceeds this range but is still within the "attention range", reduce the display intensity to remind the user; if the sound source is completely beyond the "attention range", you can choose not to display it or further reduce the display intensity to almost invisible.

[0123] For example, the preset "safety range" is within 30 meters, and the "caution range" is between 30 meters and 60 meters. For the sound source position in the above example (D = 50.02 meters), it is within the "caution range", so the sound source intensity is appropriately reduced (such as from 75% to 60%) when displayed to remind the user to pay attention. If the sound source distance increases to 70 meters, choose not to highlight the sound source on the display interface.

[0124] Combine the following Figures 2 to 4 The following are some examples of the method for identifying and displaying vehicle horn sounds according to the present invention in some applications:

[0125] like Figure 2 As shown, the microphone receives the horn sound of nearby vehicles: the acoustic microphone collects the car horn sound signal and uploads the collected data to the vehicle control unit;

[0126] The vehicle control unit processes the sound signal: Based on the collected acoustic information, the sound characteristics of the horn are extracted through voiceprint recognition technology, and other interference factors (such as human voice, music, engine noise, etc.) are filtered out to generate a sound cloud map, so that the sound signal can be visualized. Then, based on the sound positioning algorithm, the car horn sound within the collection range is obtained and the sound source is accurately located;

[0127] The HUD displays the direction and intensity of the source of the horn signal: Based on the processed data, a dynamic image of the sound source direction symbol and the sound source intensity symbol is generated to alert the driver to nearby horns in real time.

[0128] A microphone for collecting sound signals is installed outside the vehicle, and the sound pressure level range that can be measured is: 50~115dBA;

[0129] The vehicle control unit can realize echo cancellation, sound source separation, sound source localization and other functions according to the vehicle environment and the collected sound signals through signal processing algorithms. The specific implementation process is as follows:

[0130] Echo cancellation: In the closed space of an underground garage or other narrow environment, it is easy to form reflected sound, which affects the accuracy of the final image. Use AEC adaptive filtering technology to eliminate the impact of echo. Specific implementation method: Use an adaptive filter to identify the parameters of the unknown echo channel, establish a far-end signal model based on the correlation between the sound source signal and the echo signal it generates, simulate the echo path, and adjust the impulse response and the real echo path through an adaptive algorithm based on the minimum mean square error principle. Then subtract the estimated value from the signal received by the microphone to achieve the echo cancellation function.

[0131] Sound source separation: After eliminating the influence of echo, the whistle sound and other environmental interference sounds can be separated more efficiently. First, preprocessing is required to divide the signal after echo elimination, and each frame length is 25ms, in order to more accurately identify the whistle sound; the frequency range of car whistles is generally 1500-3000HZ, so other environmental sounds that are not in this frequency range are filtered out; then the environmental sound features of the whistle sound are extracted, and a model is established to sample and match the preprocessed data frame by frame with the standard whistle sound samples. The standard whistle sound can be obtained based on the sound feature recognition technology of the BP neural network. When the matching degree is higher than the set 95% threshold, it can be identified as a whistle sound, and the recognition accuracy should reach about 95%, thereby achieving the effect of sound source separation.

[0132] Sound source localization: The extracted whistle signal is localized based on the TDOA (Time Different of Arrival) algorithm to analyze the relationship between the changes in the collected sound features and time. The following is a specific algorithm description: Assume that the three microphones collecting signals are A, B, and C, and their positions are (x A ,y A )(x B ,y B )(x C ,y C ), read the arrival time of the sound signal received by the microphone respectively, and calculate the distance difference d from the sound signal source to the three microphones according to the time difference of the sound signal arriving at the microphone A d B d C , assuming that the position of the sound signal source is (x, y), according to the properties of the triangle, the following equations can be obtained:

[0133] (xx A ) 2 +(yy A ) 2 =d A 2 ;

[0134] (xxB ) 2 +(yy B ) 2 =d B 2 ;

[0135] (xx C ) 2 +(yy C ) 2 =d C 2 ;

[0136] Solving the system of equations can determine the location (x,y) of the sound signal source.

[0137] The HUD displays real-time dynamic images through the sound source direction symbol (arrow) and the sound source intensity symbol (ripple). The number of grids W displayed for the sound source intensity ranges from 0 to 6. From the sound source coordinates (x, y), the direction and distance of the sound source coordinates relative to the vehicle can be obtained. The decibel level of a car horn is 85 decibels, and the warning range is generally about 0 to 300 meters. The control unit logic is as follows: Figure 3 As shown;

[0138] The corresponding relationship between W and distance S is:

[0139] like Figure 4 As shown, the HUD display effect is that, assuming the sound source coordinates are (0, 10), the direction is along the negative y-axis, the distance S relative to the vehicle is 10m, and the sound source intensity W is 6 grids.

[0140] For the method steps disclosed in the above embodiments, the method steps are described as a series of action combinations for the purpose of simple description, but those skilled in the art should know that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0141] like Figure 5 As shown, the present invention also provides a system for identifying and displaying vehicle horn sounds, comprising:

[0142] The signal collection module 201 is configured to receive and collect whistle sound signals in the surrounding environment of the vehicle;

[0143] The signal processing module 202 is configured to process the horn sound signal, including extracting the horn sound characteristics, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source position information;

[0144] A dynamic display module 203 is configured to generate and display a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information;

[0145] The environmental adaptation module 204 is configured to detect the vehicle's surrounding environment, identify specific environmental features, and implement echo cancellation, sound source separation, and sound source localization functions through signal processing algorithms, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

[0146] It is worth noting that although only some basic functional modules are disclosed in the embodiments of the present invention, it does not mean that the composition of the present system is limited to the above basic functional modules. On the contrary, what the present embodiment wants to express is that on the basis of the above basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. In other words, the present system is open rather than closed. Just because the present embodiment only discloses individual basic functional modules, it cannot be considered that the protection scope of the claims of the present invention is limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above devices are described in terms of functions and are described separately in various units and modules. Of course, when implementing the present invention, the functions of each unit and module can be implemented in the same or one or more software and / or hardware.

[0147] like Figure 6 As shown, the present invention also provides an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method for identifying and displaying vehicle horn sounds.

[0148] Figure 6 Schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Figure 6 The electronic device provided in the embodiment of the present invention includes: one or more processors 710 and a storage device 720; the processor 710 in the electronic device may be one or more, Figure 6 A processor 710 is taken as an example; the storage device 720 is used to store one or more programs; the one or more programs are executed by the one or more processors 710, so that the one or more processors 710 implement the method for identifying and displaying vehicle horn sounds as described in any one of the embodiments of the present invention.

[0149] The electronic device may further include: an input device 730 and an output device 740 .

[0150] The processor 710, storage device 720, input device 730 and output device 740 in the electronic device can be connected via a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0151] The storage device 720 in the electronic device is a computer-readable storage medium that can be used to store one or more programs, which can be software programs, computer executable programs, and modules, such as the program instructions / modules corresponding to the method for identifying and displaying vehicle horns provided in the embodiments of the present invention. The processor 710 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the storage device 720, that is, the method for identifying and displaying vehicle horns in the above method embodiments is implemented.

[0152] The storage device 720 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the storage device 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the storage device 720 may further include a memory remotely arranged relative to the processor 710, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0153] The input device 730 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the electronic device. The output device 740 may include a display device such as a display screen.

[0154] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the method for identifying and displaying a vehicle horn sound.

[0155] Specifically, the computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0156] The present invention also provides a vehicle, wherein the vehicle is provided with the system for identifying and displaying vehicle horn sounds as described above.

[0157] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for identifying and displaying vehicle horn sounds, characterized in that: include: The signal collection step includes receiving and collecting the whistle sound signal in the surrounding environment of the vehicle; The signal processing step includes processing the horn sound signal, extracting the horn sound characteristics, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source position information; The dynamic display step includes generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information; The environmental adaptation step includes detecting the vehicle's surrounding environment, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

2. The method for identifying and displaying vehicle horn sounds according to claim 1, characterized in that: The signal collection step includes receiving and collecting the whistle sound signal in the vehicle surrounding environment, and further includes: Receiving the whistle sound signal in the vehicle surrounding environment in real time; Preprocessing the whistle sound signal, including preliminary amplification and filtering of the whistle sound signal to enhance signal strength and remove some high-frequency or low-frequency noise; The whistle sound signal is digitized and stored.

3. The method for identifying and displaying vehicle horn sounds according to claim 1, characterized in that: The signal processing step includes processing the whistle sound signal, extracting the horn sound characteristics, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain the sound source location information, and further includes: Analyzing the horn sound signal based on voiceprint recognition to extract the horn sound features, including frequency distribution and duration; Filter out interference factors of the whistle sound signal, including human voice, music and engine noise, to improve the signal-to-noise ratio of the whistle sound signal; Converting the processed whistle sound signal into a visual sound cloud map, wherein the sound cloud map represents the intensity and distribution of the whistle sound signal through visual elements of color and brightness; The sound localization algorithm includes a TDOA algorithm, and the sound source position information is calculated based on the TDOA algorithm according to the speaker sound characteristics and time information.

4. The method for identifying and displaying vehicle horn sounds according to claim 3, characterized in that: The environmental adaptation step includes detecting the vehicle's surrounding environment, identifying specific environmental features, and implementing echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions, and further includes: Detecting environmental characteristics of the vehicle's surroundings, including space size and echo strength; The specific environmental feature includes a high echo environment. When the identified environmental feature is the high echo environment, the influence of the echo on the whistle sound signal is eliminated by a signal processing algorithm, wherein the signal processing algorithm includes AEC adaptive filtering; The sound source position information is optimized based on the TDOA algorithm, including sound source separation and sound source localization.

5. The method for identifying and displaying vehicle horn sounds according to claim 1, characterized in that: The dynamic display step includes generating and displaying a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information, and further includes: Based on the sound source position information and the sound source intensity information, generating a dynamic image symbol corresponding to the direction and intensity of the sound source; The generated dynamic image symbol is combined with the sound cloud map for real-time display, and the display content is dynamically updated to provide continuous warning and prompting effects.

6. The method for identifying and displaying vehicle horn sounds according to claim 1, characterized in that: The dynamic display step further includes: Calculating the distance from the sound source position information to the vehicle; According to a preset mapping rule, the distance from the sound source position information to the vehicle is converted into a sound source intensity representation; According to the change of the sound source position information, updating the sound source position information and the intensity information of the sound source in real time; Based on a preset warning range, when the sound source location information exceeds the warning range, the sound source intensity is not displayed or the display intensity is reduced.

7. A system for identifying and displaying vehicle horn sounds, characterized in that: include: A signal acquisition module, configured to receive and collect horn sound signals in the surrounding environment of the vehicle; A signal processing module is configured to process the horn sound signal, including extracting horn sound features, filtering out interference factors, and generating a sound cloud map, and locating the sound source based on a sound localization algorithm to obtain sound source location information; A dynamic display module, configured to generate and display a dynamic image of the direction and intensity of the source of the whistle sound signal based on the sound cloud map, the sound source location information, and the sound source intensity information; The environmental adaptation module is configured to detect the vehicle's surrounding environment, identify specific environmental features, and implement echo cancellation, sound source separation, and sound source localization functions through a signal processing algorithm, so that the vehicle can recognize and display the whistle sound signal under various environmental conditions.

8. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: It stores a computer program executable by an electronic device, and when the computer program runs on the electronic device, the electronic device executes the steps of the method described in any one of claims 1 to 6.

10. A vehicle, characterized in that: The vehicle is provided with the system for recognizing and displaying vehicle horn sounds as claimed in claim 7.

Citation Information

Patent Citations

  • Automobile whistling real-time positioning system and method

    CN110956977A

  • Whistling vehicle automatic identification device and method based on sound array

    CN111243283A

  • Signal processing method, device and equipment and computer readable storage medium

    CN111710344A

  • Power equipment defect diagnosis device and method based on multi-source data fusion

    CN112419301A

  • Sound visualization method and device, equipment, storage medium and program product

    CN116013352A

Cited By

  • Map generation method and device, vehicle control method and device, vehicle and storage medium

    CN121048608A