Method and device for detecting objects from the vehicle environment of a vehicle

By analyzing vehicle-generated and external noise for object detection using auto- and cross-correlation, the method addresses measurement range limitations in noisy environments, ensuring reliable detection and collision avoidance.

DE102011079707B4Inactive Publication Date: 2024-11-14ROBERT BOSCH GMBH
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102011079707
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2011-07-25
Publication Date
2024-11-14
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing acoustic environment detection systems in vehicles face limitations in noisy environments due to excessive interference and room attenuation, leading to insufficient measurement ranges and unreliable operation.

Method used

Utilize existing acoustic signals from the vehicle's own functional noise and external noise for object detection, employing auto- and cross-correlation analysis to process these signals for collision warnings and dynamic control, without emitting additional measurement signals.

Benefits of technology

Enables reliable object detection and collision avoidance even in noisy conditions by leveraging continuous, high-power, and available acoustic signals, reducing the need for additional signal emission and enhancing system robustness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method for detecting objects from the vehicle environment of a vehicle, in which several signals suitable for signal processing, in particular electrical signals, which are generated from acoustic signals by means of at least one sensor (20) for vehicle environment monitoring, are analyzed with regard to comparable characteristics and, in the event of a possible collision of the vehicle with a detected object, a warning is issued to the driver and / or the vehicle dynamics are actively intervened and / or functions for reducing or avoiding the severity of an accident are activated, characterized in that acoustic signals from the vehicle environment are used to detect at least one first object from the vehicle environment, which strike the vehicle from at least one first predefined direction and comprise sound generated by the vehicle itself and / or sound from the vehicle environment.characterized in that acoustic signals from the vehicle environment are used to detect the first object and / or at least one second object from the vehicle environment, which strike the vehicle from at least one second predefined direction and comprise the measurement sound generated by at least one acoustic sensor located on the vehicle, which differs from the vehicle's inherent sound due to its function, wherein, in situations where both external sound and inherent sound due to its function are absent, measurement sound is emitted from the vehicle in at least one measurement direction from which no sound strikes the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Scope of the invention

[0001] The present invention relates to a method and a device for detecting objects from the vehicle's surroundings. The invention also relates to a vehicle assistance system with a device according to the invention. State of the art

[0002] Currently, pulse-based ultrasonic systems are commonly used for the acoustic detection of the environment of vehicles. These systems emit short signal pulses of 0.3 ms and determine the distance to the objects based on the travel time of reflections of these pulses from objects in the environment and the speed of sound.

[0003] For acoustic environmental monitoring, the ultrasonic frequency range is used because the intensity of ambient noise typically decreases with increasing frequency. However, due to the increasing room attenuation with rising signal frequency, the lower end of the ultrasonic band, typically around 48 kHz, is predominantly used. This frequency selection therefore represents a compromise. Because of this compromise, situations often arise where excessive interference or room attenuation results in an insufficient measurement range.

[0004] It is known from the state of the art that by increasing the pulse duration, the energy emitted per echo cycle can be slightly increased, despite finite transmission power, and with skillful reception, the range as well. However, the measurement signal power used to date in acoustic environmental monitoring is completely negligible compared to the sound power encountered in some traffic situations.

[0005] Methods for location-based vehicle-to-vehicle communication are also known from the state of the art.

[0006] Document DE 103 13 331 B4 discloses a method for determining the direction of incidence of a signal from an acoustic signal source and a device for carrying out the method. The same document discloses various methods in which a distance from the signal source is also determined. It also describes how signal analysis involves a correlation analysis between microphone signals of varying delays. The acoustic scene analysis presented there relates in particular to hearing aids, i.e., the determination of the environment surrounding a head.

[0007] Document DE 10 2007 034 054 A1 discloses a method for passively determining at least the distance to a sound-emitting target and a sonar system. It describes how a distance estimate and a horizontal bearing angle to a sound-emitting target within the antenna's reception range can be determined. In this process, the signals received from different antenna systems are each subjected to a spectral analysis and then compared in the frequency domain. If a match of spectral characteristics is found, a target marker with its horizontal bearing angle and distance estimate is displayed on a corresponding display device or screen.

[0008] Document DE 699 03 171 T2 describes a device and a method for the automatic control of video cameras using microphones, wherein a video camera can be directed at a localized sound source. Here, the delay time of the arrival of a sound wavefront at selected pairs of microphones is determined, and from this the spatial and temporal coordinates of a sound source are calculated. One or more cameras are then directed at the source. The cross-correlation of the signals from two microphones is specified as the signal processing method.

[0009] Document DE 101 36 981 A1 discloses a method and a device for detecting a stationary and / or moving object, in particular a vehicle, in which acoustic signals emitted by the object and / or reflected by another object are detected, based on which the object in question is detected, evaluated and / or identified. Such a method, similar to self-localization based on sound waves, enables both a stationary and a moving object, e.g., a vehicle, to be acoustically detected, evaluated and identified based on its own noise and / or external noise with respect to its own movement trajectory with respect to one or more coordinate axes (x-, y-axis).

[0010] In summary, the previously presented state-of-the-art documents describe the implementation of environmental sensing using externally generated acoustic signals. Various signal processing methods, such as autocorrelation and cross-correlation of the signals, are also known.

[0011] A fundamental requirement for environmental perception using externally generated acoustic signals is the continuous availability of ambient sound in the environment to be measured. Using such an environment perception system based solely on ambient sound in road traffic would be highly unreliable, as the driving situation, and therefore the presence of ambient sound in the surrounding area, is unpredictable. Disclosure of the invention

[0012] According to the invention, a method for detecting objects in the vehicle's surroundings is provided, in which several signals suitable for signal processing, in particular electrical signals generated from acoustic signals, are analyzed with respect to comparable features. If a collision between the vehicle and a detected object is imminent, a warning is issued to the driver and / or the vehicle dynamics are actively intervened in and / or functions for reducing or preventing the severity of an accident are activated. In the method according to the invention, acoustic signals from the vehicle's surroundings are used to detect at least one first object. These signals strike the vehicle from at least one predefined direction and comprise sound generated by the vehicle itself and / or sound from the vehicle's surroundings.To detect the first object and / or at least one second object, acoustic signals from the vehicle's surroundings are used. These signals strike the vehicle from at least one second predefined direction and comprise measurement sound generated by at least one acoustic sensor located on the vehicle. This measurement sound differs from the vehicle's inherent noise generated during operation. According to the invention, in situations where both external noise and inherent noise generated during operation are absent—i.e., in a quiet driving environment—measurement sound is emitted from the vehicle in at least one measurement direction from which no sound reaches the vehicle.

[0013] Furthermore, the invention provides a device for detecting objects from the vehicle environment of a vehicle, which is designed to carry out the method according to the invention and comprises at least one sensor for monitoring the vehicle environment, which sensor is designed to generate signals suitable for signal processing, in particular electrical signals, from acoustic signals. The device according to the invention comprises a signal processing device which is designed to analyze a plurality of signals generated from the acoustic signals from the vehicle environment with regard to comparable features in order to detect at least one object from the vehicle environment and to generate a warning and / or control signal in the event of a possible collision of the vehicle with a detected object.Furthermore, the device according to the invention comprises a warning unit configured to issue a warning to the driver when a warning signal generated by the signal processing unit is present, and / or a control unit configured to intervene in the vehicle dynamics when a control signal generated by the signal processing unit is present, and / or to activate functions for reducing or preventing the severity of an accident. At least one sensor is configured for monitoring the vehicle's surroundings to determine at least one sound signal emitted by the vehicle based on vehicle control data, which in particular includes information about the vehicle speed and / or engine speed and is particularly suitable for exchange via a data bus, and to provide this data to the signal processing unit in a suitable form.

[0014] The subclaims show preferred developments of the invention.

[0015] According to the invention, a method and a device are provided with which acoustic environmental monitoring can be implemented even in noisy environments, in which the already existing ambient noise and / or the inherent noise of the vehicle due to its operation are used as the measurement signal. This reduces the effort required to generate and transmit measurement signals, at least in noisy environments.

[0016] According to the invention, a device for the acoustic detection of objects in the vicinity of a vehicle is provided, wherein the vehicle is equipped with at least one sensor for converting acoustic signals from the vehicle's environment into a form suitable for signal processing, such as electrical signals. At least temporarily, preferably in situations where the vehicle's environment is already filled with ambient noise or the vehicle's own operating noise, no acoustic signals specifically generated by the vehicle itself for environmental measurement, such as the currently common ultrasonic pulses, are emitted. Based on the acoustic signals from the vehicle's environment recorded by the sensors, information and / or warnings are generated, for example, for the vehicle operator, regarding situations in the vehicle's surroundings.Based on the acoustic signals from the vehicle's surroundings recorded by the sensors, the vehicle's driving movement can also be influenced, e.g. by steering, accelerating and / or braking, and / or devices for damage prevention and / or reducing the severity of an accident, such as belt tensioners, window lifters, adjustable headrests, airbags, etc., can be parameterized or activated.

[0017] The decision to use ultrasound measurement pulses dates back to a time when it was just possible to use some then-emerging electronic components to record higher frequency electrical signals, i.e., ultrasound, within a narrow frequency range and to process them analogously at reasonable cost.

[0018] In the following 30 years, the technology continued to develop and today makes it possible to convert acoustic signals with a much higher dynamic range of 14 to 16 bits and more into digital formats using inexpensive analog-to-digital converters, such as sigma-delta converters, especially in the signal frequency range up to 20 kHz, i.e., also below the ultrasound band, and to filter and process them in other ways using signal processing technology that can now be manufactured inexpensively.

[0019] Particularly in noisy situations, i.e. in environments filled with high sound power, there are limits to increasing the range, e.g. by emitting even higher sound powers or by using acoustic-electrical transducers with even higher directional characteristics, even in the ultrasound range, despite the potential not yet being fully exploited.

[0020] In particular, the signals generated from acoustic signals from the vehicle environment are analyzed in a form suitable for signal processing by means of autocorrelation and / or cross-correlation with respect to comparable features.

[0021] The system's functionality is based on the principle that, instead of emitting its own acoustic signals in the absence of silence in at least one measurement direction, the signals arriving from one direction at least at one sensor, such as preferably an assembly of an acoustic-electrical transducer and its surrounding housing, are analyzed for comparable characteristics. This is done, for example, by means of autocorrelation and cross-correlation of the signals. Information about the path of each acoustic signal arriving at the vehicle from a given direction of propagation is stored within it. For example, information can be obtained from measured path lengthening due to reflections from objects with a certain reflectivity.Thus, the result of the autocorrelation function in the path length extensions already contains information about the spatial relationship of several objects between sound source and receiving sensor, about their reflectivity in the signal strengths, about their extent in the signal distortion, and about their relative movements in the Doppler shift of the signals.

[0022] As is well known, by evaluating the information from additional sensors in cross-correlation, equivalent results are obtained for the sensor pairings.

[0023] Experts are familiar with various methods for implementing autocorrelation and / or cross-correlation calculations and signal evaluation, such as suitable multiplication of the measurement signals transformed into the frequency domain. Therefore, these details will not be discussed explicitly here.

[0024] It is known that by using multiple sensors, positioning can be carried out based on differences in path.

[0025] According to the invention, sources that inherently generate sound are preferably used as measurement signal sources. The advantage of sound that is already present due to its function is its significantly higher power and continuous availability compared to pulsed ultrasound signals.

[0026] Such functional sound sources from the vehicle itself include, for example, engine and transmission noise, rolling noise from the wheels or tracks, rattling / natural resonances of vehicle parts, acoustic sound emitted by the vehicle from the sound system, etc., as well as the noise of the surrounding media (mostly air, but also rain, snow, etc.), which is dependent on the vehicle's own speed and wind speed. Other sound sources include, for example, other vehicles in the vicinity, stationary energy-converting equipment, or even footsteps, the squeaking of bicycle chains, rail vehicles, etc. Signals that are currently only used for providing acoustic information to road users, such as [examples of signals], are particularly suitable for the automated analysis of functional sound from the vehicle itself and / or other vehicles.Horns, sirens, bells, and / or warning signals, which are emitted as a replacement for the previously usual engine noises, e.g. from electric vehicles, to draw the attention of passers-by to the vehicles.

[0027] The sound generated in this way spreads and overlaps with sound resulting from reflections off objects surrounding the vehicle before reaching the sensors. The more sensors are installed at different locations on the vehicle, the more accurately the vehicle's environment can be acoustically analyzed.

[0028] One possible application is the detection of a side impact on a vehicle. Thanks to the numerous lateral gaps in the body, numerous measuring points with a large base spacing can be realized. The rolling noise of the vehicle is partially reflected by an object approaching from the side before hitting the sensor(s) mounted on the side of the vehicle. The propagation time relationships, the signal changes due to Doppler shift, the signal strength ratios, and / or the signal deformations due to different surface conditions are at least contained in the signals. Continuous measurement is preferred, rather than pulsed, in order to obtain a constantly updated, continuous stream of information.In the event that the vehicle is completely stationary, the object approaching from the side usually generates at least rolling noise which, without further reflection or superimposed by reflections from objects according to their paths, reaches the sensor(s) attached to the side of the vehicle.

[0029] Equivalently, a preferably signal-free acoustic environmental sensor system can also be implemented behind and in front of the vehicle, using not only the reflections of its own noise but also the signals of passing and following vehicles as a measurement signal.

[0030] A very typical application for signal-free acoustic environmental sensing is the side-view assist function, which uses received acoustic signals to infer the presence of vehicles and other objects in the vehicle's vicinity. Currently, due to limited link budgets, this function is restricted to certain application positions and maximum speeds, especially since each sensor only listens to the measurement signals it emits and is thus affected by airflow noise, its own rolling noise, and the rolling noise of other objects. According to the invention, this noise is not considered interference but is instead repurposed as a useful signal.

[0031] In the exceptional case where the entire approach scene takes place silently and there are no other sound sources nearby, an acoustic measurement signal will preferably be emitted from the vehicle itself, particularly in the direction of the side of the vehicle.

[0032] According to the invention, operation in the ultrasound range and / or coexistence with systems emitting measurement signals, preferably in quiet scenes, is also conceivable.

[0033] In particular, acoustic signals emitted from the vehicle environment or from the vehicle itself, which are in the frequency range of no more than 20 kHz, are used to detect at least one first and / or at least one second object from the vehicle environment.

[0034] Because of the lower room damping, the frequently available “natural” sound sources in the form of the already existing extraneous noise or the functional self-noise, and because of the high availability of acoustic-electrocouplers as well as other components, which are preferably designed for the frequency range up to 20 kHz, the frequency range below the ultrasonic band should preferably be used, especially since common objects in the vehicle environment have a larger dimension than 0.85 cm, which corresponds to half the wavelength of 20 kHz.

[0035] Preferably, such a measurement signal should lie in the frequency range of 3 kHz to 20 kHz, because in this range the half-wavelengths of the signals are within the range of the object dimensions of 5.7 cm to 0.85 cm, which are particularly common in the device according to the invention; because human hearing ability, and thus potential interference, is already decreasing; and because, in general, the interference power density is already decreasing and small microphones are available. However, adjacent acoustic frequency ranges, such as the currently common ultrasound range or the acoustic range below 3 kHz typical for humans, are not explicitly excluded.

[0036] According to the invention, it is particularly preferred to place sensors in concealed installations, such as in or behind the radiator grille or in existing gaps and openings in the vehicle.

[0037] Due to their compact size and wide availability on the market, electret microphone capsules are particularly suitable as electro-acoustic transducers in acoustic sensors, especially for concealed installation on vehicles. Such electret microphone capsules are currently preferably designed for the frequency range up to 20 kHz.

[0038] As a sensor for acoustic environmental monitoring, the determination of at least one emitted sound signal by means of control information, such as that exchanged as data on a data bus, is also used.

[0039] A simple form of correlation is to determine the type of sound emitted by the vehicle using control signals or measurement signals, such as the information on a data bus. For example, a speed signal can be used to determine the

[0040] The speed of the fluids flowing around the vehicle or the engine speed information can be used to infer the motor's repetition frequency. In this way, the sound signals emitted due to the vehicle's operation can be deduced from these control signals with minimal effort, and a cross-correlation can be performed inexpensively without the need for specific measurements of these emitted signals.

[0041] In particular, at least one sensor for vehicle environment monitoring comprises an electro-acoustic transducer surrounded by a core housing that is heavier than the transducer diaphragm, which is embedded in a sound-absorbing medium and is in particular surrounded by a housing.

[0042] Preferably, the sensor is configured to adjust its directional characteristic by varying the core housing shape. This is achieved in particular by means designed to carry out a suitable variation of the core housing shape.

[0043] Preferably, the sensor housing is protected on the sound-entering side at least by a rigid grid and / or by a movable protective device and / or an alignment device, which is particularly changeable depending on the driving situation.

[0044] Acoustic environmental sensors must be robust enough for everyday use. This is achieved today through a mechanically very rigid diaphragm that can withstand flying stones, dirt, and even the jet of a pressure washer. The currently common designs of electro-acoustic transducers, such as electret microphones, as well as other electro-acoustic transducers, are very sensitive to such influences. Therefore, the microphone should at least be protected by an additional grille. Alternatively, adjustable devices are also conceivable, for example, by placing a shutter between the diaphragm and the grille that is only released when the vehicle is in motion, e.g., by applying current. Alternatively, such a shutter can replace the grille entirely or be positioned in front of it.

[0045] According to the invention, a vehicle assistance system is also provided with a device according to the invention. drawing

[0046] Embodiments of the invention are described in detail below with reference to the accompanying drawings. In the drawing: Fig. 1 a sectional view of a sensor for acoustic vehicle environment monitoring in a device according to the invention with integrated electro-acoustic transducer, and Fig. 2 a perspective view of a currently used design of an electro-acoustic transducer, for example realized as an electret microphone capsule. Embodiments of the invention

[0047] In the Fig. Figure 1 shows a sectional view of a sensor 20 for acoustic vehicle environment monitoring for use in a device according to the invention (not shown).

[0048] According to the invention, such a sensor 20 is designed to be particularly robust against direct coupling of the vehicle's inherent noise resulting from its function (not shown).

[0049] Sensor 20 contains the electro-acoustic transducer 10. The electro-acoustic transducer 10 from the Fig. 1 includes the membrane 11, which represents the actual transducer surface, as well as the cables 12 connected to it.

[0050] The electro-acoustic transducer can optionally be designed as a purely passive component or contain amplifiers as active components.

[0051] The electro-acoustic transducer 10 is surrounded within the sensor 20 by a massive core housing 14. Preferably, the electro-acoustic transducer 10 is held within this housing by means of supports 13, which are characterized by low acoustic conductivity. At least one further layer 15, which conducts structure-borne sound poorly, separates this core housing 14 from the outer housing 16, which serves, among other things, to attach the sensor 20 to the vehicle. Preferably, the entire assembly or parts thereof have sound-conducting components oriented in the measuring direction, such as a funnel 17 on the core housing 14. Preferably, the diaphragm 11 is protected against foreign bodies by means of a guard 18 arranged in front of it, such as a grid, the guard preferably being arranged so that foreign bodies can fall out. Fig. 1 This is achieved by means of a slope. It is also conceivable to dispense with the separate supports 13, preferably in combination of the core housing 14 with the housing 16 of the converter 10.

[0052] In the Fig. 2 shows a perspective view of an electret microphone capsule 30, which can be used as an electro-acoustic transducer in the sensor 20 for monitoring the vehicle environment. Fig. 2 also shows, among other things, the sound entry side 40 and the connecting elements 50, which serve to electrically connect the electret microphone capsule 30 to the device according to the invention.

[0053] In addition to the written disclosure of the invention, explicit reference is hereby made to its graphic representation in the Fig. 1 and Fig. 2 referred.

Claims

[1] Method for detecting objects from the vehicle environment of a vehicle, in which a plurality of signals suitable for signal processing, in particular electrical signals, which are generated from acoustic signals by means of at least one sensor (20) for monitoring the vehicle environment, are analyzed with regard to comparable features and, in the event of a possible collision of the vehicle with a detected object, a warning is issued to the driver and / or active intervention is made in the vehicle dynamics and / or functions are activated to reduce or avoid the severity of an accident, characterized by that acoustic signals from the vehicle environment are used to detect at least one first object from the vehicle environment, which signals impinge on the vehicle from at least one first predefined direction and comprise inherent sound generated by the vehicle and / or external sound from the vehicle environment, characterized bythat for detecting the first object and / or at least one second object from the vehicle environment, acoustic signals from the vehicle environment are used, which impinge on the vehicle from at least one second predefined direction and which comprise measuring sound generated by at least one acoustic sensor located on the vehicle, which differs from the functionally induced intrinsic sound of the vehicle, wherein in situations where both external sound and functionally induced intrinsic sound are absent, measuring sound is emitted by the vehicle in at least one measuring direction from which no sound impinges on the vehicle. [2] Method according to claim 1, characterized by that the signals generated from acoustic signals from the vehicle environment are analyzed in a form suitable for signal processing by means of auto- and / or cross-correlation with regard to comparable features. [3] Method according to one of the preceding claims, characterized by that for detecting at least one first and / or the second object from the vehicle's surroundings, acoustic signals from the vehicle's surroundings or acoustic signals emitted from the vehicle's own vehicle are used, which are in the frequency range of not more than 20 kHz from the vehicle. [4] Device for detecting objects from the vehicle environment of a vehicle for carrying out a method according to one of the preceding claims, characterized byat least one sensor (20) for monitoring the vehicle's surroundings, which is designed to generate signals suitable for signal processing, in particular electrical signals, from acoustic signals from the vehicle's surroundings, a signal processing device which is designed to analyze a plurality of signals generated from the acoustic signals from the vehicle's surroundings with regard to comparable features in order to detect at least one object from the vehicle's surroundings and to generate a warning and / or control signal in the event of a possible collision of the vehicle with a detected object, a warning unit which is designed to output a warning to the driver in the event of a warning signal generated by the signal processing device and / or a control device which is designed toto intervene in the vehicle dynamics and / or to activate functions to reduce or avoid the severity of an accident when a control signal generated by the signal processing device is present, characterized by an acoustic sensor for generating the measuring sound, characterized by that at least one sensor for monitoring the vehicle environment is designed to determine at least one sound signal emitted by the vehicle on the basis of control data of the vehicle, which in particular comprise information about the vehicle speed and / or the engine speed and are in particular suitable for exchange by means of a data bus, and to provide it to the signal processing device in a suitable form. [5] Device according to claim 4, characterized bythat at least one sensor (20) for monitoring the vehicle environment comprises an electro-acoustic transducer (10) which is surrounded by a core housing (14) which is heavier than the transducer membrane (11), which is embedded in a sound-damping medium (15) and is surrounded in particular by a housing (16). [6] Device according to claim 5, characterized by that the electro-acoustic transducer (10) is designed to adjust its directional characteristic by varying the core housing shape. [7] Device according to claim 5 or 6, characterized by that the electro-acoustic transducer (10) comprises at least one rigid grid (18) and / or a movable protective device and / or an alignment device which can be changed in particular depending on the driving situation and which are arranged on the sound-incoming side of the housing (16) to protect the housing (16). [8] Vehicle assistance system with a device according to one of claims 4 to 7.

Citation Information

Patent Citations

  • Method and device for determining a stationary and / or moving object

    DE10136981A1

  • Method for passively determining at least the distance to a sound-emitting target and sonar system

    DE102007034054A1

  • Method for determining the direction of incidence of a signal from an acoustic signal source and device for carrying out the method

    DE10313331B4

  • ELECTRONIC DISTANCE AUTOMATIC FOR VEHICLES

    DE2207424A1

  • DEVICE AND METHOD FOR AUTOMATIC CONTROL OF VIDEO CAMERA BY MICROPHONE

    DE69903171T2