Methods and apparatus for identifying damage to vehicle windshields
By using microphones to detect noise and vehicle data, combined with differential analysis and integral methods, the problem of early identification of vehicle glass damage was solved, enabling accurate damage detection and automated maintenance scheduling.
Patent Information
- Application Number
- CN202580029549.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2025-04-23
- Filing Date
- 2025-04-24
- Publication Date
- 2026-11-17
AI Technical Summary
Existing technologies struggle to detect damage to vehicle glass early, especially minor damage caused by stone chips, leading to delayed detection and increased repair costs.
Using at least one microphone to detect the time-varying nature of noise and vehicle speed, combined with wind speed and environmental data, the system identifies glass damage through differential analysis and integration methods, generates damage information, and notifies the user or operator.
It enables early identification of glass damage, reduces repair costs, improves the accuracy and efficiency of damage detection, and supports automated maintenance scheduling.
Smart Images

Figure CN123125467A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to methods and apparatus and their application in corresponding systems or vehicles, which enable the identification of damage to the glass of a vehicle. Background Technology
[0002] Stones kicked up or objects falling from vehicles (such as ice slabs) can easily cause impacts to vehicle windows, such as the windshield, while driving. Most of these impacts cause little or no damage to the glass, either on the surface or within it. However, if a stone or object strikes the glass at the right angle with appropriate energy, it can easily cause chipping or even cracking. If the chipping or cracking is small, the actual damage may only become apparent as it expands over time.
[0003] This delayed visibility of damage is a particular problem in the case of fleet vehicles, such as rental cars, because in this case it is not the current user but a later user who must report the damage and, if necessary, have it repaired through the insurance company.
[0004] A method is known from document DE 10 2016 010 705 A1, in which stone impacts can be detected by means of a solid-state acoustic sensor.
[0005] The present invention aims to provide the possibility of identifying damage to glass caused by an impact as early as possible, so as to minimize further damage and thus reduce costs. Summary of the Invention
[0006] Therefore, this method, along with its associated equipment and its application in systems and vehicles, aims to provide the possibility of identifying damage to vehicle glass, such as the windshield, at an early stage. To this end, the temporal direction of noise, particularly noise originating from the windshield, is first detected using at least one first microphone. Here, the impact of an object is detected based on the temporal signal. Additionally, speed parameters, particularly vehicle speed and / or wind speed, are detected. Damage classification is then performed using the first microphone signal and the speed parameters. If relevant crack formation is identified, or a level of damage requiring repair is generally also identified, damage information is generated accordingly.
[0007] This invention is based on the use of sensors already located in or available in the vehicle. Here, to detect a first microphone signal, a hands-free microphone or a microphone from a portable smartphone can be used. The hands-free microphone is typically mounted in the area of the windshield or front window, allowing it to detect noise near the object of potential impact. Through further damage classification, the consequences of impacts can be distinguished from one another. Furthermore, the collision can be recorded, thus enabling notification of the damage event to subsequent users or fleet operators.
[0008] Furthermore, it is possible to specify the detection of a second microphone signal, which, particularly during vehicle operation, represents wind noise at the vehicle and / or at the windshield, or generally represents wind speed. Damage classification can then be additionally performed based on the second microphone signal or (wind) speed parameters derived therefrom. By taking into account wind speed and / or headwind during vehicle operation, impact energy and / or windshield damage can be determined in more detail.
[0009] For the second microphone signal, the first microphone previously used for the first microphone signal can be used. Alternatively, a second microphone can also be used, for example, mounted on the vehicle body and detecting noise from the outside. Alternatively, a pressure sensor can also be used to detect the second microphone signal. Suitable pressure sensors can be built into the bumper, for example, and are used specifically for pedestrian protection and / or within the framework of parking assistance.
[0010] Additionally or optionally, it is possible to detect consumption information related to vehicle movement. Here, it is possible to detect the fuel and / or electricity consumption used by the vehicle for forward movement and consider its variations to deduce the windward force acting on the vehicle. The windward speed parameter determined or derived thereby can be additionally used in determining damage classification.
[0011] In an improved form of the invention, environmental data of the vehicle is detected, for example, to determine the source of an object that struck the glass. To this end, at least a portion of the environmental data is added to the damage information as evidence. The environmental data can be, for example, camera information (images or video sequences), radar information, or location information. Using this environmental data, it is possible to identify a vehicle traveling ahead that may be responsible for the object. Identification features, such as license plates or other markings, can also be added to the damage information.
[0012] By using at least two first microphones, differential analysis of the two microphone signals can be performed. This differential analysis, or consideration of the first microphone signals from at least two different first microphones, can be used to identify or, more specifically, specify or classify collisions or impacts of an object. When using multiple microphone signals, the location of the impact / collision site is also possible.
[0013] In one embodiment of the invention, energy parameters representing energy input to the glass can also be derived from the first and / or second microphone signals. Using these energy parameters, damage classification can then be performed and cracks in the glass can be identified. Alternatively, impacts that, while not yet resulting in crack formation, left sufficiently deep spalling that could potentially lead to crack formation can also be identified.
[0014] In order to classify damage and / or to identify crack formation, an integral of the first microphone signal can be defined in an improved form of the invention. Specifically, crack formation can be indicated by the integral value exceeding a threshold.
[0015] In a particular design of the present invention, it is specified that the first microphone signal or the time course of noise recorded by the first microphone is detected only when the speed parameter exceeds the speed threshold.
[0016] Since the vibrational characteristics of glass change when a crack forms or crack propagates, the detected signal from the first microphone can also be used to detect propagation. Therefore, after crack formation is identified, crack propagation can be detected by further recording noise through the at least one first microphone.
[0017] The evaluation and damage classification of noise or noise signal data can be performed by control equipment within the vehicle. Alternatively, the noise or noise signal data can be sent to a central server outside the vehicle, which evaluates the noise or signal. The result of the evaluation can then be sent back to the vehicle or the control equipment within the vehicle for further damage information generation. Alternatively, the damage classification and damage information can also be generated in the central server, such that only the damage information is sent to the vehicle.
[0018] It is also possible to take individual glass parameters into account when evaluating noise or noise signal data. This can be done, for example, by considering specific glass parameters when integrating or verifying comparison thresholds.
[0019] Damage information can be transmitted to the user, but it can also be transmitted to fleet operators, insurance companies, and / or workshops. Therefore, for example, fleet operators or insurance companies can automatically initiate workshop orders and notify the vehicle's driver based on the damage information. Furthermore, other parameters, such as proximity or cost, can be considered when selecting a suitable workshop. Attached Figure Description
[0020] Figure 1a and 1b The graph illustrates the possible signal paths of noise when an object impacts glass. Figure 2 The diagram shows possible devices for implementing the present invention. Figure 3 The flowchart illustrates an embodiment of the invention within the method framework. Figure 4 This demonstrates the application of identifying glass damage. Detailed Implementation
[0021] When driving on highways and rural roads, it is common for a vehicle ahead to kick up stones, which then strike the windshield. The same applies to trucks, where bulk cargo often detaches from the loading deck. In winter, another hazard to objects striking the windshield is ice that may detach from the vehicle's roof. Most of these collisions cause little or no damage to the glass and may go undetected without a more thorough inspection. Even minor, localized damage that initially seems insignificant can spread like cracks due to vibrations and wind during driving, necessitating glass replacement. Detection of the damage event, ideally accompanied by documentation, is essential to account for the cost of such replacement. This detection is also meaningful for fleet or car rental operators to prevent damage from a previous user from being attributed to a subsequent user. The following embodiments describe methods, equipment, systems, or vehicles that enable such detection and recording of damage events.
[0022] When an object strikes glass, such as in the case of a stone impact, at least a portion of the impact energy is converted into (elastic) deformation of the glass, depending on the angle of impact, thereby producing sound. Another portion of the impact energy can cause damage to the glass, such as in the form of chipping, holes, or cracks.
[0023] exist Figure 1a The diagram exemplarily illustrates the sound level trajectory when a stone strikes without the formation of cracks. In this case, the stone is elastically scattered at the windshield, so that the impact energy is essentially returned to the stone's trajectory, thus ending the energy exchange between the stone and the glass at time t1. As can be identified from the diagram, there is essentially a symmetrical energy exchange between the stone and the glass, which causes vibration, but the vibration decays very quickly, causing the glass to return to rest after a few vibrations.
[0024] In contrast, Figure 1bThe graph shows a stone impact with crack formation at time point t2. Through crack formation, the glass loses its ability to elastically return the introduced energy to the stone, resulting in further elastic deformation of the glass after time point t2. Energy is not distributed in the glass until a later time point t3, thus significantly reducing the glass's vibration. It should be noted that similar vibrational behavior is obtained even with stone impacts accompanied by the formation of holes or flakes, where the behavior is weaker after time point t2. However, the key is the energy input at the time of glass damage, which, compared to elastic scattering, can be demonstrated as a longer and stronger vibration of the glass or also as sound. Using this invention, the difference is utilized to demonstrate the damage to glass due to an impact from an object or stone, whether cracked or otherwise.
[0025] This invention can be based on Figure 2The process is executed within the device. For this purpose, a processing unit 100 or evaluation unit is provided, which executes a corresponding method according to the invention for identifying damage to the glass of a vehicle, and can be, for example, part of an airbag control system. The processing unit 100 can have a memory 110 in which detected noise or microphone signals from the first microphone 120 and / or the second microphone 130 are stored, for example, in the form of a ring memory. Additionally, other information, such as individual physical parameters that can be associated with the windshield, can be stored in the memory 110. Based on the detected first and / or second microphone signals, the processing unit 100 performs damage classification to identify cracks or generally identify glass damage. If a crack is identified or sufficient damage to warrant action, corresponding damage information is generated. This damage information can be forwarded in the vehicle to a corresponding system 160, for example, to an external fault memory, for further processing or consideration. It is also possible that the vehicle's operation may be restricted due to identified glass damage. Thus, speed limits can be implemented on bumpy roads to slow the spread of cracks. Alternatively or additionally, the driver can be notified via auditory or visual display 170 that the glass has been damaged or that repair / replacement is necessary. It is also conceivable that information about the damaged glass could be sent to the fleet operator, insurance company, or directly to the workshop 180. For the fleet operator, the advantage is that they can associate the damage with the user and estimate when the cost of glass replacement is necessary and / or obtain a quote for glass replacement as early as possible. The insurance company can attempt to shift the cost of the damage to the at-fault party, along with the damage information and, if necessary, additional information about the at-fault party. Furthermore, the insurance company can automatically negotiate the best price by checking potential costs at the workshop before the vehicle user arrives. Additionally, the insurance company can, if necessary, direct the vehicle user to a preferred workshop. Transmitting the damage information to the (potentially assigned) workshop makes it possible for the workshop to order replacement glass as early as possible if no stock is available. Furthermore, there is the possibility of sending detected microphone signals and / or damage information to a cloud application 190. There, the microphone signal can be evaluated and, if necessary, correlated with other information (such as individual glass parameters or the risk of damage propagation) to form damage information, which is then sent back to processing unit 100 for further processing. Alternatively, such damage information may be sent as damage information to cloud application 190, which then further processes and / or forwards the information, for example, to fleet operators, insurance companies, and / or workshops.
[0026] The processing unit 100 can selectively store the detected microphone signal in a ring memory and monitor the noise level. If the noise level of the microphone signal exceeds a predetermined threshold, a copy of the detected microphone signal and vehicle data exceeding the threshold can be stored in memory 110 for further processing, such as further damage identification and damage classification.
[0027] To perform damage classification or to generate damage information, the processing unit 100 can detect at least one additional microphone signal from another first or second microphone 130. Using the at least second microphone signal, in the case of the additional first microphone signal, the location of damage or cracks on the glass can be specifically located by means of differential analysis. Using the additional microphone signal, it is further possible to confirm the noise at the time of damage or crack formation. Advantageously, at least two first microphones are spatially separated from each other, so that they also cover different glass areas for monitoring if necessary.
[0028] By utilizing the additional second microphone 130, the wind speed at the vehicle and / or at the windshield can be determined from the detected second microphone signal and the detected noise. The wind speed thus detected in a velocity parametric sense can provide clues such as the angle of impact, the inherent motion of the vehicle relative to the object, the energy input generated by the object in the windshield, and / or the magnitude of the headwind that flung / accelerated the object onto the windshield. Damage classification can also be improved based on the wind speed thus detected from the second microphone signal. The distribution of noise and / or second microphone signal intensity with wind speed based on this can be tested under laboratory and real-world conditions and stored in memory 100 as a comparison parameter or comparison table. Optionally and / or alternatively, the second microphone signal used for evaluation can also be sent to a server in cloud 190 to obtain results from there.
[0029] In addition to the pure information about the formation of damage to the glass, the damage information can also include other information related to the damage. Thus, for example, the time and location of the damage event can be recorded. Furthermore, the perpetrator can also be detected and identified using the corresponding device 140. It is conceivable that, upon identifying a stone impact, the image from the camera is detected and saved along with the damage information to, for example, identify a vehicle traveling ahead. Alternatively, it is also conceivable that the vehicle can be identified directly from the camera data, for example, by its license plate. Other sensors besides the camera can also be used to identify the perpetrator, such as a radar system with appropriate resolution. However, the device 140 can also be used to define any other type of object identification.
[0030] To initiate a method for identifying damage to the glass and to verify the identification, additional sensor parameters of the vehicle can be detected and considered by the sensor system 150 integrated into the vehicle. For example, the sensor system of the airbag control unit can be used to detect the vehicle's speed, so that noise detection using at least one microphone or identification of glass damage is only activated when a minimum speed is exceeded. Furthermore, vehicle motion can also be incorporated into the generation of damage classification or damage information. For example, vehicle motion can affect the spread of damage and thus the timeliness of replacement.
[0031] The vehicle's sensor system 150 can also be used to detect vehicle consumption in order to derive parameters representing windward speed. For example, it can detect consumption parameters representing fuel or electricity consumption over time, and derive windward speed parameters from their changes. The detected windward speed parameters can also be used to determine damage classification.
[0032] This windward speed parameter can be determined, for example, by comparing the current speed with a target speed under known consumption conditions. Alternatively or optionally, height profiles or road segment orientations can also be considered here.
[0033] According to the following text Figure 3 The flowchart illustrates a method for identifying damage to a vehicle's windshield. After the method begins, noise is detected in step 320, for example, based on the vehicle's minimum speed, using at least one first microphone. This could involve a microphone from a hands-free device in the vehicle, or preferably an additional microphone installed in the vehicle's interior near the rear. Optionally, a microphone from a portable mobile device, such as a smartphone, could also be included in the detection. In step 320, or alternatively in the preceding step 300, a speed parameter is also detected. This could involve the speed of the vehicle and / or the wind speed acting on the vehicle and / or the windshield.
[0034] Subsequently, in step 340, an object, such as a stone, impacting the glass is identified based on the detected time-series of the first microphone signal. Damage classification is performed based on the impact identification, using the first microphone signal and velocity parameters. If sufficient damage to the glass is identified that necessitates immediate or subsequent action, damage information is generated in step 370 and forwarded, for example, to the vehicle user. Alternatively, the damage information can also be saved for later service purposes. In further applications, the damage information can also be sent to the vehicle's fleet operator, insurance company, and / or workshop. If no damage is identified in step 340, the method can be terminated or restarted.
[0035] To identify object collisions and deduce damage classifications, the temporal trajectory of noise generated during the impact is evaluated. (As already mentioned...) Figure 1a and 1b As explained, impacts at the time of damage produce more significant, asymmetrical noise than impacts that are essentially elastic. Therefore, to assess an object impact, the temporal trajectory of the noise or first microphone signal is used to identify the damage, primarily determining the extent of the damage. Because the energy transferred to the glass differs in these two processes, it is also possible to use the integral of the noise signal, representing a measure of the energy input to the glass, to distinguish damage from elastic impacts. Classification of object impacts can also be performed by considering the temporal trajectory and / or energy input. Further refinement of the damage classification is possible by considering the physical parameters of the glass.
[0036] In another embodiment of the invention, the method can be specified to first detect the vehicle's speed in step 300 and then compare it with a speed threshold in a subsequent step 310. Here, the method for identifying damage is only executed if the vehicle is moving at a speed higher than the speed threshold. Otherwise, the method terminates or restarts at step 300.
[0037] As already regarding the basis Figure 2 As described in the device description, the method is also capable of detecting noise or microphone signals from at least one additional microphone in step 320. The at least two first microphone signals can be compared with each other in step 340 to perform damage identification and / or damage classification. It is conceivable that the difference in the microphone signals is used to identify a specific location on the glass where an object struck. Furthermore, a second microphone signal can be used to verify the first microphone signals and / or the impact. It is also conceivable that a second first microphone signal can be used to suppress background noise.
[0038] In another embodiment, it can be specified that in step 330, a second microphone signal representing wind noise at the vehicle and / or at the windshield is detected using a second microphone. This second microphone signal can be added as a speed parameter in step 340 to determine the damage classification. By detecting the wind noise, the intensity or speed of the wind can be detected, thereby inferring the force or energy with which an object was thrown against the windshield.
[0039] Alternatively, in step 340, when determining the damage classification, the windward speed from vehicle consumption information can also be used as an additional speed parameter. For this purpose, in step 330, the time trajectory or change of the consumption parameter, representing the fuel or electricity consumed to drive the vehicle, can be detected or read in. By comparing the known consumption with a target speed, conclusions can be drawn about the windward speed, particularly its intensity. Optionally, navigation data, altitude profiles, and / or road segment orientation can also be considered here to assess the consumption.
[0040] After identifying the object collision and damage to the glass in step 340, environmental data of the vehicle can be detected in subsequent steps. This environmental data can be used to identify the driving situation and / or potential offending vehicles traveling ahead. Thus, in addition to the time and location coordinates of the damage, images or videos from cameras showing the vehicle traveling ahead or possibly the object that collided can also be detected. Furthermore, it is conceivable that the license plate of the vehicle traveling ahead can also be identified based on the camera images in step 340. The environmental data or information thus detected can be at least partially added to the damage information and / or transmitted to an external receiver in step 370.
[0041] In a further optional step 330 or 360, additional sensor parameters or operating parameters of the vehicle can be detected, which can be helpful in specifying damage identification and damage information. It is conceivable that step 330 can be used to detect vehicle parameters that allow for a reasonable check of damage identification or support damage classification. For example, prior damage to the glass can also be detected and considered. Furthermore, uneven road surfaces, which may accelerate crack propagation, can be identified, making faster action necessary when replacing the glass. In contrast, additional data detected in step 360 can be used to detail the environmental data of step 350 or to refine the damage information using additional information. Thus, it can be demonstrated, if necessary, that the damage was not caused by driver error. Optionally, data such as the type of glass can also be detected, which may be relevant to fleet operators, insurance companies, and / or workshops after the damage event has been identified.
[0042] In an improved form of the method, step 380 can specify that damage information is sent directly to a selected or nearby workshop, thereby scheduling a time for glass replacement. The workshop can then order suitable glass before the vehicle arrives. Alternatively, it can be specified that an autonomous vehicle automatically drives to the workshop upon detecting damage.
[0043] As already explained, it is additionally possible to not only operate the object collision or stone impact recognition according to the invention in the processing unit 100 in the vehicle. Accordingly, utilizing the method according to Figure 4 The device demonstrates a cloud application. Here, the starting point is an evaluation unit 400, which detects corresponding microphone signals from the relevant vehicle system, as well as additional vehicle data if necessary. Instead of performing independent analysis of the microphone signals, the evaluation unit 400 sends the detected signals and data to a server 420 in the cloud. The server identifies and classifies the glass damage according to the aforementioned method and reports the damage information back to the evaluation unit 400. The evaluation unit 400 can then forward the damage information, along with additional data such as environmental data if necessary, to the fleet operator 430 or insurance company. The fleet operator 430 or insurance company can directly commission a workshop based on the damage information and report the appointment time back to the evaluation unit 400. Alternatively, the evaluation unit 400 can also automatically notify the workshop 440 and schedule a time for glass replacement.
Claims
1. A method for identifying damage at a glass of a vehicle, in particular at a windshield, wherein The method • Detect (320) at least one first microphone signal, the first microphone signal representing the time course of the noise, and • Based on the first microphone signal, an object, particularly a stone, is identified as impacting the glass (330), and • Detection speed parameter, and • Perform damage classification on the impact of the object based on the time direction of the first microphone signal and the velocity parameter (330). • Damage information is generated when a crack is detected in the glass (360).
2. The method of claim 1, wherein, The method • Detect at least one second microphone signal, the second microphone signal representing wind noise at the vehicle during driving, and • The damage classification is additionally performed based on the second microphone signal. Specifically, the method is specified to determine the velocity parameters and / or the impact energy of the object by means of the at least one second microphone signal.
3. The method according to claim 1 or 2, characterized in that, The method • Detect consumption information of the vehicle at least once in time, particularly fuel and / or electricity consumption parameters, and • Determine the wind speed parameter from the changes in the consumption information, the wind speed parameter representing the wind acting on the vehicle, and • Additionally, the damage classification is performed based on the wind speed parameter.
4. The method according to claim 1 or 2, characterized in that, The method • Detect the environmental data of the vehicle (340) to prove the origin of the object, and • Add at least a portion of the environmental data to the damage information (360). Specifically, it is stipulated that the method • As environmental data, detect data from at least one camera and / or radar system (340), and • Identify at least one vehicle (340) traveling ahead from the data, and • Add the data and / or the identification of the vehicle traveling ahead to the damage information (360).
5. The method according to any of the preceding claims, characterized in that, The method • Detect at least two first microphone signals (320) and • When the crack formation is detected, perform differential analysis (330) on the at least two first microphone signals. Specifically, it is stipulated that the location of the crack formation is derived by means of the differential analysis.
6. The method according to any of the preceding claims, characterized in that, The method • During the damage classification, an energy parameter (330) representing the energy input to the glass is derived from the at least one first microphone signal, and • Identify the crack formation based on the energy parameters (330).
7. The method according to any of the preceding claims, characterized in that, The method • When the speed parameter exceeds the speed threshold, the signal from at least one first microphone (320) is detected.
8. A device for identifying damage at a glass of a vehicle, in particular at a windshield, the device having a processing unit (100) which executes the method according to any one of claims 1 to 7, wherein, The processing unit (100): • Detect (320) at least one first microphone signal, the first microphone signal representing the time course of the noise, and • Based on the first microphone signal, the impact of an object, particularly a stone, onto the glass (330) is identified, and • Detection speed parameter, and • Classify the damage of the object based on the time direction of the first microphone signal and the velocity parameter (330). • Damage information is generated when a crack is detected in the glass (360).
9. A system for identifying damage to the glass of a vehicle, particularly to the windshield, for performing the method according to any one of claims 1 to 7, said system having a processing unit (100) and an evaluation unit (190), wherein • The processing unit (100) • Detect at least one first microphone signal, the first microphone signal representing the time progression of the noise, and • Detection speed parameter, and • The at least one first microphone signal and the speed parameter are sent to the evaluation unit. The evaluation unit (190) evaluates the first microphone signal and the speed parameter. • Identify the damage classification of impacts, particularly stones, onto the glass (330), and • Damage information is generated when a crack is detected in the glass (360).
10. The system according to claim 9, characterized in that, • The processing unit (100) • Detect the vehicle's environmental data to prove the origin of the stones, and The environmental data is sent to the evaluation unit based on the identification of crack formation, and • The evaluation unit (190) • Generate the damage information, which includes at least a portion of the environmental data.
11. A vehicle having the device according to claim 8 or a processing unit (100) in the system according to any one of claims 9 or 10.
Citation Information
Patent Citations
procedure for determining a rockfall
DE102016010705A1
