Alarm system for obstacles and a procedure for its operation
The obstacle alarm system addresses the limitations of existing safety systems by integrating obstacle and line-of-sight detection to project collision risks onto the dashboard and issue alarms only when necessary, enhancing driver awareness and safety.
Patent Information
- Application Number
- DE102015119704
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2015-11-16
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2035-11-16
AI Technical Summary
Existing automobile safety systems fail to provide timely and accurate warnings of potential collisions, especially in blind spots, and often generate unnecessary alarms due to misidentification of obstacles, leading to driver confusion and potential safety risks.
An obstacle alarm system that combines obstacle detection and line-of-sight detection using a detection module with an obstacle detection unit and a line-of-sight detection unit, projecting obstacle images onto the dashboard and issuing alarms only when a collision risk is imminent and within the driver's field of view.
Enhances collision avoidance by providing targeted, timely warnings based on accurate obstacle detection and driver attention, reducing unnecessary alarms and improving safety without structural modifications.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present invention relates generally to an alarm system and a method of operating the same, and more particularly to an obstacle alarm system and a method of operating the same used for automobiles for transmitting an alarm message to the driver in real time when the driver is unaware of a possible collision with obstacles, so as to direct the driver's attention to the obstacles and react thereto, and the method of operating the same. BACKGROUND OF THE INVENTION
[0002] Automobiles provide convenience for drivers and have therefore become widely adopted vehicles. However, when automobiles are on the road, the lives of drivers and pedestrians are endangered due to possible blind spots, mental fatigue, or other non-compliance with the law. To increase safety, several passive safety devices have become standard, with active safety devices being continuously developed through the efforts of several major automakers.
[0003] Among conventional active safety technology, some safety alarm devices are provided that provide real-time warnings to users, such as reversing radar that uses signal transmitters and receivers, or audio warnings when other objects are approaching the car. Unfortunately, such active safety devices are insufficient to predict potential collision risks to the driver. For example, the advance warning time should be increased to several seconds, allowing sufficient time to avoid a collision, especially when the objects the car could potentially collide with are also moving.
[0004] Furthermore, when a driver receives a voice alert, they may be uncertain about the position of the object they might collide with, its shape, direction of movement, and speed. Therefore, the driver cannot react appropriately to avoid the hazard. Furthermore, instead of identifying the objects, conventional technologies can only estimate the distance between an object and a car. Therefore, if a car is surrounded by plants that do not pose obstacles, a voice alert will still be generated or automatic braking will be activated, resulting in unnecessary trouble.
[0005] For the state of the art, please refer to the following publications.
[0006] For example, document DE 10 2005 038 181 A1 describes a motor vehicle comprising at least one optical display device mounted on or in at least one exterior mirror, having at least one light source, and a control unit. These devices are assigned to a lane change assistance system. The system is designed to indicate, via the display device, potentially dangerous road users in adjacent lanes during a lane change, thereby improving the warning function of a conventional lane change assistance system. Document D1 essentially relates to a radar sensor assigned to a lane change assistance system.
[0007] Document DE 602 04 367 T2 relates to a driver assistance system in which an image recording unit (e.g. camera) or an obstacle detection unit is activated when the vehicle moves through an area of poor visibility.
[0008] DE 10 2012 021 249 A1 discloses a method for securing a person's exit from a vehicle. In this method, a non-vehicle traffic object is detected by a monitoring device, which may, for example, be a lane change assistance system. Conventional lane change assistance systems typically include an obstacle detection unit implemented using radar, laser, infrared, and / or ultrasonic sensors.
[0009] The document DE 103 00 275 A1 shows an automobile alarm system which is configured to detect a warning event, determine a warning location at which the warning event occurred and emit an alarm sound within a passenger compartment of a vehicle.
[0010] Document DE 10 2013 217 405 A1 also shows a driver and object detection system and deals with the detection of an essentially static obstacle (person, traffic sign) in the environment of a (relatively fast) moving vehicle.
[0011] Document DE 10 2009 020 328 A1 relates to a method for displaying objects from the surroundings of a vehicle with varying degrees of visibility on the display of a display device. SUMMARY
[0012] An object of the present invention is to provide an obstacle alarm system that combines the technologies of detecting obstacles outside a vehicle and detecting the vehicle's viewing angle. Therefore, when a safety-threatening obstacle is detected, the driver can be alerted by voice signal until the driver becomes aware of it, even if the driver is unaware of the obstacle.
[0013] According to the present invention, an obstacle alarm system can be provided which uses the direction of the driver's pupils as a detection target to ensure whether the driver's visual angle is within a safe range.
[0014] According to the invention, an obstacle alarm system can identify the position, direction of movement, and speed of an obstacle while detecting it and calculate whether the obstacle's path overlaps with that of a car. If so, a collision may occur. Therefore, the present invention can issue an obstacle alarm in the event of realistic collision risks, thus avoiding unnecessary noise.
[0015] Another object of the invention is to provide a method of operating an obstacle alarm system according to claim 3, which can project the image of an obstacle onto the instrument panel, especially when the obstacle is placed in the rear lateral or lower lateral direction of an automobile, which is difficult to observe via the rearview mirror.
[0016] To achieve the objectives described above, the present invention discloses an obstacle alarm system according to claim 1, which is arranged in a vehicle and comprises a detection module, an operation module, and an alarm module. The detection module comprises at least one obstacle detection unit and a line-of-sight detection unit. The at least one obstacle detection unit is arranged in the vehicle or at least on the side of the vehicle. The line-of-sight detection unit is arranged in the vehicle. The operation module is connected to the detection module to receive and process a plurality of detection data generated by the obstacle detection unit and the line-of-sight detection unit and output alarm data. The alarm module is connected to the operation module. It receives the alarm data and sends an alarm message to the vehicle.The operation includes the steps of using an obstacle detection unit to detect location information and movement direction information of at least one obstacle outside the vehicle, using a projection unit to project the image of the obstacle onto a dashboard, using a line-of-sight detection unit to detect line-of-sight direction information of the driver, using an operation module to calculate the probability of the vehicle colliding with an obstacle according to the location information and the movement direction information of the obstacle, and using the line-of-sight direction information to judge whether the dashboard is within the driver's line of sight.If the vehicle is likely to collide with an obstacle and the dashboard is not within the driver's line of sight, the operation module sends alarm data to an alarm module and the alarm module issues an alarm message to instruct the driver. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 shows a schematic diagram of the configuration of subcomponents according to a preferred embodiment of the present invention for the purpose of illustrating the position of the components relative to the vehicle; Fig. 2 shows a schematic diagram of the structure according to a preferred embodiment of the present invention; Fig. 3 shows a flowchart according to an illustrative example; and Fig. 4 shows a flowchart according to a preferred embodiment of the present invention to illustrate the use of the projection module. DETAILED DESCRIPTION
[0017] In order to further understand and appreciate the structure and features as well as the effectiveness of the present invention, a detailed description of the present invention is provided below according to embodiments and with reference to the accompanying figures.
[0018] As in Fig. 1 and Fig. As shown in Figure 2, the obstacle alarm system according to the first embodiment of the present invention is implemented in a vehicle 1, such as a car, and includes a detection module 2, an operation module 3, and an alarm module 4. The detection module 2 includes at least one obstacle detection unit 21 and a line-of-sight detection unit 22. The obstacle detection unit 21 is implemented in the vehicle 1 or at least on one side of the vehicle 1. The line-of-sight detection unit 22 is implemented inside the vehicle 1. The operation module 3 is connected to the detection module 2, and the alarm module 4 is connected to the operation module 3.
[0019] The obstacle detection unit 21, included in the detection module 2, is used to detect whether objects that may affect traffic safety, such as pedestrians, animals, other vehicles, or immovable fences and bushes, are present in the area surrounding the vehicle 1. Since the range of a driver's field of vision is limited, several blind spots definitely exist, including, in particular, the side, rear, or lower parts of the vehicle 1. These blind spots are high-priority areas for the implementation of the obstacle detection unit 21 according to the first embodiment. However, the obstacle detection unit 21 can also be implemented in the vehicle 1 to omnidirectionally detect the surrounding areas. The obstacle detection unit 21 includes a depth detector and a two-dimensional camera.While an image is being captured, a depth message is simultaneously acquired to detect the positional relationship between the vehicle 1 and the other objects in the surrounding area. In other words, the depth message can be used to generate a complete spatial message for subsequent analysis, calculation, and reconstruction. For example, according to the movement direction and speed of the obstacle relative to the vehicle 1, it can be judged whether the obstacle will collide with the car, or whether they will come close but there is no risk of collision. The obstacle detection unit 21 may further include an embedded chip, which is used as a subsystem for setting detection parameters or for independently accessing data.
[0020] The line-of-sight detection unit 22, which is implemented in the vehicle 1, is used to detect the direction of a driver's line of sight. This can be integrated with the obstacle detection unit 21 in the vehicle 1. Some feasible methods of the line-of-sight detection unit 22 include detecting the direction of the driver's head to assess the direction of their line of sight or identifying the driver's face. According to a preferred embodiment of the present invention, an RGB-D camera is used as a pupil detection device for implementation in the line-of-sight detection unit 22. The pupil detection device can track the position of the eyeballs by capturing images to identify whether the driver's field of vision can observe the existence of a collision risk. In this embodiment, the line-of-sight unit 22 further comprises an embedded chip.
[0021] The collision risk described above can be classified into two types. One includes realistic data, while the other includes simulated data. Realistic data includes the collision risk that a driver can easily observe along the direction of movement of the vehicle 1, such as cars traveling in front or pedestrians passing in front of the vehicle 1. The driver can directly perceive the collision risk without turning their head. On the other hand, simulated data is used for positions where the driver's line of sight is limited, such as the side, rear, or lower parts of the vehicle 1. It is impossible for the driver to perceive the collision risk without turning their head or using the rearview mirrors. In some cases, the collision risk remains unobservable even by the above-mentioned methods.According to the exemplary embodiment, corresponding images can be captured by the obstacle detection unit 21 as described above. The images are then projected onto positions that are easily observable by the driver, such as the windshield.
[0022] The projection module 5, which is connected to the operation module 3, is used to project the simulated data. The projection module 5 can project the obstacle images provided by the obstacle detection unit 21 onto a dashboard using data processing by the embedded chip in the obstacle detection unit 21 or by the operation module 3. Since the obstacle detection unit 21 can capture the depth information of the images, the projected images are reconstructed stereoscopic images, making it easier for the driver to identify the shape of obstacles. Emphasizing the distance between the obstacle and the vehicle 1 using color variations is a preferred projection method. If it is chosen not to project the images onto the windshield, it is also possible to display the projection results on a display of the vehicle 1.
[0023] However, even if obstacles exist in front of the vehicle 1, or if they are displayed on the windshield using projection technology, the driver may still disregard the collision risks if they are not concentrating or paying attention to other objectives. Therefore, in this embodiment, the line-of-sight detection unit 22, as described above, is provided to assess whether the driver is aware of the collision risks. For example, if a pedestrian is walking in front of the front of the vehicle 1, or if a motorcycle is right next to the vehicle 1 and its direction of movement and speed, according to the images provided by the projection module 5, indicate the possibility of a collision, the line-of-sight detection unit 22 is provided to assess whether the driver's eyes are directed toward the front of the vehicle 1 or toward the images provided by the projection module 5.
[0024] If the detection result of the line-of-sight detection unit 22 indicates that the driver is not paying attention to the information, especially after a predetermined period of time, for example, 1 to 2 seconds or a certain time before the collision occurs, which is created by calculating the speeds of the vehicle 1 and the obstacle, the operation module 3 can remind the driver using the alarm module 4 connected to the operation module 3. The operation module 3 then creates an alarm file by referring to the detection results of the obstacle detection unit 21 and the line-of-sight detection unit 22 and transmits the alarm file to the alarm module 4. The alarm module 4 receives the alarm file and transmits an alarm message to the vehicle 1. The preferred format of the alarm message includes, but is not limited to, voice and light signals.Thus, in this embodiment, the alarm module 4 includes at least one audio unit capable of continuously outputting pre-recorded voices to remind the driver until the driver notices the obstacle. For example, if the line-of-sight detection unit 22 detects that the direction of the driver's line of sight coincides with the position of the dashboard, the alarm module 4 will stop outputting the alarm message.
[0025] The audio unit can emit sounds in different directions by positioning the audio unit at specific positions within the vehicle 1 area. For example, the audio unit can be installed in multiple corners of the vehicle 1. Regarding the position of the obstacle relative to the vehicle 1, only the audio unit located in this area will emit a sound to alert the driver and assist in determining the direction of the obstacle in the shortest possible time.
[0026] In Fig. Figure 3 illustrates the structure described above. The method for operating the obstacle alarm system, according to a general example, which serves only as an illustration, includes the following steps: Step S10: Using an obstacle detection unit to detect the position information and the movement direction information of at least one obstacle outside the vehicle; Step S11: Using a line-of-sight detection unit to detect the driver's line-of-sight direction information; Step S12: Using an operation module to calculate the probability of collision of the vehicle with the obstacle according to the position information and the movement direction information of the obstacle, and using the line-of-sight direction information to judge whether the obstacle is within the driver's line-of-sight range; and Step S13: The operation module sends alarm data to an alarm module, and the alarm module sends an alarm message to notify the driver whether the vehicle is likely to hit the obstacle when the obstacle is not within the driver's line of sight.
[0027] The method for operating the obstacle alarm system according to the invention, in which the projection module is additionally used, is described in Fig. 4. The process steps include: Step S20: Using an obstacle detection unit to detect the position information and the movement direction information of at least one obstacle outside the vehicle; Step S21: Using a projection unit to project the image of the obstacle onto a dashboard; Step S22: Using a line-of-sight detection unit to detect the driver's line-of-sight direction information; Step S23: Using an operation module to calculate the possibility of collision of the vehicle with the obstacle according to the position information and the movement direction information of the obstacle, and using the line-of-sight direction information to judge whether the dashboard is within the driver's line-of-sight range; and Step S24: The operation module sends alarm data to the alarm module, and the alarm module sends an alarm message to notify the driver whether the vehicle is likely to collide with the obstacle when the dashboard is not within the driver's line of sight.
[0028] When the obstacle alarm system disclosed in the present invention is installed in the vehicle for the first time or before each new start, the position calibration may first be performed to adjust the position of the image generated by the projection module relative to the driver's line of sight.
[0029] In summary, the present invention discloses in detail an obstacle alarm system and a method for operating the same. The viewing angle can be determined by using the detection devices and observing the driver's pupils. Moving or stationary objects within a radius of approximately several tens of meters around the car can be detected, thus improving the alarm system according to the prior art. Not only can objects affecting traffic safety be assessed, but it also ensures that the driver can perceive the risks. Furthermore, the present invention is low in cost and high in accuracy. The influence of the environment is minimized, and no modification of the car structure is required for installation.In view of the increasing emphasis on car safety, the obstacle alarm system and the method of operating the same according to the present invention undoubtedly include the potential for development and application values.
Claims
[1] Obstacle alarm system arranged in a vehicle (1) and comprising: a detection module (2) comprising at least one obstacle detection unit (21) and one line-of-sight detection unit (22), wherein the at least one obstacle detection unit (21) is arranged in said vehicle (1) or on at least one side of said vehicle (1), wherein the obstacle detection unit (21) comprises a two-dimensional camera for recording an image and a depth detector, wherein the obstacle detection unit (21) is configured to detect position information and movement direction information of at least one obstacle outside the vehicle (1) in order to identify a position, movement direction, and speed of the obstacle, from which the movement path of the obstacle and a positional relationship between the vehicle (1) and the obstacle in the surrounding area of the vehicle (1) can be calculated to predict a collision risk, wherein said line-of-sight detection unit (22) is arranged in said vehicle (1) and is configured to detect line-of-sight direction information of a driver, an operating module (3) connected to said detection module (2) for receiving and further processing a plurality of detection data generated by said obstacle detection unit (21) and said line-of-sight detection unit (22) and outputting alarm data, a projection module (5) connected to the operating module (3) and used to project the image of the obstacle onto a dashboard, and an alarm module (4) connected to said operating module (3) and receiving said alarm data and sending an alarm message to said vehicle (1) when the dashboard is located in an area outside the driver's line of sight, wherein the alarm module (4) stops sending said alarm message when said line of sight detection unit (22) detects that the driver's line of sight coincides with the position of said dashboard, wherein the alarm module (4) comprises a plurality of audio units, the plurality of audio units being formed in a plurality of corners of said vehicle (1), the alarm message being transmitted by using a part of the plurality of audio units, wherein, with regard to the position of the obstacle with respect to the vehicle (1), only the audio unit located in this area emits a sound to alert the driver and assist in determining the direction of the obstacle in the shortest possible time. [2] An obstacle alarm system according to claim 1, wherein the line-of-sight detection unit (22) comprises a pupil detection device for detecting the direction of the line of sight of a driver in said vehicle (1). [3] A method for operating an obstacle alarm system according to claim 1, wherein the alarm system is arranged in a vehicle (1) and the method comprises the following method steps: Using an obstacle detection unit (21) for detecting position information and movement direction information of at least one obstacle outside said vehicle (1) (S20) in order to identify a position, movement direction and speed of the obstacle, Using a projection module (5) to project an image of said obstacle onto a dashboard (S21), Using a line-of-sight detection unit (22) to detect the line-of-sight direction information of a driver (S22), Using an operation module (3) to calculate the probability of a collision of said vehicle (1) with said obstacle according to said position information and said movement direction information of the obstacle, wherein a realistic collision risk is determined when a calculated movement path of the obstacle overlaps with that of the vehicle (1), and using said line-of-sight direction information to judge whether the dashboard is within the driver's line of sight (S23), wherein said operating module (3) sends alarm data to an alarm module (4) and said alarm module (4) sends an alarm message to notify the driver when there is a realistic risk of collision and when the dashboard is not within the driver's line of sight (S24), wherein the alarm module (4) comprises a plurality of audio units, wherein the plurality of audio units are formed in a plurality of corners of said vehicle (1), wherein the alarm message is transmitted by using a part of the plurality of audio units, wherein with regard to the position of the obstacle with respect to the vehicle (1), only the audio unit located in this area emits a sound to alert the driver and assist in determining the direction of the obstacle in the shortest possible time, and wherein the alarm module (4) stops sending said alarm message when said line-of-sight detection unit (22) detects that the driver's line of sight coincides with the position of said dashboard.
Citation Information
Patent Citations
Motor vehicle, has light source controlled by control unit for emitting flash light signals, so that view of driver is guided to indicator device and simultaneously to mirror, during initial track change or track change intention
DE102005038181A1
Method for displaying objects from the surroundings of a vehicle with varying degrees of visibility on the display of a display device
DE102009020328A1
Method for securing exit process of person from motor vehicle i.e. passenger car, involves initiating protective action in response to detected viewing direction while viewing direction of person is directed in predetermined period
DE102012021249A1
Methods and systems for monitoring object detection by a driver
DE102013217405A1
automobile alarm system
DE10300275A1
