Method for detecting and alerting to changed surroundings
Patent Information
- Application Number
- JP2023529995
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-12-08
- Filing Date
- 2021-11-24
- Publication Date
- 2025-02-27
- Estimated Expiration
- 2041-11-24
Smart Images

Figure 0007637238000001 
Figure 0007637238000002 
Figure 0007637238000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a method for recognizing changes in the surrounding environment of a vehicle, a driving assistance system corresponding thereto, and a vehicle equipped with this driving assistance system. [Background technology]
[0002] Vehicles entering and exiting parking lots pose a great risk to all traffic participants. Despite a high rate of vehicles equipped with sensors and driver assistance systems (e.g. ultrasonic sensors, rearview cameras, surround view cameras, distance alerts, etc.), the number of accidents involving death or injury and property damage when entering and exiting parking lots remains almost high. In addition to the risk to the body and life of humans and animals and significant property damage, this also represents a high cost factor.
[0003] Despite the increasing number of installed sensors, the number of accidents when entering and exiting parking spaces has not decreased. This is due, on the one hand, to driver behavior, but on the other hand, to the question of what data is available to the driver assistance system using the vehicle's sensors to warn the driver of a collision with an object, e.g. another vehicle, a human being, an animal, etc., and how to warn the driver.
[0004] On the one hand, the blind areas around the vehicle, such as the blind spots to the sides of the vehicle, the blind areas in front of the vehicle (the size of this area increases with the size of the vehicle), the blind areas behind the vehicle (the size of this area increases with the size of the vehicle), the blind areas directly below the vehicle, etc., are not checked by the driver before starting the journey. Also, on the other hand, the surrounding environment is not checked before getting into a parked vehicle, i.e. the surrounding environment is not checked before starting the journey. Furthermore, warnings from current driver assistance systems (e.g. park distance control) are not perceived or taken into account because the driver, when his vehicle is in a narrow parking spot, knows that he and his vehicle are very close to various objects and therefore does not pay attention to, for example, continuous acoustic warnings from the driver assistance system (it is believed that it is known that this warning is only generated by the known surrounding environment).
[0005] Also, during the time the vehicle is stopped or during the switched-off state of the vehicle, the distance to objects is only recognized by known sensors or driver assistance systems, so that certain changes in the vehicle's surroundings are not recognized. For example, when a vehicle is (remotely) parked (the driver is outside the vehicle and turns on the parking process via a smartphone, smart key, etc.), neither the driver, especially when the driver manually exits the parking area, nor the vehicle itself is aware of the actual surroundings of the vehicle, since the autonomous parked vehicle only knows the surroundings state immediately after parking is completed and immediately before the parking exit is started. When driving is changed, for example, especially in the case of car sharing, a vehicle parked by another driver is used, and the surroundings that existed during the parking process by the previous driver are unknown to the new driver and also to the vehicle itself at the time of parking exit.
[0006] In many cases, the environment around the vehicle may change during the absence of the driver or during a driver change (e.g., due to the replacement of parked vehicles located in the vicinity, moving objects, e.g., objects and leaves blown by the wind or objects rolling / falling around, passing / moving people, animals, other objects, movement of the (own) vehicle, etc.), and since this change in the environment is not recognized, objects (especially children, animals, wheelchair users, etc.) still get overlooked and entangled in the vehicle when exiting a parking spot. Furthermore, objects that move into the vehicle while it is stopped (e.g., a tent in the engine compartment) are hardly detected by existing sensors so far, because these sensors do not record the time course of the movement. Summary of the Invention [Problem to be solved by the invention]
[0007] Thus, even today, numerous accidents occur when entering and exiting parking lots, some of which are fatal (e.g., when traffic participants at particularly high risk, such as children, wheelchair users or animals, are hit by the car), and damage and costs are incurred on or in the vehicle due to, for example, rodents. [Means for solving the problem]
[0008] The object of the present invention is therefore to eliminate or at least mitigate the above-mentioned disadvantages and problems. To this end, the present invention provides a method for recognizing changes in the surrounding environment of a vehicle according to independent claim 1 as well as a corresponding driving assistance system and a vehicle equipped with this driving assistance system according to the further independent claims. Advantageous configurations and developments are the subject of the corresponding dependent claims.
[0009] According to a first aspect of the present invention, a method for recognizing a change in an environment surrounding a vehicle includes: a) continuously generating or receiving an ambient environment dataset while the vehicle is stationary; b) A current change in the surrounding environment Δ by continuously comparing the surrounding environment data set being generated or received during the current stop with a stored surrounding environment data set that was generated or received and stored when the vehicle was stopped. t and continuously calculating c) Calculated current surrounding environment change Δ t is a given change threshold Δ lim Exceeds Δ t >Δ lim and providing a change alert signal if so.
[0010] The steps of the method may be performed in any meaningful order, in which case the individual steps of the method may be performed sequentially, i.e. at a common clock rate, or iteratively at a different predefined clock rate for each step.
[0011] According to a second aspect of the invention, a driving assistance system for recognizing changes in the vehicle's surrounding environment comprises means for carrying out the steps of the method according to the first aspect of the invention.
[0012] The driving assistance system may be configured as a data processing device, for example as a microcontroller (μC), an integrated circuit, an application-specific integrated circuit (ASIC), an application-specific standard product (ASSP), a digital signal processor (DSP), field programmable gate arrays (FPGA), etc. The driving assistance system may in particular comprise an interface module, a comparison module and a change warning module. The interface module may be configured to continuously receive (step a)) the surrounding environment dataset while the vehicle is stopped. The comparison module may be configured to continuously calculate (step b)) the current surrounding environment change by continuously comparing the surrounding environment dataset currently being received during the stop with a stored surrounding environment dataset that was generated or received and stored when the vehicle was stopped. The change warning module may be configured to provide a change warning signal (step c)) if the calculated current surrounding environment change exceeds a predefined change threshold. In this case, these modules may be software modules executed by the driving assistance system, data processing devices communicatively connected to each other, or a combination thereof.
[0013] According to a third aspect of the present invention, a vehicle comprises the driving assistance system according to the second aspect of the present invention.
[0014] In the context of the present invention, the concept of successively is understood as an operation being repeated, in particular performed at a predefined sampling or clock rate, i.e. the concept "successively" is understood as "at a number of predefined time points", in particular "after each predefined time interval". Steps that are performed successively are therefore understood as steps that are performed at a number of predefined time points or after each predefined time interval, i.e. at a predefined sampling / clock rate.
[0015] Using the present invention, the surroundings are monitored while the (own) vehicle is stopped (e.g. switched off, parked, etc.). For this purpose, the (own) vehicle's own vehicle sensors (internal sensors, e.g. ultrasonic sensors, cameras, LIDAR, etc.) may be used, additionally or alternatively, external information transmitted seamlessly (e.g. wirelessly) to the (own) vehicle from external entities, e.g. (intelligent) infrastructure (e.g. traffic cameras, etc.), traffic drones, other vehicles, etc. may be used. Surrounding environment datasets are continuously received while the vehicle is stopped. The received surrounding environment datasets include information about the environment or surroundings of the (own) vehicle. In particular, the distances between objects surrounding the (own) vehicle and the body of the (own) vehicle may be included in the received surrounding environment datasets. In this way, the received surrounding environment datasets may include information about the appearance of the surrounding environment of the (own) vehicle. In this case, information about the surrounding environment of the vehicle in the horizontal plane (forward, backward, left, right), additionally or alternatively, in the vertical direction (downward, upward), may be included in the received surrounding environment datasets. For example, each of the received surrounding environment data sets includes a current (vertical) distance (d) between each of a plurality of objects (i) surrounding the (own) vehicle and the body of the vehicle. i t ).
[0016] When monitoring the surroundings of a stationary vehicle, each surrounding environment data set being received is compared with stored surroundings data (reference) created when the vehicle is stopped or parked, in particular when the vehicle is started up or a journey begins (e.g. when the parking exit begins). The reference stored surroundings data set may in particular be stored in a first memory, whereas the continuously received current surroundings data set may be stored in a second memory, in particular in a ring buffer (see FIFO memory). The currently received surroundings data (e.g. a number of current vertical distances between the body of the (own) vehicle and the object) are compared against the stored surroundings data set (e.g. stored vertical distances between the body of the (own) vehicle and the object), in particular by subtraction, to determine a current surroundings change Δ t The current surrounding environment change Δ tmay in particular include the current distance change between the body of the (own) vehicle and the plurality of objects compared to the time of stopping.
[0017] If a significant change in the surrounding environment occurs since the time of stopping (e.g. the end of a parking entry), possibly indicating a collision risk (e.g. a child is positioned directly in front of the vehicle's bonnet), a change warning signal is provided. The change warning signal is independent of other warning signals, e.g. a warning signal of the (own) vehicle's park distance control. Here, a predefined change threshold Δ lim The time from which the surrounding environment change becomes noticeable is set using the current surrounding environment change Δ t is a given change threshold Δ lim If the change threshold Δ lim may have a predetermined length (e.g. 30 cm (centimeters)), in particular a predetermined length for each main direction (e.g. 30 cm for forward and backward directions, 50 cm for left and right directions). Thus, for example, a changing warning signal is provided when an object approaches the vehicle, i.e. its body, more than a predetermined distance threshold (vertical) since the vehicle stopped. The changing warning signal is a communication signal, which may be, for example, an electrical signal (impulse, rising / falling edge, pulse width modulation (PWM), etc.), and may be used, for example, to output a warning (e.g. an optical warning) from a control unit of the (own) vehicle to the driver of the (own) vehicle.
[0018] The change thresholds may also be selected depending on the situation: for example, when a trailer is used, the distance threshold in the rear direction is increased, since in this case the area far behind the bumper is also critical, since it can be caught by the trailer. Here, existing driving assistance systems (e.g. trailer assist) can also be combined, whereby the presence of a trailer is detected or, if necessary, serves as an input variable for the trailer assist for the corresponding steering recommendation.
[0019] For example, if the vehicle is parked in a narrow parking space and the park distance control outputs a continuous acoustic warning due to an object (e.g., a vehicle ahead) in contact with the narrow parking space, and a new object (e.g., a child or an animal) is located just in front of the bonnet of the vehicle at the time of exiting the parking space, the continuous acoustic warning of the park distance control does not change. Nevertheless, if the driver assumes that only the nearby object (vehicle ahead) that the driver is aware of is in front of the bonnet and starts forward, a collision with the new object (child / animal) will occur. According to the present invention, in addition to the continuous acoustic warning by the park distance control, a change warning signal is provided when exiting the parking space, and a separate warning (e.g., optical warning, other acoustic warning, etc.) is output to the driver based on this change warning signal, thus effectively alerting the driver to the changes in the surrounding environment.
[0020] If the change threshold is exceeded again by the time the vehicle is started, the system will either issue a warning or send a signal to the driver that a significant change has occurred between the time of parking and the time of the new start, and that this significant change may still be present under certain circumstances. This is particularly useful if an object has entered the engine compartment of the vehicle.
[0021] In this way, the present invention provides an additional warning function in addition to known driving assistance systems, such as, for example, park distance control, which alert the driver only to the small distance between the vehicle, i.e., the vehicle body, and an object, and not to changes in the environment around the vehicle. Thus, blind spots and non-visible areas around the vehicle can be monitored more effectively, and additional warnings can be output in a timely manner to the driver based on the supplied change warning signal. In addition, technical limitations (e.g., low resolution of ultrasonic sensors in close range) can be eliminated or compensated for. This makes it possible to effectively avoid accidents, especially when exiting a parking lot, because dangers that are not perceived (not noticed or not visible) by the driver himself or that cannot be fully detected due to (technical or structural) limitations are recognized. In particular, when a car is shared and the driver simply picks up the vehicle, it is not known what the surrounding environment was like at the time of parking, or whether a danger may have occurred due to changes in the surrounding environment since the time of parking. For this reason, the available vehicle sensors, i.e. the information supplied by them about the (own)vehicle's surrounding environment, are used more effectively and subsequent functionality, for example automatic doors, is better supported.
[0022] According to a further development of the invention, while the ignition of the vehicle is switched off, additionally or alternatively while the vehicle is locked (from the outside), surrounding environment data sets are received (in step a)) and a current surrounding environment change Δ t is calculated.
[0023] Furthermore, surrounding environment data sets are (continuously) received while the (own) vehicle is stopped or parked (speed=0) and switched off, i.e. while its ignition is switched off or while the vehicle is locked, in this way information about the surrounding environment of the vehicle is collected. The surrounding environment data sets being received in the switched off / locked (own) vehicle are then compared with the stored surrounding environment data sets (reference), whereby the current surrounding environment change Δ tis calculated (continuously).
[0024] In this way, even when starting the (own) vehicle, i.e. when switching on its ignition, or when unlocking the vehicle (when the driver is not yet present in the vehicle), the current surrounding environment change Δ t is a given change threshold Δ lim If the change warning signal is greater than 0, a change warning signal can be provided, thereby ensuring that the driver can be warned about the changed vehicle surroundings immediately after starting the vehicle.
[0025] According to a development of the invention, (in step a)) surrounding environment datasets are received by at least one internal sensor of the vehicle and additionally or alternatively by at least one external entity.
[0026] The surrounding environment dataset is received by at least one internal sensor of the (subject) vehicle (e.g., an ultrasonic sensor, a camera, a LIDAR, etc.). The at least one internal sensor provides information about the surrounding environment based on the (subject) vehicle perspective (e.g., a distance between a sensor that may be mounted on the body of the (subject) vehicle and an object).
[0027] Additionally or alternatively, the surrounding environment dataset is seamlessly received by at least one external entity, in particular by means of cooperative V2X messages (vehicle to everything messages). The at least one external entity may be an intelligent infrastructure (e.g. traffic cameras, etc.), traffic drones, other vehicles, etc. The at least one external entity provides information about the surrounding environment based on one of the viewpoints different from the (own) vehicle (e.g. observed distances between the (own) vehicle's body and objects observed from a certain separation distance, and therefore the actual distances need to be calculated using a projection based on the observed distances).
[0028] Here, a cooperative coordination may take place between the (own) vehicle and one or more external entities, e.g. external vehicles. For example, if an external vehicle, i.e. its sensors, sees an object, the (own) vehicle checks whether the (own) vehicle also sees this object with its sensors and outputs a corresponding feedback to the external vehicle. The (own) vehicle then follows this object independently in this case with its own sensors. Similarly, the (own) vehicle may for example transmit to an external entity (e.g. surrounding external vehicles) that an object has been tracked in the (own) vehicle's environment, but is no longer in view of the (own) vehicle's internal sensors. The external vehicle then takes over tracking of said object up to a predefined separation distance (danger space). As soon as said object leaves its area, a feedback is given to the (own) vehicle that said object is outside the predefined separation distance.
[0029] By using the ambient environment dataset of at least one vehicle-specific sensor, the ambient environment dataset can be quickly and easily retrieved. By using the ambient environment dataset of at least one external entity, even vehicles that do not have sensors or whose sensors are switched off or broken can be provided with changes in the vehicle ambient environment or the ambient environment dataset of the internal vehicle sensors can be supplemented.
[0030] According to a development of the invention, the method according to the first aspect of the invention comprises the steps of d) outputting an acoustic, additionally or alternatively, optical, additionally or alternatively, tactile warning to the driver of the vehicle if a changing warning signal is present; e) if a change warning signal is present, turning on the braking of the vehicle, in particular the parking brake, and additionally or alternatively at least partially turning off the cruise control elements of the vehicle; f) if a change warning signal is present, displaying at least the object that triggered the change warning signal on a screen of the vehicle.
[0031] All steps of the method may be performed in any meaningful order.
[0032] According to a further development of the invention, the driver assistance system may further comprise a warning module, additionally or alternatively a braking module, additionally or alternatively a display module. The warning module may be configured to output an acoustic, additionally or alternatively an optical, additionally or alternatively a haptic warning to the driver of the vehicle (step d)). The braking module may be configured to activate the braking of the vehicle, in particular the parking brake, and additionally or alternatively at least partially deactivate the cruise control elements of the vehicle (step e)). The display module may be configured to display at least the object which triggered the change warning signal on a screen of the vehicle (step f)).
[0033] The warning module, additionally or alternatively, the braking module, additionally or alternatively, the display module may be communicatively connected to the change warning module.
[0034] Acoustic, additionally or alternatively, optical, additionally or alternatively, tactile warnings may be output to the driver by elements of the (own)vehicle or by external devices, e.g. a mobile phone, a smartphone, a smart key, etc.
[0035] The acoustic warning may be a beep sound output to the driver when a change warning signal is present. For example, the acoustic warning to the driver may be an alarm sound output, an acoustic notification (e.g., "Pay attention to changes in surroundings, check your surroundings"), a change (lower / increase) in the playback volume of audio media (radio, streaming, etc.), or an automatic notification, such as a call to the driver's smartphone or a telematics device in the vehicle, to alert the driver to the changes in the surroundings.
[0036] The optical warning may be a light signal of a light source (e.g., LED, etc.) that is output to the driver when a change warning signal is present. For example, the optical warning to the driver may include turning on a warning light of the (own) vehicle, a message on the (own) vehicle's screen, illuminating the vehicle corners of the interior space of the (own) vehicle (e.g., enhancing or coloring the environmental lighting in the part of the interior space where there is a danger due to a significant change in the surrounding environment outside the (own) vehicle), turning on the (own) vehicle's interior space lighting (e.g., rear reading lights, make-up lights behind the sun visors) by switching on or pulsing, illuminating the vehicle's surrounding environment, for example, using the headlights or taillights, the environmental lighting under the door handle or license plate, or using the environmental lighting under the (own) vehicle's outside mirror in the part of the interior space where there is a danger due to a significant change in the surrounding environment outside the (own) vehicle), and overlaying a warning on the (own) vehicle's head-up display (statically or dynamically by virtual reality (VR)).
[0037] The haptic warning may be, in particular, a force to the driver by an element of the (own) vehicle or an external device (mobile phone / smartphone / smart key), for example, a force in the form of pressure, vibration, pulse, etc. For example, the haptic warning to the driver may be a force in the form of a cruise control element of the (own) vehicle (accelerator, accelerator pedal, throttle twist grip, hand throttle control element, etc.), a shift lever, a steering wheel, a seat belt, The armrest, seat, etc. may vibrate, the seat belt of the vehicle may be tightened, etc.
[0038] Here, the acoustic, additionally or alternatively, optical, additionally or alternatively, tactile warning is preferably different from the (acoustic / optical / tactile) warning of other driving assistance systems of the (own) vehicle, in particular the park distance control. For this, the acoustic, additionally or alternatively, optical, additionally or alternatively, tactile warning to the driver may be performed using elements of the (own) vehicle and additionally or alternatively, one or more external devices, for example, a smartphone, a mobile device / "wearable" device (e.g., smart watch, pedometer, smart glasses, headphones, e-cigarette) or an intelligent infrastructure in the vicinity of the (own) vehicle (e.g., connected lamps flash at the entrance to the parking lot, gates or barriers do not open, etc.) if the driver has not output a confirmation of risk recognition. In this way, it is prevented that the driver is unaware of changes in the surrounding environment that may cause a collision between the vehicle and an object responsible for the changes in the surrounding environment.
[0039] Additionally or alternatively, when a change warning signal is present, the (own) vehicle can be prevented from moving by braking, in particular the parking brake, by turning on the (own) vehicle. Thus, it is possible to prevent a collision with an object caused by the (own) vehicle's movement. The driver must first actively confirm the release of the (parking) brake (e.g., confirm a corresponding warning instruction on the screen of the vehicle or the smartphone or smart key) or release the (parking) brake himself, after which the vehicle can move, in particular can exit the parking area. If a significant change in the surrounding environment indicating a danger (when exiting the parking area) is recognized before the (own) vehicle moves, for example, the parking brake is turned on again. In this case, the parking brake must be manually turned off (overridden), after which the driver can move the (own) vehicle, thus alerting the driver to the significant change in the surrounding environment and preventing a collision with an object responsible for the change in the surrounding environment. In this way, the driver is assured that he will not mistakenly move the vehicle despite a change in the surrounding environment that he is not aware of, leading to a collision between the vehicle and the corresponding object that is responsible for the change in the surrounding environment.
[0040] Additionally or alternatively, the cruise control element, in technical terms the accelerator or gas pedal in motor vehicles, throttle twist grip or hand throttle control element in motor cycles, light vehicles and vehicles individually adapted for disabled persons, is at least partially switched off. In this case, for example, a first control area or the entire control area of the cruise control element may be switched off, so that no control signal is output to the motor or control device of the vehicle in that area. In this way, the vehicle does not move even if the cruise control element is operated or adjusted by the driver. The driver must first actively switch the cruise control element back on (for example, by checking the corresponding attention instruction on the screen of the vehicle or the smartphone or smart key), after which the vehicle can move, in particular exit from the parking lot. Also, a counter force may be applied in the direction of operation of the cruise control element, which the driver must first overcome in order to move the vehicle, and the driver is alerted to the changes in the surrounding environment by an increase in the force required to operate the cruise control element. In this way, if a significant environmental change is recognized, for example the cruise control element (accelerator) may be (partially) switched off and only transmits an acceleration command once the driver signals that he has understood the warning for a significant environmental change by confirming a message on the screen or manually tapping the accelerator twice. In this way, it is prevented that the driver is unaware of the environmental change and the vehicle collides with an object responsible for the environmental change.
[0041] Additionally or alternatively, when there is a change warning signal, the object that triggered the change warning signal is displayed on the vehicle's screen, for example as a symbol or as a live image, preferably in a bird's-eye view, so that the driver can immediately recognize where the surrounding environment change is and whether the vehicle can be moved safely or not. This ensures that the driver does not miss the object that caused the surrounding environment change that was not perceived by the driver himself, and thus does not cause a collision.
[0042] Step d), additionally or alternatively, step e), additionally or alternatively, step f) are performed before the vehicle is moved from a stopped state. One or more of steps d), e), and f) may be performed, for example, while the vehicle is still stopped, additionally or alternatively, when or immediately after unlocking the (own) vehicle, additionally or alternatively, when or immediately after switching on the ignition of the (own) vehicle, so that the driver obtains information regarding significant changes in the surrounding environment before moving the vehicle.
[0043] By warning and displaying the objects responsible for the changes in the surrounding environment, the driver is effectively alerted to the changes in the surrounding environment. Furthermore, by confirming the release of the (parking) brake or the release of the cruise control elements, or by actively releasing the (parking) brake or by overriding the counterforce applied to the cruise control elements, the driver is alerted to new and unusual dangers caused by the changes in the surrounding environment, and accidents are effectively avoided, especially when exiting a parking space.
[0044] According to a development of the invention, the surrounding environment data comprises at least the approximate vertical and horizontal distances between objects and the body of the vehicle in a 360° circumference around the vehicle.
[0045] The surrounding environment data includes information on each of the approximately vertical distances between the outer surface of the body of the (own) vehicle and objects in the surrounding environment of the (own) vehicle. The vertical distances may be in the horizontal plane, or additionally or alternatively in the vertical direction, in the surrounding environment data set. For example, the surrounding environment data set may include a distance between the nearest object in the forward direction and the front body surface, a distance between the nearest object in the rear direction and the rear body surface, a distance between the nearest object in the left direction and the left body surface, a distance between the nearest object in the right direction and the right body surface, and a distance between the nearest object in the downward direction and the lower body surface. The surrounding environment data set may also include respective vertical distances to each nearest object along the horizontal extent of the body of the (own) vehicle (e.g., at a predetermined distance along the horizontal extent) and along the lower surface of the body of the (own) vehicle (e.g., at a predetermined distance along the lower surface extent). In particular, for each object, the approximately vertical, horizontal or vertical distance and optionally additionally a direction to the outer surface of the body of the (own) vehicle are included in the surrounding environment data set.
[0046] (Own) Using a surrounding environment data set which comprises the vertical distances between objects in the surrounding environment of the vehicle and the vehicle body, significant surrounding environment changes can be determined particularly reliably and precisely and the driver can be warned accordingly.
[0047] According to a development of the invention, the surrounding environment data comprises a predetermined number of nearest objects with their respective positions relative to the vehicle.
[0048] The surrounding environment data includes preferably 2 to 20, more preferably 4 to 16, and particularly preferably 8 objects located closest to the (own) vehicle, i.e., its body, each having a position relative to the vehicle. In particular, for each object, the surrounding environment data set includes an approximate vertical, horizontal or perpendicular distance to the outer surface of the (own) vehicle's body and, optionally, an additional direction.
[0049] In an advantageous embodiment, a confidence interval indicative of the maturity of the information may be generated and stored.
[0050] For example, the surrounding environment data may include one, several or each (main) direction, i.e., one, two, three, four or five nearest objects in each of the forward, backward, left, right and downward directions, each having a respective position relative to the (own) vehicle or at least a respective vertical distance with the surface of the vehicle body in the corresponding direction. In the surrounding environment data, each position of the objects relative to the (own) vehicle, i.e., its vehicle body, may be represented, for example, by polar coordinates (angle / direction and radius / distance) or Cartesian coordinates (x direction—forward / backward, y direction—left / right, z direction—downward / (upward)).
[0051] Here, in an advantageous embodiment, a ring buffer may be used which records the data and discards it again if it is not relevant. Each time a new environment data set is received, the ring buffer (see FIFO memory) having a storage space at least as large as the predefined number of nearest objects is completely overwritten by a new environment data set containing the predefined number of nearest objects.
[0052] In this way, relevant information about the vehicle's surroundings is provided for further processing in a particularly fast and efficient manner.
[0053] According to a further development of the invention, (in step b)) for each object in the stored ambient environment data set, a change in distance Δd is determined by comparing its respective position in the stored ambient environment data set with its corresponding position in the currently received ambient environment data set. i is calculated as the change in the current surrounding environment. Furthermore, the distance change Δd i One of the thresholds is a given environmental change threshold Δ lim Exceeds Δd i >Δ lim If so, it provides a change alert signal.
[0054] For example, if two objects (|i|=10) are stored in each direction (forward, backward, left, right, down) along with their positions relative to the vehicle, then there are 10 distance changes Δd i For each of the ten objects included, a distance change Δd is calculated by comparing it with its corresponding position in the stored environment data set, in particular by subtracting each of its current relative positions with respect to the vehicle or each of its current vertical distances from the vehicle body from its corresponding relative position or its corresponding vertical distance from the stored environment data set. i Calculate.
[0055] In this way, current environmental changes can be calculated particularly quickly and efficiently and a change warning signal can therefore be provided particularly quickly and efficiently.
[0056] According to a further development of the invention, a confidence interval is added to each generated or received ambient environment data set, which assesses the quality of each ambient environment data set, additionally or alternatively, of the objects contained therein, using a confidence value.
[0057] The confidence interval may for example be derived based on the confidence level of the information sources: a high confidence value is given to the ambient environment datasets from a source with a high confidence level and a low confidence value is given to the ambient environment datasets from a source with a low confidence level (e.g. a high confidence value is given to the ambient environment datasets from intrinsic sensors and a low confidence value is given to the ambient environment datasets provided externally, e.g. by other traffic participants or infrastructure).
[0058] Additionally, the confidence value of an object may depend on the number of sensors detecting the object or the surrounding environment dataset that contains the object (e.g., object recognition using ultrasonic sensors, cameras and external data may yield a high confidence value, which is higher than recognition using a unique sensor).
[0059] For this purpose, based on the confidence interval or each confidence value, a corresponding type of warning may be predefined.
[0060] According to a development of the invention, a change warning signal is additionally provided if (in step c)) the currently received ambient environment data set contains at least one further object which is not present in the stored ambient environment data set.
[0061] For example, when there are always 10 nearest objects in the surrounding environment data set, that is, two objects in each of the five directions, forward, backward, left, right and downward, each having a relative position relative to the (own) vehicle or a respective vertical distance from the surface of the (own) vehicle's body, and if one of the 10 objects in the surrounding environment data set (reference) saved at the time the (own) vehicle stopped is replaced by another object located nearby in the surrounding environment data set currently being received, a change warning signal is output.
[0062] This allows for a more rapid and efficient provision of a change warning signal.
[0063] According to a development of the invention, the method according to the first aspect of the invention further comprises the step of g) continuously determining surrounding environment datasets using at least one first interior sensor of the vehicle while the vehicle is stationary or alternatively while the ignition of the vehicle is switched off, additionally or alternatively while the vehicle is locked.
[0064] All steps of the method may be performed in any meaningful order.
[0065] According to a further development of the invention, the vehicle according to the third aspect of the invention comprises at least one interior sensor, which is communicatively connected to the driving assistance system, in particular to the interface module, and is configured to continuously determine a surrounding environment dataset using at least one first interior sensor of the vehicle while the vehicle is stopped or, alternatively, while the vehicle is switched off, additionally or alternatively, while the vehicle is locked.
[0066] At least one sensor of the (own) vehicle may be an ultrasonic sensor that determines the distance to an object based on the duration analysis of an output ultrasonic impulse, a camera that determines the distance to an object by image analysis (e.g., triangulation), a LIDAR sensor that determines the distance to an object based on the duration of an output laser impulse, a tactile sensor that operates using physical scanning, etc. Also, a sensor that determines and recognizes the location by wireless communication can be used. By using this sensor, it is possible to detect and recognize the location of a radio wave source, for example, a mobile phone / smartphone, etc. This allows the position or distance of a person carrying a mobile phone / smartphone or a vehicle equipped with a mobile communication device relative to the (own) vehicle to be determined and integrated into the surrounding environment dataset.
[0067] The at least one sensor continuously determines an environment dataset comprising relative positions or vertical distances of objects relative to the (own) vehicle, i.e. its body. The continuously determined environment dataset may be transferred to a driver assistance system that determines current environment changes.
[0068] By using at least one interior sensor of the (own) vehicle, a surrounding environment dataset can be determined which comprises particularly accurate information about the (own) vehicle's surrounding environment.
[0069] According to a further development of the invention, the calculated current surrounding environment change Δ t is a given change threshold Δ limIf so, then (in step g)) the surrounding environment data set is determined additionally using at least one second interior sensor of the vehicle, additionally or alternatively at a higher sampling rate or clock rate.
[0070] Similarly, if the ambient environment data set is determined at a higher sampling rate / clock rate (step g)), the ambient environment data set may be received at or above the sampling rate / clock rate at which it is being determined (step a)), and a current ambient environment change Δ t may be calculated.
[0071] For example, the ambient environment data set may be determined continuously, typically using one ultrasonic sensor in each direction (forward, backward, left, right, down) at a sampling / clock rate of, for example, 0.2 Hz. t > a given change threshold Δ lim ) occurs, additional or alternatively, at a higher clock rate of, for example, 5 Hz, additional sensors (e.g., additional ultrasonic sensors, or additional other sensors, for example, cameras or LIDAR sensors) are used in the corresponding direction or in all directions to determine an ambient environment dataset.
[0072] In this way, on the one hand, energy can be saved when no significant changes in the surrounding environment occur, and on the other hand, particularly accurate environmental data sets can be determined when significant changes in the surrounding environment occur, thus saving energy and providing a highly accurate warning against significant changes in the surrounding environment.
[0073] According to a development of the invention, the method according to the first aspect of the invention comprises the steps of h) receiving and storing the surrounding environment dataset as a saved surrounding environment dataset at time t=0 when the vehicle stops.
[0074] According to a further development of the invention, the interface module or the comparison module may be configured to receive and store the surrounding environment data set as a stored surrounding environment data set at the time t=0 when the vehicle comes to a standstill.
[0075] At time t=0 when the vehicle stops, the currently received surrounding environment data set is permanently stored, for example in a first memory, and is used thereafter as a reference for determining surrounding environment changes. The surrounding environment data set stored at time t=0 represents the surrounding environment state around the (subject) vehicle at the time when the (subject) vehicle is no longer moving.
[0076] The present invention and technical environment will be described in more detail below based on the drawings. Please note that the present invention should not be limited by the described embodiment examples. In particular, unless otherwise specified, it is also possible to extract some configurations of the matters described in the drawings and combine them with other configurations and knowledge obtained from this specification or the drawings. In particular, please note that the drawings and the dimensions described in particular are only approximate. Since the same reference numerals indicate the same objects, the description of other drawings can be supplementarily referred to as necessary. [Brief description of the drawings]
[0077] [Figure 1] FIG. 1 is a schematic flow diagram of an exemplary embodiment of a method for recognizing changes in the surrounding environment of a vehicle. [Diagram 2] FIG. 2 is a schematic diagram of an exemplary embodiment of a driving assistance system that recognizes changes in the vehicle's surroundings. [Diagram 3] FIG. 3 is a schematic diagram of an exemplary embodiment of a vehicle equipped with the driving assistance system of FIG. [Figure 4] FIG. 4 is a schematic diagram of the vehicle's surroundings at different times. [Diagram 5] FIG. 5 is a further schematic illustration of the vehicle's surroundings at different times. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0078] 1 shows a schematic diagram of an exemplary embodiment of a method for recognizing changes in the vehicle's surroundings according to a first aspect of the invention. The method comprises a continuously receiving step a), a continuously calculating step b) and a providing step c), and optionally each of an outputting step d), an enabling step e), a displaying step f), a continuously determining step g) and a receiving and storing step h). The steps of the method may be performed in any meaningful order. The consecutive steps may each be performed at different sampling or clock rates or at a common sampling / clock rate.
[0079] In an optional step g), ambient environment data sets are determined continuously (at each instant of the clock rate / sampling rate) by means of at least one first internal sensor (3, see FIG. 3) of the vehicle (2, see FIG. 3) while the vehicle is stationary or while the ignition of the vehicle is switched off, additionally or alternatively while the vehicle is locked (from the outside). The continuously determined ambient environment data are transferred by the at least one first sensor to the driving assistance system (1, see FIGS. 2 and 3) or its interface module (11, FIG. 2) and temporarily stored in a second memory (ring buffer).
[0080] In an optional step h), the ambient environment data set determined at time t=0, which is the time when the vehicle is no longer moving and comes to a complete standstill, when the ignition of the vehicle is switched off or when the vehicle is locked, is stored as a reference. This ambient environment data set is stored in a first memory by the driving assistance system, i.e. by its interface module or comparison module (12, see FIG. 2), as a stored ambient environment data set.
[0081] In step a), ambient environment datasets are continuously received (at least one ambient environment dataset at each instant of the clock rate / sampling rate), where the ambient environment datasets may be received by means of at least one internal sensor of the vehicle and additionally or alternatively by means of an external entity (4, see FIG. 3), e.g. an intelligent infrastructure (e.g. traffic cameras, etc.), traffic drones, other vehicles, etc. In this case, the ambient environment datasets comprise information about the vehicle's surroundings, in particular the respective positions of objects (5, see FIGS. 4 and 5) relative to the vehicle.
[0082] In step b), the current surrounding environment change Δ t continuously (at each instant of the sampling rate / clock rate) by continuously comparing the surrounding environment data set currently being received when the vehicle is stopped or switched off / locked with the stored surrounding environment data set, which was received and stored when the vehicle (2) was stopped. The driver assistance system, i.e. its comparison module, calculates the current surrounding environment change Δ t To this end, a change in position or change in distance to the vehicle is calculated for each object in the vehicle's environment by subtracting the current environment data set from the second memory (ring buffer) from the stored environment data set from the first memory.
[0083] Calculated current surrounding environment change Δ t (variation in distance / position of objects in the vehicle's surrounding environment) is a given change threshold Δ lim (Maximum allowable distance change), that is, if the current surrounding environment change Δ t If the current surrounding environment change Δ tIf this is significant, and therefore if there is a risk of the vehicle colliding with an object not noticed by the driver, the driver assistance system, i.e. its change warning module (13, see FIG. 2), supplies a change warning signal, for example to a warning module (14, see FIG. 2), a braking module (15, see FIG. 2) or a display module (16, see FIG. 2) of the driver assistance system or to an external device (mobile phone, smartphone, smart key, etc.).
[0084] If a change warning signal is present, in optional step d) an acoustic, additionally or alternatively optical, additionally or alternatively haptic warning is output to the driver of the vehicle, where the driver is acoustically / optically / haptically warned by the driving assistance system, i.e. by its warning module (15, see FIG. 2), additionally or alternatively by an external device (mobile phone, smartphone, smart key, etc.) to significant changes in the surroundings, thus avoiding a collision with an object of the changed surroundings not recognized by the driver.
[0085] If the change warning signal is present, in optional step e), the vehicle brakes, in particular the parking brake, are turned on. Additionally or alternatively, the cruise control elements of the vehicle (accelerator, accelerator pedal, throttle twist grip, hand throttle control element, etc.) are at least partially turned off. If the change warning signal is present because a significant environmental change has been recognized, the driving assistance system, i.e. its braking module, turns on the (parking) brakes of the vehicle. If the change warning signal is present because a significant environmental change has been recognized, the driving assistance system, i.e. its braking module, turns off the cruise control elements of the vehicle at least partially. Thus, before moving the vehicle from a standstill, the driver must first activate the (parking) brakes (for example by confirming a message on the vehicle's screen or by tapping the cruise control element twice) or turn the cruise control element on again. This allows the driver, on the one hand, to be alerted to the significant environmental change and the resulting collision risk, and, on the other hand, to avoid a collision of the vehicle with an object responsible for the significant environmental change.
[0086] If a change warning signal is present, in optional step f) at least the object which triggered the change warning signal is displayed on the vehicle's screen (e.g. in a bird's eye view as a symbol or as a real time camera image / live image).
[0087] Fig. 2 shows a schematic diagram of an exemplary embodiment of a driving assistance system 1 for recognizing changes in the vehicle's surrounding environment according to a second aspect of the present invention. The driving assistance system 1 comprises means (modules) for performing the steps of the method of Fig. 1. In particular, the driving assistance system 1 comprises an interface module 11, a comparison module 12 and a change warning module 13, and optionally each of a warning module 14, a braking module 15 and a display module 16. The modules of the driving assistance system 1 may be software modules implemented in the driving assistance system 1 configured as a data processing device and causing the driving assistance system 1 to perform the corresponding steps, or separate hardware modules each independently performing the corresponding steps.
[0088] The interface module 11 is configured to execute step a) and, optionally, step h), in which the interface module 11 is communicatively connected to at least one first sensor of the vehicle and additionally or alternatively to at least one external entity and is capable of storing the current ambient environment data set being received in a second memory (ring buffer) and the ambient environment data set received at the time of stopping / switching off / locking the vehicle as a saved ambient environment data set in the first memory.
[0089] The comparison module 12 is communicatively connected to the interface module 11 and obtains the current surrounding environment data set being received, for example from a second memory (ring buffer), respectively. The comparison module 12 is configured to execute step b). The comparison module 12 may be communicatively connected to at least one first sensor of the vehicle and additionally or alternatively to at least one external entity and may optionally be configured to execute step h) instead of the interface module 11, whereby the comparison module 12 stores the received surrounding environment data set as a stored surrounding environment data set in the first memory at the time of stopping / switching off / locking the vehicle.
[0090] The change alert module 13 is communicatively connected to the comparison module 12 and is configured to perform step c).
[0091] An optional alert module 14 is communicatively connected to the change alert module 13 and is configured to perform step d).
[0092] An optional braking module 15 is communicatively connected to the change warning module 13 and is configured to perform step e).
[0093] An optional display module 16 is communicatively connected to the change alert module 13 and is configured to perform step f).
[0094] Fig. 3 shows a schematic diagram of an exemplary embodiment of a vehicle 2 according to the third aspect of the invention, comprising the driving assistance system 1 of Fig. 2. The vehicle 2 comprises the driving assistance system 1 and at least one (here exemplarily three) first sensor. The at least one sensor 3 is communicatively connected to the driving assistance system 1 and configured to execute step g) of the method of Fig. 1. The driving assistance system 1 may additionally or alternatively be communicatively connected to the at least one sensor 3 with an external entity 4, e.g. an intelligent infrastructure (e.g. traffic cameras, etc.), traffic drones, other vehicles, etc., by means of which it may continuously receive surrounding environment datasets.
[0095] Figure 4 shows a schematic representation of the surroundings of the vehicle 2 at two different times. The vehicle 2 and its surroundings are shown in a bird's-eye view. This representation can also be displayed in real time to the driver on the screen of the vehicle 2. On the left side, the surroundings of the vehicle 2 are illustrated at the time t=0, when the vehicle 2 is no longer moving and comes to a complete standstill, when the ignition of the vehicle 2 is switched off or when the vehicle 2 is locked. On the right side, the surroundings of the vehicle 2 are illustrated at a later time t=T, when the vehicle 2 is still stationary, when the ignition of the vehicle 2 is switched on or when the vehicle 2 is unlocked.
[0096] At time t=0, there are three objects 5 in the environment of the vehicle 2. The first object 5.1 is located at a distance d1 in front of the vehicle 2 in the x-direction. 0 The second object 5.2 is at a distance d2 to the right of the vehicle 2 in the (negative) y direction. 0 The third object 5.3 is located at a distance d3 behind the vehicle 2 in the (negative) x-direction. 0 Thus, the stored surroundings data set may for example include three objects 5 with respective horizontal, vertical distances and orientations to the vehicle 2 (i.e. to the surfaces of its body). object direction distance 1 +x d1 0 2 -y d2 0 3 -x d3 0
[0097] At time t=T, there are three objects 5 in the environment of the vehicle 2. The distance d2 of the second object 5.2 T and the distance d3 of the third object 5.3 T has not changed, and d2 T =d2 0 ;d3 T =d3 0 Therefore, for the second object 5.2 and the third object 5.3, at time t=T, the surrounding environment change Δ T On the other hand, the first object 5.1 approaches the vehicle 2 in the (negative) x-direction at a distance d1 0 Distance d1 is smaller than T , d1 T <d1 0 Thus, the current surroundings data set may include, for example, three objects 5 having respective horizontal and vertical distances and orientations to the vehicle 2 (i.e. to the surface of its body). object direction distance 1 +x d1 T 2 -y d2 T 3 -x d3 T
[0098] In this way, at time t=T, the surrounding environment change Δ T This environmental change Δ T is the difference between the distance of the first object 5.1 at time t=0 and the distance of the first object 5.1 at time t=T, that is, Δ T =d1 0 -d1 T Therefore, the current surrounding environment change Δ T may have the following values, for example: Δ T d1 0 -d1 T 0 0
[0099] This change in the surrounding environment Δ T is a given change threshold Δ lim If it is larger than (e.g. 30 cm), this corresponds to a significant change in the surroundings and a change warning signal is provided and the driver may be alerted, for example, by means of an acoustic / optical / haptic warning, or by switching on the (parking) brake, or by (partially) switching off a cruise control element, or by displaying a first object of the changed surroundings on a screen.
[0100] Figure 5 shows a schematic representation of the surroundings of the vehicle 2 at two different times. The vehicle 2 and its surroundings are shown in a bird's-eye view. This representation can also be displayed in real time to the driver on the screen of the vehicle 2. On the left side, the surroundings of the vehicle 2 are illustrated at the time t=0, when the vehicle 2 is no longer moving and comes to a complete standstill, when the ignition of the vehicle 2 is switched off or when the vehicle 2 is locked. On the right side, the surroundings of the vehicle 2 are illustrated at a later time t=T, when the vehicle 2 is still stationary, when the ignition of the vehicle 2 is switched on or when the vehicle 2 is unlocked.
[0101] At time t=0, there are three objects 5 in the environment of the vehicle 2. The first object 5.1 is located at a distance d1 in front of the vehicle 2 in the x-direction.0 The second object 5.2 is at a distance d2 to the right of the vehicle 2 in the (negative) y direction. 0 The third object 5.3 is located at a distance d3 behind the vehicle 2 in the (negative) x-direction. 0 Thus, the stored surroundings data set may, for example, include three objects 5 with their respective horizontal and vertical distances and orientations to both 2 (i.e. the surfaces of the vehicle body). object direction distance 1 +x d1 0 2 -y d2 0 3 -x d3 0
[0102] At time t=T, there are three objects 5 in the surrounding environment of the vehicle 2. Meanwhile, there is also a fourth object 5.4 in the surrounding environment of the vehicle 2, that is, in front of the vehicle 2 in the x-direction, and this fourth object 5.4 is located between the vehicle 2 and the first object 5.1, that is, closer to the vehicle 2 than the first object 5.1. T , distance d2 of the second object 5.2 T and the distance d3 of the third object 5.3 T has not changed, and d1 T =d1 0 ;d2 T =d2 0 ;d3 T =d3 0 Therefore, for the first object 5.1, the second object 5.2, and the third object 5.3, at time t=T, the surrounding environment change Δ T On the other hand, the fourth object 5.4, which was not yet present in the surroundings of the vehicle at time t=0, is similarly positioned in front of the vehicle 2 at a distance d1 of the first object. T Distance d4 is smaller than T , d4 T <d1 TThus, the surrounding environment data set at time t=T either contains four objects, or three objects in the case where each object contains only one nearest object in each direction, one of which is new. Thus, the current surrounding environment data set may, for example, contain all four objects 5 with their respective horizontal and vertical distances and directions to the vehicle 2 (i.e., to the surface of its body). object direction distance 1 +x d1 T 2 -y d2 T 3 -x d3 T 4 +x d4 T
[0103] Or alternatively, for example, there is only one nearest object in each direction, having respective horizontal and vertical distances and directions to the vehicle 2 (ie, the surface of its body). object direction distance 4 +x d4 T 2 -y d2 T 3 -x d3 T
[0104] In this way, in the first case (four objects), at time t=T, the surrounding environment change Δ T , while a change warning is provided because a new object is present in the current environment data set (t=T) compared to the stored environment change (T=0), which corresponds to a significant environment change. In the second case, an environment change Δ T This environmental change Δ T is the difference between the distance of the first object 5.1 at time t=0 and the distance of the fourth object 5.4 at time t=T, that is, Δ T =d1 0 -d4 T Therefore, the current surrounding environment change Δ T may have the following values, for example: Δ T d1 0 -d4 T 0 0
[0105] This change in the surrounding environment Δ T is a given change threshold Δ lim If it is larger (e.g. 30 cm), i.e. noticeable, a change warning signal is provided and the driver may be alerted, for example, by means of an acoustic / optical / haptic warning, or by switching on the (parking) brake, or by (partially) switching off a cruise control element, or by displaying a first object of the changed surroundings on a screen.
[0106] While specific embodiments have been shown and described in this disclosure, it will be apparent to those skilled in the art that numerous alternatives and / or equivalent implementations exist. It is recognized that the exemplary designs or embodiments are merely exemplary and are not intended to be limiting in scope, applicability, or configuration. Rather, it is understood that the summary and detailed description above provide those skilled in the art with sufficient instructions to implement at least one preferred embodiment, and that various changes in the function and arrangement of the elements described in the exemplary embodiments do not depart from the scope of the appended claims and their legal equivalents. In general, this application is intended to cover all adaptations or variations of the specific embodiments described in this disclosure.
[0107] In the above detailed description, various features are grouped together in one or more examples to keep the disclosure concise. It is understood that the above description is illustrative and not limiting. The above description encompasses all alternatives, modifications, and equivalents that may be included within the scope of the present invention. Numerous other example embodiments will be apparent to those skilled in the art upon studying the above disclosure.
[0108] In order to allow a comprehensive understanding of the present invention, specific nomenclature has been adopted and used in the above disclosure. However, in light of the description contained in this disclosure, it will be apparent to one skilled in the art that specific details are not essential in applying the present invention. Thus, the above description of specific embodiments of the present invention has been given for purposes of illustration and description. The above description is not intended to be a definitive enumeration or to limit the present invention to the exact embodiments disclosed herein, and it is apparent that numerous modifications and variations are possible in light of the above teachings. The embodiments have been chosen and described in order to best explain the principles of the present invention and its practical application, and thereby provide others skilled in the art with the option to best apply the present invention and various embodiments with various modifications that may be suitable for each application. Throughout this specification, the words "including" and "wherein" are used equivalently to the words "comprising" and "in". Additionally, the words "first", "second", "third", etc. are used as indicators only, and are not intended to impose numerical requirements on the objects or prescribe a particular order. With respect to the present specification and the claims, the conjunction "or" should be understood as being inclusive ("and / or") and not as being exclusive ("either / or"). This application relates to the invention described in the claims, but also includes the following as other aspects. 1. A method for recognizing changes in an environment surrounding a vehicle (2), comprising: a) continuously generating or receiving surrounding environment datasets while the vehicle (2) is stationary; b) continuously calculating a current change in the surrounding environment Δt by continuously comparing the surrounding environment data set being generated or received during the current stop with a stored surrounding environment data set that was generated or received and stored when the vehicle (2) was stopped; and c) providing a change warning signal if the calculated current ambient change Δt exceeds a predefined change threshold Δlim, Δt>Δlim. 2. 2. The method according to claim 1, wherein the surrounding environment data set is received and the current surrounding environment change Δt is calculated while the ignition of the vehicle (2) is switched off and / or while the vehicle (2) is locked. 3. 3. The method according to claim 1 or 2, wherein the surrounding environment dataset is received by at least one internal sensor (3) of the vehicle (2) and / or by at least one external entity (4). 4. d) if the changing warning signal is present, outputting an acoustic and / or optical and / or haptic warning to the driver of the vehicle (2); e) if said change warning signal is present, turning on the brakes of said vehicle (2), in particular the parking brake, and / or at least partially turning off a cruise control element of said vehicle (2); f) when the change warning signal is present, displaying at least the object (5) that triggered the change warning signal on a screen of the vehicle (2), according to any one of the methods described in 1 to 3 above. 5. 5. The method according to any one of 1 to 4 above, wherein the surrounding environment data includes at least the approximate vertical and horizontal distances between an object (5) in a 360° range around the vehicle (2) and the body of the vehicle (2). 6. 6. The method according to any one of 1 to 5 above, wherein the surrounding environment data includes a predetermined number of nearest objects (5) having respective positions relative to the vehicle (2). 7. Calculating, for each object (5) in the stored ambient environment data set, a distance change Δdi as the current ambient environment change by comparing its respective position in the stored ambient environment data set with its corresponding position in the currently received ambient environment data set; 7. The method according to claim 6, further comprising providing said change warning signal in step c) if one of said calculated distance changes Δdi exceeds said predetermined surrounding environment change threshold Δlim, Δdi>Δlim. 8. A method according to any one of 1 to 7 above, wherein a confidence interval is added to each generated or received ambient environment data set, the confidence interval assessing the quality of each ambient environment data set and / or the objects (5) contained therein. 9. A method according to any one of claims 6 to 8, further comprising providing the change warning signal if the currently received surrounding environment data set includes at least one other object (5) not included in the stored surrounding environment data set. 10. g) A method according to any one of claims 1 to 9, further comprising a step of continuously determining a surrounding environment dataset using at least one first interior sensor (3) of the vehicle (2) while the vehicle (2) is stationary or, in the case of the method according to claim 2, while the ignition of the vehicle (2) is switched off and / or while the vehicle (2) is locked (from the outside). 11. 11. The method according to claim 10, wherein if the calculated current surrounding environment change Δt exceeds the predetermined change threshold Δlim, the surrounding environment data set is determined additionally using at least one second internal sensor (3) of the vehicle (2) and / or at a higher sampling rate. 12. A method according to any one of claims 1 to 11, further comprising the step of: h) receiving and storing the surrounding environment dataset as the saved surrounding environment dataset at time t=0 when the vehicle (2) stops. 13. A driving assistance system (1) for recognizing changes in the surrounding environment of a vehicle (2), comprising means for executing the steps of the method according to any one of 1 to 12 above. 14. A vehicle (2) equipped with the driving assistance system (1) described in 13 above. [Explanation of symbols]
[0109] 1. Driving assistance system 2 Vehicles 3 Internal Sensor 4 External Entities 5 objects 11 Interface Module 12 Comparison Module 13 Change Alert Module 14 Warning Module 15 Braking Module 16 Display Module
Claims
1. A method for recognizing a change in an environment surrounding a vehicle (2), comprising: a) continuously receiving a set of environmental data whilst the vehicle (2) is stationary; b) continuously calculating a current ambient change Δt by continuously comparing a current ambient environment data set received during the stop with a stored ambient environment data set received and stored when the vehicle (2) was stopped; c) when the vehicle (2) is unlocked by a driver not present in the vehicle (2), if the calculated current surrounding environment change Δt exceeds a predetermined change threshold Δlim, Δt>Δlim, providing a change warning signal.
2. 2. The method according to claim 1, wherein the surrounding environment data sets are received and the current surrounding environment change Δt is calculated while the ignition of the vehicle (2) is switched off and / or while the vehicle (2) is locked.
3. 3. The method according to claim 1 or 2, wherein the surrounding environment datasets are received by at least one internal sensor (3) of the vehicle (2) and / or by at least one external entity (4).
4. d) if said changing warning signal is present, outputting an acoustic and / or optical and / or haptic warning to the driver of said vehicle (2); e) if said change warning signal is present, turning on the brakes of said vehicle (2), in particular the parking brake, and / or at least partially turning off the cruise control elements of said vehicle (2); The method according to any one of claims 1 to 3, further comprising at least one of the steps: f) if the change warning signal is present, displaying at least the object (5) which triggered the change warning signal on a screen of the vehicle (2).
5. The method according to any one of claims 1 to 4, wherein the surrounding environment data includes at least the approximate vertical and horizontal distances between an object (5) and the body of the vehicle (2) in a 360° periphery around the vehicle (2).
6. The method according to any one of the preceding claims, wherein the surrounding environment data comprises a predetermined number of nearest objects (5) having their respective positions relative to the vehicle (2).
7. Calculating for each object (5) in the stored ambient environment data set a distance change Δdi as the current ambient environment change by comparing its respective position in the stored ambient environment data set with its corresponding position in the currently received ambient environment data set; 7. The method of claim 6, further comprising providing said change warning signal in step c) if one of said calculated distance changes Δdi exceeds said predetermined change threshold Δlim, Δdi>Δlim.
8. The method according to any one of claims 1 to 7, wherein a confidence interval is added to each received environmental dataset, said confidence interval assessing the quality of each environmental dataset and / or the objects (5) contained therein.
9. The method according to any one of claims 6 to 8, further comprising providing said change warning signal if the currently received surrounding environment data set contains at least one further object (5) that is not present in the stored surrounding environment data set.
10. The method according to any one of claims 1 to 9, further comprising the step of: g) continuously determining surrounding environment datasets by means of at least one first interior sensor (3) of the vehicle (2) while the vehicle (2) is stationary or, in the case of the method according to claim 2, while the ignition of the vehicle (2) is switched off and / or while the vehicle (2) is locked.
11. 11. The method according to claim 10, further comprising determining the surrounding environment data set additionally using at least one second interior sensor (3) of the vehicle (2) and / or at a higher sampling rate if the calculated current surrounding environment change Δt exceeds the predefined change threshold Δlim.
12. The method according to any one of claims 1 to 11, further comprising the step of: h) receiving and storing an ambient environment dataset as the saved ambient environment dataset at time t=0 when the vehicle (2) comes to a stop.
13. A driving assistance system (1) for recognising changes in the surrounding environment of a vehicle (2), comprising means for carrying out the steps of the method according to any one of the preceding claims.
14. A vehicle (2) comprising the driving assistance system (1) according to claim 13.
Citation Information
Patent Citations
Method for creating an environment representation map for monitoring a vehicle and / or a vehicle trailer using a camera system
DE102018222683A1
Obstacle detector
JP2008254710A
Image recognition device for vehicle
JP2013015882A
Monitoring system, rader system and monitoring method using radar system
JP2020113215A