Method, device and system for driver assistance for a driver of a vehicle

Abstract

The invention relates to a method for driver assistance for a driver of a vehicle (V) in order to output assistance data (119) to a mobile terminal (140), comprising the following steps: reading in sensor data (122, 132) via a sensor interface (111) from at least one environmental sensor (120, 130), wherein the at least one environmental sensor (120, 130) is arranged in an infrastructure environment, wherein the sensor data (122, 132) represent a predefined protection area of ​​the infrastructure environment; receiving position data (152, 162) of the mobile terminal (140), wherein the mobile terminal (140) is assigned to the driver of the vehicle (V) and is temporarily arranged in the vehicle (V), wherein the position data (152, 162) represent a geographical position of the mobile terminal (140);Correlating the sensor data (122, 132) with the position data (152, 162) to determine whether a warning situation exists, wherein it is determined that a warning situation exists if, based on the sensor data (122, 132), a vehicle (V) is detected in the protection zone and, based on the position data (152, 162), it is determined that the mobile terminal (140) is arranged in the detected vehicle (V); and outputting assistance data (119) via a radio interface (113) to the mobile terminal (140) arranged in the detected vehicle (V) in the event of a determined warning situation, wherein the assistance data (119) provides information about the warning situation to the driver by means of the mobile terminal (140);

Description

State of the art

[0001] The invention is based on a device or method according to the class of the independent claims. The present invention also relates to a computer program.

[0002] For example, sensor-based assistance systems integrated into vehicles, such as parking assistance, are known. Information from external sensors can also be incorporated into vehicle-integrated assistance systems, such as for collision prevention at intersections, particularly using so-called C2X communication (C2X = Car-to-X). However, not all vehicles have the capabilities mentioned above. Disclosure of the invention

[0003] Against this background, the approach presented here presents a method, a device using this method, and finally a corresponding computer program according to the main claims. The measures listed in the dependent claims allow advantageous refinements and improvements of the device specified in the independent claim.

[0004] According to embodiments, in particular, information from a sensor about the movement of objects can be correlated with a position of a vehicle and a resulting danger or hazard to these objects. Furthermore, for example, information about the hazard to these objects can be transmitted to the driver of the vehicle regardless of the vehicle's equipment. In this case, in particular, entry of the vehicle into a surveillance area can be detected based on a position signal from a mobile device of the driver or so-called 5G positioning. Furthermore, for example, warnings can be transmitted not to the vehicle but to the driver's mobile device, wherein the assistance function can be implemented on the driver side in the form of an app. In particular, according to embodiments, a mobile driver assistance system with stationary sensors can thus be realized.

[0005] Advantageously, an assistance function can be implemented that does not require a complex vehicle communication system, such as C2X, for information transmission. The assistance function can also be implemented easily for vehicles without complex or separate sensors, for example, so that potentially dangerous situations can be avoided, such as those in which a vehicle would be steered "blindly" via the rearview mirror. This can increase safety for the vehicle and other road users. In particular, the assistance function does not require any modification of the vehicle, but can be implemented independently of the vehicle's equipment. No access to existing vehicle interfaces is necessary, thus enabling cross-manufacturer or manufacturer-independent application.The assistance function can be implemented using existing mobile communications technology as well as with future mobile network developments. A driver simply needs to have the mobile device with them and can use the assistance system by downloading the software application.

[0006] A method for driver assistance for a driver of a vehicle is presented, the method comprising the following steps: Reading in sensor data via a sensor interface from at least one environmental sensor, wherein the at least one environmental sensor is arranged in an infrastructure environment that can be driven through by the vehicle, wherein the sensor data represent a predefined protection area of the infrastructure environment; Receiving position data of a mobile terminal, wherein the mobile terminal is assigned to the driver of the vehicle and is temporarily arranged in the vehicle, wherein the position data represents a geographical position of the mobile terminal temporarily arranged in the vehicle; Correlating the sensor data with the position data to determine whether a warning situation exists, wherein it is determined that a warning situation exists if a vehicle is detected in the protection area based on the sensor data and it is determined from the position data that the mobile terminal is located in the detected vehicle; and Outputting assistance data via a radio interface to the mobile terminal located in the detected vehicle in the event of a detected warning situation, wherein the assistance data provides information about the warning situation to the driver via the mobile terminal.

[0007] By carrying out the method, an assistance function can be provided for the driver of the vehicle. The vehicle can be, for example, a land vehicle or a watercraft, in particular a truck with or without a trailer or another commercial vehicle, a passenger car with or without a trailer, a rail vehicle, a yacht, a cargo ship, etc. The at least one environmental sensor can be embodied as an optical sensor, for example a camera, a motion detector, a distance sensor, etc., as a radar device or the like. The at least one environmental sensor can also be referred to as an infrastructure sensor. A plurality of environmental sensors can be arranged in the infrastructure environment. The plurality of environmental sensors can use similar or at least partially different detection types. An area monitored by the at least one environmental sensor can comprise at least the protection area.The infrastructure environment may include a logistics yard, a bus depot, a container transshipment point, a train station, a marshalling yard, a harbor, a marina, a container port, a parking garage, or the like. The infrastructure environment may be located inside and, additionally or alternatively, outside at least one building. The protection zone may represent a hazardous location, a poorly visible location, an obstacle location, etc., where the vehicle is to be moved, for example, in reverse with restricted visibility for the driver.

[0008] The mobile terminal is a terminal designed to receive radio, in particular mobile radio, data. For this purpose, the terminal can comprise a radio, in particular mobile radio, interface. A temporary arrangement in the vehicle can be understood to mean an arrangement that is different from a permanent arrangement in the vehicle. Preferably, the mobile terminal is arranged or located in the vehicle (only) when the driver of the vehicle is in the vehicle. In particular, the mobile terminal is arranged in the vehicle while the position data is being received. The mobile terminal can be embodied as a mobile phone, in particular a smartphone, a smartwatch, etc.

[0009] The information for the driver can be provided acoustically, visually, and additionally or alternatively haptically. The information can consist of the driver being informed of the existence of the warning situation and, optionally, additionally of the driver being informed of details of the warning situation, in particular of hazards detected based on the sensor data regarding movement of the vehicle in the protection zone. The warning situation can represent a detected hazard and, additionally or alternatively, a detected obstacle, for example, for a parking aid, for distance measurement, or the like. The warning situation can also be referred to as an assistance situation or as a warning and / or assistance situation. In other words, in the correlation step, the sensor data can be correlated with the position data to determine whether warning and / or assistance information is relevant.

[0010] A warning situation can occur if sensor data indicates an obstacle within the protection zone, the position data of the mobile device belongs to this protection zone or an associated activation zone, and optionally sensor data indicates the vehicle. The information provided to the driver can then be, for example, a stop request. A warning situation, also referred to as an assistance situation, can occur if the position data of the mobile device belongs to the protection zone, and optionally sensor data indicates the vehicle. The information provided to the driver can then be, for example, a parking aid for the driver via the mobile device.

[0011] Optionally, the driver assistance procedure can be performed for a driver sitting in a teleoperator control center. Such a driver can have access to an additional device, or the information can be transmitted to the screens accessible to them. The control center can then be understood as a mobile device located outside the vehicle. Vehicle assignment / positioning can also be performed using methods other than mobile phone positioning.

[0012] According to one embodiment, the sensor data read in during the reading step can represent at least one person detected in the infrastructure environment. In this case, in the correlating step, it can be determined that a warning situation exists if the at least one person is located in the protection zone and, optionally, the position data of the mobile device additionally determines the relevance of this information. In this case, the assistance data output during the output step can, via the mobile device, provide the driver with information about the at least one detected person. The information about the at least one detected person can represent the presence of the person, a distance between the vehicle and the person and, additionally or alternatively, a direction of movement of the person.Such an embodiment offers the advantage that persons outside the vehicle can be protected even if they are in a blind spot with respect to the driver and additionally or alternatively with respect to a vehicle sensor system.

[0013] The sensor data read in during the reading step can also represent at least one obstacle object detected in the infrastructure environment. In this case, the correlation step can determine that a warning situation exists if the at least one obstacle object is located in the protection zone and, optionally, the position data of the mobile device also determine the relevance of this information. The assistance data output during the output step can provide the driver with information about the at least one detected obstacle object via the mobile device. The information about the at least one detected obstacle object can represent the presence of the obstacle object, a distance between the vehicle and the obstacle object, a dimension of the obstacle object and, additionally or alternatively, a free space for maneuvering around the obstacle object.Such an embodiment offers the advantage that a maneuvering aid can be provided for the driver if there is at least one obstacle object in a blind spot with respect to the driver and additionally or alternatively with respect to a vehicle sensor system.

[0014] Furthermore, the correlating step can be performed if it is determined from the position data that the position of the mobile terminal temporarily located in the vehicle lies within an activation zone of the infrastructure environment. The protection zone can be located within the activation zone. Such an embodiment offers the advantage that the assistance function is only fully activated when the vehicle in which the observed mobile terminal is temporarily located, or in which the mobile terminal communicating its position is temporarily located, or is located by the network, is actually located near the protection zone.

[0015] In addition, in the receiving step, the position data can be received from the mobile device via the radio interface. The mobile device can be configured to perform position determination or position recognition using GNSS, for example, GPS. The position signal is generated and transmitted by the mobile device based on GPS data. Such an embodiment offers the advantage that a precise position determination can be performed and thus exact and reliable position data can be provided. In other words, for example, position recognition of the mobile device and thus of the vehicle can be enabled via GPS within a non-5G mobile network.

[0016] Additionally or alternatively, in the receiving step, the position data can be received via a network interface from a mobile radio network in which the mobile device is registered. So-called 5G positioning can be used here. With 5G positioning, the 5G network generates the position information. The mobile device itself does not send any position data. Rather, the position of a mobile device in the 5G network is detected, whereby the mobile device is assigned to the driver of the vehicle and is clearly recognized in the 5G network, whereby the position data represents a geographical position of the mobile device arranged in the vehicle. In particular, receiving the position data via the network interface from the mobile radio network can comprise a network-based positioning method, e.g. in accordance with 3GPP Release 16 ff., or a sidelink positioning method, e.g. in accordance with 3GPP Release 18 ff.The position data can be determined using the network-based and / or sidelink-based positioning method, preferably according to the 3GPP standard. Such an embodiment offers the advantage that a precise position determination can be performed and thus accurate and reliable position data can be provided. In other words, position detection of the mobile device and thus of the vehicle can be enabled, for example, from a 5G network.

[0017] This method can be implemented, for example, in software or hardware or in a mixed form of software and hardware, for example in a control unit or device.

[0018] The approach presented here further provides a device configured to perform, control, or implement the steps of a variant of a method presented here in corresponding devices. This embodiment of the invention in the form of a device also allows the problem underlying the invention to be solved quickly and efficiently.

[0019] For this purpose, the device can have at least one computing unit for processing signals or data, at least one memory unit for storing signals or data, at least one interface to a sensor or an actuator for reading sensor signals from the sensor or for outputting data or control signals to the actuator, and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit can be, for example, a signal processor, a microcontroller, or the like, wherein the memory unit can be a flash memory or a magnetic storage unit.The communication interface can be designed to read in or output data wirelessly and / or wired, wherein a communication interface that can read in or output wired data can read this data, for example, electrically or optically from a corresponding data transmission line or output it to a corresponding data transmission line.

[0020] In this case, a device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals depending on them. The device can have an interface that can be implemented in hardware and / or software. In a hardware implementation, the interfaces can, for example, be part of a so-called system ASIC, which contains a wide variety of functions of the device. However, it is also possible for the interfaces to be separate integrated circuits or to consist at least partially of discrete components. In a software implementation, the interfaces can be software modules that are present, for example, on a microcontroller alongside other software modules.

[0021] A driver assistance system for a driver of a vehicle is also presented, the system having the following features: an embodiment of a device mentioned herein; the at least one environmental sensor configured to provide the sensor data; and an application on the mobile device that is designed to convert the assistance data into information about the warning situation for the driver, wherein the device, the at least one environmental sensor and the application are connected to one another in a data-transmittable manner.

[0022] Also advantageous is a computer program product or computer program with program code that can be stored on a machine-readable carrier or storage medium such as a semiconductor memory, a hard disk memory or an optical memory and is used to carry out, implement and / or control the steps of the method according to one of the embodiments described above, in particular when the program product or program is executed on a computer or a device.

[0023] Examples of the approach presented here are shown in the drawings and explained in more detail in the following description. It shows: Fig. 1 a schematic representation of an embodiment of a system for driver assistance for a driver of a vehicle; Fig. 2 shows a flowchart of an embodiment of a method for driver assistance for a driver of a vehicle; Fig. 3 a schematic representation of a maneuver of a vehicle in an infrastructure environment in connection with the system of Fig. 1 and / or the procedure from Fig. 2; and Fig. 4 a schematic representation of vehicles in an infrastructure environment in connection with the system of Fig. 1 and / or the procedure from Fig. 2.

[0024] In the following description of advantageous embodiments of the present invention, the same or similar reference numerals are used for the elements shown in the various figures and having a similar effect, whereby a repeated description of these elements is omitted.

[0025] Fig. 1 shows a schematic representation of an embodiment of a system 100 for driver assistance for a driver of a vehicle V. The vehicle V is, for example, a land vehicle or a watercraft, in particular a truck with or without a trailer or semi-trailer or another commercial vehicle, a passenger car with or without a trailer, a rail vehicle, a yacht, a cargo ship, etc.

[0026] The system 100 comprises a device 110 for driver assistance for a driver of the vehicle V, at least one environmental sensor 120, 130, and an application 150 or application on a mobile terminal 140. The device 110, the at least one environmental sensor 120, 130, and the application 150 or the mobile terminal 140 are connected to one another in a data-transmitting manner. The device 110 is connected to the at least one environmental sensor 120, 130 in a data-transmitting manner and is connectable or connected to the mobile terminal 140 or the application 150 in a data-transmitting manner. The application 150 is a computer program.

[0027] The at least one environmental sensor 120, 130 is designed to provide sensor data 122, 132. The at least one environmental sensor 120, 130 is arranged in an infrastructure environment through which the vehicle V can travel. The sensor data 122, 132 represent a predefined protected area of the infrastructure environment. The at least one environmental sensor 120, 130 is designed to detect or monitor at least the protected area. The at least one environmental sensor 120, 130 is designed, for example, as an optical sensor, for example as a camera, as a lidar sensor or the like, or as a radar device. According to the exemplary embodiment presented here, two environmental sensors 120 and 130 or two groups of environmental sensors 120 and 130 are provided. The environmental sensors 120 and 130 can be designed identically or differently, in particular with regard to their detection principle.The sensor data 122, 132 may, for example, be in the form of a point cloud and / or an object list.

[0028] The mobile terminal 140 is assigned to the driver of the vehicle V. The mobile terminal 140 is temporarily arranged in the vehicle V. The driver can carry the mobile terminal 140 with him, wherein the mobile terminal 140 can be mounted in a holder in the vehicle V while the driver is in the vehicle V. The mobile terminal 140 and / or the application 150 is / are designed to convert assistance data 119 from the device 110 into information about a warning situation or assistance situation for the driver.

[0029] The device 110 for providing driver assistance to a driver of the vehicle V is arranged outside the vehicle V. For example, the device 110 is arranged adjacent to the at least one environmental sensor 120, 130 and / or in the area of the infrastructure surroundings or the protected area. Alternatively, the device 110 is arranged remotely from the protected area and / or the infrastructure surroundings.

[0030] The device 110 comprises a reading device 112, a receiving device 114, a correlation device 116, and an output device 118. Furthermore, the device 110 comprises a sensor interface 111 and a radio interface 113. According to one embodiment, the device 110 also comprises a network interface 115.

[0031] The reading device 112 is configured to read the sensor data 122, 132 from the at least one environmental sensor 120, 130 via the sensor interface 111. The reading device 112 is connected to the sensor interface 111 in a data-transmittable manner. The reading device 112 is configured to forward the sensor data 120, 132 to the correlation device 116.

[0032] The receiving device 114 is configured to receive position data 152, 162 of the mobile terminal 140. The position data 152, 162 represent a geographical position of the mobile terminal 140 temporarily arranged in the vehicle V. The receiving device 114 is configured to forward the position data 152, 162 to the correlation device 116. According to one exemplary embodiment, the receiving device 114 is configured to receive first position data 152 via the radio interface 113 from the mobile terminal 140 and / or from the application 150. Additionally or alternatively, the receiving device 114 is configured to receive second position data 162 via the network interface 115 from a mobile radio network 160, in particular from a 5G core, in which the mobile terminal 140 is logged on or registered.

[0033] The correlation device 116 is designed to correlate the sensor data 122, 132 with the position data 152, 162 to determine whether a warning situation exists. In other words, it is determined whether sensor information is relevant for the driver with the mobile terminal 140. The correlation device 116 is designed to determine that a warning situation exists if, based on the sensor data 122, 132, a vehicle V is detected in the protection zone and, based on the position data 152, 162, it is determined that the mobile terminal 140 is arranged in the detected vehicle V. According to one embodiment, the correlation device 116 is designed to perform the correlation if, based on the position data 152, 162, it is determined that the position of the mobile terminal 140 temporarily arranged in the vehicle V lies in an activation area of the infrastructure environment.The protection zone is located within the activation zone. In other words, the activation zone at least partially surrounds the protection zone.

[0034] The output device 118 is configured to output the assistance data 119, in the event of a detected warning situation, via the radio interface 113 to the mobile terminal 140 or the application 150 arranged in the detected vehicle V. The output device 118 is connected to the radio interface 113 in a data-transmittable manner. The assistance data 119 provide information about the warning situation to the driver via the mobile terminal 140 or the application 150. The assistance data 119 can also be referred to or understood as an output activation to provide the information.

[0035] According to one exemplary embodiment, the sensor data 122, 132 represent at least one person detected in the infrastructure environment and / or at least one obstacle object detected in the infrastructure environment. The correlation device 116 is configured to determine that a warning situation exists when the at least one person is located in the protection area and / or when the at least one obstacle object is arranged in the protection area. Furthermore, the output device 118 is configured to output assistance data 119, which, via the mobile terminal 140 or the application 150, provides the driver with information about the at least one detected person and / or about the at least one detected obstacle object. This occurs when the position data 152, 162 imply that the mobile terminal 140 is located in the activation area and / or in the protection area.

[0036] According to one embodiment, the device 110 is also configured to send a request signal 124, 134 or subscription signal to the at least one environment sensor 120, 130. In this way, for example, the sensor data 122, 132 can be requested.

[0037] Fig. 2 shows a flowchart of an embodiment of a method 210 for driver assistance for a driver of a vehicle. The method 210 is in this case in connection with the system of Fig. 1 or a similar system. The method 210 is carried out by means of or using the device from Fig. 1 or a similar device or, more precisely, the steps of the method 210 are carried out by means of or using the device of Fig. 1 or a similar device. The device from Fig. 1 comprises devices configured to execute the steps of method 210. The driver assistance method 210 comprises a reading step 212, a receiving step 214, a correlating step 216, and an outputting step 218.

[0038] In step 212 of reading, sensor data is read in via a sensor interface from at least one environmental sensor. The at least one environmental sensor is located in an infrastructure environment accessible to the vehicle. The sensor data represents a predefined protected area of the infrastructure environment. In step 214 of receiving, position data from a mobile terminal is received. The mobile terminal is assigned to the driver of the vehicle and is temporarily located in the vehicle. The position data represents a geographical position of the mobile terminal temporarily located in the vehicle. Step 212 of reading and step 214 of receiving can run in parallel.

[0039] Subsequently, in step 216 of correlation, the sensor data are correlated with the position data to determine whether a warning situation exists or whether a potentially existing warning situation is relevant for the user of the mobile device. A warning situation is determined to exist if, based on the sensor data, a vehicle is detected in the protection zone and, based on the position data, it is determined that the mobile device is located in the detected vehicle. Subsequently, in step 218 of output, if a warning situation is detected, assistance data is output via a radio interface to the mobile device located in the detected vehicle. The assistance data uses the mobile device to provide the driver with information about the warning situation.

[0040] Fig. 3 shows a schematic representation of a maneuver of a vehicle V in an infrastructure environment 370 in connection with the system of Fig. 1 and / or the procedure from Fig. 2. In the representation of Fig. 3, the maneuver is shown in four partial images: a first partial image A, a second partial image B, a third partial image C, and a fourth partial image D. Each of the partial images A to D shows the vehicle V, the infrastructure environment 370, a person P, a gate 371, for example in the area of a loading ramp at a logistics yard or the like, the protection area 372, and the activation area 375. The protection area 372 borders the gate 371. The mobile device with the application is temporarily arranged in the vehicle V, which is, for example, a truck.

[0041] In the first partial figure A, the mobile terminal in the vehicle V is outside the activation area 375. Therefore, in this state, no information or warning is sent to the driver of the vehicle V on the mobile terminal or by means of the mobile terminal.

[0042] In the second partial image B, the position of the mobile device in the vehicle V is within the activation area 375. The mobile device receives assistance data via the system device based on corresponding object data from the at least one environmental sensor. In this state, the driver of the vehicle V is not informed or warned on the mobile device or via the mobile device because there is no obstacle in the protection area 372.

[0043] In the third partial image C, the rear end of vehicle V is located at the edge of the protection zone 372 or monitoring area. The driver is informed via the mobile device that the assistance system is now active. Person P is located outside the protection zone 372.

[0044] In the fourth partial figure D, person P is detected as being in the protection area 372 or monitoring area. The driver is informed of this or of the warning situation via the mobile device. Person P is located within the protection area 372. In other words, the driver is informed because person P is located in the protection area 372 and the mobile device is located in the activation area 375 and / or protection area 372 or monitoring area of the sensors, and because, optionally, vehicle V was also detected by the sensor, i.e., is part of the object list.

[0045] To summarize again and express it in other words, the maneuver of vehicle V in the sub-figures A to D of Fig. 3 can also be described as follows: A truck driver or the driver of vehicle V drives through a gate into the infrastructure environment 370, here specifically onto the grounds of a logistics yard. Upon entry, they can, for example, download appropriate assistance software to their mobile device or smartphone via a QR code. They are then able to use the logistics yard's assistance system, i.e., the installed infrastructure sensors or environmental sensors in combination with a 5G campus network provide the device with relevant information or warnings via the system's device.

[0046] Fig. 4 shows a schematic representation of vehicles V1, V2, V3 in an infrastructure environment 370 in connection with the system of Fig. 1 and / or the procedure from Fig. 2. Shown in Fig. 4 here the infrastructure environment 370, the device 110, the at least one environment sensor 120, 130, the sensor data 122, 132, the assistance data 119, a first vehicle V1, a second vehicle V2, a third vehicle V3, mobile terminals 140 in the first vehicle V1 and the second vehicle V2, a gate 371, a protection area 372, a further gate 473, a further protection area 474 and a person P.

[0047] The protected area 372 borders the gate 371. The person P is located within the protected area 372. The further protected area 474 borders the further gate 473. The first vehicle V1 is arranged adjacent to the protected area 372. The second vehicle V2 and the third vehicle V3 are arranged adjacent to the further protected area 474. It is further illustrated that the at least one environmental sensor 120, 130 and the mobile terminals 140 are connected to the device 110 in a data-transmittable manner.

[0048] The driver of the first vehicle V1 is informed via the mobile terminal 140, which is temporarily arranged in the first vehicle V1, that the person P has been detected or recorded in the protection zone 372. The information provided by the assistance data 119 can optionally also include a distance to the person P or a weighted warning dependent on the distance.

[0049] No information or warning message is sent via the mobile terminal 140, which is temporarily assigned to the second vehicle V2, because no person was detected or recorded in front of the additional gate 473 or in the additional protection zone 474. However, according to one exemplary embodiment, the movement of the third vehicle V3 can be predicted, and preventive warning messages or assistance data 119 can be communicated, in particular to the mobile terminal 140, which is temporarily assigned to the second vehicle V2. Thus, added value for collision avoidance in automated driving can also be achieved.

[0050] In addition to the at least one environmental sensor 120, 130 or as part of the at least one environmental sensor 120, 130, according to one embodiment, a so-called fusion computer is provided, which is connected to the sensor, for example, by cable. The fusion computer evaluates the sensor data 120, 130 and transmits the object list to the device 110 or main application. The information regarding the gate 371 or 473 in front of which a person P and / or an obstacle object, such as the third vehicle V3, was detected, is assigned to the correct vehicle V1 or V2 by the device 110 or main application and transmitted. The application on the mobile terminal 140 in the vehicle sends position data, for example using GPS, 5G positioning via 5G core, etc., to the device 110 or main application. The application on the mobile terminal 140 outputs relevant information from the device 110 to the driver, e.g.a stop instruction. The system or assistance system can thus be used to output warning information visually and / or acoustically via mobile devices 140.

[0051] With reference to the figures described herein, embodiments and advantages thereof are summarized below and, in other words, briefly explained.

[0052] According to exemplary embodiments, a mobile driver assistance system or system for driver assistance 100 with stationary sensors is provided. This makes it possible to provide information about the immediate surroundings of the vehicle V or V1, V2, for example, for detecting people behind loaded trucks, even if the on-board sensors of a vehicle V or V1, V2 are not able to fully capture the information about the immediate surroundings of the vehicle V or V1, V2. This applies, for example, to trucks that have loaded a container if only the driver's cab is equipped with sensors, but not the gun carriage and container. From the vehicle V or V1, V2, one then only has a view to the rear via the rear-view mirrors (cameras), for example, and cannot easily see what is directly behind the vehicle / container. There are also vehicles V orV1, V2, which could in principle be equipped with sufficient sensors, but this has not been done. Thus, the function presented here does not require assistance systems that are permanently installed in vehicles, consisting of sensors, displays, and, if necessary, routines (interventions). Individual, subsequent adaptation / supplementation of such systems to obtain additional information in defined danger zones, which would be complex and often not economically viable, can thus be avoided. It is also advantageous to dispense with vehicle communication systems such as C2X communication, which require special infrastructure and modern vehicle architectures with their own mobile communication capabilities. This is because vehicle OEMs would also have to be willing and ready to open vehicle interfaces, and standards would have to be established.A modification of such systems, which is not easily possible anyway, can thus also be avoided.

[0053] According to embodiments, relevant information about the surroundings of a recipient, here the application 150 on the mobile device 140, is transmitted in a targeted manner in the form of assistance data 119, about which the recipient would otherwise have no or only limited knowledge. This is possible by recognizing when relevant information is available, obtaining and processing relevant information, recognizing when relevant recipients are present, and transmitting the processed information in a targeted manner. The device 110, the method 210 and / or the system 100 for driver assistance is / are adaptable to the individual needs of the environment and the information can be communicated via a mobile device 140 regardless of the equipment of the vehicle V or V1, V2. According to embodiments, a solution is thus provided for determining hazards, e.g., for persons P behind vehicles V or V1, V2 orin the "driver's blind spot" and the simultaneous information about this hazard to the vehicle V or V1, V2 or the driver responsible for the hazard. The solution is also possible as a "retrofit" or retrofit for vehicles V or V1, V2, V3 without separate sensors. Implementation does not require any modification of the vehicle V or V1, V2, V3. It can be realized equally well with existing mobile communications technology and with the subsequent evolution of the mobile communications network. Almost all drivers have a smartphone as a mobile device 140 and, depending on the process, the software could be downloaded via QR code, e.g., at a gate or entrance to an infrastructure environment 370, and the assistance system 100 can be used.

[0054] According to exemplary embodiments, a sensor provides information about an object at a specific location, here the protection zone 372, 474. This information is linked to the information about a hazardous area or protection zone 372, 474 to be monitored. When a vehicle V or V1, V2 enters the hazardous area or protection zone 372, 474, the vehicle V or V1, V2 is informed about the object. The position of the vehicle V or V1, V2 is determined based on the transmitted GPS data, which was determined by the mobile phone or mobile terminal 140 located in the vehicle V or V1, V2 and / or via the positioning algorithms in the 5G network, which detects the current position of the mobile phone or mobile terminal 140 located in the vehicle V or V1, V2 and forwards this to the algorithm of the device 110.

[0055] This eliminates the need for a conventional solution, which requires an additional person to monitor the area behind vehicle V or V1, V2. This eliminates the need for additional personnel, and solutions for automated container placement, for example, can be implemented. Another area of application would be a marina, for example. With the help of the assistance function presented here, ship owners can navigate their yachts more precisely to the landing site, which can reduce damage to the harbor and also to yachts. The assistance function can be used if the area of operation or the infrastructure environment 370 has suitable sensors or if these can be retrofitted. The assistance function can be used in conjunction with the sensors so that a mobile device 140 serves as an additional assistance system for a driver for defined use cases.In particular, this requires: a mobile communications network, position detection of the mobile terminal 140 and thus of the vehicle V or V1, V2 via GPS within a non-5G mobile communications network, and / or position detection of the mobile terminal 140 and thus of the vehicle V or V1, V2 from within the 5G network. For the assistance function, integration effort only exists for the connectivity of sensor systems or the at least one environmental sensor 120, 130 and the device 110 or main application. The mobile terminal 140 with the application 150 or application can be used anywhere without further integration.

[0056] If an embodiment includes an “and / or” link between a first feature and a second feature, this should be read as meaning that the embodiment according to one embodiment includes both the first feature and the second feature and according to another embodiment includes either only the first feature or only the second feature.

Claims

[1] Method (210) for driver assistance for a driver of a vehicle (V; V1, V2) in order to output assistance data (119) to a mobile terminal (140), the method (210) comprising the following steps: Reading (212) sensor data (122, 132) via a sensor interface (111) from at least one environmental sensor (120, 130), wherein the at least one environmental sensor (120, 130) is arranged in an infrastructure environment (370) that can be driven through by the vehicle (V; V1, V2), wherein the sensor data (122, 132) represent a predefined protection area (372, 474) of the infrastructure environment (370); Receiving (214) position data (152, 162) of the mobile terminal (140), wherein the mobile terminal (140) is assigned to the driver of the vehicle (V; V1, V2) and is temporarily arranged in the vehicle (V; V1, V2), wherein the position data (152, 162) represent a geographical position of the mobile terminal (140) temporarily arranged in the vehicle (V; V1, V2); Correlating (216) the sensor data (122, 132) with the position data (152, 162) to determine whether a warning situation exists, wherein it is determined that a warning situation exists if, based on the sensor data (122, 132), a vehicle (V; V1, V2) is detected in the protection area (372, 474) and, based on the position data (152, 162), it is determined that the mobile terminal (140) is arranged in the detected vehicle (V; V1, V2); and Outputting (218) assistance data (119) via a radio interface (113) to the mobile terminal (140) arranged in the detected vehicle (V; V1, V2) in the event of a detected warning situation, wherein the assistance data (119) provide information about the warning situation to the driver by means of the mobile terminal (140). [2] Method (210) according to claim 1, wherein the sensor data (122, 132) read in in step (212) of reading represent at least one person (P) detected in the infrastructure environment (370), wherein in step (216) of correlating it is determined that a warning situation exists when the at least one person (P) is located in the protection area (372, 474), wherein the assistance data (119) output in step (218) of outputting provide information about the at least one detected person (P) for the driver by means of the mobile terminal (140). [3] Method (210) according to one of the preceding claims, in which the sensor data (122, 132) read in in step (212) of reading represent at least one obstacle object (V3) detected in the infrastructure environment (370), wherein in step (216) of correlating it is determined that a warning situation exists if the at least one obstacle object (V3) is arranged in the protection area (372, 474), wherein the assistance data (119) output in step (218) of outputting provide information about the at least one detected obstacle object (V3) for the driver by means of the mobile terminal (140). [4] Method (210) according to one of the preceding claims, in which the correlating step (216) is carried out when it is determined from the position data (152, 162) that the position of the mobile terminal (140) temporarily arranged in the vehicle (V; V1, V2) lies in an activation area (375) of the infrastructure environment (370), wherein the protection area (372, 474) is arranged within the activation area (375). [5] Method (210) according to one of the preceding claims, wherein in the receiving step (214) the position data (152) are received via the radio interface (113) from the mobile terminal (140). [6] Method (210) according to one of the preceding claims, wherein in the receiving step (214) the position data (162) are received via a network interface (115) from a mobile radio network (160) in which the mobile terminal (140) is registered. [7] Device (110) which is arranged to carry out and / or control the steps of the method (210) according to one of the preceding claims in corresponding units (112, 114, 116, 118). [8] System (100) for driver assistance for a driver of a vehicle (V; V1, V2), the system (100) having the following features: a device (110) according to claim 7; the at least one environmental sensor (120, 130) which is designed to provide the sensor data (122, 132); and an application (150) on the mobile terminal (140) which is designed to convert the assistance data (119) into information about the warning situation for the driver, wherein the device (110), the at least one environmental sensor (120, 130) and the application (150) are connected to one another in a data-transmittable manner. [9] Computer program which is configured to execute and / or control the steps of the method (210) according to one of claims 1 to 6. [10] A machine-readable storage medium on which the computer program according to claim 9 is stored.

Images