Device, means of transport and method for supporting the guidance of a first means of transport through a narrow passage using externally determined environmental information

DE102017218680B4Active Publication Date: 2024-11-14VOLKSWAGEN AG
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102017218680
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2017-10-19
Publication Date
2024-11-14
Estimated Expiration
2037-10-19

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for assisting the guidance of a first means of locomotion (10) through a narrow passage by means of a second means of locomotion (11) comprising the steps: - Determining a predefined collision relevance of the environment object (1) by the first means of locomotion (10), - Determining the necessity of the first means of transport (10) for a request for data from the second means of transport (11), - Request by the first means of transport (10) for the recording and / or provision of data by the second means of transport (11), - Determining (200) an environmental object (1) in an environment of the first means of transport (10) by means of an environmental sensor (2) of the second means of transport (11), - Sending (500) data from the environmental sensors (2) by the second means of transport (11), - Receiving (600) the data in the first means of transport (10) and - Determining information about the environment object (1) using the data.
Need to check novelty before this filing date? Find Prior Art

Description

State of the art

[0001] The present invention relates to devices, means of transport, and methods for supporting the guidance of a first means of transport. In particular, the present invention relates to the use of environmental data determined by a second means of transport in a first means of transport.

[0002] In the current state of the art, sensors are increasingly being used to detect the vehicle's surroundings and to inform the user about their own vehicle situation. This data is sometimes automatically used for longitudinal and / or lateral guidance of the EGO vehicle. However, situations can arise in which the environmental sensors installed in the EGO vehicle are either not suitable for adequately resolving surrounding objects, and / or the perspective of the installed environmental sensors is not suitable for obtaining the necessary information about the nature and / or location of the surrounding object (for example, with respect to the EGO vehicle).

[0003] DE 10 2012 210 344 A1 discloses a method for detecting collision hazards using car-to-car communication, wherein lane detection is improved by exchanging a vehicle cooperation message between two vehicles.

[0004] DE 10 2011 078 288 A1 discloses a motor vehicle with a driver warning device, whereby the driver is assisted by projecting traffic-situation-specific information onto a road surface. The information projected onto the road surface can, for example, originate from overtaking vehicles and alert the driver to a potential risk of collision.

[0005] US 2014 / 0009307 A1 discloses a collision selection system of a land vehicle that may be configured to coordinate sensor operation with one or more other sensor systems of one or more other land vehicles.

[0006] EP 2 122 598 B1 relates to a method for detecting a traffic situation which is not visible to a first vehicle by means of a sensor system of a second vehicle.

[0007] DE 10 2015 221 439 B3 discloses a method for displaying sensor data of one or more motor vehicles via a human-machine interface of another motor vehicle.

[0008] DE 10 2006 055 344 A1 discloses a method for communication between two vehicles, wherein a first vehicle planning an overtaking maneuver cannot perceive the road situation due to a second vehicle obstructing its view. The obstructing second vehicle can use sensors to detect the traffic situation that could be relevant to the overtaking maneuver of the first vehicle and send the sensor data to the first vehicle planning the overtaking maneuver.

[0009] DE 10 2013 212 010 A1 describes a method for supporting a vehicle and a following vehicle in navigating through a bottleneck. It also describes a method for managing survey information to support vehicle maneuvers through bottlenecks.

[0010] Based on the aforementioned prior art, it is an object of the present invention to better exploit the theoretical possibilities for supporting drivers of a means of transport and thereby make participation in road traffic safer and more comfortable.

[0011] The above-mentioned object is achieved according to the invention by a method for assisting the guidance of a first means of transport through a narrow section by means of a second means of transport. The first means of transport could also be referred to as an ego means of transport. The second means of transport could also be referred to as a third-party means of transport, other road users, or the like. The method relates in particular to the maneuvering of the first means of transport through the narrow section. A narrow section can be understood as a traffic situation which requires a high degree of lateral guidance precision from the driver of the first means of transport in order to avoid a collision with an object in the surroundings. In particular, the guidance of the means of transport through the narrow section can comprise a maneuvering maneuver and / or driving at walking pace.According to the invention, the request for data by the first means of transport is tied to the presence of a collision relevance of the environmental object, which has a predefined relationship to a reference. In other words, it is first determined to what extent the environmental object is collision-relevant for the movement of the first means of transport, and only in response to the presence of the collision relevance of the environmental object is the request for the data and / or the processing of the data triggered. The collision relevance can result from a predefined spatial relationship (distance and / or state of motion) between the environmental object and the first means of transport and / or from the nature of the environmental object (solidity, mass, density, dimensions, position relative to the current trajectory, etc.).In a further step, in order to minimize the data communication effort between the first and second means of transport, the request for data from the environmental sensor system of the second means of transport by the first means of transport is used as the trigger for executing the method according to the invention. In other words, the necessity or at least the possibility of advantageously using the data from the environmental sensor system of the second means of transport is determined in the first means of transport, and in response, a signal is sent to the environment of the first means of transport.By receiving this signal, the second means of transport is prompted according to the invention to provide the data acquired by means of its environmental sensors to the first means of transport or even to record data relating to its surroundings only in response to the signal from the first means of transport and then provide it. In a further step, an environmental object (e.g. statistical or mobile, such as a vehicle, a person, an animal) is determined in an environment of the first means of transport. This can be done by means of an environmental sensor of the second means of transport. In other words, both the first means of transport and the second means of transport are in the vicinity of the environmental object. The two means of transport can be at different distances from the environmental object.In particular, the first means of transport and / or the second means of transport can have an optical axis / clear view of the surrounding object, so that the surrounding sensor system of the second means of transport can directly detect the surrounding object. The second means of transport can thus map the surrounding object in data form and, in a second step, send data from the surrounding sensor system to the first means of transport. This can be done directly or indirectly (e.g., via a server, via a telecommunications network, or similar). In particular, an ad hoc data connection between the first means of transport and the second means of transport can be used to send the data from the surrounding sensor system to the first means of transport. The data is then received in the first means of transport. This can be done, for example, via a wireless communication connection.Alternatively or additionally, optical and / or acoustic signals can be used to send the data relating to the surrounding object to the first means of transport or to be received by the first means of transport. Accordingly, the first means of transport can have an acoustic sensor (microphone or similar) and / or a light sensor (e.g. camera or similar) and / or an antenna for receiving electromagnetically coded data. Information about the surrounding object is determined beforehand or subsequently. In other words, the first means of transport can obtain information about the surrounding object based on the data. To do this, the first means of transport can evaluate / interpret the data. Alternatively or additionally, the information about the surrounding object can already be derived from the data in the second means of transport and / or in a server used for communication between the means of transport.In particular, a computationally intensive algorithm can be used in the server to derive suitable information from a large amount of data and even initiate appropriate measures. In summary, the environmental sensors of a second means of transport are used to assist the first means of transport in passing through the narrow passage by making the sensor-determined data available to the first means of transport. Due to the possibly different environmental sensors, or at least the different perspective of the environmental sensors of the second means of transport on the surrounding object and / or the first means of transport, a broader and possibly more informative database can be created, which can support the guidance of the first means of transport.

[0012] The subclaims show preferred developments of the invention.

[0013] The data determined by the environmental sensors of the second means of transport can, for example, represent a distance between the first means of transport and the surrounding object. This does not preclude the data from containing further information. In particular, the data can be so-called raw data, which requires interpretation by the first means of transport in order to obtain collision-relevant information. The distance between the means of transport and the surrounding object can, for example, be contained in the data in image form, so that the information about the surrounding object must be obtained by the first means of transport from the image data. This does not preclude the data from containing a reference on the basis of which the information must be obtained.

[0014] The information about the surrounding object that can be obtained based on the data can also represent the distance between the first means of transport and the surrounding object. In other words, the distance and / or a direction of movement and / or a speed between the first means of transport and the surrounding object can be determined from the information. In other words, the information can be understood as the basis for an investigation into which maneuvers are suitable for avoiding a collision with the surrounding object. As explained above, the information can be obtained from the data by an evaluation unit within the first means of transport.

[0015] Preferably, the distance can be compared with a predefined reference. In other words, it can be determined that the distance between the first means of transport and the surrounding object has a predefined relationship to a threshold value, a characteristic map and / or a characteristic curve. Depending on the relationship of the distance to the predefined reference, different measures can be initiated. For example, in response to a predefined result of the comparison, a signal can be output in the first means of transport (e.g., to a driver of the first means of transport and / or to a driving robot / driver assistance system of the first means of transport). The signal can provide assistance in initiating suitable measures to guide the means of transport through the narrow section or can already suggest specific maneuvers (longitudinal and / or lateral guidance maneuvers).

[0016] If the data is sent essentially as raw sensor data from the second means of transport to the first means of transport, the delay that would be caused by evaluating / interpreting the data in the second means of transport can be avoided. Furthermore, the data is only examined by the evaluation unit of the first means of transport when necessary, thereby reducing the computational effort. Furthermore, a possibly more powerful evaluation unit in the first means of transport can perform a combined evaluation of the data received from the second means of transport with data acquired by its own environmental sensors. In this way, the database acquired by the own environmental sensors can be supplemented in a suitable manner with the data received from the second means of transport, if necessary.Additionally, the significance of the processed data can be increased if the data from the first and second modes of transport are integrated beforehand. For example, uncertainties about the exact location of objects can be reduced, or objects overlooked by one mode can be supplemented by the other, and conversely, erroneously seen objects can be dispelled using the data from the other mode.

[0017] In particular, if the data acquired by the environmental sensors of the first means of transport and the second means of transport are to be evaluated in combination, the data that the first means of transport receives from the second means of transport can be weighted against the data that the first means of transport has acquired using its own environmental sensors. The weighting can be based, for example, on the suitability of the respective perspectives of the environmental sensors on the bottleneck, the surrounding object, and / or the first means of transport. The nature of the operating principle of the environmental sensors of the first means of transport and the second means of transport can also be taken into account in the weighting / by the weighting.The signal can then be output in the first means of transport depending on the weighted data, whereby the signal represents the best possible information basis for guiding the first means of transport through the bottleneck.

[0018] The environmental sensor system can, for example, comprise a camera (2D / 3D camera) and, alternatively or additionally, a laser scanner / LIDAR sensor and, alternatively or additionally, an ultrasonic sensor (ultrasonic transceiver or similar) and, alternatively or additionally, a radar sensor. In particular, the environmental sensor system used in the first means of transport to collect the environmental data can comprise a different one of the aforementioned sensor types, i.e., the environmental sensor system of the second means of transport that was used to collect the data. In this way, the broadest possible database can be created to support the guidance of the first means of transport through the narrow passage.

[0019] In particular, if the data request involves a directed transmission of information (e.g., optical, electromagnetic, and / or acoustic), the second means of transportation can, based on the request, specifically map those areas of its own environment and transmit corresponding data in which the first means of transportation and / or the surrounding object are suspected. This can reduce the amount of data to be collected and / or transmitted, thereby reducing the data communication and analysis effort required to determine information about the surrounding object.

[0020] To ensure successful determination of the environmental data by the second means of transport, transmission of the data to the first means of transport, and timely consideration of the information regarding the environmental object by the first means of transport, it can first be determined whether the first means of transport is falling below a predefined speed, in response to which the aforementioned steps of the method according to the invention are carried out. For example, traveling at walking pace by the first means of transport can be used as a prerequisite. Similarly, predefined speeds of 10 km / h, 20 km / h, 30 km / h, or 40 km / h can be maintained in order to initiate the method according to the invention.Of course, corresponding speed thresholds can also be used as a basis for the speed of the second means of transport, ensuring a sufficiently long spatial relationship between the first means of transport, the second means of transport, and the surrounding object, and preventing unnecessary data from being collected and exchanged. Furthermore, the second means of transport can also determine the collision relevance for the first means of transport with a surrounding object and, conversely, initiate data transmission on its own. For example, the first means of transport could continue to travel very fast but not even notice that there is a high risk of collision.

[0021] According to a second aspect of the present invention, a device is proposed for assisting the guidance of a first means of transport through a narrow passage by means of a second means of transport. The means of transport can be configured as road vehicles, in particular as cars, vans, trucks, motorcycles, or the like. The device comprises a data input, which can, for example, comprise a bus subscriber. Additionally, the device comprises an evaluation unit (e.g., a processor, an electronic control unit, a microcontroller, or the like) provided with the data input, which can evaluate the data received via the data input to determine information regarding the surrounding object.By means of the data input, the evaluation unit is thus configured to receive data sent by the second means of transport, representing an environmental object in an environment of the first means of transport, which has been determined by means of environmental sensors of the second means of transport. Based on the received data, the evaluation unit of the first means of transport can determine information about the environmental object. In other words, the device is intended for use in the first means of transport in order to support / enable the method according to the invention, which is based on the transmission of environmental data from a second means of transport to a first means of transport, via the hardware of the first means of transport. Furthermore, one could assume that the calculations can take place in a "cloud" or on an external server and that only certain results are reported to the first means of transport.

[0022] According to a third aspect of the present invention, a device is proposed for assisting the guidance of a first means of transport through a narrow passage by means of a second means of transport. The device comprises a data input and an evaluation unit, as described by way of example in connection with the second aspect of the invention. Additionally, a data output is provided, which can be connected, for example, to a wireless communication unit for transmitting data to an external means of transport. The evaluation unit is configured to use the data input, using an environmental sensor system of the second means of transport, to determine data representing an environmental object in an environment of the first means of transport.The evaluation unit is configured to send the data to the first means of transport via the data output in order to assist the first means of transport in navigating through the narrow passage. It can be seen that both the device according to the second aspect of the invention and the device according to the third aspect of the invention are preferably involved in the implementation of a method according to the invention. These devices are arranged in a first and a second means of transport, respectively, in order to configure the two means of transport for participation in a method according to the first aspect of the present invention.

[0023] According to a fourth and a fifth aspect of the present invention, respective means of transportation are proposed, each comprising a device according to the second aspect of the invention and a device according to the third aspect of the invention, respectively. The means of transportation can be configured as a car, van, truck, motorcycle, or the like, thus enabling improved guidance of the first means of transportation through a narrow passage due to an object in the surroundings.

[0024] Individual aspects and features as well as embodiments of the present invention are presented below without limiting the subject matter defined by the appended claims: More and more vehicles are equipped with Car2X or other data transmission mechanisms (e.g., Wi-Fi, Bluetooth, LTE). These can be used to transmit environmental data from one vehicle to another. This transmission allows one vehicle (the first vehicle) to close gaps in its own environmental model (e.g., due to sensor-related or installation-related dead zones) in its own environmental model in order to reduce uncertainties in its own environmental model and thus offer better functional performance. For example, two vehicles passing each other in narrow spaces can exchange data and thus implement a bottleneck assistant. The bottleneck assistant calculates a suitable driving trajectory, which can then be followed either by the driver themselves (e.g., through driving instructions via HMI / MMI) or by the vehicle automatically. The function can also determine whether passing is even possible at this point and issue appropriate instructions (e.g.,One vehicle should reverse and let the other vehicle pass first. The vehicle's sides are particularly critical when maneuvering in tight spaces, as there are typically relatively few sensors installed there. For example, the two vehicles can exchange camera data, giving the driver a kind of "mirror" of themselves, showing how tight the situation is at the moment. Alternatively, the camera data from the passing vehicle could be used to generate a large area-view image (a top-down view of the situation), which helps the driver better assess the situation.

[0025] An algorithm can then use such a representation to determine optimal driving instructions for both vehicles, e.g. to get out of a deadlock situation.

[0026] The corresponding calculations can be performed either directly in the vehicle or in a backend (server). Performing the calculations in the server could offer the advantage of using a comparatively complex learning process to continuously improve the passing trajectories and driving instructions over time.

[0027] Embodiments of the present invention are described in detail below with reference to the accompanying figures. They show: Fig. 1 a schematic plan view of a bottleneck situation of two means of transport designed according to the invention with two devices designed according to the invention during the execution of a method according to the invention; and Fig. 2 a flowchart illustrating steps of an embodiment of a method according to the invention.

[0028] Fig. 1 shows a road situation in which a first means of transport in the form of a car 10 has to negotiate a narrow section caused by two surrounding objects 1a, 1b. In particular, the surrounding object 1a is not located within the detection range of the ultrasonic sensor 2a, which, like an antenna 6, is connected to a data input 3 of an electronic control unit 4 as an evaluation unit. The electronic control unit 4 can control a screen 7 via a data output 5 in order to display information regarding the surrounding objects 1b, 1a to a driver (not shown) of the car 10. A second means of transport in the form of a car 11 is located beyond the narrow section, so that the surrounding object 1a lies within the detection range 8 of a LIDAR sensor 2b.The data recorded by the LIDAR sensor 2b is received via a data input 3 of an electronic control unit 4, processed if necessary, and fed via a data output 5 to an antenna 6, by means of which the passenger car 11 can send an ad hoc message to the passenger car 10 containing the data for detecting the position of the surrounding object 1a as well as the position of the passenger car 10. In particular, a distance d between the passenger car 10 and the surrounding object 1a can be determined based on the wirelessly received data within the passenger car 10. In return, the passenger car 10 can send information regarding the surrounding object 1b, which is not within the detection range 8 of the LIDAR sensor 2b of the passenger car 11, to the passenger car 11 via the antenna 6, from which the passenger car 11 in turn receives assistance in passing the narrow section.

[0029] Fig.2 shows steps of an exemplary embodiment of a method according to the invention for assisting the guidance of a first means of transport through a narrow passage by means of a second means of transport. In step 100, it is determined that a predefined speed is being undershot by the first means of transport and / or the second means of transport. In other words, the first means of transport is traveling slower than a predefined speed threshold, so that the execution of the method according to the invention has a good chance of successfully assisting in the guidance of the first means of transport. In step 200, an environmental object in the vicinity of the first means of transport is detected by an environmental sensor system of the first means of transport. In this case, it is determined that the environmental object has a minimum collision relevance for the guidance of the first means of transport.In step 300, therefore, a request for data from the environmental sensor system is sent by the first means of transport into its surroundings. The request is then received by a second means of transport, which in step 400 determines the environmental object in the vicinity of the first means of transport using its own environmental sensor system. In step 500, data from the environmental sensor system is sent by the second means of transport and received in the first means of transport in step 600. In step 700, the data received by the first means of transport is weighted against the data acquired by the environmental sensor system of the first means of transport. The perspective and sensor principle of the respective environmental sensor system can be taken into account here. Information about the environmental object is then determined.For this purpose, in step 800, the distance d between the surrounding object and the first means of transport is compared with a predefined reference. In response to a predefined result of the comparison, a signal is output to the user and to a driver assistance system in the first means of transport in step 900. This signal enables the driver assistance system to independently initiate a measure to avoid a collision when passing the narrow section. The same applies to the user if they opt for manual guidance of the first means of transport.

[0030] As a result, the method according to the invention leads to an improved use of the available information in supporting the guidance of a means of transport. List of reference symbols 1 environment object 2 Environmental sensors 3 Data input 4 electronic control unit 5 Data output 6 Antenna 7 screen 8 Detection range 10 cars 11 cars 100-900 process steps d distance

Claims

[1] Method for supporting the guidance of a first means of transport (10) through a narrow passage by means of a second means of transport (11), comprising the steps: - determining a predefined collision relevance of the surrounding object (1) by the first means of transport (10), - determining a need for the first means of transport (10) to request data from the second means of transport (11), - requesting by the first means of transport (10) a recording and / or provision of data by the second means of transport (11), - Determining (200) an environmental object (1) in an environment of the first means of transport (10) by means of an environmental sensor system (2) of the second means of transport (11), - sending (500) data from the environmental sensors (2) by the second means of transport (11), - receiving (600) the data in the first means of transport (10) and - Determining information about the environment object (1) based on the data. [2] Method according to claim 1, wherein the data represent a distance (d) between the first means of transport (10) and the surrounding object (1). [3] Method according to claim 1 or 2, wherein the information represents a distance (d) between the first means of transport (10) and the surrounding object (1). [4] The method of claim 2 or 3, further comprising - comparing (800) the distance (d) with a predefined reference and in response to a predefined result of the comparison - Outputting (900) a signal in the first means of transport (10). [5] Method according to one of the preceding claims, wherein the data are raw sensor data of the environmental sensor system (2). [6] Method according to one of the preceding claims further comprising - weighting (700) of the data against data acquired by environmental sensors (2) of the first means of transport (10) and - Outputting a signal in the first means of transport (10) as a function of the weighted data. [7] Method according to one of the preceding claims, wherein the environmental sensor system (2) - a camera and / or - a LIDAR sensor and / or - an ultrasonic sensor and / or - includes a radar sensor. [8] Method according to one of the preceding claims further comprising - Sending (300) a request for data from the environmental sensor system (2) by the first means of transport (10). [9] Method according to one of the preceding claims further comprising - Determining (100) whether the speed of the first means of transport (10) falls below a predefined speed. [10] Device for supporting the guidance of a first means of transport (10) through a narrow passage by means of a second means of transport (11) comprising - a data input (3) and - an evaluation unit (4), wherein the evaluation unit (4) is arranged - by means of the data input (3), - to determine a predefined collision relevance of the surrounding object (1) by the first means of transport (10), in response to the presence of the collision relevance - to determine a need for a request by the first means of transport (10) for data of the second means of transport (11), - to request the recording and / or provision of data by the second means of transport (11) by means of the first means of transport (10), - to receive data sent by the second means of transport (11) representing an environmental object (1) in an environment of the first means of transport (10), which has been determined by means of an environmental sensor system (2) of the second means of transport (11), and - to determine information about the environment object (1). [11] Means of locomotion (10, 11) comprising a device according to claim 10.

Citation Information

Patent Citations

  • method of wireless communication between vehicles

    DE102006055344A1

  • Vehicle e.g. passenger car, has projection device to project light distribution on track in visible range of driver for warning driver, where light distribution changes with time as long as detection device detects traffic condition

    DE102011078288A1

  • Vehicle cooperative control unit for vehicle, has passive landmark comprising dividing strip between two lanes of roads, and control unit sending vehicle cooperative message to receiver outside of vehicle

    DE102012210344A1

  • Method and device for assisting a vehicle through a narrow passage, method for assisting a following vehicle through a narrow passage, and method for managing survey information to assist vehicles through narrow passages.

    DE102013212010A1

  • Method and device for selecting and transmitting sensor data from a first to a second motor vehicle

    DE102015221439B3