Method and device for determining the position and / or orientation of a vehicle

Abstract

Method for determining the position and / or orientation of a vehicle (10), wherein at least two sensors (14) are provided which are configured to provide data relating to the position and / or orientation of the vehicle (10), and whose data are fused, characterized in that a quality measure (20) is dynamically generated for the data of each sensor (14) by means of artificial intelligence (18), and that the sensor data and the quality measures (20) are fused to determine the position and / or orientation.

Description

[0001] The invention relates to a method for determining the position and / or orientation of a vehicle, as well as a vehicle and a computer program product.

[0002] Driver assistance systems and autonomous vehicles rely on a variety of information to efficiently perform driving tasks. One piece of information that is helpful for automated driving is location data, meaning the vehicle's position and orientation within a reference coordinate system. If this information is lane-accurate, it can be very effectively used to support the decisions of the vehicle control system. An example project is autonomous valet parking (AVP).

[0003] The quality of location information, however, is highly dependent on the environmental conditions in which the vehicle is navigating and its driving state. In parking garages, tunnels, or urban canyons, for example, satellite-based positioning modules (GPS) function only with significant limitations in information quality or not at all. For this reason, modern navigation systems evaluate not only GPS but also other sensors. These sensors include, for example, wheel speed sensors. Analyzing wheel speed information also allows conclusions to be drawn about the vehicle's movement and can be used to compensate for GPS failures. However, this wheel speed-based positioning is subject to the error-causing influence of wheel slip, which occurs particularly when cornering or braking.

[0004] The publication DE 10 2007 055 639 A1 proposes the evaluation of sensor data, such as acceleration or yaw rate data, using a neural network to determine the current state of a vehicle.

[0005] Document DE 10 2006 045 115 A1 proposes the fusion of sensor data to improve the target or object tracking of a vehicle.

[0006] Current approaches to account for the error behavior of positioning modules during information fusion are primarily model-based. Developing these error models is very complex and, so far, has not resulted in lane-accurate positioning using mass-market sensors.

[0007] DE 102009046595 A1 discloses a map-supported positioning sensor system in which GPS data and data from an inertial navigation system are fused, for example, with a Kalman filter.

[0008] DE 102012216207 A1 discloses a method for determining the attitude data of a vehicle based on vehicle dynamics data and position data. The vehicle dynamics data are filtered based on the detected distance. Factors such as noise can be taken into account by using a state observer or a Kalman filter as a filter.

[0009] US 8892271 B2 discloses a method for data transmission to a vehicle, wherein Kalman filters or neural networks are used for optimal use of information such as position, speed and acceleration of the vehicle.

[0010] The invention is based on the objective of improving the location tracking of a vehicle.

[0011] This problem is solved by a method according to claim 1, a vehicle according to claim 7 or a computer program product according to claim 10.

[0012] The inventive method for determining the position and / or orientation of a vehicle, wherein at least two sensors are provided which are configured to provide data relating to the position and / or orientation of the vehicle, and whose data are fused, comprises dynamically generating a quality measure for the data of each sensor by means of artificial intelligence and fusing the sensor data and the quality measures to determine the position and / or orientation.

[0013] The method according to the invention has the advantage that the quality of every available piece of localization information is correctly assessed, resulting in an optimal fusion of this information. Optimal in this context means that the maximum information content is utilized through this fusion. Higher localization accuracy is then only possible by using additional localization information. The modular application of artificial intelligence (AI) proposed here for the quality assessment of localization modules for use in data fusion advantageously leads to lane-accurate localization using only mass-market sensors. Further advantages include simple parameterization and a high utilization rate of the available information, so that the use of mass-market sensors is sufficient to achieve lane accuracy.

[0014] The process can be described as hybrid self-localization, since the data from the sensors or positioning modules and their quality assessment are incorporated into the data fusion to determine position and / or orientation. The term "lane-accurate" can be defined as meaning that the determined most probable position of the vehicle lies within a lane. The sensors include all sensors configured to provide data or measurements relating to the position and / or orientation of the vehicle.

[0015] A covariance matrix can be calculated for each sensor based on its data. This covariance matrix can consist of the variances and covariances of the sensor data. The covariance matrix allows for a simple implementation of a performance measure for a positioning module.

[0016] The covariance matrix can be calculated depending on the driving situation and / or the sensor's acquisition conditions. Unlike static methods, here the covariance matrices are calculated dynamically, meaning they adapt to the specific situation. This recalculation is performed using artificial intelligence. The specific situation can be determined by the driving situation, i.e., by data from the vehicle or sensors related to the vehicle, and / or by the sensor's acquisition conditions, such as sensor accuracy or the vehicle's surroundings (fog can reduce the accuracy of optical sensors).

[0017] An artificial neural network or a Bayesian network can be used to generate the quality measure. These artificial intelligence algorithms can be adapted with high flexibility and minimal effort to evaluate the quality of any tracking module.

[0018] The sensor data and quality measures can be fused using a Kalman filter. A Kalman filter is well-suited for such tasks and easy to implement.

[0019] The artificial intelligence can be parameterized with reference measurement data before the determination phase. This means that the parameterization takes place before the actual runtime phase, which simplifies operation.

[0020] The vehicle according to the invention comprises a device for determining the position and / or orientation of a vehicle and at least two sensors for determining location and / or orientation. The same advantages and modifications apply as described above.

[0021] The device for determining the position and / or orientation of a vehicle, comprising at least two inputs for sensor data for position and / or orientation determination and a data fusion module configured for fusing the data, includes a quality assessment module for each input, configured to dynamically generate a quality measure for the received data using artificial intelligence; communication between the quality assessment modules and the data fusion module; and the data fusion module being configured to fuse the sensor data and the quality measures to determine position and / or orientation. The same advantages and modifications apply as previously described.

[0022] The quality assessment modules can each be configured to calculate a covariance matrix based on sensor data and / or vehicle data. This allows for the implementation of adaptive or dynamic quality assessment, resulting in improved accuracy.

[0023] AND gates can be connected to the inputs of the data fusion module, with each input connected to an input for sensor data and the corresponding quality assessment module. This linking of the sensor data and the corresponding quality measures of the quality assessment modules is easy to implement in terms of circuitry. Alternatively, the linking, evaluation, or weighting of the factors can take place within the data fusion module itself. This can be implemented there in software and / or hardware.

[0024] The computer program product according to the invention comprises program code for carrying out the method described above when the program product is executed on a computing unit or a device for determining the position and / or orientation of a vehicle. The same advantages and modifications apply as described above.

[0025] The invention is explained below using exemplary embodiments with reference to the accompanying drawings. These show: Fig. 1 a block diagram of a device for determining the position and / or orientation of a vehicle according to a first embodiment of the invention. Fig. 2 a block diagram of a device for determining the position and / or orientation of a vehicle according to a second embodiment of the invention.

[0026] Fig. Figure 1 shows a device 12 arranged in a vehicle 10 for determining the position and / or orientation of the vehicle 10. At least two tracking modules 14 are provided in the vehicle 10. The tracking modules 14 can contain sensors and / or have access to sensors and process the sensor data. Examples of tracking modules 14 are absolute tracking systems such as GPS systems, relative tracking systems such as odometry, 2D inertial measurement platforms, stereo cameras, and similar systems.

[0027] The device 12 has an input or a connection to a bus system or network for each of the tracking modules 14, via which communication takes place. Each tracking module 14 is connected to a quality assessment module 16 via this input. The quality assessment module 16 evaluates the quality of the respective sensor signal or the sensor data. For this purpose, the quality assessment module 16 contains an AI-based quality assessment 18. An artificial intelligence algorithm, such as an artificial neural network or a Bayesian network, is implemented in the quality assessment 18.

[0028] The quality assessment 18 generates a covariance matrix 20 as a measure of quality. The covariance matrix contains variance and covariance values ​​of the sensor data and thus allows conclusions to be drawn about the quality and therefore the reliability of the data from the associated positioning module 14. The covariance matrix 20 is dynamically generated or adapted, meaning it is adjusted depending on the respective driving situation or environmental influences, such as weather, which affect the sensor data. The AI-based quality assessment 18 performs such adaptations to new or changing situations. For this purpose, the quality assessment 18 is parameterized with data in a setup phase before operation. This data includes, for example, reference measurement data. After the initial parameterization, the AI-based quality assessment 18 can then independently adapt to changing conditions and thus generate a new or modified covariance matrix 20 or a similar measure of quality.

[0029] The covariance matrix 20 is output by the quality assessment module 16 to an input of an AND gate 22. Several AND gates 22 are provided, each communicating with one input of the quality assessment module 16. A second input of the AND gate 22 is connected to the corresponding location module 14. Thus, for each sensor or location module 14, an individual signal path is formed, consisting of the quality assessment module 16 with quality assessment 18 and covariance matrix 20, as well as an AND gate 22. The number of parallel signal paths depends on the number of input variables or location modules 14.

[0030] The quality factor is digitally input via the AND gates 22. These AND gates allow the data from the tracking module 14 to be passed on or blocked. Alternatively, other signal processing circuits are provided that allow the data from the tracking module 14 to be weighted. This can be implemented continuously, for example via artificial intelligence, or in steps, for example at 10 percent intervals, using further logic circuits.

[0031] The outputs of all AND gates 22 are connected to a data fusion module 24. In the data fusion module 24, the results of the individual signal paths—that is, the respective results of the data and quality assessment available at the output of the AND gate 22—are fused together. This results in a comprehensive analysis of different sensors. The data fusion module 24 contains a Kalman filter for the data fusion.

[0032] The data fusion module 24 outputs a determination 26 of position and / or orientation, which is available to other systems of the vehicle 10, such as assistance systems or an autonomous driving system.

[0033] Fig. Figure 2 shows a further embodiment of a device 120 arranged in a vehicle 10 for determining the position and / or orientation of the vehicle 10 in a block diagram. The location module 14 available in the vehicle 10 are arranged in a block 28, "Location Method". The quality ratings 18 are arranged in a block 30, "Location Quality Determination". Finally, the data fusion module 24 is arranged in the block 32, "Data Fusion".

[0034] Each location module 14 is assigned a quality rating 18, which communicates with the corresponding location module 14, allowing data or location information to be transmitted from the location module 14 to the quality rating 18. The quality rating 18 uses artificial intelligence, for example an artificial neural network or a Bayesian network, to generate a location quality score. This location quality score is the measure of the accuracy of the location information from the location module 14 and may, for example, take the form of a covariance matrix.

[0035] The location accuracy and location information are fed into data fusion module 24. In data fusion module 24, the location information and location accuracy are fused to generate a determination 26 of position and / or orientation, which is then output.

[0036] The method and device utilize artificial intelligence algorithms such as artificial neural networks (ANNs) or Bayesian networks (BNs), which can be adapted with high flexibility and ease to evaluate the performance of each tracking module 14. Parameterizing the artificial intelligence is possible with minimal effort using reference measurement data. A reference is used only for parameterization, not during operation. The resulting accuracy is lane-specific, achieved exclusively using mass-market sensors. Reference symbol list 10 vehicles 12, 120 Device 14 Location module 16 Quality Assessment Module 18 Quality assessment 20 Covariance matrix 22 AND gates 24 Data Fusion Module 26 Determining position and / or orientation 28 Block location method 30 Block Location Quality Determination 32 Block Data Fusion

Claims

[1] Method for determining the position and / or orientation of a vehicle (10), wherein at least two sensors (14) are provided which are configured to provide data relating to the position and / or orientation of the vehicle (10), and the data of which are fused, characterized by , that for the data of each sensor (14) a quality measure (20) is dynamically generated by means of artificial intelligence (18) and that the sensor data and the quality measures (20) are fused to determine position and / or orientation. [2] Method according to claim 1, characterized by , that for each sensor (14) a covariance matrix (20) is calculated based on its data. [3] Method according to claim 2, characterized by , that the covariance matrix (20) is calculated depending on the driving situation and / or a detection situation of the sensor (14). [4] Method according to any one of the preceding claims, characterized by, that an artificial neural network or a Bayesian network is provided for the generation of the quality measure (20). [5] Method according to any one of the preceding claims, characterized by , that the sensor data and the quality measures (20) are fused with a Kalman filter (24). [6] Method according to any one of the preceding claims, characterized by , that the artificial intelligence (18) is parameterized with reference measurement data before determination. [7] Vehicle comprising two sensors (14) for determining location and / or orientation and a device for determining the position and / or orientation of a vehicle (10), with at least two inputs for data from the sensors (14) for determining location and / or orientation and a data fusion module (24) set up for fusing the data, characterized by, that for each input a quality assessment module (16) is provided which is set up to dynamically generate a quality measure (20) for the received data by means of artificial intelligence (18), that the quality assessment modules (16) communicate with the data fusion module (24), and that the data fusion module (24) is set up to fuse the sensor data and the quality measures (20) to determine position and / or orientation. [8] Vehicle according to claim 7, characterized by , that the quality assessment modules (16) are each set up to calculate a covariance matrix (20) depending on the data of the sensors (14) and / or data of the vehicle (10). [9] Vehicle according to claim 7 or 8, characterized by , that AND gates (22) are connected upstream of the inputs of the data fusion module (24), the inputs of which are each connected to an input for data of the sensor (14) and the corresponding quality assessment module (16). [10] Computer program product with program code for carrying out the method according to any one of claims 1 to 6, when the program product is executed on a computing unit or a device (12; 120) for determining the position and / or orientation of a vehicle (10).

Images