Method and system for determining an environment model for a vehicle

DE102018217840B4Active Publication Date: 2025-07-10VOLKSWAGEN AG
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
DE102018217840
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-10-18
Publication Date
2025-07-10
Estimated Expiration
2038-10-18

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for determining an environment model for a vehicle (1), in which an initial position estimate for the vehicle (1) is recorded; map data are recorded, wherein the map data comprise information about the spatial arrangement of geographical areas (37, 38, 39) and the geographical areas (37, 38, 39) are assigned to different area categories; Environmental data are recorded in a recording room (36); objects (32, 33, 34, 35) are detected based on the environmental data, wherein each detected object (32, 33, 34, 35) is assigned an object position and an object category, and wherein the detected objects (32, 33, 34, 35) comprise dynamic objects; and the environment model is determined on the basis of the detected objects (32, 33, 34, 35); wherein assignment rules are provided which define an assignment of the object categories to the area categories, wherein the detection of the objects (32, 33, 34, 35) takes place depending on the assignment rules.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for determining an environment model for a vehicle, in which an initial position estimate for the vehicle is acquired and map data is acquired, wherein the map data comprises information about the spatial arrangement of geographical areas and the geographical areas are assigned to different area categories. Environmental data is acquired in a detection space, and objects are detected based on the environmental data, wherein each detected object is assigned an object position and an object category. The environment model is determined based on the detected objects.The invention further relates to a system for determining an environment model for a vehicle, comprising a position detection unit for detecting an initial position estimate for the vehicle and a map data detection unit for detecting the map data based on the initial position estimate, wherein the map data comprises information about the spatial arrangement of geographical areas and the geographical areas are assigned to different area categories. The system further comprises an environment data detection unit for detecting environmental data in a detection space and a detection unit for detecting objects based on the environment data and for assigning an object position and an object category to each detected object. It further comprises an environment model determination unit for determining the environment model based on the detected objects. The invention also relates to a computer program product.

[0002] When vehicle sensors and systems detect objects, misdetections often occur. For example, data can be misinterpreted if the side of a truck is mistaken for a house wall, or an incorrect classification can occur if, for example, a bike path marking is mistaken for a lane marking on the road. If the detected objects are used to perform navigation or determine a vehicle's position, this can lead to incorrect results.

[0003] It is known to use multiple sensors and perform a fusion of the sensor data in order to achieve more reliable object detections.

[0004] US 2017 / 0 337 435 A1 proposes a method for detecting objects in which images are captured with a camera. First, a coarse detection is performed, in which objects are detected in non-consecutive images. These objects are then analyzed in a fine detection.

[0005] In the method described in US 2017 / 0 008 521 A1 for calibrating a speed indicator for an autonomous vehicle, landmarks are detected in a large number of images and the speed of the vehicle is calculated based on their movement relative to the vehicle.

[0006] US 2017 / 0 350 712 A1 describes a method for determining the position of a vehicle. Features in the vehicle's surroundings are extracted and the probability that the objects are stationary is determined. Based on these stationary objects, the vehicle's own position is corrected.

[0007] JP 2014 - 145 666 A describes a navigation system that issues driving instructions relative to a specific object, such as a shop sign. This takes into account how well the object can be detected by the vehicle.

[0008] JP 2008 - 51 612 A describes a system for detecting landmarks. A vehicle camera captures data and detects landmarks. A check is performed to determine whether the conditions are sufficient for reliable detection. If the detected landmarks deviate from the information on a centrally provided map, this is only reported to the control center if the conditions were sufficiently good.

[0009] DE 10 2014 204 383 A1 describes a driver assistance system with improved object recognition.

[0010] DE 10 2013 211 109 A1 describes a driver assistance system that uses an environment model as a database for situation analysis, driving planning, and / or vehicle control. For this purpose, the assistance device has at least one sensor that scans the vehicle's surroundings and stores an environment model of the scanned environment in a control unit.

[0011] DE10 2017 201 669 A1 describes a method for updating a digital map for locating motor vehicles. In this method, environmental information from a vehicle is acquired to update the digital map and compared with environmental information stored on the digital map.

[0012] Finally, the subsequently published DE 10 2018 117 660 A1 describes a method for determining a vehicle position, in which preliminary vehicle position data and environmental data are acquired, landmark measurement data for detected landmarks in the vehicle's surroundings are determined based on the environmental data, and map data is acquired, wherein the map data includes prior landmark data. Optimized vehicle position data are then determined, and the vehicle position is determined based on the optimized vehicle position data.

[0013] The present invention is based on the object of providing a method, a system and a computer program product that allow particularly reliable detection of objects in the surroundings of the vehicle.

[0014] According to the invention, this object is achieved by a method having the features of claim 1, a system having the features of claim 12, and a computer program product having the features of claim 14. Advantageous embodiments and further developments emerge from the dependent claims.

[0015] According to the invention, in the method explained above, the detected objects comprise dynamic objects. Furthermore, the method provides assignment rules that define an assignment of the object categories to the area categories, with the detection of the objects taking place depending on the assignment rules.

[0016] This advantageously allows detections of objects to be identified as faulty and filtered out if the detected objects are not allowed to occur in certain areas.

[0017] An "environment model" within the meaning of the invention comprises information about the spatial surroundings of the vehicle. In particular, it comprises information about the arrangement of objects relative to the vehicle and relative to each other. It may also comprise information about parameters of the objects, such as orientation, length or height, width, angle, or radius.

[0018] In particular, the environment model depicts the vehicle's surroundings at a specific position or pose. The term "position" is used below to include a "pose," i.e., a combination of position and orientation in space.

[0019] In one embodiment of the method according to the invention, the area categories comprise at least one passable area, one non-passable area, one roadway area, one built-up area, and / or one vegetation area. This advantageously allows for distinguishing between areas that are of particular relevance to a model of the vehicle's surroundings. Other area categories can be provided alternatively or additionally.

[0020] For example, the map data may include information that a specific area is a road, whereby the area category "road" may also be assigned to the category "driveable area." Within the area categorized as a road, further areas may be located, such as several different lanes, a hard shoulder, or a peripheral area. Furthermore, a specific area may be categorized as a "developed area," which may contain buildings. Another area may be categorized as a "footpath" and "not driveable."

[0021] Based on the initial position estimate, the arrangement of the areas relative to the vehicle can be determined. For example, the vehicle may be in a certain position on a road, and the map data can be used to determine the distance and direction of the other areas relative to the vehicle.

[0022] In a further development of the method, the accuracy of the initial position estimate is determined, and based on this accuracy, the arrangement of the geographical areas relative to the vehicle is determined. This advantageously ensures optimal use of the available data even with varying degrees of position estimate accuracy.

[0023] The method particularly determines how the geographical areas defined by the map data are arranged relative to the vehicle. The initial position estimate is used to determine the position or pose of the vehicle within the reference system of the map data. The accuracy of the initial position estimate can be determined in a conventional manner. It can also be predetermined, for example, for certain methods of position determination, or the accuracy can be output by a device for determining the position, for example, as an error range or confidence interval.

[0024] This determines how the various areas are arranged relative to the vehicle. The method can take into account that, for example, if the vehicle's own position estimate is less accurate, the arrangement of the areas can be determined with correspondingly lower accuracy. In particular, areas and their arrangement relative to the vehicle are determined for which their affiliation to a specific area defined in the map data cannot be precisely determined. It can be provided that the assignment rules are modified in such areas to handle ambiguous assignments.

[0025] The environmental data is acquired in a manner known per se, in particular by means of sensors. For example, lidar, radar or ultrasonic sensors can be used, or a camera can also be used. Other sensors can also be used, in particular combinations of different sensors. The acquisition space in which environmental data is acquired is defined in particular as the spatial area in which the sensors used can acquire data, for example a range or a field of vision of the sensors. It can be provided that the acquisition space is adaptable, for example by restricting the acquisition of environmental data to a specific spatial area.

[0026] The detection of objects in the environmental data can also be performed in a conventional manner, for example, using pattern recognition. This method particularly detects semantically defined objects, i.e., objects that are recognizable as distinct entities and assigned to specific object categories.

[0027] The assignment to the object categories also takes place in a known manner, with each detected object being assigned at least one object category. In particular, a distinction is made between static and dynamic objects, with static objects being present for a longer period of time in a fixed arrangement within the coordinate system of the map data, for example traffic engineering facilities, buildings, road markings or elements of vegetation. In particular, these can be so-called "landmarks". Dynamic objects can be, for example, other road users or objects temporarily located in a certain position. When an object is detected, the position of the object relative to the vehicle is also determined, such as a distance and an angle at which the object was detected.

[0028] The mapping rules can be provided in various ways known per se. For example, they can be specified by means of a storage unit or received from an external unit. In particular, the map data can include mapping rules, or the mapping rules can be captured together with the map data. Alternatively or additionally, the mapping rules can be captured through user input. Machine learning methods can also be used to determine the mapping rules.

[0029] In a further development of the invention, a negative assignment for a specific area category and a specific object category is determined based on the assignment rules. Objects assigned to the specific object category are detected based on those environmental data that do not relate to geographical areas assigned to the negatively assigned specific area category. This advantageously ensures that no objects based on false detections are taken into account in the environmental model, and detection can be performed more efficiently.

[0030] The negative assignment of specific object categories and area categories determined based on the assignment rules excludes certain object categories from certain area categories. Therefore, to detect objects of the specific object category, environmental data with a smaller scope can be used, making the detection step faster and more efficient. For example, the environmental data can be filtered to exclude areas of the negatively assigned area category. Furthermore, it can be specified that no environmental data is collected in areas assigned to a negatively assigned area category.

[0031] For example, objects in the "road markings" category can be negatively associated with areas in the "house wall" category. To detect road markings, the environmental data can then be filtered so that environmental data collected in the area of house walls is not taken into account. It can also be planned to control a sensor so that it does not collect environmental data in the area of house walls.

[0032] Alternatively or additionally, detected objects can be discarded if they are assigned to a specific object category and are detected in an area for which this object category is excluded.

[0033] Conversely, specific object categories can also be positively linked to specific area categories. Objects in these object categories are therefore only detected and accepted for further processing if they are located in areas of the positively linked area categories. The positive assignment can be used to specifically use environmental data from areas of certain area categories to detect objects of a specific object category and to exclude other areas. This also leads to a reduction in the amount of data to be processed.

[0034] Analogous to the example above, objects in the "road markings" category can be positively linked to areas in the "road surface" category. To detect road markings, the environmental data can then be filtered so that only environmental data collected in the area of the road surface is taken into account. It can also be configured to control a sensor so that it preferentially or exclusively collects environmental data in the area of the road surface.

[0035] In a further development, preliminary detections are first determined during object detection, and the preliminary detections are then filtered based on the matching rules. This advantageously allows the detections to be verified based on the matching rules.

[0036] During filtering, each object is checked to determine which object category it belongs to and which area category the position of the detected object is assigned to. If the object and area categories are mutually exclusive, the detected object is discarded and not considered when determining the environment model. If, however, the object and area categories are positively assigned to each other, the detected object is considered.

[0037] In a further development, a subset of the recorded environmental data is determined based on the assignment rules when detecting objects, and the objects are detected based on this subset of environmental data. This advantageously makes the processing of the environmental data particularly efficient, as unnecessary environmental data is not used for detection, and real-time processing or processing at a speed sufficient for use during vehicle travel can be ensured.

[0038] For example, it can be specified that objects of a certain object category are to be detected specifically. Based on the assignment data, it can be determined which area categories these objects are positively linked to, i.e. in which areas the desired objects can be detected. Based on the map data, it is determined how the areas of the corresponding area categories are arranged relative to the vehicle. The recorded environmental data is processed in such a way that a subset is formed that is essentially limited to these areas. This can be done, for example, using filtering. The environmental data is reduced in the process. For example, it can be specified that road markings are only detected in the area of the road surface and other areas, such as built-up areas, are excluded from detection.

[0039] In a further embodiment, the acquisition space in which the environmental data is acquired is defined based on the mapping rules. This advantageously limits the acquired data to the necessary extent. Unlike in the case explained above, in which the acquired environmental data is reduced to a suitable subset, here the reduction can already occur during acquisition. For example, a solid angle within which data is acquired can be limited.

[0040] Here, too, it can be taken into account that the initial position estimation is carried out with a certain inaccuracy and that the relevant areas must therefore be selected as large as possible in order to be able to capture all relevant objects.

[0041] In a further development, the detected objects are static objects. These are particularly well-suited for use in position determination. Static objects are assigned to specific object categories, which are referred to as static. They exhibit essentially constant properties, such as a fixed position and orientation, size, height, width, or an arrangement relative to one another.

[0042] For example, the object categories can include posts, poles, traffic structures, peripheral development elements, road markings, signs, and traffic lights. Such elements are advantageously widespread in road environments and therefore universally applicable.

[0043] The initial position estimate is performed in a known manner, for example, using a global navigation satellite system, such as GPS. The position or pose of the vehicle can be determined in various coordinate systems, such as a global coordinate system or a coordinate system relative to a specific reference point. In addition, known methods can be used to optimize the position determination, for example, using landmarks. The initial position estimate can also be generated by an external unit and received by the vehicle, for example, provided by other road users or a traffic monitoring device.

[0044] In a further development, an optimized position estimate for the vehicle is determined based on the initial position estimate and the environment model. The optimized position estimate can be used as a new initial position estimate in an iterative implementation of the method, for example, to update and redetermine a further optimized position estimate or the environment model. The environment model can thus be advantageously used to determine the position or pose of the vehicle with particular precision.

[0045] The optimized position estimate is specified, in particular, in a global coordinate system or in a coordinate system of the map data. In particular, a map comparison is performed in which the information about landmarks contained in the map data, in particular detectable objects, is compared with the actually detected objects. In particular, an optimization problem is solved in which the positions of the detected objects are approximated as closely as possible to the landmarks contained in the map data. The relationship between the position and orientation of the vehicle and the arrangement of the detected objects allows the position and orientation of the vehicle in the map coordinate system to be determined.

[0046] According to the invention, the detected objects include dynamic objects. This advantageously allows detections of dynamic objects to be checked for plausibility.

[0047] For example, the object categories to which dynamic objects are assigned may include other road users. In this case, the method according to the invention can be used to ensure that such objects are only detected in permissible areas and to avoid false detections and inappropriate reactions to false detections. For example, known methods have the difficulty that the irregular shapes of vegetation at the edge of a roadway lead to the erroneous detection of other road users in these areas. For example, a vehicle located in the area of vegetation may be erroneously detected.

[0048] Dynamic objects can be included in the environment model or processed in addition to it, for example to transfer them to a driver assistance system.

[0049] The map data can be acquired in a manner known per se, for example by retrieving it from a storage unit of the vehicle, for example as part of a navigation system. In one embodiment of the method according to the invention, the map data are at least partially received by an external unit. This can be, for example, an external server or a backend device that is at least temporarily connected to the vehicle via data technology. For this purpose, a data connection is established between the vehicle and the external unit, for example via a data network such as the Internet, and the map data can be requested and received by the vehicle. This advantageously makes it possible to always provide up-to-date map data.

[0050] The map data is collected, in particular, based on the initial position estimate of the vehicle, for example, so that the map data relates to a geographical area in the vicinity of the vehicle, such as within a certain minimum radius around the initially estimated position of the vehicle. The map data may also relate to a geographical area in which the vehicle is expected to be located in the future, taking into account, for example, a planned route. This allows map data to be collected well in advance, before it becomes relevant at a later point in time.

[0051] In the invention, the map data are designed such that they comprise information about at least two geographical areas and their spatial arrangement. For example, the arrangement of the geographical areas relative to one another and / or in a specific global or relative coordinate system can be included. The map data particularly comprise information about the boundaries of specific areas, which define the shape and position of the geographical areas. The geographical areas can be defined as planar structures or as points or lines, wherein points and lines can in particular be assigned a width, a radius and / or other information about their areal extent.

[0052] The map data also includes information about the area categories to which a geographical area is assigned. The area categories can be formed such that an area category is provided for each of the areas of the map data. A geographical area can also be assigned to multiple area categories.

[0053] The map data can also be updated by providing update data from the external unit as needed. Furthermore, map data can be requested when the vehicle enters a specific geographical area, which can be determined, for example, based on a planned route from a navigation system.

[0054] The data received from the external unit may also include supplementary information, such as information on the arrangement of geographical areas, their assignment to area categories or assignment rules.

[0055] In a further development, transmission data is generated based on the specific environment model and transmitted to an external unit, such as a server or a backend device. The environment model generated for a vehicle can thus be advantageously used for other purposes.

[0056] For example, the environment model or part of the information it contains can be made available to another road user. Furthermore, it can be checked whether existing map data matches the environment model or requires updating. If, for example, multiple vehicles detect deviations between the actually detected objects and the map data, such as changes to buildings or road layouts, these deviations can be identified. The map data can subsequently be corrected or updated, for example, by commissioning a new acquisition or by evaluating the information from the vehicle's environment model.

[0057] In the system according to the invention explained above, the objects comprise dynamic objects. Furthermore, in the system according to the invention, the detection unit is designed to detect the objects depending on assignment rules, wherein the assignment rules define an assignment of the object categories to the area categories.

[0058] The system according to the invention is particularly designed to implement the above-described method according to the invention. The system thus has the same advantages as the method according to the invention.

[0059] In one embodiment of the system according to the invention, the environmental data acquisition unit comprises a lidar, radar, or ultrasonic sensor, or a camera for visible or infrared light. Furthermore, other sensor types may be included, or combinations of multiple sensors and sensor types may be provided. In this way, a plurality of possibly already existing vehicle sensors can be used to acquire the environmental data.

[0060] The computer program product according to the invention comprises instructions which, when executed by a computer, cause the computer to carry out the method described above.

[0061] The invention will now be explained using exemplary embodiments with reference to the drawings. Fig. 1 shows a vehicle with an embodiment of the system according to the invention, Fig. 2 shows an embodiment of the method according to the invention and Fig. 3A to 3D show an embodiment of a traffic situation in which the method according to the invention can be carried out.

[0062] With reference to Fig. 1 a vehicle with an embodiment of the system according to the invention is explained.

[0063] The vehicle 1 comprises a position detection unit 2, a map data acquisition unit 3, and an environmental data acquisition unit 4. In the exemplary embodiment, the position detection unit 2 comprises a GPS module. The map data acquisition unit 3 comprises an interface to a storage unit (not shown) that provides map data for retrieval. In other exemplary embodiments, the map data acquisition unit 3 can be designed as an interface to an external unit from which map data or supplementary map data can be retrieved. In the exemplary embodiment, the environmental data acquisition unit 4 comprises a camera that is arranged in the front area of the vehicle 1 and captures image data about the area in front of the vehicle 1. In further exemplary embodiments, other sensors can be provided alternatively or additionally, such as an infrared camera, a 3D camera, or an ultrasound, radar, or lidar sensor.

[0064] The vehicle 1 further comprises a computing unit 7, which in turn comprises a detection unit 5 and an environment model determination unit 6. The computing unit 7 is coupled to the position detection unit 2, the map data acquisition unit 3, and the environment data acquisition unit 4. The computing unit 7 is further coupled to a driver assistance system 8.

[0065] In the exemplary embodiment, the driver assistance system 8 comprises a module for at least partially autonomous control of the vehicle 1. Various driver assistance systems 8 known per se can be provided.

[0066] With reference to Fig. 2 explains an embodiment of the method according to the invention. This is based on the above-explained embodiment of the system according to the invention, which is further specified by the description of the method.

[0067] In step 21, an initial position estimate is acquired. In the exemplary embodiment, this is done using the position detection unit 2 with its GPS module. Various methods known per se can be used for position determination, with particular provision being made for providing an indication of the accuracy of this estimate along with the position estimate. In the exemplary embodiment, the position determination also includes determining the orientation of the vehicle, i.e., the pose of the vehicle is determined.

[0068] In a further step 22, map data is acquired. In the exemplary embodiment, map data about a geographical area within a specific radius around the vehicle 1 are acquired based on the initial position estimate. In further exemplary embodiments, map data about a geographical area that the vehicle 1 is expected to travel through in the future can be acquired alternatively or additionally, for example because a route to this area is planned.

[0069] The map data includes information about the location and arrangement of geographical areas as well as information about the area categories to which the individual areas are assigned. For example, information about the course of streets and roads is included, as well as their width or other spatial extent. Furthermore, the exemplary embodiment includes information about where buildings are located next to a road. Examples of area categories are passable and non-passable areas, a roadway area, a built-up area or a vegetation area. The arrangement of the areas is described below with reference to the Fig. 3A to 3D are explained in more detail.

[0070] In a step 23, environmental data are acquired, whereby in the exemplary embodiment the camera of the environmental data acquisition unit 4 is used for this purpose.

[0071] In a further step 24, objects are detected based on the environmental data, in particular using known pattern recognition methods, such as for detecting landmarks. Machine learning or artificial intelligence methods can also be used in this case. If an object is detected in the environmental data, it is assigned a position and an object category. Furthermore, it can be provided that further characteristics are determined, such as an orientation, size, length, width or color design of an object. The assignment to an object category is carried out in particular based on the characteristics detected for an object. Examples of object categories include posts, piles, traffic structures, elements of peripheral development, road markings, signs or traffic lights.

[0072] In the exemplary embodiment, static objects are detected, in particular, which are assigned to corresponding static object categories. In further exemplary embodiments, dynamic objects can be detected alternatively or additionally. Examples of dynamic object categories include other road users, cars, trucks, pedestrians, or bicycles.

[0073] In a step 25, the detected objects are filtered. For this purpose, assignment rules are recorded, which in the exemplary embodiment are provided by the map data acquisition unit 3. The assignment rules comprise a positive and / or negative assignment of object categories and area categories. In particular, it is defined that objects of a certain object category should not be detected in areas of a certain area category. For example, it can be assumed that there are no building edges on a roadway. In the present exemplary embodiment, these objects are therefore discarded in step 25.

[0074] In step 26, an environment model for vehicle 1 is determined based on the detected objects. This model includes the positions and, in particular, the orientations of the detected objects relative to vehicle 1. It also includes information about the objects, in particular the object categories assigned to them. The environment model may include further information.

[0075] The initial position estimation is optimized, in particular by means of map matching. This solves an optimization problem in which the detected objects, whose positions relative to vehicle 1 and relative to each other have been determined, are overlaid with the positions contained in the map data for the objects. This is done in a conventional manner, in particular using methods for determining positions using landmarks. In this way, an optimized position and, in particular, also the orientation of vehicle 1 in the coordinate system of the map data is determined.

[0076] In a further step 27, the optimized position is output to the driver assistance system 8, for example in order to carry out a partially or fully autonomous control of the vehicle 1.

[0077] In further embodiments, it is provided that the accuracy of the initial position estimate is taken into account when filtering the detected objects. For example, it cannot be precisely determined for a position relative to vehicle 1 whether it belongs to an area of a first area category or to a second area category. The assignment rules can be applied here such that, for example, objects of a certain object class are accepted at a position even though they are located with a certain probability in an area in which they should not be detected. Conversely, it can be provided that detected objects are discarded in such cases of doubt.In addition, a method can be provided in which, upon detection of a specific object, especially at a position not clearly assigned to an area category, a plausibility check is performed, for example by searching for corresponding objects in the map data. In this way, it can be determined whether a specific detection of an object is plausible and whether the object should therefore be considered in the environment model or rejected.

[0078] When determining the environment model, one difficulty can arise from the fact that a position is to be determined based on the environment model, while simultaneously requiring an initial position estimate. It may be planned that the optimized position is used in an iterative process to improve the initial position estimate in a subsequent step. Furthermore, the inaccuracy of the initial position estimate can be taken into account in various ways, for example, by checking individual detected objects in parallel with their assignment to specific area categories.

[0079] In a further embodiment, it is provided that the assignment rules comprise a positive assignment between object categories and area categories. In this case, the assignment rules define that objects of a certain object category can only be found in areas that belong to a certain area category. It can also be provided that, when detecting the objects, it is already taken into account in which areas objects of a certain object category should or should not be detected. In this case, the acquired environmental data is filtered such that only data that was acquired in suitable areas is taken into account. This means that the environmental data is restricted to a subset such that only environmental data from areas that are positively or at least not negatively linked to a certain object category are analyzed.This reduces the amount of data within which object detection is to be performed, which significantly shortens the computing time, especially for complex pattern recognition methods. This allows the method to be performed more effectively in real time or at runtime, i.e., during operation of the vehicle 1.

[0080] In further embodiments, the environmental data acquisition unit 4 is configured to acquire environmental data only in specific spatial areas. To acquire objects of a specific object category, environmental data is then acquired only in areas that are positively or at least not negatively linked to the object category. In this way, the amount of data to be processed can be reduced.

[0081] With reference to the Fig. 3A to 3D, the exemplary embodiment of the method according to the invention is explained in more detail in an exemplary traffic situation. This is based on the exemplary embodiments of the system and method according to the invention explained above.

[0082] Fig. 3A shows a representation of the ego vehicle 30 on a roadway 31. An arrow symbol symbolizes the forward direction of the vehicle 30. Furthermore, a detection area 36 of the environmental data acquisition unit 4 is indicated, which extends symmetrically forward from the vehicle 30 at a specific angle. The detection area 36 can be configured differently, particularly depending on the sensors used by the environmental data acquisition unit 4, in particular with regard to the aperture angle, the direction, the range, and the dependence on environmental conditions, such as visibility.

[0083] A lane marking 35, running centrally in the exemplary embodiment, is applied to the surface of the roadway 31, and the roadway 31 is laterally bordered by a curb 34. In the exemplary embodiment, the roadway 31 curves to the right. Posts 33 are arranged next to the roadway 31, which can be identified as delineators, particularly based on their thickness and height. Furthermore, buildings 32 are arranged laterally next to the roadway 31.

[0084] In the exemplary embodiment, the map data that is acquired by the map data acquisition unit 3 for carrying out the method according to the invention includes information about the course and spatial extent of the roadway 31, the lane markings 35, the presence and certain features of the curb 34, the posts 33 and the buildings 32. In particular, the map data includes information about the arrangement of certain areas and their assignment to certain area categories. This will be explained below with reference to the Fig. 3B to 3D are explained in more detail.

[0085] In Fig. 3B, a drivable area 37 is highlighted, or rather the intersection of such a drivable area 37 with the detection space 36. The drivable area 37 extends over the surface of the roadway 31. Positions within this area are assigned to the area category "drivable area." In the exemplary embodiment, it is provided that certain object categories, for example objects in the category "posts" or "building edges," are not to be detected here; that is, such detections are discarded as false detections. On the other hand, this area category is positively linked to other object categories, for example the category "road markings." In the exemplary embodiment, it is therefore provided that, in order to detect the road marking 35, only a subset of the recorded environmental data that includes the drivable area 37 is analyzed.Another exemplary object category can be a “vehicle driving ahead”, the detection of which is only expected in the drivable area 37 and not, for example, in the area of the buildings 32.

[0086] In Fig. 3C highlights a building front area 38 that is located at a specific distance from the roadway 31 and along the buildings 32. The arrangement of the building front area 38 can, for example, be included in the map data, or a unit of the vehicle 1 can determine where the building fronts 38 are located based on the position of the buildings 32 included in the map data. Here, for example, edges, facade structures, or other features of buildings 32 can be detected as static objects. The building front area 38 can be positively linked to object categories in which features of the buildings 32 are detected; it can be negatively linked to object categories that, for example, affect other road users.Analogous to the procedure described above, it can be provided that only a subset of the recorded environmental data is analyzed for the detection of building edges and corners, which includes the building front area 38.

[0087] In Fig.3D highlights a roadway edge area 39 that is adjacent to, at a short distance from, or with a slight overlap with the roadway 31. For example, the posts 33 are located in this roadway edge area 39. Furthermore, the curb 34 can be found in this area. Accordingly, it can be provided that these objects are only detected in a corresponding subset of the environmental data with the roadway edge area 39. Other exemplary objects can be pedestrians who are on a footpath in the roadway edge area 39; analogously, cyclists can be detected on a cycle path.By appropriately defining the areas, it can be ensured, for example, that markings on a roadway located in the road edge area 39 are not interpreted as relevant for the travel of the vehicle 1, while at the same time the lane marking 35 in the drivable area 37 is recognized as relevant.

[0088] In a further embodiment, it is provided that the vehicle 1 comprises an interface to an external unit. Map data or supplementary data as well as assignment rules are acquired by the external unit. This can be configured as an external server or as backend devices. Furthermore, a transmission of data from the vehicle 1 to the external unit is provided, for example to enable an evaluation of map data, for example, when the plausibility of the map data is checked based on the acquired environmental data or the environmental model generated by the vehicle 1. List of reference symbols 1 vehicle 2 Position detection unit 3 Map data acquisition unit 4 Environmental data acquisition unit 5 Detection unit 6 Environment model determination unit 7 Computing unit 8 Driver assistance system 21 Recording an initial position estimate 22 Collection of card data 23 Collection of environmental data 24 Detection of objects 25 filtering detected objects 26 Determining an environment model, position optimization 27 Output of the optimized position 30 Ego Vehicle (Symbol) 31 roadway 32 Static object, building 33 Static object, post 34 Static object, curb 35 Static object, lane marking 36 recording area 37 Accessible area, roadway area 38 Development area, building fronts 39 Roadside area

Claims

[1] Method for determining an environment model for a vehicle (1), in which an initial position estimate for the vehicle (1) is recorded; map data are recorded, wherein the map data comprise information about the spatial arrangement of geographical areas (37, 38, 39) and the geographical areas (37, 38, 39) are assigned to different area categories; Environmental data are recorded in a recording room (36); objects (32, 33, 34, 35) are detected based on the environmental data, wherein each detected object (32, 33, 34, 35) is assigned an object position and an object category, and wherein the detected objects (32, 33, 34, 35) comprise dynamic objects; and the environment model is determined on the basis of the detected objects (32, 33, 34, 35); wherein assignment rules are provided which define an assignment of the object categories to the area categories, wherein the detection of the objects (32, 33, 34, 35) takes place depending on the assignment rules. [2] Method according to claim 1, characterized by that the area categories comprise at least one passable area (37), one non-passable area, one roadway area (37), one built-up area (38) and / or one vegetation area. [3] Method according to claim 1 or 2, characterized by that an accuracy of the initial position estimate is determined and, depending on the accuracy, an arrangement of the geographical areas relative to the vehicle (1) is determined. [4] Method according to one of the preceding claims, characterized bythat a negative assignment for a specific area category and a specific object category is determined on the basis of the assignment rules; and objects (32, 33, 34, 35) assigned to the specific object category are detected on the basis of those environmental data which do not concern geographical areas (37, 38, 39) assigned to the negatively assigned specific area category. [5] Method according to one of the preceding claims, characterized by that when detecting the objects (32, 33, 34, 35), preliminary detections are first determined and the preliminary detections are filtered using the assignment rules. [6] Method according to one of the preceding claims, characterized by that when the objects (32, 33, 34, 35) are detected, a subset of the recorded environmental data is determined on the basis of the assignment rules and the objects (32, 33, 34, 35) are detected on the basis of the subset of the environmental data. [7] Method according to one of the preceding claims, characterized by that the detection space (36) in which the environmental data is detected is formed on the basis of the assignment rules. [8] Method according to one of the preceding claims, characterized by that the detected objects (32, 33, 34, 35) are static objects (32, 33, 34, 35). [9] Method according to claim 8 characterized by that the object categories include posts (33), piles, traffic structures, elements of peripheral development (32), road markings (35), signs or traffic lights. [10] Method according to one of the preceding claims, characterized by that an optimized position estimate for the vehicle (1) is determined based on the initial position estimate and the environment model. [11] Method according to one of the preceding claims, characterized by that the map data is at least partially received by an external unit. [12] System for determining an environment model for a vehicle (1), comprising a position detection unit (2) for detecting an initial position estimate for the vehicle (1); a map data acquisition unit (3) for acquiring map data, wherein the map data comprises information about the spatial arrangement of geographical areas (37, 38, 39) and the geographical areas (37, 38, 39) are assigned to different area categories; an environmental data acquisition unit (4) for acquiring environmental data in a detection space (36); a detection unit (5) for detecting objects (32, 33, 34, 35) based on the environmental data and for assigning an object position and an object category to each detected object (32, 33, 34, 35), wherein the detected objects (32, 33, 34, 35) comprise dynamic objects; and an environment model determination unit (6) for determining the environment model based on the detected objects (32, 33, 34, 35); wherein the detection unit (5) is configured to detect the objects (32, 33, 34, 35) depending on assignment rules, wherein the assignment rules define an assignment of the object categories to the area categories. [13] System according to claim 12, characterized by that the environmental data acquisition unit (4) comprises a lidar, radar or ultrasonic sensor or a camera for visible or infrared light. [14] A computer program product comprising instructions which, when executed by a computer, cause the computer to carry out the method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Assistance device and method for supporting a driver of the vehicle

    DE102013211109A1

  • Driver assistance system for object detection and procedures

    DE102014204383A1

  • Method and apparatus for updating a digital map

    DE102017201669A1

  • METHOD AND SYSTEM FOR DETERMINING THE POSITION OF A VEHICLE

    DE102018117660A1

  • Landmark recognizing system

    JP2008051612A