Procedure for providing a card

By distinguishing between important and secondary 3D objects and using metadata-based generic objects, the method addresses the challenge of high detail and realism in three-dimensional maps, achieving efficient data usage and dynamic representation.

DE102009001311B4Active Publication Date: 2025-11-27ROBERT BOSCH GMBH
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
DE102009001311
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2009-03-04
Publication Date
2025-11-27
Estimated Expiration
2029-03-04

AI Technical Summary

Technical Problem

Existing methods for generating three-dimensional maps face challenges in achieving high detail and realism while minimizing data volume, particularly in large-scale applications, as they often require extensive databases and high storage capacity, and struggle to represent rural areas and non-prominent features realistically.

Method used

A method that distinguishes between important and secondary 3D objects, using real-world data for prominent objects and generic 3D objects for less significant features, allowing for a detailed and realistic map representation with reduced data volume by employing metadata-based generation of generic objects.

Benefits of technology

Enables highly detailed and realistic map representations with reduced data storage requirements, facilitating dynamic changes and seamless integration of time-dependent variations, while maintaining high image quality from various viewing angles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for providing a map (4, 104) configured to represent 3D objects (108, 110), wherein for providing the map (4, 104) a distinction is made between important 3D objects (108) and secondary 3D objects (110), and wherein the map (4, 104) is combined from real 3D objects (8, 10, 112) representing the important 3D objects (108) and generic 3D objects (20, 22, 26, 114) representing the secondary 3D objects (110).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for providing a card, an arrangement for providing a card, a computer program and a computer program product. State of the art

[0002] Based on real-world terrain data, various applications exist for, for example, three-dimensional map displays. These have diverse application areas such as tourism information, vehicle navigation, pedestrian navigation, urban planning, and simulation.

[0003] The data used is collected for various spatial coverages. Applications typically utilize combinations of different data types. Commonly used data types include a digital elevation model (DEM), which visualizes differences in elevation across the terrain. This also incorporates defined areas with specific uses, such as roads, buildings, forests, etc., as well as real-world raster images of the surface, such as aerial or satellite imagery, and 3D models of individual objects, buildings, or trees. When using real-world terrain data for large-scale applications, data acquisition and the sheer volume of data in the model are particularly complex.

[0004] For the film industry and computer games, depictions of terrain that are virtually indistinguishable from the real landscape are advantageous. A very high level of detail is necessary here. Terrain elements for terrain models can be synthetically generated using generators such as Procedural Terrain or Ecotope Modelling. These terrain elements include vegetation with variations in plant species, shape, and size depending on vegetation zones and the season; roads with animated traffic; bodies of water; elevation models with erosion effects; and the sky with clouds. These terrain models create a very realistic-looking image, which, however, only represents a fantasy landscape and does not correspond to any real-world landscape.

[0005] German patent application DE 10 2004 038 739 A1 describes a method for displaying map information that uses direct representations of real-world objects—i.e., satellite images, aerial photographs, or elevation models—to generate a 3D scene. The level of detail and the required data volume are directly correlated. For example, a resolution of 1 meter requires a storage capacity of 140 GB for Germany alone. Even with this large data volume, a photorealistic representation from the driver's perspective is not possible. Furthermore, only image data taken almost vertically from above is used. Textured representation of building facades is not feasible. Typically, only the roof of a house is available in the image data; the walls are not. Depending on the resolution of the elevation model, various defects occur in the representation.This limits the view of the model to a viewing angle of approximately 90°.

[0006] A GPS user guidance device with a three-dimensional display for a navigation system is known from German patent application DE 299 13 292 U1. This device uses a virtual three-dimensional environment for navigation. The data for the virtual environment is stored in a database, which is created by a user guidance device editor based on cartographic data of prominent, real-world objects. A large database is required to achieve a high level of detail in the virtual environment. Furthermore, if nearly photorealistic images are desired, several gigabytes of data are needed for a single city. A detailed and comprehensive representation for a large coverage area, such as Europe, is only achievable with this approach at a high cost.The editor in question generates the database based on cartographic data and prominent landmarks. While the prominent landmarks are individual, potentially complexly created 3D objects, the data for the rest of the 3D scene is derived exclusively from the cartographic data. Therefore, the 3D scene is only as detailed as the cartographic data. In rural areas, where the density of prominent landmarks decreases significantly, the 3D scene is reduced to a simple and by no means photorealistic representation.

[0007] A method for multimedia-supported navigation and a navigation device are described in German patent application DE 198 52 662 A1. This method uses distinctive, real-world objects on the data carrier to support acoustic and visual navigation, employing not complete 3D scenes, but only individual, non-contiguous distinctive objects. Objects that have not been individually captured beforehand cannot be described. Therefore, the coverage is directly correlated with the capture effort. This method also describes the use of a distinctive object for navigation depending on its visibility at night.

[0008] Document WO 2008 / 074 561 A1 describes a method for displaying a map section in a navigation system for a motor vehicle, in which, in addition to a road network, further objects are displayed, whereby the type of display of the objects depends on their distance to the vehicle position.

[0009] Publication WO 00 / 66 977 A1 describes a method for generating a three-dimensional map representation for a navigation system. The representation is created from two-dimensional road map data for a specific field of view.

[0010] The publication EP 1 508 780 B1 describes a navigation device for guiding a vehicle, including a display unit for outputting a route and displaying objects. The intensity of the object's display color decreases continuously with increasing distance.

[0011] The publication DE 600 09 365 T2 describes a method for stereoscopic map display to show a scene on a display screen. Two different display zones are created and two display operating modes are provided.

[0012] Publication WO 2007 / 147 830 A1 describes a method for generating a three-dimensional computer image from geoinformation, using predefined building types. Disclosure of the invention

[0013] The invention relates to a method for providing a map designed to represent several 3D objects, wherein a distinction is made between important 3D objects and secondary 3D objects for the purpose of providing the map, and wherein the map is combined from real 3D objects representing the important 3D objects and generic 3D objects representing the secondary 3D objects.

[0014] In the implementation, the real 3D objects are placed on the map. Additionally, at least one area between and / or away from real 3D objects, where no real 3D object is placed, is defined as at least one freely usable area, which can also be referred to as a usage area. The generic 3D objects are then inserted into this at least one freely usable area.

[0015] This method allows for the creation of a three-dimensional electronic map depicting at least a portion of the Earth's surface or a space defined as terrain, landscape, or city, encompassing the aforementioned 3D objects. Accordingly, the map is designed as a topographic map, city map, or street map that includes topographic and / or geographic 3D objects.

[0016] It is possible for the generic 3D objects to be designed as general 3D objects encompassing an entire category. In this context, these generic 3D objects can be reduced to a few key commonalities that are typically shared by all 3D objects and / or represented schematically and stylized. This allows for an abstraction of common features and properties across many different 3D objects by focusing on their shared characteristics.

[0017] This method allows, among other things, a clear separation between real 3D objects and generic 3D objects on the usable areas. Thus, every location in the room or within a scene arranged in that room is either occupied by a real 3D object or assigned to a usable area, with unused usable areas being filled with generic 3D objects corresponding to a specific use type. The important 3D objects can typically be represented realistically.

[0018] When implementing the procedure, it can be decided on an application-specific basis which 3D objects are classified as important 3D objects and which 3D objects are classified as secondary 3D objects, whereby the important 3D objects to be realistically represented are typically provided from a database.

[0019] In a further development, time-dependent variations of the 3D objects can be displayed, so that the objects are shown depending on current external conditions, e.g. depending on a real time given when the process is carried out, usually the respective season and / or time of day.

[0020] Alternatively or additionally, dynamic behavior of the 3D objects can be displayed, whereby the 3D objects are animated. Furthermore, prominent 3D objects that are typically arranged in the space can also be classified as important 3D objects.

[0021] In one application, a map intended for vehicle navigation is displayed, with at least one traffic route, usually a road, represented as a real 3D object.

[0022] In this application of the map for vehicle navigation, traffic-related 3D objects, i.e., roads and traffic signs, can still be defined as real 3D objects. If the map is used, for example, for a city tour, points of interest can be displayed as real 3D objects.

[0023] The invention also relates to an arrangement for providing a map configured to represent 3D objects. The arrangement is configured to distinguish between important 3D objects and secondary 3D objects when providing the map, and to combine the map from real 3D objects representing the important 3D objects and generic 3D objects representing the secondary 3D objects.

[0024] The invention enables, among other things, map display through a synthesis of real 3D objects and generic terrain models, which are formed from the areas encompassed by the generic 3D objects. Thus, the simultaneous use of generic and real 3D objects is possible.

[0025] The described arrangement is designed to perform all steps of the presented procedure. Individual steps of this procedure can also be performed by individual components of the arrangement. Furthermore, functions of the arrangement or functions of individual components of the arrangement can be implemented as steps of the procedure. It is also possible for steps of the procedure to be realized as functions of individual components of the arrangement or of the entire arrangement.

[0026] The invention further relates to a computer program with program code means to carry out all steps of a described method when the computer program is executed on a computer or a corresponding computing unit, in particular in an arrangement according to the invention.

[0027] The computer program product according to the invention, comprising program code means stored on a computer-readable data carrier, is designed to perform all steps of a described method when the computer program is executed on a computer or a corresponding computing unit, e.g. in an arrangement according to the invention.

[0028] By combining real-world terrain data for real 3D objects with generic 3D objects, map images are generated that show highly detailed scenes even with a small data volume, and in which individual important 3D objects are depicted realistically. Realistic in this context refers, among other things, to the location, shape, surface, and dynamic behavior of the 3D objects.

[0029] The 3D objects deemed important and intended for realistic representation are captured and stored in a database. The assessment of whether a 3D object is realistically represented depends on the intended use of the maps being displayed. For vehicle navigation, for example, roads, prominent buildings, and the elevation model are crucial for simple and safe orientation.

[0030] In one implementation, the scene to be displayed in the space, which includes the 3D objects, is built up sequentially. This involves, as a first step, placing the real-world 3D objects from the database, which typically form the unchangeable foundation of the scene. In the case of vehicle navigation, this step involves placing all important transport routes, such as roads, rivers, and railway lines, the elevation model (usually initially without texture), and the most significant buildings as 3D objects within the scene.

[0031] In a second step, the typically unused areas that can be designated as usable areas are defined. Here, areas with the same or similar uses are described between the areas already occupied by real 3D objects. A contiguous usable area is usually defined by identical or very similar buildings and / or vegetation. After this step, every location in the scene, and consequently the space to be represented by the map, is either occupied by a real 3D object or assigned to a usable area. For example, if the map is used for vehicle navigation, mixed forest, meadow, farmland, a village (e.g., in Northern Germany), an urban area (e.g., Berlin), etc., are defined as usable areas.

[0032] In a third step, usable areas are enriched with generic 3D objects. Generic 3D objects are added to the remaining unused areas of the scene, with each object being generated according to its intended use. The 3D objects are generated using rules that ensure an appropriate distribution and variation of 3D objects, resulting in naturally appearing areas within the scene.

[0033] In the case of vehicle navigation, this third step typically involves adding more houses, sidewalks, and trees to a usable area for an urban area. First, the houses are aligned with the streets and existing real-world buildings. Then, sidewalks and trees are appropriately placed between the houses.

[0034] The described method allows for the combination of realistic map representations with generic terrain models. In a further development, it enables the generation of 3D objects based on real-world metadata. Compared to purely realistic representations, a map with a comparable level of detail can be generated using a significantly smaller database. This reduces the effort required for data collection and also necessitates less storage space for map calculations. The reduced storage space also allows for online updates of the database. The generic models generally remain constant; only modifiable metadata is updated. Compared to generic models, the maps generated using this method correspond to key aspects of the real world. The specific 3D objects, and thus map elements, that are important can be determined based on the application.This significantly increases the realism.

[0035] Time-dependent changes to the representation are easier and more detailed with this method than with more realistic methods.

[0036] The real-world 3D objects generated in the first step of setting up the scene for the map are, in one case, direct representations of real-world 3D objects, such as aerial photographs, textured 3D models of buildings, etc. Alternatively, real-world objects can be recreated based on metadata. Thus, the database does not contain a complete representation of the typically real-world 3D objects, but rather a condensed version of their most important characteristics. For example, roads, bridges, tunnels, etc., are generated based on a plan and type.

[0037] For traffic routes, the layout is typically an important feature. With just a few additional metadata points, such as road type, number of lanes, etc., 3D scene elements can be generated that correspond to the important features of reality while also exhibiting a high level of detail.

[0038] In addition to roads, traffic-related objects such as traffic lights, road signs, roundabouts, bus stops, etc., serve as further reference points for orientation when using the map. These traffic-related elements can be generated with minimal metadata based on their real-world position and type.

[0039] Buildings can be provided for the map based on their footprint, i.e., their actual shape and position, height, roof type, and building style. In addition to 3D renderings of major buildings, smaller buildings can also be realistically generated based on their footprint, height (or number of stories), and roof type. Facades can be generically added to suit the building's use within a given district. Trees within the city can be generated based on their position, type, and height, thus serving as additional orientation aids. Typically, 3D plants can be inserted into the scene with minimal metadata.

[0040] All these examples show that by describing real objects and scenes using rule sets and meta descriptions, a higher level of detail in the map can be achieved with reduced data volume.

[0041] Since many objects in the scene are described with metadata, the resulting generation of 3D objects for the scene can also take into account variations of an object, such as a time-dependent change in appearance. Typical variations include the season, the time of day or the position of the sun, and weather conditions. For example, trees can be generated with green leaves in summer and without leaves in winter. Another type of time-dependent change is the animation of objects, such as flowing traffic, moving clouds, etc.

[0042] For each type of object or element of the 3D scene, it is possible to store them completely as images of real objects as 3D objects in offline data, or to describe the objects in the offline data only by metadata and assemble them into 3D objects only in online processing.

[0043] In one application of the method, two process paths can be used simultaneously, so that a few outstanding real 3D objects are displayed together with many generically generated objects.

[0044] Alternatively, 3D objects can be generated from metadata using offline calculations. The result is a database of 3D objects that can be used for map display.

[0045] In addition, known methods for displaying the map can also be used, whereby detailed 3D landscapes can be generated even with reduced effort for data collection.

[0046] In contrast to the procedure described in the publication DE 10 2004 038 739 A1, the invention allows the required data volume to be reduced, so that, for example, all of Europe can be mapped down to centimeter details with a smaller data volume.

[0047] The described method assembles a scene from individual three-dimensional models, such as 3D trees generated with a CAD program. In this scene, the image quality is consistent from every viewing angle. Furthermore, variability over time can be achieved. The 3D model produces images that correspond to the original aerial photographs. Changes depending on time, typically based on the time of day, the position of the sun, the season, weather conditions, etc., are not possible with the method described in German patent application DE 10 2004 038 739 A1.

[0048] In contrast, the described method according to the invention, in its embodiment, only a few generic objects are changed depending on the time of day in order to change the entire scene. This makes it easy to implement changing times of day or seasons.

[0049] A large volume of data is also required for the GPS participant guidance device known from publication DE 299 13 292 U1. With the method according to the invention, a database containing all individual details is not necessary in one embodiment.

[0050] The high level of detail in the described invention is achieved, among other things, through a small number of highly detailed but generic objects, such as individual typical trees, individual typical houses, etc., which seamlessly integrate into the offline-generated virtual world using the described method. Furthermore, this level of detail is independent of the cartographic data. The cartographic data required here is limited to the allocation of land use and, if necessary, a height model; the level of detail is generated through the enrichment of the generic objects.

[0051] In contrast to the method described in German patent application DE 198 52 662 A1, the method according to the invention, in one embodiment, can provide a complex 3D scene that includes, among other things, distinctive objects, but above all, shows the entire environment. Furthermore, in one embodiment of the method, a generic enhancement of reality is possible, so that the method is not limited to objects that were previously individually captured. Through this generic object enrichment, a high level of detail can also be achieved in areas not specifically captured.

[0052] Since the presented method is typically model-based or rule-based, the generic additions can also be modeled as animations. This makes it possible for airplanes or birds to fly, cows to walk in a pasture, or leaves to fall from a tree. In previously known methods, reality is always modeled statically. Dynamic behavior is not provided for. Furthermore, changes to the display can be made depending on the time of day, the season, weather conditions, etc.

[0053] When implementing this method, minor irregularities in the generic reproduction of the real landscape are not replicated. Furthermore, intentional irregularities in the generically generated objects can create characteristics of natural landscapes.

[0054] In navigation systems, the described method can improve the quality of map displays. Therefore, a realistic representation of the surroundings facilitates orientation within a section of the map.

[0055] Further advantages and embodiments of the invention will become apparent from the description and the accompanying drawings.

[0056] It is understood that the features mentioned above and those to be explained below can be used not only in the combinations specified, but also in other combinations or on their own, without leaving the scope of the present invention. Brief description of the drawings Fig. Figure 1 shows a schematic diagram of a first embodiment of a method according to the invention for providing a card. Fig. Figure 2 shows a schematic diagram of a second embodiment of a method according to the invention for providing a card. Fig. Figure 3 shows a schematic representation of an embodiment of an arrangement according to the invention. Embodiments of the invention

[0057] The invention is schematically illustrated with reference to embodiments in the drawings and is described in detail below with reference to the drawings.

[0058] The figures are described in a coherent and comprehensive manner; the same reference symbols denote the same components.

[0059] For the in Fig. Figure 1 shows an embodiment of the inventive method for providing a scene 2 for a map 4, in which this scene 2 is built up layer by layer in several steps. In the present embodiment, the map 4 is designed to represent a real space, here a landscape, which includes the scene 2.

[0060] In the first step, 4 real 3D objects (8, 10) are placed in the first layer (6) of the map. These real 3D objects (8, 10) are traffic routes, represented here as roads, and a prominent 3D object, in this case a high-rise building. These real 3D objects are intended to be important for the use of map 4, specifically for road navigation.

[0061] Between the real 3D objects 8, 10, the first layer 6 of the map has 4 free areas 13, in which, in a second step of the process, in a second layer 12, first usage areas 14 for a building, a second usage area 15 for an industrial area and a third usage area 16 for a forest are inserted.

[0062] In a third step of the process, a third layer 18 provides first generic 3D objects 20 and second generic 3D objects 22. A fourth layer 24 provides additional third generic 3D objects 26. These generic 3D objects 20, 22, and 26 are designed to represent secondary 3D objects, which differ in their function in representing map 4 from the primary 3D objects. Specifically, the first generic 3D objects 20 represent houses, the second generic 3D objects 22 represent industrial facilities, and the third generic 3D objects 26 represent trees. The first generic 3D objects 20 are assigned to the first usable area 14, the second generic 3D objects 22 to the second usable area 15 and the third generic 3D objects 26 to the third usable area 16.Scene 2 for map 4, representing the space, is created by combining the described layers 6, 12, 18, 24, which include all real 3D objects 8, 10, here the traffic routes and the high-rise building, as well as the generic 3D objects 20, 22, 26.

[0063] The in Fig. Diagram 2 shows steps of a second embodiment of the inventive method for providing a map. First, offline data 40 are provided. This offline data 40 includes data for a height model 42, for land use 44, for generic vegetation 46 suitable for all land use types, data for important, prominent buildings 48 within a 3D model, building metadata 50 including floor plans and 3D heights, data for generic buildings 52, traffic area metadata 54 including floor plans and types, data for 3D traffic elements 56, traffic element metadata 58, and data for generic traffic elements or traffic objects 60.

[0064] In subsequent online processing 62, data for a surface texture 64 of the map are generated from the data for the elevation model 52 and the land use 44. Furthermore, data for 3D plants 66 are generated from the data for land use 44 and the generic vegetation 46. Data for 3D buildings 68 are generated from the building metadata 50 and the data for generic buildings 52. Data for 3D traffic routes 70 are generated from the traffic area metadata 54. Data for 3D traffic elements 72 are provided during online processing 62 from the traffic element metadata 58 and the data for generic traffic elements 60.

[0065] When scene 74 of the map is provided to represent the space, a textured elevation model 76 is generated from the data for the elevation model 52 and the surface texture 64 for scene 74. The data for 3D plants 66 are directly incorporated into scene 74. Suitable 3D buildings 78 for scene 74 are generated from the data for important buildings 48 and the data for 3D buildings 68. The data for 3D roads 70 are directly incorporated into scene 74. Suitable 3D traffic elements 80 for scene 74 are generated from the already provided data for 3D traffic elements 56 and 72.

[0066] Fig.Figure 3 shows a schematic representation of an embodiment of an arrangement 100 according to the invention for providing a scene 102 for a map 104, which is configured to represent a real space 106, in this case a landscape. The space 106 comprises important 3D objects 108 and secondary 3D objects 110. The arrangement 100 is configured, in one embodiment of the method according to the invention, to distinguish the important 3D objects 108 from the secondary 3D objects 110, taking into account the application of the map 104 to be provided. Thus, when the scene 102 is generated for the map 104, the arrangement 100 represents the important 3D objects 108 as real 3D objects 112 and the secondary 3D objects 110 as generic 3D objects 114.

Claims

[1] Method for providing a map (4, 104) designed to represent 3D objects (108, 110), wherein for providing the map (4, 104) a distinction is made between important 3D objects (108) and secondary 3D objects (110), and wherein the map (4, 104) is combined from real 3D objects (8, 10, 112) representing the important 3D objects (108) and generic 3D objects (20, 22, 26, 114) representing the secondary 3D objects (110). [2] Method according to claim 1, wherein the real 3D objects (8, 10, 112) are placed in the map (4, 104) and at least one area (13) in which no real 3D object (8, 10, 112) is placed is defined as at least one freely usable area (13), wherein the generic 3D objects (20, 22, 26, 114) are inserted into the at least one freely usable area (13). [3] Method according to claim 1 or 2, wherein the important 3D objects (8, 10, 112) are represented realistically. [4] Method according to any of the preceding claims, wherein, depending on the application, it is decided which 3D objects are classified as important 3D objects (108) and which 3D objects are classified as secondary 3D objects (110). [5] Method according to any of the preceding claims, wherein the real 3D objects (8, 10, 112) are provided from a database. [6] Method according to one of the preceding claims, wherein time-dependent variations of the 3D objects are displayed, such that the 3D objects are displayed depending on current external conditions. [7] Method according to any of the preceding claims, wherein a dynamic behavior of the 3D objects is represented. [8] Method according to any of the preceding claims, wherein distinctive 3D objects are classified as important 3D objects (108). [9] Method according to one of the preceding claims, by which a map (4, 104) intended for carrying out navigation is displayed, wherein at least one traffic route is displayed as a real 3D object (8, 10, 12). [10] Arrangement for providing a map (4, 104) configured to represent 3D objects (108, 110), wherein the arrangement (100) is configured to distinguish between important 3D objects (108) and secondary 3D objects (110) when providing the map (4, 104) and to combine the map (4, 104) from real 3D objects (8, 10, 112) representing the important 3D objects (108) and generic 3D objects (20, 22, 26, 114) representing the secondary 3D objects (110). [11] Computer program with program code means to carry out all steps of a method according to any one of claims 1 to 9 when the computer program is executed on a computer or a corresponding computing unit, in particular in an arrangement (100) according to claim 10. [12] Computer program product comprising program code means stored on a computer-readable data carrier to perform all steps of a method according to any one of claims 1 to 9 when the computer program is executed on a computer or a corresponding computing unit, in particular in an arrangement (100) according to claim 10.

Citation Information

Patent Citations

  • Stereoscopic map display method and navigation system for use in the method

    DE60009365T2

  • Navigation device

    EP1508780B1

  • Method of obtaining a three-dimensional representation of a map, and navigation system

    WO2000066977A1

  • Method for producing a three-dimensional computer model of a town

    WO2007147830A1

  • Method for displaying a map section in a navigation system, and navigation system

    WO2008074561A1