Method for presenting an image of a camera system of a vehicle
By presenting obstacles around the vehicle in a virtual three-dimensional space and using predefined textures and filters, the problem of overloading information in all-round field of view system is solved, reducing calculation overhead and improving drivers' ability to identify important information, ensuring driving The officers can control the vehicle safely.
Patent Information
- Application Number
- CN201880066136.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2017-10-11
- Filing Date
- 2018-09-10
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2038-09-10
AI Technical Summary
The existing all-round vision system is confusing the driver due to information overload, and the overhead of generating complex monitors is high, so it cannot effectively provide important relevant information at present.
By presenting detected obstacles in virtual three-dimensional space, using predefined textures and filters to reduce the information content and calculation overhead of the illustration, display only important relevant information, and select criteria such as user input or parking assist systems Activate the automatic adjustment diagram.
The computing power of generating illustrations is significantly reduced, the driver's ability to identify important information is improved, and the distraction of attention is reduced from obstacles, ensuring that the driver can control the vehicle safely, especially when parking.
Smart Images

Figure CN111213185B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method for presenting an image of a camera system of a vehicle. The camera system is particularly an all-around vision system which can detect images of the vehicle's surroundings. Background Art
[0002] Such all-round vision systems are known from the prior art as surround view systems (SVS). Such systems use different data types in order to display the maximum amount of information. In this way, the maximum amount of information that the system can provide is displayed to the driver. Such data types can be obtained in particular from sensor data fusion, cloud information and many other sources. Typical data from sensor data fusion include information about occupied and free areas around the vehicle, which is obtained with the aid of the vehicle's video sensors, radar sensors, lidar sensors or other environmental sensors. Information from the cloud can be, in particular, weather conditions and available parking spaces.
[0003] Due to the large amount of information that should be displayed by the SVS, the driver of the vehicle may be confused if this information is not displayed appropriately. This results in unnecessary detection of data that does not provide added value to the driver, because the driver does not recognize the information of this data. At the same time, in the prior art, very complex displays are created with great computational overhead, which integrate all the information available for the surround view system into the display image. However, in order to provide the driver with current, important and relevant information, such a huge computational overhead is usually not required. Summary of the invention
[0004] The method according to the invention makes it possible to display information in different illustrations. These illustrations are determined according to selection criteria. In this way, on the one hand, only important and relevant information can be presented to the driver, and on the other hand, the computing power of the system generating the counter-information can be significantly reduced.
[0005] The method according to the invention for presenting images of a camera system of a vehicle is provided for presenting obstacles detected from the surroundings of the vehicle by means of the camera system on a display device. This presentation takes place in a virtual three-dimensional space. In the virtual three-dimensional space, the detected obstacles are presented as virtual three-dimensional objects.
[0006] The observer thus receives the following impression: this is a stereoscopic presentation in which a three-dimensional object is presented. This corresponds to a virtual viewing angle from the corresponding virtual camera position to the actual scene. As a result, the vehicle driver can be provided with an overview of the scene in front of him. In order to optimally present important relevant information on the one hand and reduce the computing power of the system generating the illustration on the display device on the other hand, it is determined according to a selection criterion whether the virtual three-dimensional object and / or the virtual three-dimensional space is coated with a texture generated by the camera system or with at least one predefined texture. The predefined texture can also be a monochrome with different shades, so that no texture is presented on the display device. By omitting the actual texture (i.e. the texture generated by the camera system), the information content of the illustration on the display device can be reduced on the one hand, and the computing overhead for generating the illustration can be reduced on the other hand. As a result, on the one hand, the vehicle driver can be focused on important relevant information, and on the other hand, the required computing power can be significantly reduced.
[0007] The dependent claims contain advantageous developments of the invention.
[0008] Advantageously, it is determined according to the selection criteria whether the texture provided for coating the virtual three-dimensional object and / or the virtual three-dimensional space is to be processed with the aid of a predefined filter. In particular, the contrast of the texture can be increased by the predefined filter. Thus, there is the possibility of presenting the texture while improving the recognition of the virtual three-dimensional object on the display device.
[0009] In particular, it is provided that the predefined filter includes gray shades. Gray shades reduce the color depth of the texture, thereby increasing the contrast. At the same time, the information content of the texture is reduced by the gray shades, so that the recognition of the virtual three-dimensional object on the display device is simplified for the driver.
[0010] The predefined texture is advantageously a predefined brightness variation process. Only the outline and / or outer surface of the virtual three-dimensional object is presented through the predefined brightness variation process. This means that only the outline and / or shape of the virtual three-dimensional object can be recognized on the display device. Therefore, no texture is presented, thereby significantly reducing the computational overhead when generating the diagram on the display device. At the same time, the driver of the vehicle can safely and reliably steer the vehicle around obstacles in the surrounding environment, which is particularly advantageous when parking the vehicle. In particular, the driver will not be distracted from the actual obstacles by the detailed texture.
[0011] In another preferred embodiment, it is provided that at least a part of the virtual three-dimensional objects, in particular all the virtual three-dimensional objects, are highlighted on the display device by at least partial superposition. This superposition advantageously includes the frame of the corresponding virtual three-dimensional object. In this way, obstacles in the surrounding environment can be reliably visualized. Therefore, the vehicle driver can clearly recognize: where the obstacles are located in the surrounding environment, and whether these obstacles pose a danger to his vehicle. It is also advantageous to provide the driver with a superposition of additional prompts of features in the surrounding environment. Therefore, for example, a free and available parking space can be highlighted on the display device by corresponding markings.
[0012] Advantageously, the selection criterion is a user input. Thus, the user can freely select whether a simplified representation with at least one predefined texture or a more complex representation with the texture of the camera system is desired. The user can also determine whether at least a part of the texture of the camera system should be processed with the aid of a predefined filter. Thus, the driver can freely select which view provides the greatest possible information content in the current situation without being confused by a large amount of currently unnecessary information.
[0013] In another specific embodiment, it is preferably provided that the selection criterion includes successful recognition of a parking space and / or activation of a parking assistance system. The switching of the graphics is therefore preferably carried out automatically. In this way, the driver of the vehicle can be provided with the current objectively best graphics. Thus, in particular, graphics with only predefined textures can be used during the activation of the parking assistance system in order to explain to the driver in a simple manner which obstacles the parking assistance system has recognized and how to implement the parking strategy based on these obstacles.
[0014] The invention further relates to a computer program, which is configured to implement the method described above. The computer program is in particular a computer program comprising machine-readable instructions which, when executed on a computing device, cause the computing device to implement the steps of the method described above. The computing device is in particular a control device of a vehicle.
[0015] Furthermore, the present invention comprises a machine-readable storage medium on which the above-mentioned computer program is stored. The machine-readable storage medium is particularly an optical data carrier and / or a magnetic data carrier and / or a flash memory.
[0016] Finally, the invention relates to a control device for carrying out the above-described method. The control device is also advantageously designed to carry out the above-described computer program. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] The embodiments of the present invention are described in detail below with reference to the accompanying drawings. The accompanying drawings show:
[0018] Figure 1 A schematic diagram of a vehicle having a control device for carrying out a method according to an exemplary embodiment of the present invention is shown;
[0019] Figure 2 A first example of a diagram generated by means of a method according to an embodiment of the present invention is shown;
[0020] Figure 3 A second example of a diagram generated by means of a method according to an embodiment of the present invention is shown;
[0021] Figure 4 A third example of a diagram generated by means of a method according to an embodiment of the present invention is shown;
[0022] Figure 5 A fourth example of a diagram generated by means of a method according to an exemplary embodiment of the present invention is shown. DETAILED DESCRIPTION
[0023] Figure 1 A vehicle 1 is schematically shown which includes a control device 2 according to an exemplary embodiment of the present invention.
[0024] The vehicle 1 comprises a camera system 3 which is designed to detect the surroundings of the vehicle 1. Thus, the entire surroundings of the vehicle 1 can be scanned by the camera system 3. The control device 2 is used to create a graphic representation on a display device 4 in order to present the surroundings to the driver. In this arrangement, the control device 2 presents obstacles detected from the surroundings of the vehicle by means of the camera system 3 as virtual three-dimensional objects 5 in a virtual three-dimensional space 6 on the display device 4. This is Figures 2 to 5 The graphic representation to be presented on the display device 4 is selected according to the selection criteria.
[0025] Advantageously, the selection criterion is a user input. Thus, the user can select which of the different illustrations he wants to view. Alternatively, the selection criterion can be determined automatically by selecting an illustration based on successful recognition of a parking space and / or based on activation of a parking assistance system. The goal is to always display an optimal image of the surroundings including important relevant information to the vehicle driver without overwhelming the driver with a large amount of information. At the same time, the computational effort in the control device 2 is significantly reduced by the targeted selection of the illustrations, since illustrations with reduced information content are also displayed on the display device, without having to continuously generate illustrations with maximum information content.
[0026] Figure 2A first example of a representation on a display device 4 is schematically shown. Here, an obstacle detected from the vehicle surroundings is presented as a virtual three-dimensional object 5 in a virtual three-dimensional space 6. Furthermore, for better distinguishability, it is provided that a frame 7 is displayed around the obstacle 5. Thus, the driver of the vehicle 1 can easily recognize the obstacle in the surroundings based on the virtual three-dimensional object 5. Furthermore, it is preferably provided that for better overview, a representation 10 of the vehicle 1 is displayed in the virtual three-dimensional space 6.
[0027] exist Figure 2 In the example shown, it is provided that all virtual three-dimensional objects 5 and virtual three-dimensional spaces are coated with a texture that has been detected with the aid of the camera system 3. This means that a photo-realistic illustration is produced. As a result, a large amount of different information in the illustration is provided to the driver of the vehicle 1. If individual obstacles are not identified and therefore not displayed as virtual three-dimensional objects 5, the driver can still recognize these obstacles based on the texture. However, there is the risk that the vehicle driver is confused by the large amount of information. As a result, the driver of the vehicle 1 may ignore important information, which means that there is a risk of a collision between the vehicle 1 and an obstacle, because the driver ignores the approach of the representation 10 of the vehicle 1 to the virtual three-dimensional object 5.
[0028] Figure 3 A second example is shown in FIG. In this example, a display without texture is performed. The scene and Figure 2 Same as Figure 2 The difference is that the virtual 3D object 5 and the virtual 3D space 6 are not coated with a texture. This means that the virtual 3D object 5 and the virtual 3D space 6 only have the following brightness change process: the brightness change process includes a graphic representation of the outline of the virtual 3D object 5. It is further preferably provided that the virtual 3D object 5 is emphasized by highlighting 7.
[0029] exist Figure 3 In the illustration shown in , the information content is limited to the presence and absence of obstacles. Therefore, the driver of the vehicle 1 is not confused by a large number of different textures, but instead can focus on not colliding with obstacles in the surrounding environment, which means that a distance is always maintained between the representation 10 of the vehicle 1 and the virtual three-dimensional object 5.
[0030] at last, Figure 4 A third example of the diagram is shown. Here, using Figure 2 The texture shown. Figure 2 The difference is that in this example, a filter is placed on the texture. This filter is in particular a shade of gray. This increases the contrast of the display while reducing the color depth. This creates a graphic representation that is somewhere between Figure 2 Zhongyu Figure 3The texture continues to be presented to the driver of the vehicle, so that the driver can recognize obstacles that may not be recognized, while the recognized obstacles can be reliably recognized by the driver via the virtual three-dimensional object 5.
[0031] at last, Figure 5 A fourth example is shown. In this example, the diagram is divided into a first area 8 and a second area 9. Here, the first area 8 corresponds to Figure 2 The first example shown in FIG. 1 , and the second area 9 corresponds to Figure 3 The third example shown in . As a result, the texture generated by the camera system 3 transitions to a texture that has been processed by means of a predefined filter. Thus, the advantages of a high degree of refinement for the near area can be combined with the advantages of increased contrast in the far area.
Claims
1. A method for presenting an image of a camera system (3) of a vehicle (1), wherein: obstacles detected from the surroundings of the vehicle (1) by means of the camera system (3) are presented as virtual three-dimensional objects (5) in a virtual three-dimensional space (6) on a display device (4), In which, it is determined according to a selection criterion whether the virtual three-dimensional object (5) and / or the virtual three-dimensional space (6) is coated with a texture generated by the camera system (3) or with at least one predefined texture, The selection criteria include, in this case, successful recognition of a parking space and / or activation of a parking assistance system.
2. The method according to claim 1, characterized in that Based on the selection criterion, it is determined whether the texture, which is provided for coating the virtual three-dimensional object (5) and / or the virtual three-dimensional space (6), is processed with the aid of a predefined filter.
3. The method according to claim 2, characterized in that The predefined filter comprises shades of grey.
4. The method according to any one of claims 1 to 3, characterized in that The predefined texture is a predefined brightness variation process so as to present only the outline and / or the outer surface of the virtual three-dimensional object (5).
5. The method according to any one of claims 1 to 3, characterized in that At least a portion of the virtual three-dimensional object (5) is highlighted on the display device (4) by at least partial superposition (7).
6. The method according to any one of claims 1 to 3, characterized in that The selection criteria are user input.
7. The method according to claim 5, characterized in that All virtual three-dimensional objects (5) are highlighted on the display device (4) by at least partial superposition (7).
8. The method according to claim 5, characterized in that At least a portion of the virtual three-dimensional object (5) is highlighted on the display device (4) by a frame.
9. The method according to claim 5, characterized in that All virtual three-dimensional objects (5) are highlighted on the display device (4) by means of a frame.
10. A computer program product comprising instructions which, when executed by a computer, cause the computer to implement the method according to any one of claims 1 to 9. 11 . A machine-readable storage medium having instructions stored thereon, and when the instructions are executed by a computer, the instructions cause the computer to implement the method according to any one of claims 1 to 9.
Citation Information
Patent Citations
Generating method of virtual view image of surveying system of vehicular multi-lens camera
CN101976460A
Image generating apparatus, image generating method, and image generating program
JP2005268847A
