Methods, computer program products, and driver assistance systems for providing image representations of at least a portion of the vehicle environment.

By displaying the second part of the vehicle environment in a mirror form on the vehicle display device, the information omission problem caused by perspective limitation in the prior art is solved, and the safety and comfort of the driver's information acquisition are improved.

CN112703127BActive Publication Date: 2024-11-05CONNAUGHT ELECTRONICS
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980060925.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-08-10
Filing Date
2019-07-24
Publication Date
2024-11-05
Estimated Expiration
2039-07-24

AI Technical Summary

Technical Problem

The prior art, when providing a 360° surround view of the vehicle environment, may result in inability to see the relevant information of the environment from a selected perspective, resulting in the risk of the user missing important information, and changing the perspective is time-consuming and uncomfortable.

Method used

Capture an environment image by at least one vehicle sensor and display a second portion of the environment on the display device in a mirror form on the defined area represented by the vehicle, thereby providing additional information within the defined viewing angle and viewport, including the use of a camera or other sensor such as a laser Scanners, ultrasonic sensors and radars, combined with the laws of physical light reflection or their defined deviations to calculate the mirror.

Benefits of technology

Reduces the risk of drivers missing important information in the vehicle environment, improves safety, provides a more natural and authentic display of information, reduces user distraction and irritability, and supports drivers' position awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112703127B_ABST
    Figure CN112703127B_ABST
Patent Text Reader

Abstract

The invention relates to a method for providing an image representation (15) of an environment (7) of a vehicle (1), wherein the environment (7) of the vehicle (1) is at least partially captured, an image representation (15) of at least a first part (10a) of the captured environment (7) is provided within a defined viewport (10) from a defined viewing angle (11), wherein the image representation (15) comprises a vehicle representation (14) representing the vehicle (1), and wherein the image representation (15) is displayed on a display device (12). Furthermore, when providing the image representation (15), at least a second part (16a) of the captured environment (7) is represented in the form of a mirror image (18) of the at least one second part (16a) of the environment (7) on a defined area (17, 19, 20) of the vehicle representation (14).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a method for providing an image representation of at least a part of an environment of a vehicle on a display device, wherein the environment of the vehicle is captured at least in part by means of at least one vehicle sensor and the image representation of at least a part of the captured environment is provided within a defined viewport from a defined perspective, wherein the image representation comprises a vehicle representation representing the vehicle. Furthermore, the image representation is displayed on the display device. The invention also relates to a computer program product and a driver assistance system for a vehicle for providing an image representation of at least a part of the environment of the vehicle. Background Art

[0002] Some systems are known from the prior art, which seek to provide, for example, a 360° surround view of a vehicle, which can be displayed on a display device of the vehicle to help the driver, for example, in parking. For this purpose, a 360° top view of the vehicle's surroundings, for example including a representation of the vehicle, such as a 2D bitmap image of the vehicle itself, can be shown in a plan view. Systems are also known that are able to provide a 3D vehicle model, which allows dynamic changes in the viewing angle on the display scene. Typically, in order to capture the environment to provide such a visualization, a vehicle camera system comprising several cameras is used. In such a multi-camera automotive vision system, different types of views can be generated using multiple camera images. In such a visualization framework comprising several cameras and an electronic computing unit, the original camera images are first mapped to a target viewport and merged, thereby generating a mosaic image representing the view from a specific 3D point somewhere around the vehicle. In the simplest case, the virtual camera is placed above the car, and the projection surface is a flat 2D plane seen from the top center position. As mentioned above, this view is usually called a top view. More general cases include, for example, a bowl view, in which the projection 2D surface has a bowl shape and the virtual camera or virtual viewpoint is located at an arbitrary position in the 3D space.

[0003] Despite being able to change the viewing angle of the surrounding scene including the vehicle representation, it may still happen that, from a certain selected viewing angle, parts of the environment that may include relevant information are outside the defined viewport and are therefore not displayed and cannot be seen by the user. This can lead to a very critical situation. In order to ensure that the user does not miss any relevant information, the user can change the viewing angle of the representation of the entire surroundings of the vehicle. However, this would be very time-consuming and uncomfortable for the user. Therefore, for the sake of convenience, most users do not change the viewing angle all the time to ensure that no important information is missed. This again can lead to a very critical situation. Summary of the invention

[0004] It is therefore an object of the present invention to provide a method for providing a graphical representation of at least a portion of a vehicle's surroundings on a display device, a computer program product and a driver assistance system, by means of which the risk of missing important surrounding information can be reduced.

[0005] This object is solved by a method, a computer program product and a driver assistance system comprising the features according to the respective independent claims. Advantageous embodiments of the invention are presented in the dependent claims, the description and the drawings.

[0006] According to a method for providing an image representation of at least a portion of an environment of a vehicle on a display device in the context of the present invention, the environment of the vehicle is at least partially captured by at least one vehicle sensor, and an image representation of at least a first portion of the captured environment is provided within a defined viewport from a defined perspective, wherein the image representation comprises a vehicle representation representing the vehicle. Furthermore, the image representation is displayed on the display device. Furthermore, when providing the image representation, at least a second portion of the captured environment is represented in the form of a mirror image of the at least one second portion of the environment on a defined area of ​​the vehicle representation.

[0007] Thus, advantageously, a part of the environment, i.e. at least a second part of the environment, can be represented as a reflection on a defined area of ​​the vehicle, e.g. a reflection on a window of the vehicle representation. This has several great advantages. Firstly, it is thereby possible that a part of the environment which is not actually visible from the currently selected perspective can still be visible to the user on the display device in the form of a reflection (i.e. a mirror image) on at least a part of the vehicle representation. Thus, for a defined perspective and a defined viewport, additional information about the vehicle environment can be displayed simultaneously. Thus, the risk of the driver missing important information in the vehicle environment can be greatly reduced. For example, in the case where an environmental scene including the vehicle representation is displayed on the display device from a perspective of the vehicle representation from behind, and in the case where the driver is currently performing a parking operation to park the vehicle backwards into a parking space behind the vehicle, then the parking space itself cannot usually be seen from the perspective of the vehicle representation from behind, because from such a perspective essentially only the environmental information in front of the vehicle is displayed. However, by means of the present invention, the parking space and the surrounding area behind the vehicle can now still be seen as a reflection of the rear window of the vehicle representation, in particular in addition to the representation of the environmental part in front of the vehicle. Thus, by means of the present invention, more relevant information about the vehicle environment can be provided to the driver or user, which provides better assistance in different driving or parking situations, thereby greatly improving safety. Another great advantage of the invention is that the second part of the environment is displayed in the form of a mirror image or reflection on a defined area of ​​the vehicle representation. On the one hand, by providing this mirror image on a part of the vehicle representation, possibly important information provided by at least one first part of the captured environment cannot be hidden by the mirror image. On the other hand, by providing the information about the second part of the environment in the form of a reflection or mirror image, a natural impression of light reflections can be provided to the user, so that this additional information is provided in a very natural and realistic way and is therefore very easy and intuitive to recognize for the user. This again reduces distraction or irritation for the user, thereby also improving safety and again reducing the risk of missing important information. Furthermore, this realistic representation supports the driver in recognizing that this additionally displayed content represented in the form of a mirror image actually constitutes a reflection or mirror image of the second part of the environment, which is very helpful for being able to correctly position the second part of the environment represented by the mirror image relative to the vehicle.

[0008] Preferably, the at least one vehicle sensor is configured as a camera. Furthermore, the vehicle preferably comprises several cameras, in particular with a total field of view of 360°. The images of the environment captured by these cameras can then be merged together and mapped to a defined viewport from a selected viewing angle as described above. However, in general, the at least one vehicle sensor can be configured as any arbitrary vehicle sensor, such as a laser scanner, an ultrasonic sensor and / or a radar. With the aid of all these sensors, a representation of the vehicle environment or at least a part thereof can be provided by appropriately processing the captured sensor data to provide an image representation of the captured environmental information.

[0009] Furthermore, the mirror constitutes an image of the at least one second part of the environment, which at least one second part has been mirrored in a predefined manner, in particular computationally mirrored, for example according to physical laws of reflection or also with a defined deviation from physical laws of reflection, as will be described in more detail later.

[0010] Furthermore, according to a preferred embodiment of the invention, the second part of the environment is at least partially different from the first part of the environment. In other words, by mirroring, parts of the vehicle environment are visible that would otherwise not be seen on the defined viewport from a defined perspective. Thus, advantageously, the driver or user of the vehicle can be provided with additional information about its environment and the risk of missing important information can be reduced.

[0011] Furthermore, it is particularly advantageous when the defined area of ​​the vehicle representation constitutes a part of the vehicle representation relating to the windows of the vehicle, in particular the windscreen and / or the rear window and / or the roof window and / or the side windows. Thus, by additionally displaying the mirror image, the natural appearance of the vehicle representation can be maintained and the risk that the user may be distracted or annoyed can be reduced. However, in general the mirror image can be provided on any arbitrary part of the vehicle representation, for example on a part representing a door or a trunk lid.

[0012] According to another advantageous embodiment of the invention, the specific mirror image is determined in dependence on the defined geometry of the mirror plane associated with the defined area of ​​the vehicle representation on which the mirror image is displayed and / or on the defined viewing angle, and / or on the position and / or orientation of the mirror plane relative to the defined viewing angle. Thus, a very natural appearance of the mirror image can be achieved, since these dependencies correspond to the laws of real reflections. In other words, which second part of the environment is represented by means of the mirror image depends on the position of the defined viewing angle and the inclination of the surfaces of the vehicle representation, such as the geometry and surface inclination of the windows of the vehicle representation and the position of these virtual reflective surfaces relative to the virtual viewpoint from which the entire scene is finally displayed on the display device.

[0013] Furthermore, the vehicle representation can be provided in the form of a 2D image of the car, in particular a bitmap image, which represents the vehicle from a defined perspective. Such a vehicle representation in the form of a 2D image of the vehicle is particularly advantageous, for example for a top view. However, other views of the scene can also be provided in the form of several different defined perspectives. In this case, a corresponding 2D image can be defined for each perspective. Using a 2D image of the vehicle as the vehicle representation has advantages, in particular in combination with the representation of a mirror image on a portion of the vehicle representation, which is particularly computationally inexpensive. Thus, for each perspective, a corresponding mirror plane associated with a defined area of ​​the vehicle representation can be defined, and the mirror image can be easily calculated from a given perspective.

[0014] Therefore, another advantageous embodiment of the invention is when the viewing angle is adjustable to several predefined discrete viewing angles, wherein for each predefined viewing angle a corresponding 2D image of the vehicle is stored, and wherein in case of a change in the viewing angle the 2D image and the mirror image change accordingly. Thus, it is also advantageous that with limited processing power a plurality of different views on the scene can be provided, which are advantageously enriched with additional information provided by the mirror image, in particular the corresponding mirror image, since the content of the mirror image also depends on the selected viewing angle.

[0015] According to another advantageous embodiment of the invention, the vehicle representation is provided in the form of a vehicle model, in particular a 3D vehicle model, wherein the geometry of the mirror plane is determined by the geometry of a defined area of ​​the vehicle model on which the mirror is displayed. In other words, in order to calculate the real environment reflection of a part of the vehicle model, the geometry of this part of the 3D vehicle model can simply be used for these calculations. By using a 3D vehicle model as a vehicle representation, in particular in combination with the mirror, a more realistic scene visualization, in particular a dynamically changeable visualization, can be provided.

[0016] Therefore, it is another advantageous embodiment of the present invention, when the defined perspective is dynamically adjustable, wherein the representation and mirroring of the vehicle model is dynamically adjusted according to the dynamically adjusted perspective. Thus, environmental information can be provided from any viewpoint in 3D space, and advantageously, a continuous transition can be provided between different perspectives.

[0017] Furthermore, on the one hand, the mirror image can be simply calculated based on the physical laws of light reflection. Therefore, this is another advantageous embodiment of the invention when the mirror image is determined based on the physical laws of light reflection. This results in a very natural and realistic representation of the final display. On the other hand, this can also be very advantageous when the calculation of the mirror image does not strictly follow the physical laws of light reflection.

[0018] Therefore, when the mirror image is determined based on a limited deviation from the physical law of light reflection, this is another advantageous embodiment of the present invention. For example, the content to be displayed as a reflection on the vehicle representation can be pre-designed, for example to show hidden surrounding scenes, such as key scenes from the far corners of the vehicle. For example, the mirror image can be calculated as if the light from the second part of the environment would first pass through some virtual optics, such as a virtual lens, and then be reflected by the mirror plane to the virtual viewpoint. The design of such virtual optics then defines a limited deviation. Therefore, more important information can be provided to the user.

[0019] It is particularly advantageous if, when the mirror image is determined based on a defined deviation from the physical laws of reflection of light, the field of view from the defined viewing angle to the second part of the environment represented by the mirror image is larger than if the mirror image is determined based on the physical laws of reflection of light without a defined deviation. Preferably, the field of view is enlarged in particular in the horizontal direction, i.e. perpendicular to the vertical axis of the vehicle, which is very advantageous in most driving or parking situations. In order to create such a large field of view, not only can the input data of only one single sensor, such as a single camera, be used, but the calculation of the mirror image can also be based on environmental data provided by different sensors, in particular different (e.g. adjacent) cameras, which can then be appropriately fused and merged together. The mirror image can be calculated by simulating light from the second part of the environment through a virtual lens, which has, for example, fisheye properties in the horizontal direction, thereby providing a particularly large field of view in the horizontal direction, which is then virtually reflected on the defined mirror plane to the virtual viewpoint.

[0020] According to another advantageous embodiment of the invention, the defined area of ​​the vehicle representation changes depending on the change of the defined viewing angle. As mentioned above, it is very advantageous if the defined area of ​​the vehicle representation constitutes, for example, a window of the vehicle representation. Since the vehicle representation also includes several windows, such as a windshield, a rear window, side windows and possibly a top window, like a normal car, all these window representations of the vehicle representation can be used as a defined area, on which the mirror image is finally displayed, or several corresponding mirror images are displayed simultaneously. However, depending on the viewing angle, some of these window representations may be more suitable than others for use as a mirror plane. For example, if the image representation is displayed from the perspective of looking at the vehicle representation from behind, then using the rear window as a mirror plane to display the mirror image is more suitable than, for example, using the windshield, especially from such a viewing angle, the windshield of the vehicle representation may not even be visible. Therefore, according to this advantageous embodiment of the invention, the area of ​​the vehicle representation in which the mirror image should be displayed can also be advantageously selected according to the viewing angle. Preferably, if the viewing angle is from behind the vehicle representation, the rear window of the vehicle representation is used as the defined area of ​​the vehicle representation, if the viewing angle is from somewhere in the front the vehicle representation, the defined area comprises the windshield representation of the vehicle representation, if the defined viewing angle is from somewhere in the side the vehicle representation, then preferably one of the side windows of the vehicle representation constitutes the defined area of ​​the vehicle representation, and in case of a top view the defined area consists of at least the rear window and the windshield of the vehicle representation, and optionally also of the side windows of the vehicle representation. Advantageously, by changing the viewing angle of the image representation the user can now change not only the field of view represented as the environment surrounding the vehicle representation, but also the field of view of the second part of the ring represented as a reflection on at least a part of the vehicle surface.

[0021] According to another advantageous embodiment of the invention, the reflectivity of the mirror is adjustable, wherein the mirror and the defined area of ​​the vehicle representation are cross-faded according to the adjusted reflectivity. Thus, the reflectivity can be adjusted automatically, for example, depending on the driving situation. For example, in normal driving situations, the reflectivity can be set to 20%, which means that 20% of the mirror is visible on the defined area of ​​the vehicle representation and 80% of the defined area of ​​the vehicle representation itself is visible, such as a window representation. A reflectivity of 0% then means that the mirror is not displayed and only the defined area of ​​the vehicle representation is visible, while a reflectivity of 100% means that only the mirror can be seen, like an ideal reflector, but the part of the vehicle represented in the defined area of ​​the vehicle representation is not visible at all. When parking in a parking space where the environmental information is much more important than in normal driving situations, the reflectivity can be increased so that the user can now easily collect the environmental information presented by the mirror. However, the reflectivity can also be adjusted by the user himself. For example, the reflectivity can be adjusted between 0 and 100%. This is very advantageous because the user can thereby set the reflectivity according to his preferences. At the same time, the user can also be provided with the option of turning on or off this glass reflection feature. If the user switches off the display of the mirror image, the vehicle representation, in particular defined areas such as windows of the vehicle representation, are displayed transparently, for example, with no or only very weak reflections of the scene.

[0022] The present invention also relates to a computer program product comprising program code stored in a computer readable medium and, when executed by a processor of an electronic control device, causing the processor to: provide an image representation of at least a first portion of a captured vehicle environment within a defined viewport from a defined perspective, wherein the image representation comprises a vehicle representation representing the vehicle; and display the image representation on a display device. In addition, the computer program product further comprises causing the processor to represent at least a second portion of the captured environment in the form of a mirror image of the at least one second portion of the environment on a defined area of ​​the vehicle representation when providing the image representation.

[0023] Furthermore, the invention relates to a driver assistance system for a vehicle for providing an image representation of at least a portion of a vehicle environment on a display device, wherein the driver assistance system comprises: at least one vehicle sensor configured to at least partially capture an environment of the vehicle; a processing unit configured to provide an image representation of at least a first portion of the captured environment within a defined viewport from a defined perspective, wherein the image representation comprises a vehicle representation representing the vehicle; and a display device configured to display the image representation. Furthermore, the processing unit is configured to, when providing the image representation, represent at least a second portion of the captured environment in the form of a mirror image of the at least one second portion of the environment on a defined area of ​​the vehicle representation.

[0024] Furthermore, a vehicle comprising a driver assistance system according to the invention is also to be regarded as belonging to the present invention.

[0025] The advantages described with regard to the method according to the invention and its exemplary embodiments also apply to the computer program product according to the invention, the driver assistance system and the vehicle according to the invention.

[0026] Preferably, the at least one sensor is configured as at least one camera. Preferably, the driver assistance system comprises several cameras, for example four cameras, such as a front camera mounted at the front of the vehicle, a rear camera mounted at the rear of the vehicle, a left rearview mirror camera mounted on the left rearview mirror of the vehicle and a right rearview mirror camera mounted on the right rearview mirror of the vehicle. At each time step, these cameras may capture an image of the vehicle environment, which may then be projected from a defined virtual viewpoint defining a defined viewing angle to a given viewport, thereby providing a corresponding output image, in which a vehicle representation is inserted and displayed on a display device, in particular a display device of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Further features of the invention are apparent from the claims, the drawings and the description of the drawings. The features and feature combinations mentioned above in the description of the drawings and / or the features and feature combinations only shown in the drawings can be used not only in the respectively specified combinations, but also in other combinations or alone without departing from the scope of the invention. Therefore, embodiments should also be considered to be included and disclosed by the present invention, which are not explicitly shown and described in the drawings, but appear and arise from feature combinations separated from the described embodiments. Embodiments and feature combinations should also be considered to be disclosed and therefore do not have all the features of the originally formulated independent claims. In addition, embodiments and feature combinations should be considered to be disclosed, especially through the embodiments described above, which exceed or deviate from the feature combinations described in the relationship of the claims.

[0028] In the accompanying drawings:

[0029] Figure 1 is a schematic diagram of a vehicle having a driver assistance system according to an embodiment of the present invention;

[0030] Figure 2 is a schematic diagram of a projection surface configured as a bowl with an inserted model of a vehicle according to one embodiment of the present invention;

[0031] Figure 3 is a schematic diagram of an image representation displayed on a vehicle display device according to an embodiment of the present invention; and

[0032] Figure 4FIG. 4 is a schematic diagram of an image representation displayed on a vehicle display device according to another embodiment of the present invention. DETAILED DESCRIPTION

[0033] Figure 1 A schematic diagram of a vehicle 1 including a driver assistance system 2 according to an embodiment of the present invention is shown. The driver assistance system 2 includes at least one environmental sensor, in this case four cameras 3, 4, 5, 6, namely a front camera 3, a rear camera 4, a left rearview mirror camera 5 and a right rearview mirror camera 6. Each camera 3, 4, 5, 6 can be configured as a wide-angle camera. Therefore, each of the cameras 3, 4, 5, 6 can capture a very large field of view. In this example, the front camera 3 includes a corresponding field of view FOV1, which is limited by the illustrated boundary line 3a in the horizontal plane. Similarly, the rear camera 4 includes a corresponding field of view FOV2, which is limited by the corresponding boundary line 4a in the horizontal plane. The left rearview mirror camera 5 includes a corresponding field of view FOV3, which is limited by the illustrated boundary line 5a in the horizontal plane, and the right rearview mirror camera 6 includes a corresponding field of view FOV4, which is limited by the illustrated boundary line 6a in the horizontal plane. Hence, each of the cameras 3, 4, 5, 6 is configured to capture a corresponding part 7a, 7b, 7c, 7d of the environment 7 of the vehicle 1. Furthermore, the fields of view FOV1, FOV2, FOV3, FOV4 overlap in pairs.

[0034] The driver assistance system 2 further comprises a processing unit configured as an image processing module 8. The image processing module 8 maps the images captured by the respective cameras 3, 4, 5, 6 onto a target surface, such as a bowl 9 (see Figure 2 ) or a flat 2D plane, and then merges and renders the images from an arbitrarily selected virtual camera to a viewport 10 at a virtual viewpoint 11 (see Figure 2 ), thereby defining a viewing angle. A graphical representation of the environment within the viewport 10 and further a representation of the vehicle 1 are then displayed on a display device 12 of the vehicle 1 .

[0035] Figure 2 A schematic diagram of a projection surface, which in this example is configured as a bowl 13, together with a 3D model of a vehicle 1 as an example of a vehicle representation 14 is shown. As described above, the images captured by the vehicle cameras 3, 4, 5, 6 are merged together and projected on the surface of the bowl 13. Furthermore, a certain viewport 10 is defined, which depends on the position of the selected viewing angle, which is represented here by a virtual viewpoint 11. In this example, the viewing angle 11 is selected so as to provide a view from behind of the vehicle 1 represented by the vehicle model or as a whole by the vehicle representation 14. The final image representation 15 finally displayed on the display device 12 of the vehicle 1 is shown in FIG. Figure 3 shown.

[0036] Advantageously, not only a first part 10a of the environment 7 of the vehicle 1 associated with the viewport 10 is shown, but also a second part 16a of the environment 7 of the vehicle 1 is shown. Figure 2 14 and can therefore be considered to be associated with the second viewport 16. The second portion 16a is displayed in the form of a mirror image 18 of the second portion 16a of the environment 7 on a specific area of ​​the vehicle representation 14, in particular on the rear window 17 in this example (see Figure 3 ). Thus, additional environmental information can be displayed to the user of the vehicle 1 in a very natural and realistic manner.

[0037] In general, any window representation 17 may be used to display a mirror image 18, such as a representation of a windshield 19 or a side window 20, as shown in FIG. Figure 4 In particular, Figure 4 A schematic diagram of another example of an image representation 15 in the form of a top-down image is shown, wherein a virtual viewpoint 11 is located directly above a vehicle 1, which is also represented by a corresponding vehicle representation 14. In this case, the vehicle representation 14 is preferably provided by a 2D bitmap image. In this example, the corresponding viewport 10 is the ground plane, and advantageously, in this case, other parts of the environment that are not within the defined viewport are presented as corresponding mirror images 18 on the windows 17, 19, 20 of the vehicle representation 14.

[0038] Therefore, it is particularly advantageous when the mirror image 18 is presented on the part of the vehicle representation 14 that constitutes the windows 17, 19, 20, because this gives the user a very natural impression of light reflection. By showing an additional part of the environment in the form of such a mirror image 18, for example using a glass window, it is possible to Figure 4 10 or outside any other selected viewport 10 reflecting key scenes in the environment 7, such as in Figure 3 In the example of FIG. 7 , this greatly helps to improve the driver's observation of the environment 7.

[0039] In order to provide such a mirror image 18, the calculation can strictly follow the physical laws of light reflection. To this end, in the case where the vehicle representation 14 is provided in the form of a 3D vehicle model 14, a mirror plane can be defined, which can be determined by the geometry of a defined area of ​​the vehicle representation 14, on which the mirror image 18 is displayed. However, in the case where the vehicle 1 is represented by a 2D bitmap image, a defined area (such as a window area) can be associated with a corresponding mirror plane, on which light from the environment 7 is reflected according to the model calculation, in particular depending on the position of the virtual viewpoint 11.

[0040] Furthermore, when calculating the mirror image 18, limited deviations from the physical laws of light reflection can also be allowed. This means that the scene displayed on the glass can be pre-designed to show hidden surrounding scenes, such as key scenes from the far corners of the vehicle 1. Advantageously, therefore, the field of view provided by the mirror image 18 can be enlarged by this artificial deviation from the laws of light reflection. In this case, image distortion and viewport design can be applied to expand the field of view. Image distortion and viewport design are techniques for transforming the original images of the real cameras 3, 4, 5, 6 to correctly display more interesting image content.

[0041] This reflection feature, i.e. showing a part of the environment as a mirror image, may be particularly useful for some vehicle operational operations, such as reverse parking a vehicle into a parking space. Furthermore, the reflection level is also adjustable, in particular by the user, which defines the brightness or intensity of the reflection that appears on a defined area of ​​the vehicle representation 14. To this end, the user may be provided with any kind of input device to adjust the reflection level according to his preferences. A default reflection level may also be provided so that the reflection is as natural as possible, such as 20%. Furthermore, the user may be provided with the option of turning this glass reflection feature on or off. Thus, when this feature is off, the glass will appear transparent with no or only very weak reflection of the scene.

[0042] In summary, with the help of the present invention or its embodiments, additional possibly critical content can be displayed to the user in a very natural and realistic way, without hiding any other relevant representation parts of the environment, which is therefore very beneficial in many driving and parking situations and reduces the risk of missing critical information.

Claims

1. A method for providing a graphical representation (15) of at least part of an environment (7) of a vehicle (1) on a display device (12), comprising the following steps: at least partially capturing the environment (7) of the vehicle (1) by means of at least one vehicle sensor (3, 4, 5, 6); providing an image representation (15) of at least a first portion (10a) of the captured environment (7) within a defined viewport (10) from a defined perspective (11), wherein the image representation (15) includes a vehicle representation (14) representing the vehicle (1); and displaying the image representation (15) on the display device (12); It is characterized in that When providing the image representation (15), at least one second part (16a) of the captured environment (7) is represented on a defined area of ​​the vehicle representation (14) in the form of a mirror image (18) of the at least one second part (16a) of the environment (7), The defined area of ​​the vehicle representation (14) forms a part of a window (17, 19, 20) of the vehicle representation (14) relating to the vehicle (1).

2. The method according to claim 1, It is characterized in that The second part (16a) of the environment (7) is at least partially different from the first part (10a) of the environment (7).

3. The method according to any one of the preceding claims, It is characterized in that The specific mirror (18) is determined based on a defined geometry of a mirror plane associated with the defined area of ​​the vehicle representation (14) displaying the mirror (18) and / or the defined viewing angle (11), and / or based on a position and / or orientation of the mirror plane relative to the defined viewing angle (11).

4. The method according to claim 1 or 2, It is characterized in that The vehicle representation (14) is provided in the form of a 2D image of the vehicle (1), the 2D image representing the vehicle (1) from the defined viewing angle (11).

5. The method according to claim 1 or 2, It is characterized in that The viewing angle (11) is adjustable to several predefined discrete viewing angles (11), wherein a corresponding 2D image of the vehicle (1) is stored for each predefined viewing angle (11), wherein when the viewing angle (11) changes, the 2D image and the mirror image (18) change accordingly.

6. The method according to claim 3, It is characterized in that The vehicle representation (14) is provided in the form of a vehicle model, wherein the geometry of the mirror plane is determined by the geometry of the defined area of ​​the vehicle model on which the mirror image (18) is displayed.

7. The method according to claim 1 or 2, It is characterized in that The defined viewing angle (11) is dynamically adjustable, wherein the representation of the vehicle model and the mirror image (18) are dynamically adjusted according to the dynamically adjusted viewing angle (11).

8. The method according to claim 1 or 2, It is characterized in that The defined area of ​​the vehicle representation (14) changes according to changes in the defined viewing angle (11).

9. The method according to claim 1 or 2, It is characterized in that The mirror image (18) is determined based on the physical law of light reflection.

10. The method according to claim 1 or 2, It is characterized in that The mirror image (18) is determined based on defined deviations from physical laws of light reflection.

11. The method according to claim 1 or 2, It is characterized in that The mirror image (18) is determined based on a defined deviation from the physical law of reflection of light, so that the field of view from the defined viewing angle (11) to the second part (16a) of the environment (7) represented by the mirror image (18) is larger than the field of view in the case where the mirror image (18) is determined based on the physical law of reflection of light without the defined deviation.

12. The method according to claim 1 or 2, It is characterized in that The reflectivity of the mirror image (18) is adjustable, wherein the mirror image (18) and the defined area of ​​the vehicle representation (14) are alternately changed in accordance with the adjusted reflectivity.

13. The method according to claim 1 or 2, It is characterized in that The windows of the vehicle (1) are a windshield (19) and / or a rear window (17) and / or a roof window and / or a side window (20).

14. The method according to claim 4, It is characterized in that The 2D image is a bitmap image.

15. A computer program product comprising a program code stored in a computer readable medium and which, when executed by a processor of an electronic control device (8), causes the processor to perform the following steps: providing an image representation (15) of at least a first portion (10a) of a captured environment (7) within a defined viewport (10) from a defined perspective (11), wherein the image representation (15) includes a vehicle representation (14) representing a vehicle (1); and displaying the image representation (15) on a display device (12); It is characterized in that The computer program product further comprises, when providing the image representation (15), causing the processor to represent at least one second part (16a) of the captured environment (7) in the form of a mirror image (18) of the at least one second part (16a) of the environment (7) on a defined area of ​​the vehicle representation (14), wherein the defined area of ​​the vehicle representation (14) constitutes a part of a window (17, 19, 20) of the vehicle representation (14) relating to the vehicle (1).

16. A driver assistance system (2) for a vehicle (1) for providing a graphical representation (15) of at least a portion of an environment (7) of the vehicle (1), wherein: The driver assistance system (2) comprises: at least one vehicle sensor (3, 4, 5, 6) configured to at least partially capture an environment (7) of the vehicle (1); a processing unit (8) configured to provide an image representation (15) of at least a first portion (10a) of the captured environment (7) within a defined viewport (10) from a defined perspective (11), wherein the image representation (15) comprises a vehicle representation (14) representing the vehicle (1); and a display device (12) configured to display the image representation (15); It is characterized in that The processing unit (8) is configured to represent at least one second part (16a) of the captured environment (7) in the form of a mirror image (18) of the at least one second part (16a) of the environment (7) on a defined area of ​​the vehicle representation (14) when providing the image representation (15), The defined area of ​​the vehicle representation (14) forms a part of a window (17, 19, 20) of the vehicle representation (14) relating to the vehicle (1).

17. The driver assistance system (2) according to claim 16, wherein: The windows of the vehicle (1) are a windshield (19) and / or a rear window (17) and / or a roof window and / or a side window (20).