DEVICE AND METHOD FOR ADJUSTING IMAGE PROCESSING BASED ON A FORM OF DISPLAY DEVICE FOR A MOTOR VEHICLE

Description

Technical field

[0001] The present invention relates to image processing and display systems in motor vehicles.

[0002] In particular, the present invention relates to a device and a method for adapting image processing based on a shape of a display device of an A-pillar for a motor vehicle. Technical background

[0003] Current image processing functions for 360° vehicle surround view systems (also known as surround-view systems) do not take the shape of the display or display unit into account. However, the shape of the display or display unit has a significant impact on the visualization quality.

[0004] Visible reprojection artifacts from other moving car components, such as side or rear doors and fuel filler caps, can also occur.

[0005] WO 2015 / 044280 A1 describes a method and device for controlling an image generation device of a head-up display.

[0006] EP 3082127A1 describes a display control unit, heads-up image display system and a method.

[0007] US 2008 / 089611 A1 describes a heads-up image display system and method.

[0008] DE 10 2007 021 230 A1 describes a method for calibrating a large number of projection devices. EP 3082127A1 describes a display control unit, a heads-up display system, and a method.

[0009] US 2008 / 089611 A1 describes a heads-up image display system and method.

[0010] Publication EP 2 127 950 A1 describes a method and a device for enlarging the field of vision of a driver in a motor vehicle. For this purpose, images are captured using at least one camera located outside the vehicle and further processed in electronic processing units, resulting in images that correspond to the driver's field of vision as it would appear without the obstacles limiting it. These images are then projected section by section onto projection surfaces attached to the inside of the obstacles in the front of the vehicle by means of at least one projection device located inside the vehicle. Summary of the invention

[0011] It is an object of the present invention to provide an improved all-round view or environment display of the motor vehicle for a driver assistance system.

[0012] This problem is solved by the subject matter of the independent patent claims. Further developments and embodiments can be found in the dependent patent claims, the description, and the figures in the drawings.

[0013] A first aspect of the present invention relates to a device for adapting image processing based on a form of a display device for a motor vehicle.

[0014] The device for adapting image processing based on a shape of a display device for a motor vehicle comprises a detection device which is configured to detect a shape of a display device and an extrinsic camera parameter of a camera, an intrinsic camera parameter of the camera, and at least one field of view of the camera.

[0015] In other words, the acquisition device is designed to acquire the camera's extrinsic and intrinsic parameters; this can include acquiring all extrinsic and intrinsic camera parameters.

[0016] The device further comprises a computing unit which is configured to calculate a reprojection surface and a correspondence table based on the detected shape of the display device and based on the extrinsic camera parameter, the intrinsic camera parameter, and the at least one field of view.

[0017] The device further comprises an image processing unit which is designed to perform adapted image processing based on the calculated reprojection surface and the calculated correspondence table.

[0018] The term "shape" of the display device as used by the present invention includes, for example, the characteristics of the surface of the display device, such as the curvature over a display width.

[0019] Advantageous embodiments of the present invention can be found in the dependent claims.

[0020] According to the invention, the detection device is designed to detect the shape of the display device of an A-pillar of a motor vehicle.

[0021] In an advantageous embodiment of the present invention, the computing device is configured to calculate the reprojection surface to compensate for a curvature of the display device.

[0022] This makes it advantageous to improve the quality of the display of environmental scenarios and to avoid image distortions of displayed image information.

[0023] In an advantageous embodiment of the present invention, the computing device is configured to calculate the reprojection surface based on a projected display grid.

[0024] In an advantageous embodiment of the present invention, the computing device is configured to generate the projected display grid on a partial area of ​​the viewing field.

[0025] According to the invention, the shape of the display device of an A-pillar of a motor vehicle is captured.

[0026] In an advantageous embodiment of the present invention, it is provided that the reprojection surface is calculated to compensate for a curvature of the display device.

[0027] In an advantageous embodiment of the present invention, it is provided that the reprojection surface is calculated based on a projected display grid.

[0028] In an advantageous embodiment of the present invention, it is provided that the projected display grid is generated on a partial area of ​​the field of view.

[0029] The described configurations and training programs can be combined in any way desired.

[0030] Further possible embodiments, developments and implementations of the present invention also include combinations of features of the present invention described previously or subsequently with regard to the embodiments that are not explicitly mentioned.

[0031] The accompanying drawings are intended to provide a further understanding of the embodiments of the present invention.

[0032] The accompanying drawings illustrate embodiments and serve, in connection with the description, to explain concepts of the present invention.

[0033] Other embodiments and many of the aforementioned advantages become apparent with regard to the figures in the drawings. The elements depicted in the figures in the drawings are not necessarily shown to scale. Brief description of the characters

[0034] They show: Fig. 1 is a schematic representation of a device for adapting image processing based on the shape of a display device for a motor vehicle according to an embodiment of the present invention; Fig. 2 is a schematic representation of a flowchart of a method for adapting image processing based on the shape of a display device for a motor vehicle according to a further embodiment of the present invention; and Fig. 3 is a schematic representation of a method for adapting image processing based on the shape of a display device for a motor vehicle according to a further embodiment of the present invention; Fig. 4 is a schematic representation of a simulation of camera reprojection with image rectification of the display shape according to a further embodiment of the present invention. Detailed description of the exemplary implementations

[0035] In the figures of the drawings, identical reference numerals denote identical or functionally equivalent elements, components, parts or process steps, unless otherwise stated.

[0036] The motor vehicle or vehicle is, for example, a motor vehicle or a hybrid vehicle, such as a hybrid vehicle with a sailing function, such as a motorcycle, a bus or a truck or a bicycle.

[0037] The Fig. 1 shows a schematic representation of a device for adapting image processing based on a form of a display device for a motor vehicle according to an embodiment of the present invention.

[0038] The device 100 for adapting an image processing system based on a form of a display device 200 for a motor vehicle comprises a detection device 10 and a computing device 20 as well as an image processing device 30.

[0039] The device 100 can therefore provide an improved camera surround view system with adapted image reprojection.

[0040] The detection device 10 is designed to detect a form of a display device 200 and at least one extrinsic camera parameter of a camera, at least one intrinsic camera parameter of the camera, and at least one field of view of the camera.

[0041] The computing device 20 is designed to calculate a reprojection surface and a correspondence table based on the captured shape of the display device 200 and based on the at least one extrinsic camera parameter, the at least one intrinsic camera parameter, and the at least one field of view.

[0042] The image processing unit 30 is designed to perform customized image processing based on the calculated

[0043] to perform the reprojection area and the calculated correspondence table.

[0044] The Fig. 2 shows a schematic representation of a flowchart of a method for adapting an image processing system based on a form of a display device for a motor vehicle according to a further embodiment of the present invention.

[0045] The procedure for adapting an image processing system based on a form of a display device 200 for a motor vehicle comprises the following procedure steps: As a first process step, the shape of the display device 200 is acquired S1 by means of an acquiring device 10. As a second process step, an extrinsic camera parameter, an intrinsic camera parameter, and at least one field of view of the camera are acquired S2 by means of the acquiring device 10. As a third process step, a reprojection surface and a correspondence table are calculated S3 based on the acquired shape of the display device 200 and based on the at least one extrinsic camera parameter, the at least one intrinsic camera parameter, and the at least one field of view of the camera by means of a computing device 20. As a fourth process step, the adapted image processing is carried out S4 based on the calculated reprojection surface and the calculated correspondence table by means of an image processing device 30.

[0046] The Fig. 3 Figure 1 shows a schematic representation of a method for adapting an image processing system based on a form of a display device 200 for a motor vehicle according to a further embodiment of the present invention.

[0047] The Fig. 4 Figure 1 shows a schematic representation of a simulation of camera reprojection with rectification of the display shape according to a further embodiment of the present invention.

[0048] It should also be noted that "comprehensive" and "include" do not exclude any other elements or steps, and "a" or "an" does not exclude a multitude.

[0049] Furthermore, it should be noted that features or steps described with reference to one of the above embodiments may also be used in combination with other features or steps from other embodiments described above. Reference numerals in the claims are not to be considered as limitations.

Claims

1. An apparatus (100) for adapting image processing based on a shape of a display device (200) for a motor vehicle, the apparatus (100) comprising: - a detection device (10), which is configured to detect the shape of the display device (200) and an extrinsic camera parameter of a camera, an intrinsic camera parameter of the camera, and at least one field of view of the camera; and - a computing device (20), which is designed to calculate a reprojection surface and a correspondence table based on the detected shape of the display device (200) and based on the extrinsic camera parameter, the intrinsic camera parameter, and the at least one field of view; and - an image-processing device (30), which is designed to carry out adapted image processing based on the calculated reprojection surface and the calculated correspondence table, characterized in that the detection device (10) is designed to detect the shape of the display device (200) of an A pillar of a motor vehicle.

2. The apparatus according to claim 1, wherein the computing device (20) is designed to calculate the reprojection surface for compensating for a curvature of the display device (200).

3. The apparatus according to any one of the preceding claims, wherein the computing device (20) is designed to calculate the reprojection surface based on a projected display grid.

4. The apparatus according to claim 3, wherein the computing device (20) is designed to generate the projected display grid on a partial surface of the field of view.

5. A method for adapting image processing based on a shape of a display device (200) for a motor vehicle, the method comprising the following method steps: - detecting (S1) the shape of the display device (200) by means of a detection device (10); and - detecting (S2) an extrinsic camera parameter, an intrinsic camera parameter, and at least one field of view of the camera by means of the detection device (10); and - calculating (S3) a reprojection surface and a correspondence table based on the detected shape of the display device (200) and based on the extrinsic camera parameter, the intrinsic camera parameter, and the at least one field of view of the camera using a computing device (20); and - carrying out (S4) the adapted image processing based on the calculated reprojection surface and the calculated correspondence table by means of an image processing device (30), characterized in that the shape of the display device (200) of an A pillar of a motor vehicle is detected.

6. The method according to claim 5, wherein the reprojection surface is calculated for compensating for a curvature of the display device (200).

7. The method according to any one of the preceding claims 5 to 6, wherein the reprojection surface is calculated based on a projected display grid.

8. The method according to claim 7, wherein the projected display grid is generated on a partial surface of the field of view.