Providing environment display on motor vehicle

Abstract

The invention relates to a method (200) for providing an environment display on a motor vehicle (105), comprising the following steps: creating a first image (305) of a region behind the motor vehicle (105); creating a second image (310) of a region behind the motor vehicle (105); a viewing angle (140) of the first image (305) is greater than a viewing angle (145) of the second image (310); the second image (310) is clipped into the first image (305) and a resulting third image (315) is provided.

Description

Technical Field

[0001] The present invention relates to providing an environment display on a motor vehicle. In particular, the present invention relates to a camera monitor system. Background Art

[0002] A motor vehicle comprises a camera monitor system (CMS) which is provided to replace a conventional rearview mirror. The CMS comprises a camera which is provided to scan the surrounding area behind the motor vehicle and a monitor for displaying the detected camera image. The installation positions of the camera and the monitor are preferably coordinated with each other in order to provide the driver of the motor vehicle with a visual impression similar to that of a rearview mirror.

[0003] In order to replace the side mirror, a camera can be installed on the side of the motor vehicle, and the monitor is preferably installed on the same side of the vehicle. In order to replace the interior rearview mirror, a camera can be set, which is arranged centrally in the transverse direction of the vehicle. The associated monitor can also be arranged centrally. In one embodiment, the two CMSs can also be combined with each other in that the same monitor is used for both cameras. The monitor is usually installed in the center console between the driver and the co-driver. However, this central monitor may be used to a large extent or completely because of the display of two camera images. Then it may no longer be possible to operate other devices, such as air conditioning equipment or entertainment systems. In another embodiment, the camera image occupies only a part of the monitor, wherein only the camera image of the one or the other camera can be displayed. Summary of the invention

[0004] In different driving states of a motor vehicle, different views of the surroundings may be required. The object of the invention is to provide an improved technology for displaying the surroundings of a motor vehicle by means of a camera mirror system. The invention achieves this object by means of the technical solution of the independent claim. The dependent claims provide preferred embodiments.

[0005] According to a first aspect of the invention, a method for providing an environment display on a motor vehicle comprises the following steps: creating a first image of an area behind the motor vehicle; creating a second image of the area behind the motor vehicle; wherein the viewing angle of the first image is greater than the viewing angle of the second image; splicing the second image into the first image and providing the resulting third image.

[0006] It is known that different cameras on a motor vehicle have different viewing angles, wherein the image provided by a camera with a smaller viewing angle represents a portion of the image of another camera with a larger viewing angle. Therefore, a second image can be spliced ​​into a first image to generate a third image. The transition between the first and second image can be designed in such a way that no or only very small geometric deformations, missing image content or jumps are perceptible in the display. In order to splice the second image into the first image, a technique known as "stitching" can be used.

[0007] The third image can be provided to the driver of the motor vehicle. The third image can be displayed on a single monitor, which simultaneously displays the contents of the two cameras.

[0008] The geometry of the first and second images is preferably adapted to one another with respect to the third image. For this purpose, the selection, size or deformation of the image parts can be adapted. In various embodiments, the geometry of the first image can be adapted to the geometry of the second image or vice versa. It is also possible to adapt the geometry of the two images to the geometry of the previous level. In another embodiment, it is also possible to adapt the brightness or color range of the two images to one another.

[0009] It is preferred that the parameters of the adaptation are fixed and predetermined. The parameters can be predetermined based on the characteristics of the camera providing the first image or the second image. The installation position, orientation or viewing angle or focal length of the camera on the motor vehicle can be assumed to be known. These characteristics of the camera are usually constant. Adapting the images to each other based on predetermined geometric information can be called pre-warping. In this case, it is not necessary to analyze the image content for geometric adaptation. Geometric adaptation can be performed quickly and accurately. The required resources in terms of processing technology may be small.

[0010] In a particularly preferred embodiment, the third image is magnified by a predetermined magnification factor and cut to a predetermined size. The predetermined size may correspond in particular to a display area on a monitor provided for the third image.

[0011] The magnification factor can now be freely selected so that a portion of the third image selected according to the magnification factor can be displayed on a predetermined display surface. If the magnification factor is changed, the impression is given that the camera has been moved or the focal length of the underlying camera has changed. This effect is called zooming in or zooming out. The greater the magnification factor is selected, the more the third image is influenced by the second image or is represented by the second image. If the magnification factor is selected to be smaller, the second image is less prominent.

[0012] The change in the magnification factor can preferably be animated. In one embodiment of the method, the change in the magnification factor is determined and the enlargement of the third image is caused to continuously track the magnification factor. For this purpose, a series of third images with different magnification factors can be provided. The enlargement of the third image is preferably tracked in such a way that a perceptible magnification or reduction effect is produced for the observer. In one embodiment, enough third images are displayed so that a continuous animation is produced for the observer.

[0013] The enlargement can be tracked at a predetermined speed. The predetermined speed can be constant or follow a predetermined curve. In another embodiment, the enlargement follows a predetermined speed curve. The predetermined curve can in particular describe slow changes at the beginning and / or end of the animation and faster changes in between. Switching between different views characterized by different magnification factors can be intuitive for the observer. The observer can be continuously provided with a view of the environment and the view can be adapted to the current situation by correspondingly selecting the magnification factor.

[0014] In a particularly preferred embodiment, the first and second magnification factors are predetermined. A speed curve can be applied between the magnification factors. The first magnification factor can be assigned to the first display and the second magnification factor can be assigned to the second display.

[0015] One of the predetermined amplification factors can be selected as a function of a signal indicating whether the motor vehicle should be driven forward or reverse. The signal can be provided in particular by a transmission that can be switched between forward and reverse driving. The signal can also be provided by an operating element for such a transmission. In an automatic transmission, forward driving can be indicated by a driving position D and reverse driving can be indicated by a driving position R. In a manual transmission, a plurality of forward gears and one or more reverse gears can be manually engaged.

[0016] If the motor vehicle is to be driven backwards, a smaller magnification factor can be selected so that the viewing angle of the displayed third image is large and the observer can have a good overview of the area behind the motor vehicle. If the motor vehicle is to be driven forwards, the magnification factor can be selected to be higher so that the observer can be presented with a third image having a smaller viewing angle. Thus, views adapted for forward and reverse driving can be displayed on a single monitor. The transition between the displays can be animated so that the motor vehicle can be better controlled depending on the display of the third image.

[0017] According to another aspect of the present invention, an apparatus for providing an environmental display on a motor vehicle includes a first camera for providing a first image of an area behind the motor vehicle; a second camera for providing a second image of the area behind the motor vehicle; a viewing angle of the first image being greater than a viewing angle of the second image; and a processing device configured to splice the second image into the first image and display the resulting third image.

[0018] The processing device is preferably configured to partially or completely execute the method described herein. For this purpose, the processing device can be implemented electronically and can include, for example, an integrated circuit, a programmable logic module or a programmable microcomputer. The method can be implemented in the form of a configuration or as a computer program product with program code means for the processing device. The configuration or the computer program product can be stored on a computer-readable data carrier. The features or advantages of the method can be transferred to the device, or vice versa.

[0019] The device may include a display device for displaying the third image to the driver of the motor vehicle. The display device is preferably mounted in front of the driver so that the driver can see the area of ​​the environment of the motor vehicle behind him on the display device.

[0020] The display device may be characterized in that its width is significantly greater than its height. In one embodiment, the ratio of the width to the height of the third image on the display device is greater than four. The ratio may also be greater than five or more preferably greater than six. In another embodiment, the ratio may be twelve or greater.

[0021] For example, the display device may include a head-up display. The display device can be displayed on the motor vehicle by means of projection technology. It is possible that the display area of ​​the display device actually occupies the entire width of the interior of the motor vehicle. Accordingly, the height of the display area can be significantly smaller. For example, the projection can be performed on the lower edge of the front windshield. This type of display is called a panoramic head-up display (Panorama-Head-Up-Anzeige).

[0022] According to another aspect of the present invention, a motor vehicle comprises the device described herein. The motor vehicle preferably comprises a car. In other embodiments, the motor vehicle may also comprise a truck or a bus, for example. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The present invention will now be described in more detail with reference to the accompanying drawings. The accompanying drawings are as follows:

[0024] Figure 1 Showing the system;

[0025] Figure 2 a flow chart showing the method;

[0026] Figure 3 showing an exemplary splicing of the second image into the first image; and

[0027] Figure 4 An exemplary representation of a third image on a display device on board a motor vehicle is shown. DETAILED DESCRIPTION

[0028] Figure 1 A system 100 is shown with a motor vehicle 105, which includes a device 110. Device 110 is provided for scanning a portion of an environment 115 of motor vehicle 105 and displaying it in motor vehicle 105. The display is in particular for a person 120, who may be the driver of motor vehicle 105. Purely by way of example, Figure 1 A person 120 is shown on the left side of the vehicle.

[0029] The device 110 includes a processing device 125, a first camera 130 and a second camera 135. The first camera 130 may in particular include a reversing camera, which is further preferably centrally mounted on the motor vehicle 105 in the transverse direction. The second camera 135 may include a side camera, which may be mounted on the right or left side of the motor vehicle 105. As shown in the figure, the second camera 135 may be mounted approximately at the height of the first row of seats in the longitudinal direction. In another embodiment, the second camera 135 may also be movable in the longitudinal direction, in particular backwards. Figure 1 In the illustration of FIG. 1 , two second cameras 135 are shown on sides that are opposite to each other.

[0030] The first camera 130 operates at a first viewing angle 140 and the second camera 135 operates at a second viewing angle 145. In this case, the first viewing angle 140 is greater than the second viewing angle 145. The first viewing angle 140 can be, for example, in the range of approximately 180°. The second viewing angle 145 is typically approximately 60° or less. In this case, the scanning areas of the cameras 130, 135 overlap, in particular in the area behind the motor vehicle 105.

[0031] The device 110 may also include a display device 150, which is implemented, for example, as a projection surface of a panoramic head-up display (pHUD). An optional interface 155 is provided for detecting a signal indicating whether the motor vehicle 105 should travel forward or backward. The interface 155 may be connected, for example, by means of a data bus to a transmission, an operating unit or a control device for the transmission. The signal is preferably binary, wherein one value is assigned to travel forward and the other value is assigned to travel backward. The corresponding signal can be used to operate the reversing lights of the motor vehicle 105.

[0032] The processing device 125 is arranged to splice the image provided by the second camera 135 into the image provided by the first camera 130. The resulting image may be scaled and cropped to a predetermined size according to a magnification factor (which may be selected based on a signal determined on the interface 155). The result of this processing may be displayed on the display device 150 or a portion thereof.

[0033] Figure 2 A flow chart of a method 200 for displaying surroundings 115 on motor vehicle 105 is shown. In step 205, a first image is provided at a first viewing angle 140. For this purpose, in particular, first camera 130 can be used. In step 210, a second image is provided at a second viewing angle 145 that is smaller than first viewing angle 140. The second image is preferably detected by means of second camera 135.

[0034] In step 215, the second image is spliced ​​into the first image. Due to the smaller viewing angle, the second image only shows a portion of the first image. The second image is spliced ​​into the first image in such a way that the transition between the first and second image is as inconspicuous as possible. For this purpose, the first image and / or the second image can be appropriately deformed or corrected. In addition, color adaptation or brightness adaptation can be performed. The splicing generates a third image.

[0035] In step 220, the direction of travel in which motor vehicle 105 is to travel can be determined. The direction of travel can be, in particular, forward or backward. Based on the direction of travel, an amplification factor can be determined in step 225. An amplification factor can be assigned to a direction of travel. The amplification factor assigned to backward travel is preferably smaller than the amplification factor assigned to forward travel.

[0036] In step 230, the third image can be scaled with the determined magnification factor. When the magnification factor changes, an animation can be created for this purpose, in which the third image is scaled with a series of monotonically decreasing or monotonically increasing magnification factors. The change in the magnification factor over time can be determined here according to a predetermined transition. The duration of the transition is preferably predetermined and can be in the range of a few seconds to less than about one second. The scaled third image can be provided in step 235. In particular, the third image can be output to the person 120 in the motor vehicle 105 on the display device 150.

[0037] Figure 3 An exemplary cut-out of images is shown. In the lower region, a first image 305 is shown, which is recorded by a reversing camera 130 of motor vehicle 105 . In the upper region, a second image 310 is shown, which may be recorded by a side camera 135 on the same motor vehicle 105 .

[0038] The second image 310 is inserted in a zoomed form at a suitable position in the first image 305, thereby generating a third image 315. The third image 315 can now adopt a predetermined magnification factor in order to show a part in an enlarged manner. The vanishing point of the enlargement is preferably predetermined and preferably lies in the region of the second image 310 within the third image 315. The magnification factor can be increased until the display shows only the second image 310. Optionally, the display can be further enlarged until only a part of the second image 310 is still visible.

[0039] Figure 4 An exemplary view 400 of third image 315 on display device 150 on motor vehicle 105 is shown. The display is based on a possible perspective of a front passenger, for example, in the first row of seats of motor vehicle 105. The dashboard of motor vehicle 105 is shown in the lower region, which adjoins the front windshield of motor vehicle 105 at its upper end. In the left region, the dashboard is partially covered by a steering wheel, by means of which motor vehicle 105 can be controlled.

[0040] Display device 150 is designed as a pHUD, wherein a wide strip, but only a few centimeters high, is used as a projection surface at the lower end of the windshield. For example, third image 315 can be seen in the middle area of ​​the projection surface. Above the projection surface, the windshield of motor vehicle 105 can be seen. Reference numerals list

[0041] 100 systems

[0042] 105 Motor Vehicles

[0043] 110 equipment

[0044] 115 Environment

[0045] 120 people

[0046] 125 Processing device

[0047] 130 First camera, reversing camera

[0048] 135 Second camera, side camera

[0049] 140 First Person View

[0050] 145 Second Perspective

[0051] 150 Display device

[0052] 155 interface

[0053] 200 Methods

[0054] 205 Provide first image

[0055] 210 Provide a second image

[0056] 215 Splicing

[0057] 220 Determine driving direction

[0058] 225 Determine the magnification factor

[0059] 230 Animated Transition

[0060] 235 Output image

[0061] 305 First Image

[0062] 310 Second Image

[0063] 315 Third Image

[0064] 400 views

Claims

1. A method (200) for providing a surroundings display on a motor vehicle (105), wherein: The method (200) comprises the following steps: - creating (205) a first image (305) of the area behind the motor vehicle (105); - creating (210) a second image (310) of the area behind the motor vehicle (105); - wherein the viewing angle (140) of the first image (305) is greater than the viewing angle (145) of the second image (310); - splicing (215) the second image (310) into the first image (305) and providing (235) the resulting third image (315).

2. The method (200) according to claim 1, wherein: The geometries of the first image and the second image (310) are adapted to one another for a third image (315).

3. The method (200) according to claim 2, wherein: The adapted parameters are fixed and predetermined.

4. The method (200) according to any one of the preceding claims, wherein: The third image (310) is magnified by a predetermined magnification factor and cropped to a predetermined size.

5. The method (200) according to claim 4, wherein: determining a change in the magnification factor; and causing the enlargement of the third image (310) to continuously track the magnification factor.

6. The method (200) according to claim 5, wherein: The enlargement is tracked at a predetermined speed (230).

7. The method (200) according to claim 5, wherein: The amplification is tracked at a predetermined speed curve (230).

8. The method (200) according to any one of claims 5 to 7, wherein: The first and second amplification factors are predetermined.

9. The method (200) according to claim 8, wherein: One of the predetermined amplification factors is selected (225) as a function of a signal indicating whether the motor vehicle (105) is to travel forward or backward.

10. A device (110) for providing a surroundings display on a motor vehicle (105), the device comprising the following elements: - a first camera (130) for providing a first image (305) of an area behind the motor vehicle (105); a second camera (135) for providing a second image (310) of the area behind the motor vehicle (105); -in, The viewing angle (140) of the first image (305) is greater than the viewing angle (145) of the second image (310); and A processing device (125) is configured to splice the second image (310) into the first image (305) and to provide a resulting third image (315).

11. The device (110) according to claim 10, further comprising a display device for displaying the third image (315) to a driver of the motor vehicle (105).

12. The device (110) according to claim 11, wherein A ratio of a width to a height of a third image (315) on the display device exceeds four.

13. The device (110) according to claim 11 or 12, wherein: The display device includes a head-up display.

14. A motor vehicle (105) comprising a device (110) according to any one of claims 10 to 13.

Images