All-round view with a vehicle view

Abstract

Arrangement comprising a vehicle, a first camera, a second camera and a computing device which is designed to create an all-round view representation of the vehicle from an image of the first camera and an image of the second camera; wherein the first camera does not detect the vehicle; characterized in that at least a part of the vehicle is detected by the second camera; wherein the computing device is designed to display at least one part of the vehicle captured by the second camera in the all-round view display.

Description

The invention relates to an arrangement according to the preamble of claim 1, a computing device according to the preamble of claim 3 and a computer program according to the preamble of claim 4.Omniview systems are known from the prior art. These are used to generate an all-round view representation of the environment of a vehicle from the bird's eye view. By means of a plurality of cameras which are mounted on a vehicle, images of the environment of the vehicle are recorded. These images are further processed and fused to form a overview image. The vehicle is contained in the overview image as prefabricated graphics, since it is not captured by the cameras.US 2018 / 0 192 005 A1 discloses a system in which the environment of the vehicle is shown as comprehensively as possible with the aid of camera images. For this purpose, camera images of the environment of the vehicle are recorded from different perspectives and displayed on a screen.The object of the invention is to make available an improved surround view representation of a vehicle. This object is achieved by an arrangement according to claim 1, a computing device according to claim 3 and a computer program according to claim 4.The arrangement comprises a first camera and a second camera. The two cameras are preferably optical photographic and / or video cameras. The cameras produce images of objects which are located in the detection range of the respective camera on the basis of light of the visible spectrum.In addition, the arrangement comprises a computing device. Preferably, it is a control device of a vehicle. The computing devices can also be arranged externally, that is to say outside the vehicle, and connected to the latter via a preferably wireless data line.According to the invention, the computing device is designed to generate an all-round view representation of the vehicle from an image of the first camera and an image of the second camera. The surround view representation is also called birdview, omniview or surroundview representation. This is an image of the environment of a vehicle, which is composed of a plurality of individual images. In the present case, the surround view representation is composed of images of further cameras. The composition of the surround view representation from the individual images is preferably carried out by correcting distortions in the individual images, projecting the images into a common representation plane and carrying out an image fusion. Corresponding methods are known from the prior art.The first camera does not capture the vehicle. The vehicle is therefore not located in the detection range of the first camera. Preferably, further cameras are present which do not capture the vehicle and whose images are incorporated into the surround view representation. The first camera and the further cameras are preferably mounted on the front, rear, a side or a corner of the vehicle.According to the invention, the second camera captures at least a part of the vehicle. At least a part of the vehicle is thus located in the detection range of the second camera.The computing device is configured to display the part of the vehicle located in the detection range of the second camera in the surround view representation. Thus, instead of a prefabricated graphic of the vehicle, the surround view representation contains an image of the at least one part of the vehicle recorded by means of the second camera. The around view representation therefore not only reproduces the environment of the vehicle, but also the current state of the at least one part of the vehicle. It is thus possible for a viewer of the around view display to draw conclusions on the state of the at least one part of the vehicle on the basis of the display.In a preferred development, the at least one part of the vehicle located in the detection range of the second camera is at least one part of a load surface, of a superstructure of an attachment, for example of a crane, and / or of a roof of the vehicle. According to a development, the observer of the surround view representation sees the instantaneous state of the at least one part of the load surface, the superstructure, the attachment and / or the roof. It can thus be assessed, for example, whether the attachment is in a travel position or whether the roof of the vehicle is free of ice.The display of the image of the second camera in the around view display is preferably limited to a section whose outlines correspond to the outlines of the vehicle. The representation of image information outside this outline is then generated from the image of the first camera and, if appropriate, from the images of the further cameras which may be present. The image of the second camera is preferably transparently superimposed in the overlap regions on the image of the first camera and, if appropriate, on the images of the further cameras which may be present.In order that existing all-round vision systems can be retrofitted according to the invention, the calibration of the second camera is preferably carried out on an image basis by detecting vehicle edges and structures. It is also possible to carry out the calibration by means of markers which are set up in the environment of the vehicle.A computing device according to the invention is designed to generate an all-round view representation corresponding to the computing device of the arrangement according to the invention.A computer program according to the invention is designed to cause a computing device to generate an all-round view representation corresponding to the computing device of the arrangement according to the invention.

Claims

Arrangement having a vehicle, a first camera, a second camera and a computing device which is designed to generate an all-round view representation of the vehicle from an image of the first camera and an image of the second camera; wherein the first camera does not capture the vehicle; characterized in that at least part of the vehicle is captured by the second camera; wherein the computing device is designed to display the at least part of the vehicle captured by the second camera in the all-round view representation.Arrangement according to Claim 1, characterized in that the at least one part of the vehicle captured by the second camera is at least one part of a load surface, a superstructure, an attachment and / or a roof of the vehicle.A computing device configured to generate an all-round view representation of a vehicle from an image of a first camera and an image of a second camera; wherein the first camera does not capture the vehicle; characterized in that at least a portion of the vehicle is captured by the second camera; wherein the computing device is configured to represent the at least a portion of the vehicle captured by the second camera in the all-round view representation.A computer program configured to cause a computing device to generate an around view representation of a vehicle from an image of a first camera and an image of a second camera; wherein the first camera does not capture the vehicle; characterized in that at least a portion of the vehicle is captured by the second camera; wherein the at least a portion of the vehicle captured by the second camera is represented in the around view representation.