Detection system for a vehicle and a method

Abstract

A detection system 10 for a vehicle 12 comprises an image capturing device (e.g. camera) 14 connected to an electronic computing device 20. The camera is mounted at an elevated position 16 above the

Description

FIELD OF THE INVENTION

[0001] The invention relates to the field of automobiles. More specifically, the present invention relates to a detection system for a vehicle according to claim 1. Furthermore, the present invention relates to a method, a corresponding computer program product, and a corresponding non-transitory computer-readable storage medium. BACKGROUND INFORMATION

[0002] In the state of the art, the capture of images for vehicle control or provision of functions is already known, with various methods existing for capturing these image files or videos.

[0003] The objective of the invention is to provide a system and method enabling particularly informative image capture.

[0004] This objective is achieved by means of a detection system with the features of claim 1 and by means of a method according to the invention. Advantageous embodiments and further developments can be inferred from the dependent claims and the description. SUMMARY OF THE INVENTION

[0005] One aspect of the intention relates to a detection system for a vehicle, capturing vehicle image data from a bird's-eye view. It comprises at least one capturing device mounted at an elevated position relative to the vehicle, covering a wide field of view for complete capturing of the vehicle's immediate surroundings. An electronic computing device connected to the capturing device analyzes received image data and generates at least one control signal for the vehicle's control device. A learning-based solution is employed for bird’s-eye view generation using image-to-image translation from available vehicle cameras to a top-down view. Ground truth data are obtained by mounting a downward-facing camera on a pole to capture the actual bird’s-eye view.

[0006] This solution has no additional labeling cost since the additional camera acts as an expert sensor. By avoiding heavy distortions known by an inverse perspective mapping (IPM), the approach generates a more precise surround view image, crucial for accurate visual feedback during parking maneuvers. Additionally, the birds-eye view image quality is enhanced by eliminating strong distortions, making it visually appealing.

[0007] Therefore it is possible to create a dataset. By mounting a camera at the top, it's possible to obtain an undistorted bird’s-eye view image, serving as ground truth. The model learns to infer these images based on given sensor data, primarily cameras but potentially including Radar / Lidar / USS as input. No specific model architecture is specified; the focus is on cleverly creating data to provide supervised learning. Users benefit from undistorted bird’s-eye view images with no distortion, overcoming this issue by collecting data with the pole-mounted downward-facing camera.

[0008] The vehicle detection system may include additional technical implementations. Firstly, a variable height adjustment of the capturing device allows for flexible positioning relative to the vehicle, enabling different perspectives and viewing angles. By combining multiple sensors such as cameras, lidar, and radar, a more comprehensive and precise perception of the surroundings is possible.

[0009] The electronic computing device is capable of processing received image data in real-time, facilitating rapid decision-making for vehicle control and enabling timely responses to changing traffic situations. In addition to a standard light source, infrared or laser light sources may be positioned to enhance image quality in low-light conditions or support specific applications such as night vision.

[0010] A mounting structure (a telescopic pole) ensures the stability and reliability of sensor positioning, even under challenging conditions such as vibrations during driving. Furthermore, the system may feature a self-calibration function to maintain sensor accuracy over time.

[0011] Another aspect of the invention relates to a method for operating a detection system for a vehicle, wherein vehicle image data from a bird's-eye view are captured by at least one capturing device mounted at an elevated position relative to the vehicle, wherein the capturing device covers a wide field of view to enable complete capturing of the immediate surroundings of the vehicle, and wherein, the received image data are analyzed by an electronic computing device connected to the capturing device, and at least one control signal is generated for controlling a control device of the vehicle and transmitted to the control device.

[0012] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawing. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figure and / or shown in the figure alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWING

[0013] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0014] The drawing show in:

[0015] Fig. 1 a detection system for a vehicle to capture vehicle image data from a bird's-eye view.

[0016] In the figure the same elements or elements having the same function are indicated by the same reference signs. DETAILED DESCRIPTION

[0017] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0018] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0019] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0020] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawing that forms part hereof, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment is described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0021] Fig. 1 shows a detection system 10 for a vehicle 12 to capture vehicle image data from a bird's-eye view, equipped with at least one capturing device 14 mounted at an elevated position 16 relative to the vehicle 12. Here, for example, a rod or a telescopic pole 18 can be employed, centrally positioned on the roof of the vehicle 12, which can lift the capturing device 14 up- and downwards or hold it in the elevated position 16. The elevated position 16 of the capturing device 14 relative to the vehicle 12 is at least semi- automatically adjustable. This means that different angles in the bird's-eye view are also accessible. Adjustment of the relative position 16 to the vehicle 12 is needed for making different adaptations while driving, for example.

[0022] The capturing device 14 may be configured as a camera with zoom capabilities to adjust focal points and sharpness levels of the image data from all possible elevated positions 16. Consequently, the capturing device 14 can cover a wide field of view to enable complete capturing of the immediate surroundings of the vehicle 12.

[0023] An electronic computing device 20, connected to the capturing device 14, is designed to analyze the received image data and generate at least one control signal for controlling a control device 22 of the vehicle 12 and transmit it to the control device 22. This implies that the image data can be utilized for vehicle 12 control purposes, such as autonomous driving, parking, and other controls. Particularly, image data for at least partially autonomous vehicle 12 control can be continuously captured, indicating a data streaming of image files is planned to generate a continuous flow of information.

[0024] To further elaborate on the data and provide more information, it is possible, that at least one sensor device 24 may also be used and may also be positioned at the elevated position 16, from which sensor data can be transmitted to the electronic computing device 20 for generating the control signal. This sensor device 24 may be a Lidar, radar, or other sensors already installed on the vehicle 12 or at the elevated position 16 to enhance the detection field. Additionally, a variety of capturing devices 14, sensor devices 22, cameras, etc., can be arranged to receive the best possible bird's-eye view coverage.

[0025] For instance, a light source 24 for a better capturing of the image data may be positioned, either represented by the vehicle's 12 existing lights or alternatively, a light source 26 may be placed in the elevated position, directly illuminating the capturing area of the vehicle 12, thus enabling particularly good image quality.

[0026] In summary, the invention proposes learning-based generation of surround-view camera images to avoid image distortions. signs detection system vehicle capturing device elevated position telescopic pole electronic computing device control device sensor device light source

Claims

1. Detection system (10) for a vehicle (12) for capturing vehicle image data from a bird's-eye view, comprising at least one capturing device (14) for capturing the image data, which is mounted at an elevated position (16) relative to the vehicle (12), wherein the capturing device (14) covers a wide field of view to enable complete capturing of the immediate surroundings of the vehicle (12) and the vehicle (12) itself, and with an electronic computing device (20) connected to the capturing device (14) and implemented to analyze the received image data and generate at least one control signal for controlling a control device (22) of the vehicle (12) and transmit it to the control device (22).

2. Detection system (10) according to claim 1, characterized in thatthe elevated position (16) of the capturing device (14) relative to the vehicle (12) is at least semi-automatically adjustable.

3. Detection system (10) according to claim 1 or 2, characterized in thatthe capturing device (14) is configured as a camera with zoom capabilities.

4. Detection system (10) according to any one of the preceding claims, characterized in thatimage data for an at least partially autonomous control of the vehicle (12) are continuously capturable.

5. Detection system (10) according to any one of the preceding claims, characterized in thatat least one sensor device (24) is positioned, from which sensor data can be transmitted to the electronic computing device (20) for generating the control signal.

6. Detection system (10) according to any one of the preceding claims, characterized in thata light source (26) is positioned for capturing the image data.

7. Method for operating a detection system (10) for a vehicle (12), wherein vehicle image data from a bird's-eye view are captured by at least one capturing device (14) mounted at an elevated position (16) relative to the vehicle (12), wherein the capturing device (14) covers a wide field of view to enable complete capturing of the immediate surroundings of the vehicle (12), and wherein, the received image data are analyzed by an electronic computing device (20) connected to the capturing device (14), and wherein at least one control signal is generated for controlling a control device (22) of the vehicle (22) and transmitted to the control device (22).

8. A computer program product comprising program code means for performing a method according to claim 7.

9. A non-transitory computer-readable storage medium comprising at least the computer program product according to claim 8.

Images