Camera arrangement for a vehicle and method for operating the camera arrangement

Abstract

The invention relates to a camera arrangement with a reversing camera for monitoring the rear of a vehicle. According to the invention, it is provided that - the reversing camera is designed as a spherical camera (2) and is arranged in a tailgate (1.1) of the vehicle (1), - the spherical camera (2) is coupled to a control unit and - the control unit is designed to align the spherical camera (2) by controlling a drive unit (4) coupled to the spherical camera, such that the spherical camera (2) is positioned in one position (P1) to monitor a rear area (R) of the vehicle (1) and in another position (P2) is directed towards a trunk (K) of the vehicle (1). The invention further relates to a method for operating the camera arrangement.

Description

[0001] The invention relates to a camera arrangement with a reversing camera for monitoring the rear of a vehicle. The invention further relates to a method for operating such a camera arrangement.

[0002] From DE 10 2012 105 361 A1, a touch-type display mirror device and a method for controlling the display mirror device are known. The display mirror arrangement comprises a touch panel via which an operator inputs a first signal, a light-sensitive panel arranged on a rear surface of the touch panel, and a display panel arranged on a rear surface of the light-sensitive panel and comprising a signal processing unit that processes the first signal input from the touch panel, wherein the signal processing unit is connected to an angle-adjustable reversing camera and sets a recording angle of the angle-adjustable reversing camera according to a second signal input from the touch panel.

[0003] Furthermore, DE 10 2021 005 091 A1 describes a method for interacting with an animal in a vehicle, wherein the animal is in a box equipped with a camera, a microphone, a loudspeaker, and a food and water dispensing device. Image data of the animal captured by the camera is displayed on a touch-sensitive display unit in the passenger compartment of the vehicle and / or on a display unit of a user's mobile device. Based on the image data and / or recorded acoustic signals, a reaction from the animal within a specific time period is detected. The animal is then trained using voice commands and / or corresponding inputs at the display unit. Food is dispensed via voice command and / or corresponding input at the display unit, and the food is released upon successful completion of the training.Depending on detected animal activity, water is dispensed and / or ventilation is activated. Furthermore, a self-learning system is trained to recognize and display detected animal activities and resulting needs on the display unit, and animal training is monitored using captured image data, acoustic signals, and / or the self-learning system for recognizing animal reactions.

[0004] Furthermore, GB 2 439 346 A discloses a gimbal arrangement comprising a spherical socket having a partially spherical inner surface with a first radius; a sphere arranged in the spherical socket having a partially spherical outer surface with a second radius smaller than the first radius; a first arrangement of electromagnets attached to the outer surface of the sphere; a second arrangement of electromagnets mounted on the inner surface of the spherical socket; and means for supplying power to the various electromagnets of the two arrangements to hold the sphere in the spherical socket in a position in which the partially spherical surfaces of the sphere and the spherical socket are arranged substantially concentrically around a common center point. The sphere has an internal cavity for accommodating a video camera, with an opening for observation.

[0005] The invention is based on the objective of providing a novel camera arrangement for a vehicle and a method for operating the camera arrangement.

[0006] The problem is solved according to the invention by a camera arrangement having the features specified in claim 1 and a method having the features specified in claim 8.

[0007] Advantageous embodiments of the invention are the subject of the dependent claims.

[0008] A camera arrangement includes a reversing camera for monitoring the rear of a vehicle, wherein, according to the invention, it is provided that - the reversing camera is designed as a spherical camera and is located in a tailgate of the vehicle, - the spherical camera is coupled with a control unit and - the control unit is designed to align the spherical camera by controlling a drive unit coupled to the spherical camera, so that the spherical camera is positioned to monitor a rear area of ​​the vehicle in one position and to direct itself into a trunk of the vehicle in another position.

[0009] Using such a camera arrangement, particularly a spherical camera, it is possible to optically capture both the rear of the vehicle and the trunk with a single image acquisition unit. Compared to using two cameras, one for the rear and one for the trunk, this reduces the complexity of at least one wiring and control system.

[0010] Such a camera setup can be used to implement digital functions for vehicle users, thus enhancing their experience with these functions. For example, the vehicle user can be notified if the image data captured by the spherical camera detects that cargo in the trunk has fallen over and / or a load securing device has come loose.

[0011] In one version, the spherical camera is mounted to rotate around a horizontally arranged axis of rotation. The spherical camera thus rotates around this horizontal axis to assume one position for monitoring the rear of the vehicle or another position for scanning the trunk.

[0012] In one embodiment, the lens of the spherical camera is concealed in a passive position, particularly when the vehicle's ignition is switched off, i.e., when the vehicle is stationary, especially when parked or refueling / charging at a fuel station. In this position, the lens is directed towards an opening in the tailgate, making it inaccessible. In this passive position, the lens is protected from damage, particularly from mechanical impact, as well as from contamination.

[0013] In another embodiment of the camera arrangement, the control unit is designed to transmit image data captured by the spherical camera of the vehicle's rear and trunk to a display unit located inside the vehicle and / or to a mobile device belonging to the vehicle user. The vehicle user thus sees the captured image data on the display unit, allowing them to view the rear of the vehicle, particularly when reversing into a parking space, or the trunk, for example, to check whether they have loaded a specific item, such as a crate of drinks.

[0014] In another embodiment, the control unit is designed to perform object recognition based on the image data captured by the spherical camera. For example, computer vision methods using convolutional neural networks and / or machine learning attention mechanisms are employed for this purpose. This makes it possible to unambiguously identify objects in the trunk using the control unit, allowing the vehicle user, for instance, to query which objects are located in the vehicle's trunk.

[0015] In one embodiment, the control unit is configured to recognize objects in the vehicle's trunk, and the display unit is configured to highlight each recognized object, at least visually. For example, the vehicle user might ask whether a crate of drinks is in the trunk, and if so, it would be highlighted on the display unit, perhaps with a different color.

[0016] In another version, the control unit is designed to detect changes in recognized objects or changes in image areas between two time-separated recordings of a journey when the camera is pointed towards the trunk. If a change is detected, the driver can be alerted visually, textually, or audibly to any cargo that has fallen over in the trunk.

[0017] One camera configuration involves a control element located inside the vehicle and / or on the mobile device to align the spherical camera. This means that when the vehicle user activates the control element, the spherical camera is positioned as desired, for example, to view the rear of the vehicle or to look for a specific object in the trunk, such as a crate of drinks or an umbrella.

[0018] Furthermore, the invention relates to a method for operating a camera arrangement. According to the invention, the spherical camera is controlled by means of the control unit, so that the rear of the vehicle is monitored by means of the spherical camera in its position, or image data from the trunk is captured by means of the spherical camera positioned in another position, wherein manual positioning of the spherical camera is carried out by actuating the control element in the interior of the vehicle and / or the mobile device.

[0019] The spherical camera can therefore assume at least two different positions in succession, allowing it to perform two functions: rear-view monitoring and trunk monitoring. For example, the camera automatically positions itself for rear-view monitoring when the vehicle is put into reverse, while the camera can be manually positioned towards the trunk by pressing the control button.

[0020] In one embodiment of the method, image data captured by the spherical camera via the control unit is transmitted to the display unit inside the vehicle and displayed there. Thus, the vehicle user sees captured image data of the rear of the vehicle when the spherical camera is positioned accordingly, and image data of the trunk when the spherical camera is in a different position.

[0021] Exemplary embodiments of the invention are explained in more detail below with reference to drawings.

[0022] This shows: Fig. 1 schematically a side view of a vehicle with a spherical camera mounted on a tailgate, Fig. 2 schematically a section of the tailgate with the spherical camera in a position facing the rear of the vehicle, Fig. 3 schematically a section of the tailgate showing a spherical camera in a further position facing the trunk of the vehicle and Fig. 4 schematically the spherical camera in a passive position.

[0023] Corresponding parts are marked with the same reference symbols in all figures.

[0024] Fig. Figure 1 shows a side view of a vehicle 1 with a spherical camera 2 arranged on a tailgate 1.1, which faces a rear compartment R of the vehicle 1, in Fig. The position P1 shown in 2 can be such that a detection area E of the spherical camera 2 is directed towards the rear. In addition, the spherical camera 2 can be positioned in a Fig. 3. The further position P2 shown is positioned so that the detection area E is directed into a trunk K of the vehicle 1.

[0025] Fig. Figure 4 shows the spherical camera 2, which has a passive position P3.

[0026] It is generally known that a vehicle 1 has environmental sensors (not shown in detail), for example an external camera, for recording a specific area outside the vehicle 1. An interior camera (not shown) may also be arranged inside the vehicle 1, for example to monitor a vehicle user and / or other occupants of the vehicle 1.

[0027] In order to inspect the trunk K of the vehicle 1, a vehicle user is usually forced to leave the vehicle 1 and open the tailgate 1.1 so that the vehicle user can look into the trunk K, for example to check for the presence of an object, such as an umbrella 3, or to check whether a transport securing device or a load securing device in the trunk K has come loose.

[0028] Installing a separate camera to inspect or monitor the trunk K, for example to be able to view the trunk from inside the vehicle and / or via remote access, increases the complexity of the wiring, control, etc., which also increases the cost.

[0029] In order to be able to view the rear area R of vehicle 1 and the trunk K of vehicle 1 with only one camera, vehicle 1 has a camera arrangement described below.

[0030] The camera arrangement comprises the spherical camera 2, which is coupled to a drive unit 4, the drive unit 4 being connected to a control unit (not shown). The control unit is connected to a display unit, in particular an infotainment system, a so-called head unit, located in the interior of the vehicle 1.

[0031] The spherical camera 2 has a spherical housing and is rotatably mounted via a horizontal axis of rotation D extending in the direction of a transverse axis of the vehicle by means of a bracket that corresponds at least partially to the spherical camera 2, and can assume at least three different positions P1, P2, P3. This means that the spherical camera 2 can be positioned facing the rear space R, facing the trunk K, and, when not in use, particularly when the vehicle 1 is stationary, it has the passive position P3.

[0032] Rear-view monitoring is particularly intended for assistance applications, such as a parking assistant, whereby the visibility of the trunk K can be used, for example, for load monitoring, or to determine whether a specific object, such as the umbrella 3, has been loaded or to check whether cargo has fallen over.

[0033] The spherical camera 2 can therefore be positioned in three different positions P1 to P3 by means of the drive unit 4, in particular in the form of an electric motor or, in accordance with GB 2 439 346 A, via electromagnets. For example, the spherical camera 2 is arranged on the tailgate 1.1 such that the spherical camera 2 can be extended and retracted relative to the tailgate 1.1 by means of the drive unit 4, for example also folded in and out.

[0034] If the spherical camera 2 is in position P1, it serves primarily as a reversing camera, especially for parking and maneuvering the vehicle 1. Alternatively or additionally, the spherical camera 2 can be used for rear-view monitoring, particularly for other driver assistance applications. For this purpose, the focus of the spherical camera 2 can be set automatically, for example, via an autofocus system. Alternatively, it is possible to switch between at least two or more different, predefined focus points with an adjustable camera system. Furthermore, a viewing area can be actively illuminated by switching on an external light.

[0035] If the spherical camera 2 has the further position P2, the detection area E is directed into the trunk K and in the passive position P3 the spherical camera 2 is positioned and / or retracted and / or folded in such a way that a lens of the spherical camera 2 is protected from contamination and / or mechanical damage.

[0036] As described above, the spherical camera 2 is connected to the control unit, which transmits the captured image data from the spherical camera 2, regardless of the direction of the detection area E. The control unit is connected to the display unit, which displays the captured image data. Alternatively or additionally, depending on the settings, the captured image data is transmitted to and displayed on a mobile device, particularly a smartphone, belonging to the vehicle user. This connection is established, for example, via an application program, particularly one from a vehicle manufacturer, which is installed on the vehicle and / or on the mobile device.

[0037] If the vehicle user activates a control element, in particular of the application program, a mode of the spherical camera 2, but also an orientation of the spherical camera 2, can be changed.

[0038] In one possible implementation, the image data captured by the spherical camera 2, in particular the image data relating to the trunk K, are evaluated and / or processed using object recognition. This makes it possible to display objects detected in the trunk K, such as the umbrella 3, to the vehicle user on the display unit. Object recognition can be achieved using known computer vision methods with convolutional neural networks and / or networks with attention mechanisms from machine learning.

[0039] Another implementation allows the vehicle user or another occupant of vehicle 1 to query, via acoustic and / or textual input, which objects are located in trunk K, or whether a specific object, for example, umbrella 3, can be detected in trunk K. Output regarding the respective object detection can be acoustic and / or visual, for example, by displaying the queried and detected object, which may also be highlighted in color on the display unit. The successful object detection can also be indicated via text. Connections to a "Visual Teaching" function are possible.

[0040] The ball camera 2 can also be swivelled into the further position P2 so that it dries relatively quickly, for example if the lens is fogged up.

[0041] In the event that the tailgate 1.1 cannot be fully closed, for example because a charging state does not allow this, the ball camera 2 is aligned as required by the control unit so that both the rear area R and the trunk K are optimally visible.

[0042] Another embodiment of the camera arrangement provides that the spherical camera 2 provides a preventive view into the trunk K if there is a suspicion that transported cargo is no longer adequately secured. For example, the preventive view into the trunk K via the spherical camera 2 is granted after driving over a bumpy surface and / or after detecting a noise coming from the trunk K; that is, the spherical camera 2 is positioned accordingly in the further position P2.

[0043] In one embodiment, the spherical camera 2 is proactively positioned in the additional position P2 when, for example, a person approaches the vehicle 1 and / or when, for example using a machine learning classifier network, a comparatively high probability of a break-in by this person is predicted. The spherical camera 2 is in the additional position P2 so that image data of the interior of the vehicle 1, particularly areas not visible from the outside, such as the trunk K, is displayed on the infotainment system's display unit and / or on the vehicle 1 itself, for example on an external screen, and / or projected onto a ground surface in front of and / or next to the vehicle 1 using a projection unit. This can reduce the probability of vehicle windows being broken if there are no valuables inside the vehicle 1.A potential burglar is highly unlikely to risk a break-in if they can be certain that there are no valuables in vehicle 1. For example, the image data can be manipulated. To this end, if a so-called high-value target is detected in vehicle 1, particularly in the trunk, image data of this area without the high-value target and / or with so-called low-value targets, which were taken at a previous time, will be displayed.

[0044] It is also conceivable to grant a preventive insight into vehicle 1, i.e. into the trunk K, if vehicle 1 is, for example, in a traffic control.

[0045] Furthermore, it is provided that the orientation angle of the spherical camera 2 can be actively adjusted by the vehicle user in order to set different detection ranges E, i.e., viewing angles, of the spherical camera 2. For this purpose, the spherical camera 2 can also be mounted in the tailgate 1.1 in such a way that it can be aligned both vertically and horizontally. In particular, the spherical camera 2 can be rotatably mounted by means of a ball socket for this purpose. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2012 105 361 A1

[0002] DE 10 2021 005 091 A1

[0003] GB 2 439 346 A [0004, 0033]

Claims

[1] Camera arrangement with a rear view camera for monitoring the rear area of ​​a vehicle, characterized by , that - the reversing camera is designed as a spherical camera (2) and is arranged in a tailgate (1.1) of the vehicle (1), - the spherical camera (2) is coupled to a control unit and - the control unit is designed to align the spherical camera (2) by controlling a drive unit (4) coupled to the spherical camera, so that the spherical camera (2) monitors a rear space (R) of the vehicle (1) in one position (P1) and is arranged in a further position (P2) directed into a trunk (K) of the vehicle (1). [2] Camera arrangement according to claim 1, characterized by that the spherical camera (2) is mounted so as to be rotatable about a horizontally arranged axis of rotation (D). [3] Camera arrangement according to claim 1 or 2, characterized bythat a lens of the spherical camera (2) is arranged concealed in a passive position (P3) of the spherical camera (3) by means of the tailgate (1.1). [4] Camera arrangement according to one of the preceding claims, characterized by that the control unit is designed to transmit captured image data of the spherical camera (2) of the rear space (R) of the vehicle (1) and the trunk (K) to a display unit arranged in the interior of the vehicle (1) and / or a mobile terminal of a vehicle user. [5] Camera arrangement according to one of the preceding claims, characterized by that the control unit is designed to carry out object recognition with respect to the captured image data of the spherical camera (2). [6] Camera arrangement according to claim 5, characterized bythat the control unit is designed to recognize queried objects in the trunk (K) of the vehicle (1) and the display unit is designed to display a queried and recognized object at least optically highlighted. [7] Camera arrangement according to one of claims 4 to 6, characterized by that an operating element in the interior of the vehicle (1) and / or the mobile terminal is designed to align the spherical camera (2). [8] Method for operating a camera arrangement according to one of claims 1 to 7, characterized bythat the spherical camera (2) is controlled by means of the control unit, so that the rear area (R) of the vehicle (1) is monitored by means of the spherical camera (2) having the position (P1) or image data from the trunk (K) is recorded by means of the spherical camera (2) positioned in a further position (P2), wherein a manual positioning of the spherical camera (2) takes place by actuating the operating element in the interior of the vehicle (1) and / or the mobile terminal. [9] Method according to claim 8, characterized by that image data of the spherical camera (2) captured by the control unit are transmitted to the display unit in the interior of the vehicle (1) and the image data are displayed on the display unit.

Images