Method for adjusting a vehicle mirror and / or a screen and system for carrying out the method

By employing a vehicle's interior camera to capture and analyze the driver's head relative to fixed vehicle geometry, the method adjusts mirrors and screens efficiently with minimal computing power, leveraging existing vehicle components.

DE102020109760B4Active Publication Date: 2026-04-02BAYERISCHE MOTOREN WERKE AG
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-04-08
Publication Date
2026-04-02

AI Technical Summary

Technical Problem

Existing methods for adjusting vehicle mirrors and screens require significant computing power and additional systems, making them inefficient and resource-intensive.

Method used

Utilizing a vehicle's standard interior camera to capture the driver's head outline relative to fixed vehicle geometry, calculating the head position using simplified 2D image analysis, and controlling actuators to adjust mirrors and screens based on predefined head dimensions, without requiring additional hardware.

Benefits of technology

Achieves efficient adjustment of vehicle mirrors and screens with minimal computing power, utilizing existing vehicle components, thereby reducing energy consumption and costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for adjusting at least one vehicle mirror, in particular at least one side mirror (20) and / or one interior mirror (25), and / or one screen (30), wherein the method comprises the following steps: a) Capturing a head outline (70) of a driver (100) in relation to at least one vehicle geometry (81, 82, 83) of the vehicle interior (95) using an interior camera (40) of the vehicle (10), b) Calculating the position of the driver's head (65) (100) based on the captured head outline (70) and on calibration information regarding at least one vehicle geometry (81, 82, 83) of the vehicle interior (95), c) Determining a target position of the at least one vehicle mirror (20, 25) and / or the screen (30) based on the calculated head position, whereby a previously defined mean value with respect to a head length (L) and a head width (B) is used to determine the target position of the vehicle mirror (20, 25) and / or the screen (30), d) Controlling an actuator of at least one vehicle mirror (20, 25) and / or the screen (30) to establish the specified target position of the vehicle mirror (20, 25) and / or the screen (30).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for adjusting at least one vehicle mirror and / or a screen, according to claim 1.

[0002] Furthermore, the invention relates to a system for carrying out a method according to the invention for adjusting at least one vehicle mirror and / or a screen, according to claim 7. The invention further relates to a computer-readable storage medium, according to claim 13.

[0003] It is known from the prior art that vehicle interiors, safety systems, and vehicle assistance systems can be adapted to the specific needs of a driver with regard to their spatial arrangement. In this respect, it is known, for example, that driver-specific information is stored using a token or car key, so that when the driver-specific token or car key is read, the aforementioned systems or components can be individually arranged.

[0004] This can include, for example, seat settings, the adjustment of vehicle mirrors, the selection of a radio program, etc. However, this requires collecting various driver-specific information before the start of a journey, storing it in a database, and providing corresponding tokens or car keys.

[0005] Other systems are based on capturing driver-specific information before the journey begins. This requires sophisticated 3D camera systems to, for example, capture a driver's gaze direction. Based on this captured data, it is then possible to adjust the vehicle's mirrors individually. Such 3D camera systems require significant computing power to detect the necessary information. For example, DE 10 2015 219 237 A1 discloses the ability to adjust one or more comfort and / or safety systems in a motor vehicle based on three-dimensional eye position tracking.

[0006] In contrast, US 2004 / 0 240 706 A1 describes a system for adjusting a restraint system, such as an airbag in a motor vehicle, whereby a head outline of the vehicle occupant is recorded to calculate the head position of a vehicle occupant.

[0007] Therefore, it is necessary to provide additional computing capacity in a vehicle for such applications.

[0008] The invention is therefore based on the objective of providing a further developed method for adjusting at least one vehicle mirror and / or a screen, which can be carried out in a simple manner.

[0009] In particular, the method according to the invention should be feasible with a comparatively low computing power. An additional aspect of the present invention is to further develop the method for adjusting at least one vehicle mirror and / or a screen with regard to energy savings.

[0010] Furthermore, it is an object of the invention to provide a system with which a method according to the invention can be carried out. In particular, the system should be based on the fact that the components and systems already present in a vehicle can also be used in connection with the adjustment of a vehicle mirror and / or a screen. In particular, no additional installations and / or systems should be required to carry out the method according to the invention.

[0011] This problem is solved with regard to the method according to claim 1, with regard to the system according to claim 7 and with regard to a computer-readable storage medium according to claim 13.

[0012] In particular, the problem is solved by a procedure for adjusting at least one vehicle mirror and / or a screen, comprising the following steps: a) Capturing the outline of a driver's head in relation to at least one vehicle geometry of the vehicle interior using an interior camera of the vehicle, b) Calculating the position of the driver's head based on the captured head outline and on calibration information relating to at least one vehicle geometry of the vehicle interior, c) Determining a target position of the at least one vehicle mirror and / or the screen based on the calculated head position, using a previously defined mean value for head length and head width to determine the target position of the vehicle mirror and / or the screen, d) Controlling an actuator of at least one vehicle mirror and / or screen to establish the specified target position of the vehicle mirror and / or screen.

[0013] The idea is to use the vehicle's interior camera to capture the outline of the driver's head. Interior cameras are now standard equipment in many vehicles.

[0014] In step a), the driver's head outline is captured in relation to at least one vehicle geometry of the vehicle interior. This vehicle geometry is a fixed point and / or a fixed edge and / or an unchanging geometry of the vehicle. Specifically, this vehicle geometry is a geometry of the vehicle interior.

[0015] The unchangeable vehicle geometry could, for example, be a section of the A-pillar of the vehicle and / or a section of the B-pillar of the vehicle and / or a section of the C-pillar of the vehicle.

[0016] The driver's head outline is captured in relation to this unchanging vehicle geometry. In other words, both the driver's head outline and the predefined vehicle geometry of the interior are captured by the interior camera, whereby the position of the head outline relative to at least one of the vehicle geometry is recorded. In other words, both the head outline and the predetermined, unchanging vehicle geometry of the interior are depicted in a single image captured by the vehicle's interior camera.

[0017] In step b), the position of the driver's head is calculated based on the captured head outline and calibration information relating to at least one vehicle geometry within the vehicle interior. This calibration information allows the distance of the driver's head position relative to this at least one vehicle geometry to be determined. Based on this data, the actual calculation of the driver's head position within the vehicle interior is possible.

[0018] Based on the calculated position of the driver's head, step c) then determines a target position for at least one vehicle mirror and / or the screen. For example, a database may contain several reference values ​​for the position of the driver's head within the vehicle interior. For each reference value in the database, the target position of a vehicle mirror, in particular at least one side mirror and / or an interior mirror, and / or a screen is also specified.

[0019] Side mirrors are specifically the exterior mirrors of a vehicle.

[0020] The target position of a vehicle mirror and / or a screen is to be understood in particular as the tilt angle of the vehicle mirror and / or the screen in relation to at least one mounting axis of the vehicle mirror and / or the screen.

[0021] The database may contain data regarding the required angles of a vehicle mirror and / or a screen in relation to the position of the driver's head.

[0022] In step d), an actuator of at least one vehicle mirror and / or the screen is controlled to establish the specified target position of the vehicle mirror and / or the screen. For this purpose, the current position of the vehicle mirror and / or the screen is first recorded. Subsequently, it must be determined how the actuator is to be controlled to achieve the predetermined target position of the vehicle mirror and / or the screen.

[0023] It is known that small actuators are incorporated in vehicle mirrors, especially in side mirrors and / or in an interior mirror, and / or in a screen.

[0024] In one embodiment of the method according to the invention, a standard interior camera of a vehicle is used to capture the driver's head outline in step a). In particular, an interior camera already integrated into the vehicle is used. The interior camera is preferably a 2D camera or a fisheye camera. Evaluating images produced by 2D or fisheye cameras is significantly simpler than evaluating 3D images generated by 3D cameras. Capturing the head outline according to step a) and calculating the head's position according to step b) thus requires considerably less computing power.

[0025] In one embodiment of the invention, an elliptical shape is adapted to the captured head outline. Accordingly, in a computational step performed between step a) and step b), the head outline captured by the interior camera is reproduced in a simplified form. Specifically, an edge section is first performed with respect to the captured head outline of the driver, and the edges are then reproduced in the form of an ellipse.

[0026] In a further embodiment of the invention, in step a) the driver's head outline is captured several times and an average of the captured head outlines is calculated. This calculated average of the captured head outlines is preferably then used in step b).

[0027] Furthermore, it is possible that for several captured head outlines, an elliptical shape is adapted to each captured head outline. Therefore, it is possible to determine an average of the adapted elliptical shapes and use it in step b).

[0028] According to the invention, in step c), a previously defined average value for head length and head width is used to determine the target position of the vehicle mirror and / or the screen. This is preferably done taking into account the adapted elliptical shape(s). By previously defining an average value for head length and head width, step c) can be simplified. It can therefore be assumed that at least one vehicle mirror and / or a screen can be individually adjusted even when using an average value for head length and head width, provided that calculated information regarding the actual position of the head is available.

[0029] The decisive factor for adjusting a vehicle mirror and / or screen is therefore not the actual shape of the driver's head, but rather the position of the driver's head within the vehicle. The adjustment of a vehicle mirror and / or screen is based on the height of the head within the vehicle. It is known that the eye axis is located approximately halfway up the head. Therefore, based on this information, the actual direction of a driver's gaze can be deduced. Consequently, precisely detecting or capturing a driver's eyes, and thus applying a complex detection method, is not necessary to adjust at least one vehicle mirror and / or screen.

[0030] To improve and / or stabilize the result, the driver's upper body outline can also be recorded in step a). This data can then be used in step b) to calculate the driver's head position.

[0031] In a further embodiment of the invention, it is possible to measure the distance between the interior camera and the at least one vehicle geometry in a calibration step. The at least one vehicle geometry is preferably a section of the A-pillar and / or a section of the B-pillar and / or a section of the C-pillar. The distance between the interior camera and the at least one vehicle geometry is preferably measured by means of a sensor, in particular an infrared sensor. Alternatively, the distance can be measured manually and entered into and stored in a processing unit of the vehicle.

[0032] The at least one vehicle geometry refers to such unchanging areas or sections of the vehicle interior that are clearly detectable by the interior camera.

[0033] If the distance between the interior camera and the at least one vehicle geometry is known, the distance of the driver's head outline or the position of the driver's head to the interior camera can be determined when a driver's head outline is detected in relation to the at least one vehicle geometry.

[0034] In other words, it is possible, due to the calibration step, to provide calibration information regarding at least one vehicle geometry of the vehicle interior, so that depth information can be calculated from a captured two-dimensional image.

[0035] The calibration step can be performed once upon completion of the vehicle. Preferably, such a calibration step is performed before delivery of a completed vehicle. In a further embodiment of the invention, it is possible to perform a calibration step before each adjustment of at least one vehicle mirror.

[0036] It has surprisingly been shown that, for adjusting at least one vehicle mirror and / or screen, evaluating information obtained using a 2D camera or a fisheye camera is sufficient to determine the correct target position of the vehicle mirror and / or screen.

[0037] The method according to the invention requires significantly less computing power than is known in connection with already known methods for adjusting vehicle mirrors.

[0038] Another aspect of the invention relates to a system for carrying out a method according to the invention. This system comprises: - at least one interior camera, - at least one computing unit, - at least one data connection from the computing unit to at least one actuator of a vehicle mirror and / or a screen, and - at least one memory in which the mean value with respect to a head length and a head width is stored.

[0039] In a particularly preferred embodiment of the invention, the interior camera is a 2D camera or a fisheye camera.

[0040] The actuator of a vehicle mirror can be the actuator of a side mirror and / or exterior mirror, as well as the actuator of an interior mirror. These actuators are typically implemented as small servo motors.

[0041] The interior camera preferably has a viewing angle of 100° - 120°, in particular 110° - 160°, and in particular 120° - 130°.

[0042] In a preferred embodiment of the invention, the at least one interior camera is arranged on the central axis of a vehicle, in particular in the area of ​​a vehicle roof or a windshield root.

[0043] These positions of the interior camera prove to be particularly advantageous with regard to capturing the outline of a driver's head, as well as capturing the unchanging vehicle geometry of the vehicle interior.

[0044] Preferably, the interior camera is an interior camera that is already used in the vehicle for other applications.

[0045] Furthermore, it is possible that the value of the distance between the interior camera and at least one vehicle geometry of the vehicle interior is stored in the memory. In a preferred embodiment of the invention, the memory is integrated into the processing unit.

[0046] In a further embodiment of the invention, the system comprises a distance sensor, in particular an infrared sensor. The distance sensor, in particular the infrared sensor, serves in particular to determine the distance between the interior camera and the at least one vehicle geometry.

[0047] In connection with the system according to the invention for carrying out a method for adjusting at least one vehicle mirror and / or a screen, the same advantages arise as those already described in connection with the method according to the invention.

[0048] Another aspect of the invention relates to a computer-readable storage medium which contains instructions that cause at least one computing unit, in particular an on-board computer of a vehicle, to implement a method as described above.

[0049] Further advantageous embodiments are described in the dependent claims.

[0050] The invention will below be described with regard to further features and advantages using exemplary embodiments, which will be explained in more detail with reference to illustrations.

[0051] This shows: Fig. 1 a schematic representation of a top view of a vehicle; Fig. 2 a representation of a process step of the method according to the invention for adjusting at least one vehicle mirror and / or a screen; and Fig. 3 a flowchart of a method according to the invention for adjusting at least one vehicle mirror and / or a screen.

[0052] In the following description, the same reference numbers are used for identical and equivalent parts.

[0053] Fig. Figure 1 shows a schematic representation of a top view of a vehicle 10 comprising a system according to the invention for carrying out a method for adjusting at least one vehicle mirror and / or a screen.

[0054] Accordingly, the side mirrors 20, which can also be referred to as exterior mirrors, and the interior mirror 25 can be adjusted using a method according to the invention. Furthermore, it is possible for the screen 30, also shown, to be adjusted using the method according to the invention.

[0055] The system includes at least one Interior Camera 40. The Interior Camera 40 is also used for other applications in the vehicle. The Interior Camera 40 is either a 2D camera or a fisheye camera.

[0056] Furthermore, the system includes a computing unit 50. The computing unit 50 can, for example, be integrated into the vehicle's on-board computer 10. A data connection (not shown) is provided between the computing unit 50 and the actuators of the mirrors 20 and 25, as well as to the screen 30.

[0057] The schematic diagram shows the design of the A-pillar 81, the B-pillar 82, and the C-pillar 83, at least for the left half of the vehicle. Pillars 81-83 represent fixed vehicle geometries. These pillars can be detected using the interior camera 40.

[0058] The infrared sensor 60 can be used to detect the distance between the interior camera 40 and the unchanging vehicle geometry, for example, the distance between the interior camera 40 and the A-pillar 81 and / or the B-pillar 82 and / or the C-pillar 83. Preferably, this distance detection is carried out in a calibration step, which is preferably performed once, vehicle-specifically, during the completion of the vehicle 10.

[0059] It can be seen that the interior camera 40 is located on the central axis M of the vehicle 10. It is possible that the interior camera 40 is located in the area of ​​the vehicle roof or in the area of ​​the base of the windshield.

[0060] The procedure begins with capturing the outline of the driver's head 70. The outline of the head 70 is captured in a lateral view of the head 65.

[0061] When the head outline 70 of the driver 100 is detected, the vehicle geometry is detected simultaneously, that is, in the illustrated case, the A-pillar 81, the B-pillar 82 and / or the C-pillar 83. Therefore, the head outline 70 is detected in relation to at least one of the aforementioned vehicle geometries 81, 82 and 83.

[0062] The position of the driver's head 65 100 is then calculated based on the captured head outline 70 and the calibration information acquired during the calibration step. Therefore, the exact position of the head 65, including depth data, can be calculated. The two-dimensional image data from the interior camera 40 is then evaluated.

[0063] In step c), a target position for the vehicle mirrors 20 and 25 and the screen 30 is determined. The target positions are determined based on the calculated head position.

[0064] Subsequently, one actuator each for the rearview mirrors 20 and 25, as well as for the screen 30, is activated. This serves to establish the specified target position of the vehicle mirrors 20 and 25 and the screen 30.

[0065] Fig. Figure 2 shows how an elliptical shape 90 is formed around the detected head outline 70. Accordingly, an ellipse 90 is placed around the head outline 70 in such a way that the elliptical shape 90 is adjacent to as many detected edge segments 71 of the head outline 70 as possible.

[0066] In step c), a previously defined value regarding a head length L and a head width B is preferably used to determine the target position of the vehicle mirror 20, 25 and / or the screen 30. This is done in particular taking into account the elliptical shape 90.

[0067] In Fig. Figure 3 shows individual steps of the inventive method, to be carried out one after the other, in simplified form.

[0068] In step 200, a calibration step is performed in which the distance between the interior camera 40 and at least one vehicle geometry 81, 82, and 83 is determined using the infrared sensor 60. In step 210, the respective value of the distance between the interior camera 40 and the vehicle geometry is stored in a memory.

[0069] In step 220, the average value for head length L and head width B is additionally stored in the memory. Steps 210 and 220 can also be performed simultaneously or in reverse order.

[0070] In step 230, the head outline 70 of the driver 100 is captured in relation to the vehicle geometry 81, 82 and 83 of the vehicle interior 95. This capture is performed using the interior camera 40.

[0071] In step 240, an elliptical shape 90 is adapted to the captured head outline 70 (see Fig. 2).

[0072] It is possible that in step 230 the head outline 70 of the driver 100 is captured multiple times. Therefore, in step 240, an elliptical shape 90 would have to be adjusted to a mean value of the captured head outlines 70.

[0073] In step 250, the position of the driver's head 70 is calculated based on the captured head outline 70, taking into account the elliptical shape 90. Calculation step 250 is also performed using the calibration data captured in step 200 and stored in step 210. Using this calibration data, the distance between the head outline 70 of the positioned head 65 of the driver 100 and the interior camera 40 can be determined.

[0074] In step 260, the target positions of the vehicle mirrors 20 and 25, as well as the screen 30, are determined. This can be done, for example, using comparison data stored in a database. The comparison data is selected based on the calculated head position.

[0075] In step 270, the actuators (not shown) of the vehicle mirrors 20 and 25 and the screen 30 are finally controlled to establish the previously determined target positions of the vehicle mirrors 20 and 25 and the screen 30.

[0076] It should be noted here that all the parts described above, considered individually and in any combination, especially the details shown in the drawings, are claimed as essential to the invention. Modifications to this are familiar to those skilled in the art. Reference symbol list 10 vehicles 20 side mirrors 25 Interior mirrors 30-inch screen 40 Interior camera 50 computing units 60 Infrared Sensor 65 head 70 Head outline 71 edge section 81 A-pillar 82 B-pillar 83 C-pillar 90 elliptical shape 95 Vehicle interior 100 drivers B Head width L Head length M Longitudinal axis 200 - 270 process steps

Claims

[1] Method for adjusting at least one vehicle mirror, in particular at least one side mirror (20) and / or one interior mirror (25), and / or one screen (30), wherein the method comprises the following steps: a) Capturing a head outline (70) of a driver (100) in relation to at least one vehicle geometry (81, 82, 83) of the vehicle interior (95) using an interior camera (40) of the vehicle (10), b) Calculating the position of the driver's head (65) (100) based on the captured head outline (70) and on calibration information regarding at least one vehicle geometry (81, 82, 83) of the vehicle interior (95), c) Determining a target position of the at least one vehicle mirror (20, 25) and / or the screen (30) based on the calculated head position, whereby a previously defined mean value with respect to a head length (L) and a head width (B) is used to determine the target position of the vehicle mirror (20, 25) and / or the screen (30), d) Controlling an actuator of at least one vehicle mirror (20, 25) and / or the screen (30) to establish the specified target position of the vehicle mirror (20, 25) and / or the screen (30). [2] Method according to claim 1, characterized by adapting an elliptical shape (90) to the captured head outline (70). [3] Method according to claim 1 or 2, characterized by , that in step a) the head outline (70) of the driver (100) is recorded several times and an average of the recorded head outlines (70) of the driver (100) is calculated and used in step b). [4] Method according to claim 2 or 3, insofar as it relates back to claim 2, characterized by , that in step c) the previously determined mean value with regard to the head length (L) and the head width (B) is used to determine the target position of the vehicle mirror (20, 25) and / or the screen (30) taking into account the adapted ellipse shape (90). [5] Method according to any of the preceding claims, characterized by , that in a calibration step (200) the distance between the interior camera (40) and the at least one vehicle geometry (81, 82, 83), in particular to a section of the A-pillar (81) of the vehicle and / or to a section of the B-pillar (82) of the vehicle and / or to a section of the C-pillar (83) of the vehicle, is detected by means of a sensor, in particular an infrared sensor (60), or measured manually and entered and stored in a computing unit (50) of the vehicle (10). [6] Method according to claim 5, characterized by , that the calibration step (200) is performed once upon completion of the vehicle (10) or before each adjustment of at least one vehicle mirror. [7] System for carrying out a method according to any one of claims 1 to 6, comprising: - at least one interior camera (40), - at least one computing unit (50), - at least one data connection to at least one actuator of a vehicle mirror (20, 25) and / or a screen (30), and - at least one memory in which the mean value of the head length (L) and the head width (B) is stored. [8] System according to claim 7, characterized by that at least one interior camera (40) is a 2D camera or a fisheye camera. [9] System according to claim 7 or 8, characterized by , that the interior camera (40) has a viewing angle of 100° - 220°, in particular of 110° - 160°, in particular of 120° - 130°. [10] System according to any one of claims 7 to 9, characterized by , that the at least one interior camera (40) is arranged on the central axis (M) of a vehicle (10), in particular in the area of ​​a vehicle roof or a windshield root. [11] System according to any one of claims 7 to 10, characterized by , that the memory contains the value of the distance of the interior camera (40) to at least one vehicle geometry (81, 82, 83) of the vehicle interior (95), wherein the memory is preferably formed in the computing unit (50). [12] System according to any one of claims 7 to 11, characterized by a distance sensor, in particular an infrared sensor (60). [13] Computer-readable storage medium containing instructions that cause at least one computing unit (60), in particular an on-board computer of a vehicle (10), to implement a method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method for automatically adjusting one or more comfort and / or safety systems in a motor vehicle, motor vehicle, computer program product and computer program

    DE102015219237A1

  • Method and apparatus for determining an occupant' s head location in an actuatable occupant restraining system

    US20040240706A1