Device and method for determining a blocking of the gaze of a

Abstract

The invention relates to a device for determining the occlusion of the line of sight of a driver of a vehicle, comprising: (i) a mirror of the vehicle, in particular an interior mirror or a right side mirror, through which the driver of the vehicle can see an area; (ii) a movable part of the vehicle; (iii) an analysis and control device configured to: read a current adjustment value representative of a current position of the movable part; comparing the current adjustment value with a reference adjustment value stored in the evaluation and control device, said reference adjustment value representing a reference position of the movable part in which the line of sight of the driver to the mirror is blocked by the movable part; and, if the comparison has indicated that the current adjustment value substantially coincides with the reference adjustment value such that the line of sight of the driver viewing mirror is occluded by the current position of the movable part, a signal is emitted.

Description

Technical Field

[0001] The present invention relates to a device and a method, in particular a computer-implemented method, for determining an occlusion of the line of sight of a driver of a vehicle. Background Art

[0002] In a vehicle, a temporary occlusion of the line of sight may occur, especially on the interior rearview mirror or the side rearview mirror. In these situations, the driver cannot see the traffic situation through the corresponding mirror.

[0003] Here, it is known that a possible occlusion of the line of sight can be determined using image data collected by an interior space camera. However, for this purpose, a time-consuming algorithm is required, through which the field of view that the driver looks at the mirror can be determined, and through which the occlusion of the field of view or the line of sight can also be ascertained. In the case where an occlusion of the line of sight has been determined, the area collected by the camera, which corresponds to the area visible through the mirror, can alternatively be displayed by a display device, especially by a display. Summary of the Invention

[0004] The object of the present invention is to determine an occlusion of the line of sight of a driver looking at a mirror of a vehicle with little effort.

[0005] A solution for achieving the object is taught by the independent claims. Different embodiments and improvements of the present invention are the subject matter of the dependent claims.

[0006] The first aspect of the solution relates to a device for determining an occlusion of the line of sight of a driver of a vehicle, the device having: (i) a mirror of the vehicle, especially an interior rearview mirror or a right side rearview mirror, through which the driver of the vehicle can see an area; (ii) a movable part of the vehicle; (iii) an analysis and control device configured to: read a current adjustment value representing the current position of the movable part; and compare the current adjustment value with a reference adjustment value stored in the analysis and control device, the reference adjustment value representing a reference position of the movable part, in which the line of sight of the driver looking at the mirror is occluded by the movable part; and, if the comparison has shown that the current adjustment value is substantially consistent with the reference adjustment value, such that the line of sight of the driver looking at the mirror is occluded by the current position of the movable part, then emit a signal.

[0007] The terms "comprising", "including", "containing", "having", "carrying", or any other variant thereof that may be used herein should cover non-exclusive inclusion. Thus, for example, a method or device that includes or has a series of elements is not necessarily limited to those elements, but may contain other elements not expressly stated or inherent to such method or such device.

[0008] In addition, unless the contrary is explicitly stated, "or" means an inclusive "or" rather than an exclusive "or". For example, the condition A or B is satisfied by one of the following conditions: A is true (or exists) and B is false (or does not exist), A is false (or does not exist) and B is true (or exists), and both A and B are true (or exist).

[0009] As used herein, the term "a" or "an" is defined to mean "one or more". The terms "an additional" and "another" and each other variant thereof are to be understood to mean "at least one other".

[0010] As used herein, the term "plurality" is to be understood to mean "two or more".

[0011] As used herein, the term "configured" or "set" for implementing a particular function (and its corresponding variations) is to be understood to mean that the corresponding device is already in such a configuration or setting in which the device can perform the function, or that the device is at least settable, i.e., configurable, such that the device can perform the function after the corresponding setting. Herein, the configuration can be achieved, for example, by correspondingly setting the parameters of a process or a switch or the like for activating or deactivating a function or a setting. In particular, the device can have a plurality of predetermined configurations or operating modes, so that it can be configured by selecting one of these configurations or operating modes.

[0012] As used herein, the term "electro-optical acquisition device" is to be understood in particular as a device having a sensor that is configured to acquire or measure an electromagnetic signal and convert the electromagnetic signal into an electrical signal. These sensors can in particular be charge-coupled sensors, also known as CCDs (Charge-Coupled-Devices), can be radar sensors, lidar sensors or other sensors. In addition, such a sensor can also be configured to emit an electromagnetic signal onto an object and then measure the electromagnetic signal reflected from the object, so that information about the object can be obtained from the emitted and reflected electromagnetic signals in a subsequent analysis, also known as a TOF (Time-of-Flight) camera.

[0013] With the device according to the first aspect, it is possible to technically simply determine an occlusion of the driver's line of sight to the mirror. In contrast to the known technical solutions that require a costly analysis of the acquired image data, according to the solution of claim 1, an occlusion can be ascertained by reading the current adjustment value and subsequently comparing this adjustment value with a reference adjustment value. If the comparison indicates an occlusion, a signal for triggering a function is emitted. The signal can in particular trigger an acoustic or optical cue signal or warning signal for the driver, so that the driver is made aware of the presence of the occlusion. The signal can also in particular trigger a function of an electrical device of the vehicle.

[0014] The preferred embodiments of the device are described below. As long as they are not explicitly excluded or technically infeasible, the embodiments can be arbitrarily combined with each other and with other aspects described respectively.

[0015] In some embodiments, the device further includes an electro-optical acquisition device, in particular a camera, which is configured to be able to substantially acquire the area visible through the mirror; wherein, the analysis and control device is configured to trigger the display of the area acquired by the electro-optical acquisition device through the display device by means of a signal for triggering a function. Here, the analysis and control device can be connected to the electro-optical acquisition device and the display device in terms of signal technology, and trigger the display of the photographed area through the display device by means of a signal for triggering a function. Thereby, when the line of sight to the mirror is occluded, the visible area can be substantially displayed on the display device. The driver can thus still see an area that is substantially equivalent to the visible area of the mirror.

[0016] In some embodiments, the analysis and control device is configured to read a plurality of temporally successive current adjustment values during the movement of the movable part, and thereby determine the movement direction of the movable part with respect to the reference position, and when the determined movement direction already indicates that the movable part is moving in the direction towards the reference position, emit a signal for triggering a function. Thereby, it is possible to emit a signal for triggering a function earlier, in particular before the occlusion occurs, so that the driver is not surprised by this. In the case of triggering the display of the acquired area through the display device, this can be carried out before the occlusion occurs partially or completely. In this way, it can be achieved that the driver can see the visible area at least through the mirror or the display device at any time.

[0017] In some embodiments, the part can be automatically moved electromechanically, and the analysis and control device is further configured to trigger the movable part to move in a direction away from the reference position by means of a signal for triggering a function. Thereby, an occlusion that may occur or an impending occlusion due to the determined movement direction of the movable part can be reversed or prevented.

[0018] In some embodiments, the movable part includes the co-pilot seat or the panoramic display. Thereby, it is possible to determine the occlusion caused by the co-pilot seat or the panoramic display.

[0019] In some embodiments, the electro-optical acquisition device includes a digital camera. By means of the digital camera, the data acquired by the sensor can be generated into an image file for further analysis.

[0020] The second aspect of the solution relates to a vehicle having the device according to any one of the preceding claims.

[0021] The third aspect of the solution relates to a method for determining the line-of-sight occlusion of a driver looking at a mirror of a vehicle, in particular a computer-implemented method, which includes the following steps: (i) reading a current adjustment value, which represents the current position of a movable part of the vehicle; (ii) comparing the current adjustment value with a stored reference adjustment value, which represents the reference position of the movable part, in which the driver's line of sight looking at the mirror is occluded by the movable part; (iii) if the comparison has shown that the current adjustment value is substantially consistent with the reference adjustment value, such that the driver's line of sight looking at the mirror is occluded by the current position of the movable part, then a signal for triggering a function is issued.

[0022] In some embodiments, the method further includes the following steps: (i) acquiring, by means of the electro-optical acquisition device, the area that can be seen substantially through the mirror; (ii) triggering, by means of the signal for triggering the function, the display of the area acquired by the electro-optical acquisition device by means of the display device.

[0023] The features and advantages described with respect to the first aspect of the solution correspondingly also apply to the other aspects described. Description of the Drawings

[0024] Other advantages, features and application possibilities result from the following description of the preferred embodiments in conjunction with the drawings. In the drawings:

[0025] Figure 1 Schematically shows a device according to an embodiment;

[0026] Figure 2 Shows a flow chart for illustrating a preferred embodiment of the method. Detailed Description

[0027] In the drawings, the same reference numerals are always used for the same or corresponding elements.

[0028] In Figure 1Schematically shows a device according to an embodiment. Here, vehicle 100 is schematically shown, in which an interior rearview mirror 150 and a side rearview mirror 140 on the right with respect to the driving direction are arranged in the interior space. The driver 180 can see an area of the traffic situation through the interior rearview mirror 150 and the right-side rearview mirror 140 respectively while driving.

[0029] Vehicle 100 also has a front passenger seat 120 that can move forward and backward in the driving direction, where the direction of movement is shown by a double arrow. As Figure 1 Schematically shown, when the front passenger seat moves forward to the end position, the backrest of the front passenger seat may be in the field of view of the driver 180 towards the right-side rearview mirror 140. In this case, the driver 180 can no longer perceive the traffic situation through the right-side rearview mirror 140. This may affect safety when driving vehicle 100. Vehicle 100 also has a movable panoramic display 130 that is movable around a rotation axis. The movable panoramic display 130 can be arranged planar at the roof of vehicle 100 in an inactive or stationary position. In use, the panoramic display 130 can be flipped downwards by a rotational movement so that vehicle occupants on the rear seats can view the content displayed on the panoramic display. Here, the panoramic display 130 is located between the interior rearview mirror 150 of the vehicle and the rear window (not shown here), and the driver 180 can no longer see the traffic situation through the rear window of vehicle 100 via the interior rearview mirror 150 or can only see it strongly reduced. This situation may also affect safety when driving vehicle 100.

[0030] Vehicle 100 also has a camera 160, a display device 170, and an analysis and control device 110. Here, the analysis and control device 110 is connected to the camera 160, the panoramic display, the front passenger seat 120, and the display device 170 in terms of signal technology, where these signal technology connections are shown by dashed lines. The camera 160 is arranged in the area of the bumper of vehicle 100 (not shown here) and can collect the external area of vehicle 100 behind vehicle 100. This external area can also include a partial area of the area visible through the right-side rearview mirror 140. To collect the area visible through the right-side rearview mirror 140 more accurately, an additional camera (not shown here) can be arranged near the right-side rearview mirror 140.

[0031] The movable co-pilot seat 120 and the panoramic display 130 can be adjusted automatically in an electromechanical manner in their respective positions. For example, the movement of the co-pilot seat 120 is achieved by an electric motor (not shown here). Here, the current position of the co-pilot seat 120 can be determined using the adjustment values representing the current position. These adjustment values can be read by the analysis and control device 110, and the respective corresponding positions can also be determined by the analysis and control device 110. Here, reference adjustment values are additionally stored in the analysis and control device 110. The reference adjustment values represent the following positions of the co-pilot seat 120, in which the driver 180's view looking at the right rearview mirror is blocked. The analysis and control device 110 continuously reads the current adjustment values during operation and compares them with the reference adjustment values respectively. If the comparison shows that the current adjustment value is basically consistent with the reference adjustment value, the analysis and control device 110 emits a signal, whereby the display device 170 displays the area captured by the camera 160. The display device 170 is arranged in the driver 180's field of view, so that the driver can see the display device in his field of view when looking straight ahead. In Figure 1 this, from the perspective of the driver 180, the display device 170 is arranged behind the steering wheel of the vehicle 100 on the instrument panel in the view. The display device 170 can also be arranged in the center console. The adjustment values of the panoramic display 130 can also be read out by the analysis and control device 110, and the respective corresponding positions can also be determined by the analysis and control device 110. In addition, the analysis and control device 110 is configured to control the co-pilot seat 120 and / or the panoramic display 130 in terms of their positions. Here, the current movement direction of the co-pilot seat 120 and / or the panoramic display 130 can be determined. The movement direction can be compared with the corresponding reference position, and thereby it can be determined whether the co-pilot seat 120 and / or the panoramic display 130 is moving towards the reference position or away from the reference position. If the co-pilot seat 120 and / or the panoramic display 130 is moving towards the reference position, this movement can be stopped or a movement in the opposite direction can be triggered. Thereby, the occurrence of line-of-sight occlusion can be prevented in advance.

[0032] In Figure 2 this, a flowchart 200 showing a preferred embodiment of a method for determining the occlusion of the line of sight of the driver 180 of the vehicle 100 is shown, and the method includes the following steps.

[0033] In the first step 210 of the method, the current adjustment values representing the current positions of the movable components 120, 130 of the vehicle 100 are read.

[0034] In another step 220 of the method, the current adjustment value is compared with a stored reference adjustment value, where the reference adjustment value represents a reference position of the movable parts 120, 130 in which the line of sight of the driver 180 looking at the rearview mirrors 140, 150 is blocked by the movable parts 120, 130.

[0035] In another step 230 of the method, if the comparison shows that the current adjustment value is substantially the same as the reference adjustment value such that the line of sight of the driver 180 looking at the rearview mirrors 140, 150 is at least partially blocked by the current position of the movable parts 120, 130, a signal for triggering a function is sent. If the comparison shows that the current adjustment value is substantially different from the stored adjustment value, the next adjustment value is read according to method step 210.

[0036] Although at least one exemplary embodiment has been described above, it should be noted that there are a large number of variations of the embodiment. It should also be noted here that the described exemplary embodiment is only a non - restrictive example, and its purpose is not to limit the scope, applicability or configuration of the devices and methods described herein. Instead, the above description provides a guide for those skilled in the art to implement at least one exemplary embodiment. It can be understood that various changes can be made to the elements described in the exemplary embodiment in terms of functional manner and arrangement structure without departing from the subject matter and its legal equivalents respectively defined in the appended claims.

[0037] List of reference numerals

[0038] 100 Vehicle

[0039] 110 Analysis and control device

[0040] 120 Passenger seat

[0041] 130 Panoramic display

[0042] 140 Right - hand rearview mirror

[0043] 150 Interior rearview mirror

[0044] 160 Camera

[0045] 170 Display device

[0046] 180 Driver

[0047] 200 Flowchart

[0048] 210 Read current adjustment value

[0049] 220 Compare

[0050] 230 Send signal for triggering function

Claims

1. An apparatus for determining an occlusion of a driver's (180) line of sight in a vehicle (100), the apparatus having: a mirror (140, 150) of the vehicle (100), an area visible to a driver (180) of the vehicle (100) through the mirror; movable components (120, 130) of the vehicle (100); an analysis and control device (110) configured to: - read a current adjustment value (120, 130) representative of a current position of the movable components (120, 130); and - compare the current adjustment value with a reference adjustment value stored in the analysis and control device (110), the reference adjustment value representative of a reference position of the movable components (120, 130) in which a line of sight of the driver (180) to the mirror (140, 150) is occluded by the movable components (120, 130); and - if the comparison has shown that the current adjustment value is substantially in agreement with the reference adjustment value such that the line of sight of the driver (180) to the mirror (140, 150) is occluded by the current position of the movable components (120, 130), issue a signal triggering a function.

2. The apparatus according to claim 1, the apparatus further having: an electro-optical acquisition device (160) configured to substantially acquire an area visible through the mirror (140, 150); Among them, the analysis and control device (110) configured to trigger, by the signal of the triggering function, a display of the area acquired by the electro-optical acquisition device (160) through a display device (170).

3. The device according to claim 1 or 2, wherein, The analysis and control device (110) is configured to read a plurality of temporally successive current adjustment values during movement of the movable components (120, 130), and thereby determine a direction of movement of the movable components with respect to the reference position, and issue the signal of the triggering function when the determined direction of movement has shown that the movable components (120, 130) are moving in a direction towards the reference position.

4. The device according to any one of claims 1 to 3, wherein, The movable components (120, 130) are automatically movable electromechanically, and the analysis and control device (110) is further configured to trigger, by the signal of the triggering function, the movable components (120, 130) to move in a direction away from the reference position.

5. The device according to any one of the preceding claims, wherein, The movable components include a passenger seat (120) or a panoramic display (130).

6. The apparatus according to any one of the preceding claims, wherein, The electro-optical acquisition device includes a camera (160) of the vehicle (100).

7. A vehicle (100) having an apparatus according to any one of the preceding claims.

8. A method for determining an occlusion of a driver's (180) line of sight in a vehicle (100), the method comprising the steps of: - reading a current adjustment value representative of a current position of the movable components (120, 130) of the vehicle (100); - Compare the current adjustment value with the stored reference adjustment value, where the reference adjustment value represents the reference position of the movable parts (120, 130) in which the line of sight of the driver (180) looking at the mirrors (140, 150) is blocked by the movable parts (120, 130); - If the comparison has shown that the current adjustment value is substantially consistent with the reference adjustment value such that the line of sight of the driver (180) looking at the mirrors (140, 150) is blocked by the current position of the movable parts (120, 130), then emit a signal to trigger the function.

9. The method according to claim 8, the method further comprising the following steps; - Collect the area that can be seen substantially through the mirrors (140, 150) by the electro-optical acquisition device (160); - Trigger the display of the area collected by the electro-optical acquisition device (160) by the display device (170) by the signal triggering the function.

Images