Apparatus and method for determining eye image data, eye position and / or gaze direction of a vehicle user within a vehicle
By using cameras and light sources inside the vehicle to guide users in adjusting the position of the seat and steering wheel, the problem of eye position and gaze recognition is solved, enabling more reliable recognition and normal operation of the assistance system.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- MERCEDES BENZ GRP
- Filing Date
- 2020-06-25
- Publication Date
- 2026-04-21
AI Technical Summary
In existing technologies, the recognition of a vehicle user's eye position and gaze direction is easily obstructed by objects such as the steering wheel, leading to recognition interference and affecting the reliability and functionality of the driver assistance system.
It employs a camera, image data evaluation unit, and controller in conjunction with a light source device. The light source is activated only when the eyes are not obstructed. Optical and acoustic signals guide the user to adjust the seat and steering wheel position to ensure reliable acquisition of eye position and direction of vision.
It improves the reliable recognition of the vehicle user's eye position and direction of gaze, reduces recognition interference, and ensures the effective operation of the driver assistance system.
Smart Images

Figure CN114041174B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a method for determining the eye image data of a vehicle user and the current position (POS) of both eyes (A1, A2) within a vehicle. A1 POS A2 And / or the device and method by which the vehicle user is currently looking. Position POS of the two eyes A1, A2. A1 POS A2 The measurement here is advantageously used as a basis for determining the current line of sight of the vehicle user. Background Technology
[0002] In particular, modern driver assistance systems have the ability to be controlled based on the determined current gaze direction of the vehicle user. Therefore, current driver assistance and safety systems within motor vehicles utilize a wealth of information to achieve better system configuration and effectiveness. This includes information from within the vehicle cabin that may involve the driver or other passengers.
[0003] Therefore, it is possible to determine, for example, the driver's gaze direction and use this relevant information in driver assistance systems. To determine this information, a video camera is typically used, which captures the driver's head from the front. The camera can be positioned, for example, within the dashboard or instrument panel area, near the windshield. Image processing algorithms search the images captured by the camera according to typical features (e.g., two round eyes, a long nose, and a horizontally extending mouth). Simple head orientation recognition can be achieved by evaluating the symmetry of these features; a better implementation specifies that the pupils within the eye area are also located and evaluated. For sufficient recognizability in dark scenes, an infrared camera can be positioned from the front, along with active infrared illumination targeting the driver's upper body.
[0004] The gaze direction recognition or head orientation recognition is used, for example, to determine the driver's level of attention to the road. Based on this level of attention, driver assistance systems and / or safety systems are then controlled according to different times of day or varying degrees of intensity; that is, system operating parameters are adjusted.
[0005] Specific examples include: in collision warning and emergency braking systems, it is known that warnings or braking are triggered earlier when the driver's gaze is off-target. In ACC start-stop systems and traffic jam assist systems, automatic start-up is not possible when the driver's gaze is not on the road. Lane keeping assist systems (lane departure warning) warn significantly earlier or more strongly when the driver is distracted. Finally, lane change assist systems should also be mentioned, as they also warn earlier or more strongly when the driver's gaze is not on the side mirrors.
[0006] A device for recognizing the gaze of a vehicle user is disclosed, for example, by publication DE 10 205 206 982 A1. This publication discloses a combined dashboard including a display, wherein a camera for driver observation or driver gaze tracking is positioned in the edge area of the display. The camera can be used, for example, to monitor driver takeover readiness during autonomous driving or to identify driver fatigue. Based on the determined gaze, vehicle functions can also be controlled. For example, once the driver's gaze is directed towards the screen, the screen is brightened or a display / area on the screen is activated. Furthermore, functions can be controlled via a combination of gaze and voice / gesture. Thus, the side window can be intentionally opened by looking at the vehicle's side window and making a gesture indicating opening.
[0007] DE 10 2008 036 023 A1 discloses a vehicle information notification device that uses a camera to detect the driver's face. Once a seat sensor installed in the driver's seat detects that someone is seated, the camera takes a picture of the face.
[0008] EP 3 249 497 A1 describes a device in which a display device is activated once driver gaze recognition is not possible.
[0009] WO 2018208446 discloses a camera for driver observation, wherein a light source arrangement above or next to the camera is used for information display and object illumination.
[0010] DE 10 2014 221 039 A1 discloses an apparatus for acquiring facial image data, which includes a camera, an image evaluation unit, and a controller for providing a positioning signal indicating the steering direction of the steering wheel, so that the driver's face is not obscured and can be identified by the camera.
[0011] Reliable execution is based on the eye position POS of the corresponding vehicle user. A1 POS A2 The premise for determining or recognizing the vehicle user's gaze is that the camera can determine the vehicle user's eye position (POS) as continuously and without interference as possible. A1 POS A2 (That is, especially when the eyes are not obstructed by objects placed in the area between the camera and the eyes).
[0012] When a vehicle occupant's eyes are obstructed by the steering wheel rim due to their seat position and body size, such as at the POS position (part of the driver's eye),... A1 POS A2 Interference occurred during the determination process. Summary of the Invention
[0013] The objective of this invention is to provide an improved device for determining the eye position and / or direction of gaze of a vehicle occupant within a vehicle, thereby minimizing interference.
[0014] The invention is derived from the features of the independent claims. Advantageous improvements and designs are the subject of the dependent claims.
[0015] A first aspect of the present invention relates to an apparatus for determining eye image data, eye position, and / or the current gaze direction of a vehicle occupant within a vehicle. The proposed apparatus includes: a camera capable of acquiring image data of the vehicle interior; and an apparatus capable of determining the positions POS of eyes A1 and A2 based on the acquired eye image data. A1 POS A2 And / or an image data evaluation unit for the current gaze direction of the vehicle user; and a POS unit for situations where eye image data, eye A1, A2, and current position cannot be determined. A1 POS A2 A controller that generates an activation signal S for the light source in the case of the eye position and / or gaze direction. The device of the present invention is characterized in that the light source has one or more individual light sources, wherein the one or more individual light sources are arranged and designed such that the one or more individual light sources can only be recognized by the vehicle user when the eyes A1, A2, the eye position and / or gaze direction can be captured by the camera without obstruction and / or when the eyes are within a predefined optimal spatial area or spatial angle area relative to the camera, i.e., within the camera's capture area. In other words, the vehicle user can guarantee the image data of the eyes A1, A2, and the position POS of the eyes A1, A2 (102). A1 POS A2 And / or the current gaze direction is captured by the user adjusting the seat or steering wheel so that the light source, i.e., a single light source or all individual light sources, can be seen without obstruction. Advantageously, with this arrangement, the light source or multiple individual light sources realize an integrated display element that shows the user image data of eyes A1, A2 that the camera cannot detect, and the position POS of eyes A1, A2 (102). A1 POS A2 And / or the current viewing direction, while simultaneously providing the user with an intuitive direction of operation, namely adjusting the seat, seat position, and steering wheel direction, so as to enable camera detection and the use of assistance systems that rely on camera data.
[0016] The term "vehicle user" here includes the driver or front passenger or other passengers in the vehicle.
[0017] Here, "A1" refers to the left eye of the vehicle user, for example, and "A2" refers to the right eye accordingly.
[0018] The term "camera" specifically refers to digital cameras, video cameras, infrared cameras, or stereo cameras, which respectively acquire image data and transmit it to an image data evaluation unit. Cameras are advantageously sensitive to visible light, preferably infrared light. The latter is particularly useful for determining the pupil positions of the vehicle user's eyes A1, A2 and for detecting eye position in dark environments such as night. The camera is oriented towards the interior of the vehicle occupied by the vehicle user or driver.
[0019] The image evaluation unit is designed to extract eye image data from the camera's image data, that is, to identify the vehicle user's eyes from the entire image data of the camera.
[0020] The positions of eyes A1 and A2 (POS) A1 POS A2 Specifically, this refers to the position within the vehicle coordinate system. This is to derive the eye positions POS (A1, A2) in the vehicle coordinate system from the eye positions determined in the image data. A1 POS A2 Furthermore, determining the view direction, in particular, requires corresponding transformations and conditional calibrations. The appropriate evaluation algorithms, utilizing the corresponding transformation parameters, are conveniently stored within the image data evaluation unit.
[0021] The image data evaluation unit is also designed and configured to determine the current gaze direction of the vehicle user. This is based on the acquired image data and evaluation algorithms known in the prior art. Details are available from relevant prior art.
[0022] In a favorable improvement to this device, the light source is an LED, OLED, incandescent lamp, halogen lamp, laser, or Nensto lamp. The light source is placed in a suitable location within the vehicle.
[0023] The light source advantageously has a light-shielding plate or light-shielding device that restricts the light emitted by the light source to a predetermined spatial angle. Therefore, such a light source with a light-shielding plate / light-shielding device can only be seen by the eye located at the predetermined spatial angle.
[0024] In an advantageous improvement, the light source includes one or more pixels of a display connected to a controller. The light source is advantageously designed as part of the display. The display is advantageously a display for a vehicle's instrument cluster. The display is advantageously an LED display, OLED display, plasma display, or LC display. Advantageously, the camera is integrated into the display. The display preferably has a notch that interrupts the overall profile to accommodate the camera, so that the camera is positioned within the outer contour of the display.
[0025] A favorable improvement is characterized in that the controller, upon generating a signal S, drives the display to output optical information, wherein this information instructs the vehicle user to adjust their seat position and / or steering wheel position adjustment such that the eyes A1, A2 are positioned POS. A1 POS A2 The light source can be viewed freely and unobstructed. The optical information output is advantageously represented by displayed text and / or by at least one corresponding indicator / graphic. The light source and optical output information are advantageously displayed on a monitor. In an alternative embodiment, these can be generated using components that are different from each other.
[0026] A beneficial improvement to the proposed device is that it additionally includes an audio output unit connected to a controller, which drives the audio output unit to output sound information upon generating a signal S. This information instructs the vehicle user to adjust their seat and / or steering wheel position so that their eyes, A1 and A2, are positioned at POS. A1 POS A2 Allow free and unobstructed view of the light source. Audio information could be, for example, alarm signals and / or spoken text.
[0027] In an advantageous improvement to the proposed device, the controller is configured and designed to predict the current eye position of the vehicle user based on image data acquired from the vehicle user's head (i.e., estimated based on a mathematical model) upon generating a signal S, and further generate information based on the predicted eye position indicating how to adjust (i.e., down / up, forward / backward) the current seat position and / or the current steering wheel position so that eyes A1, A2 can look freely and unobstructed towards the camera, or are within an optimal spatial area. This information is advantageously output optically and / or acoustically.
[0028] A beneficial improvement to the proposed device is that it also includes a seat sensor to determine if a vehicle seat is occupied by a vehicle occupant. Advantageously, the device is activated only when the seat sensor determines that the vehicle seat is occupied. This is particularly beneficial for energy conservation and extending the lifespan of the corresponding components. Furthermore, it avoids unnecessary and disruptive optical and acoustic output when the driver leaves the driver's seat while the front passenger remains in the vehicle and the device is still powered on.
[0029] In an advantageous improvement, each individual light source of the light source has a light-shielding device that restricts the light emitted from the respective individual light source to a corresponding predefined spatial angle region. As an alternative or supplement to the light-shielding device, the individual light source is combined with a corresponding optical system that restricts the light emitted from the respective individual light source to a corresponding predefined spatial angle region that at least coincides with or covers the camera's detection area.
[0030] The predefined spatial angle regions of individual light sources advantageously overlap within a spatial region. Advantageously, eyes A1 and A2 can only see all individual light sources simultaneously within this spatial region. If the vehicle user's eyes A1 and A2 are located within this spatial region, there is a possibility that the eyes can be best identified by the camera, i.e., the eyes are not obstructed by, for example, the steering wheel rim of the vehicle's steering wheel within this spatial region.
[0031] Therefore, by activating the light source or a single light source, the vehicle user is first alerted that their eyes cannot be identified, their current eye position, and / or direction of gaze cannot be determined. Furthermore, this prompts the vehicle user to adjust their seat and / or steering wheel position so that they simultaneously see the light source or all individual light sources. If this is the case, the vehicle user has optimally adjusted their relative position to the camera. This is particularly relevant to the reliability and functionality of all vehicle functions related to determining the vehicle user's eye position and / or direction of gaze.
[0032] Advantageously, the first individual light source is positioned to the left of the camera, the second individual light source to its right, and / or the third individual light source above it and / or the fourth individual light source below it. By arranging individual light sources, a simple and intuitive indication is obtained for adjusting at least the seat position or for correctly sitting in the seat. If the vehicle user does not see all the individual light sources, for example, only the first, second, and fourth individual light sources, this indicates that the seat adjustment must be changed so that the head and, consequently, the eyes, must move vertically upwards to also see the third individual light source. Alternatively or additionally, the steering wheel position adjustment can be adjusted so that all four individual light sources can be simultaneously perceived by the vehicle user. In alternative embodiments, only the first and second, or the first, second, and third individual light sources, are present. Alternatively, multiple first, second, third, and / or fourth individual light sources of the camera are arranged adjacent to each other.
[0033] The light source and / or individual light sources are arranged such that, based on the user's seat position and body size, the potential obstruction of the camera by the steering wheel relative to the user's eyes due to the steering wheel restricts the user's line of sight to the light source or individual light sources. The light source is preferably arranged such that it is only partially covered by the steering wheel, allowing the user to see the activation of the light source under any circumstances. However, it can also be configured such that the entire light source is completely within the user's field of vision, thereby achieving completely unobstructed acquisition of image data of the eyes, the vehicle user's eye position, and / or the vehicle user's current line of sight. Therefore, the arrangement of the light source or individual light source relative to the camera depends on the geometry between the driver's size, the steering wheel, and the seat position, thus allowing the light source or individual light source to be positioned near or spaced apart from the camera. This arrangement ensures that, regardless of the user's and his / her seat and steering wheel setup, the light source or multiple individual light sources are at least partially obstructed as long as the camera cannot sufficiently detect the required image data of the eyes A1, A2 or the required current eye positions POSA1, POSA2 and / or the required direction of gaze due to at least partial obstruction by the steering wheel.
[0034] A key improvement to the proposed device is that the control unit is designed and configured such that if the camera cannot detect eyes A1 and A2, i.e., the eyes cannot be determined within the generated image data, the connection to the eye position POS is switched off. A1 POS A2 The system collects and / or determines the relevant vehicle functions based on the current line of sight and outputs an alert to the vehicle user. The alert is advantageously an optical output alert and / or an audible output alert.
[0035] If a camera detects the eyes of a vehicle user and can determine the POS position of the vehicle user's eyes based on that image data... A1 POS A2 If the current line of sight is in the correct direction, then advantageously no signal S is generated and the light source is not activated.
[0036] The proposed device therefore allows for more reliable determination of the vehicle user's eye position and / or current gaze direction. The proposed device can be understood as a driver assistance system. It generates at least one optical alarm output by activating a light source in the event that an object is positioned between the camera and the eye, thus obstructing the recognition of the eye in the image data. By activating this light source, the vehicle user is allowed to ideally adjust the seat position or steering wheel adjustment, thereby enabling uninterrupted determination of the eye position and / or the vehicle user's gaze direction.
[0037] Another aspect of the invention relates to a vehicle having the device described above.
[0038] An advantageous improvement to the proposed vehicle is characterized by having a driver assistance system that incorporates at least one POS (position of eyes A1, A2) based on eye image data. A1 POS A2 And / or functions related to the vehicle user's gaze. These functions are then advantageously turned off when a signal S is generated, wherein, in this case, an alarm that can be perceived by the vehicle user in an optical / or acoustic and / or tactile manner is output, indicating to the vehicle user that the corresponding function is no longer available because the vehicle user's eye position and / or gaze direction cannot be determined at present.
[0039] Another aspect of the invention relates to a method for determining the eye position and / or gaze direction of a vehicle occupant within a vehicle and a method for operating the device as described above.
[0040] The proposed method includes the following steps. In the first step, image data of the vehicle interior is acquired using a camera. In the second step, an image data evaluation unit determines the eye image data and the position POS of eyes A1 and A2 (102) based on the acquired image data. A1 POS A2 And / or the current gaze direction of the vehicle user. In the third step, the controller determines the current position POS of eyes A1, A2 (102) when it is impossible to determine. A1 POS A2 A signal S for activating the light source is generated in the context of the vehicle user's gaze. Here, the light source includes one or more individual light sources, which are arranged and implemented such that the one or more individual light sources can only be seen by the vehicle user, or can be seen simultaneously and therefore fully seen, if the vehicle user's eyes A1, A2, eye position and / or his current gaze can be detected by the camera without obstruction.
[0041] A favorable improvement to the proposed method is that if a signal S is generated and thus the light source is activated, a display for outputting optical information is also driven, wherein this information instructs the vehicle user to adjust their seat position and / or steering wheel position adjustment such that the eyes A1, A2 are positioned POS. A1 POS A2 Allow unobstructed view of the light source.
[0042] A favorable improvement to the proposed method is that if a signal S is generated and thus the light source is activated, an audio output unit for outputting sound information is driven, wherein this information indicates to the vehicle user how to adjust their seat position and / or steering wheel position adjustment, i.e., so that the positions POS of their eyes A1 and A2 are adjusted.A1 POS A2 Allow unobstructed view of the light source.
[0043] The advantages and beneficial improvements of the proposed method are obtained by similarly and reasonably applying the description of the proposed apparatus. Attached Figure Description
[0044] Other advantages, features, and details are derived from the following detailed description of at least one embodiment, perhaps with reference to the accompanying drawings. Identical, similar, and / or functionally identical components are marked with the same reference numerals.
[0045] The attached diagram shows:
[0046] Figure 1 The schematic structure of the proposed device is shown.
[0047] Figure 2 Showing according to Figure 1 A schematic diagram of the driver's seat of the device.
[0048] Figure 3 A highly schematic process diagram of the proposed method is shown. Detailed Implementation
[0049] Figure 1 The diagram illustrates a highly schematic structure of a proposed device 100 for determining the eye position and / or current gaze direction of a vehicle occupant within a vehicle. In this embodiment, device 100 includes: a 4K video camera 101 capable of acquiring image data of the vehicle interior, i.e., the head and eyes A1, A2 102 of the vehicle occupant; and capable of determining eye image data and the position POS of eyes A1, A2 102 based on the acquired image data. A1 POS A2 and / or the image data evaluation unit 103 of the vehicle user's current gaze direction; and the current position POS of the eyes A1 and A2 when the eye image data cannot be determined. A1 POS A2 A controller 106 that generates a signal S to activate the light source 104 in the case of and / or the line of sight.
[0050] To simplify, Figure 1 The image shows three vertically distinct positions (POS) relative to camera 101 for the left eye A1 102 of the vehicle user only. A1 '、POS A1 POS A1The light source 104 has three individual light sources 104 arranged vertically overlapping each other, which are shown as black circles. The acquisition range of the camera 101 is marked by a solid line from the camera. At the highest vertical position POS A1 The left eye A1 102's line of sight to all three vertically overlapping individual light sources 104 is blocked by the steering wheel rim 110, which has a circular cross-section. The vehicle user's view from this highest position POS... A1 In particular, the tallest individual light source 104 cannot be seen. Therefore, on the other hand, the 4K video camera 101 cannot recognize the POS at that location. A1 'Left eye A1 102.
[0051] If the vehicle user's eyes A1, A2 102 are located at POS in this example A1 If the corresponding vertical position is not determined, the image data evaluation unit 103 cannot identify the vehicle user's eyes based on the image data, and therefore cannot determine the position POS of eyes A1 and A2 102. A1 POS A2 And / or the current gaze direction of the vehicle user, thereby the control unit 106 generates a signal S to activate all individual light sources 104 of the device 100. This prompts the vehicle user to change their seat position or steering wheel position so that their gaze is freely and unobstructed to all individual light sources 104.
[0052] Furthermore, the control unit is connected to the display 107 to output optical information. Once the control unit 106 generates a signal S, it drives the display 107 to output optical information, which instructs the vehicle user to adjust their seat position and / or steering wheel position accordingly, i.e., the position POS of their eyes A1 and A2. A1 POS A2 Allow free and unobstructed view of the light source. Optical information is preferably in the form of graphic and / or textual indications.
[0053] Figure 2 Shown from the driver's perspective and based on Figure 1 The principle and corresponding arrangement. The same components are used with... Figure 1 The same reference numerals are used to indicate these features. The driver's gaze is directed at the full-screen display 116, which includes a circular instrument panel 114, a display surface 107, and a display area for displaying individual light sources 104 located to the left and right of the camera 101. A light source 112, such as an infrared light source, is positioned next to the camera 101 to illuminate the interior. The camera 101 and the light source are arranged within a notch in the display 116. Figure 1In this situation, the camera 101 is obstructed by the steering wheel rim 110, preventing the vehicle occupant's eyes A1 and A2 from being unobstructed by the camera 101. Correspondingly, each individual light source 104 is activated. To allow unrestricted recognition of eyes A1 and A2, the vehicle occupant adjusts their seat or steering wheel so that all individual light sources are visible. Corresponding indications are displayed on the display surface 107.
[0054] Figure 3 A highly schematic process diagram is shown for the proposed method for determining the eye position and / or current gaze direction of a vehicle user within a vehicle, the method comprising the following steps:
[0055] In the first step 201, image data of the vehicle interior is acquired using camera 101. In the second step 202, image data evaluation unit 103 determines the image data of eyes A1 and A2 based on the acquired image data, and determines the position POS of eyes A1 and A2. A1 POS A2 And / or the vehicle user's gaze. If the image data of eyes A1 and A2, and the position (POS) of eyes A1 and A2. A1 POS A2 If the current gaze direction of the vehicle user cannot be determined or is only insufficiently determined, then in the third step 203, the controller 106 generates a signal S to activate the light source 104.
[0056] While details of the invention have been shown and described in detail through preferred embodiments, the invention is not limited to the disclosed examples, and those skilled in the art can derive other modifications without departing from the scope of protection of the invention. Therefore, it is clear that many possible variations exist. It is also clear that the exemplified embodiments are merely examples and should in no way be construed as limiting, for example, the scope of protection, possible applications, or configurations of the invention. Rather, the foregoing description and accompanying drawings enable those skilled in the art to embody the exemplary embodiments, wherein, with knowledge of the disclosed inventive concept, they can make various changes, for example, regarding the function or arrangement of the various elements mentioned in the exemplary embodiments, without departing from the scope of protection defined by the claims and their legal equivalents, such as the detailed description in the specification.
Claims
1. An apparatus (100) for determining eye image data, eye position, and / or the current gaze direction of a vehicle user within a vehicle, comprising: - A camera (101) capable of acquiring the image data. - A steering wheel positioned between the camera (101) and the user's eyes. - Image data evaluation unit (103) thereby determining the position POS of the vehicle user's eyes A1 and A2 (102) based on the collected eye A1 and A2 (102) image data. A1 POS A2 and / or the current gaze direction of the vehicle user, and - Controller (106), which is unable to determine the eye image data, the current position POS of the eyes A1 and A2. A1 POS A2 A signal S is generated to activate the light source (104) in the case of the vehicle user's gaze direction, wherein the light source (104) has one or more individual light sources arranged and designed such that the one or more individual light sources can be fully seen or simultaneously seen by the vehicle user in an unobstructed manner only when the vehicle user's eyes A1, A2 (102), the eye position and / or the vehicle user's current gaze direction can be captured by the camera (101) in a manner unobstructed by the steering wheel. - The controller (106) is designed and configured such that if eyes A1 and A2 are not detected by the camera (101), the vehicle functions related to the detection of eyes A1 and A2 are shut down and an alarm is issued to the vehicle user. The one or more individual light sources enable an integrated display element that shows the user image data of the eye, the eye's position, and / or current gaze direction, which the camera cannot detect. The display element also provides the user with intuitive directions for operation, enabling the use of camera-detected and camera-data-dependent auxiliary systems.
2. The apparatus (100) according to claim 1, wherein the light source (104) includes one or more pixels of a display (107) connected to a controller (106).
3. The apparatus (100) according to claim 1 or 2, wherein the controller (106) drives the display (107) to output optical information upon generating a signal S, and wherein, This information instructs the vehicle user to adjust their seat and / or steering wheel position so that the positions of the eyes A1 and A2 are POS. A1 POS A2 Allow free and unobstructed viewing of the light source.
4. The apparatus (100) according to claim 1 or 2 further includes an audio output unit (108) connected to the controller (106), wherein, The controller (106) drives the audio output unit (108) to output sound information upon generating a signal S, wherein the information instructs the vehicle user to adjust their seat position and / or steering wheel position adjustment so that the position POS of the eyes A1, A2 is adjusted. A1 POS A2 Allow free and unobstructed viewing of the light source.
5. The device (100) according to claim 1 or 2 further comprises a seat sensor capable of determining that a vehicle seat is occupied by a vehicle user, wherein, The device (100) is activated only when the seat sensor determines that the vehicle seat is occupied.
6. The apparatus according to claim 1 or 2, wherein, The first individual light source is arranged to the left of the camera (101), the second individual light source is arranged to the right of the camera and / or the third individual light source is arranged above the camera and / or the fourth individual light source is arranged below the camera, and the emission areas defined by each of the four individual light sources overlap only within a region RB.
7. A vehicle having the device according to any one of claims 1 to 6.
8. A method for identifying the eyes of a vehicle user, determining the eye position of the vehicle user, and / or the current gaze direction of the vehicle user within a vehicle, the vehicle having a steering wheel disposed between the eyes of the vehicle user and a camera (101), the method comprising the steps of: - Image data is acquired (201) via camera (101). - The image data evaluation unit (103) determines the image data of eyes A1 and A2 (102) and the position POS of eyes A1 and A2 (102) based on the acquired image data. A1 POS A2 And / or the current gaze of the vehicle user, and - If the image data of the eyes, and the current position (POS) of eyes A1 and A2 cannot be determined... A1 POS A2 And / or the line of sight, then the controller (106) generates (203) a signal S to activate the light source (104), wherein, The light source (104) has one or more individual light sources, which are arranged and designed such that the one or more individual light sources can be fully seen or simultaneously seen by the vehicle user in an unobstructed manner only when the vehicle user's eyes A1, A2 (102), eye position, and / or the vehicle user's current gaze can be captured by the camera in a manner unobstructed by the steering wheel. - If eyes A1 and A2 are not detected by the camera (101), the vehicle functions related to the detection of eyes A1 and A2 are shut down and an alarm is issued to the vehicle user. The one or more individual light sources enable an integrated display element that shows the user image data of the eye, the eye's position, and / or current gaze direction, which the camera cannot detect. The display element also provides the user with intuitive directions for operation, enabling the use of camera-detected and camera-data-dependent auxiliary systems.
Citation Information
Patent Citations
vehicle information reporting device
DE102008036023A1
Control device for a motor vehicle with a camera for the driver's face and method for recording the face of a vehicle occupant
DE102014221039A1
Eye tracking
EP3249497A1
Polymer composites of high dielectric constant and low dielectric dissipation
WO2018208446A1
Control unit for a motor vehicle having a camera for the driver's face, and method for imaging the face of a vehicle occupant
CN105522992A