Vehicle display device

The vehicle display device uses a camera and control unit to detect polarized sunglasses by analyzing brightness changes in facial images, enabling improved visibility adjustments for drivers wearing them.

DE112022006441T5Pending Publication Date: 2024-12-05YAZAKI CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
DE112022006441
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-18
Filing Date
2022-12-21
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Drivers wearing polarized sunglasses face difficulty in seeing virtual images displayed by vehicle display devices like head-up displays due to reduced brightness and visibility.

Method used

A vehicle display device equipped with a camera, polarizer, and control unit that captures facial images, determines the polarization direction, calculates brightness values, and compares them over time to detect the wearing of polarized sunglasses, adjusting display settings accordingly.

Benefits of technology

Facilitates easy determination of polarized sunglasses wear, enhancing visibility by adjusting display brightness or polarization angle, thereby improving the usability of vehicle display devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A vehicle display device is provided that can easily determine whether a driver is wearing polarized sunglasses. A vehicle display device 1 includes a polarizer 30 positioned in front of a lens 12 of a camera 11, which continuously captures facial images of a driver P, such that the polarization direction is a horizontal direction orthogonal to a vertical direction. Within the vehicle display device 1, a control unit 22 calculates a brightness value corresponding to each facial image and instructs a storage unit 27 to store the calculated brightness values ​​as brightness value information in a time series.The control unit 22 then compares the current brightness value information with the past brightness value information in a plurality of brightness value information parts stored in the memory unit 27, and determines, when the current brightness value information decreases, that the driver should put on the polarized sunglasses.
Need to check novelty before this filing date? Find Prior Art

Description

Area

[0001] The present invention relates to a vehicle display device. background

[0002] When a driver wearing polarized sunglasses drives a vehicle in which a vehicle display device such as a head-up display is mounted, the driver may find it difficult to see a virtual image (display image) displayed in front of the vehicle (see, for example, Patent Literature 1). Citation listPatent literature

[0003] [Patent Literature 1] WO2020 / 194853 SummaryTechnical task

[0004] Furthermore, once it becomes apparent that the driver is wearing polarized sunglasses, it is possible to increase the visibility of the display image by, for example, increasing the brightness of the display image or changing the polarization angle of the display light. Thus, it is necessary to detect whether the driver is wearing polarized sunglasses.

[0005] It is an object of the present invention to provide a vehicle display device that can easily determine a driver's state of wearing polarized sunglasses. Solution to the task

[0006] The vehicle display device according to the present invention includes: a camera that continuously captures facial images including a face of a driver of a vehicle; a polarizer disposed in front of a lens of the camera, converts incident light into linearly polarized light, and emits the light toward the camera;and a control unit that determines whether the driver is wearing polarized sunglasses based on the acquired facial images, wherein the polarizer is arranged so that a polarization direction becomes a horizontal direction orthogonal to a vertical direction. The control unit includes a calculation unit that calculates a brightness value corresponding to each of the facial images and causes a memory to store the calculated brightness value in association with a time series as brightness value information, and a determination unit that compares current brightness value information with past brightness value information in a plurality of pieces of brightness value information stored in the storage unit. When the current brightness value information decreases, the control unit determines that the driver is wearing polarized sunglasses, and the control unit outputs a result of the determination to the outside. Advantageous effects of the invention

[0007] The vehicle display device according to the present invention has the effect of easily determining the driver's state of wearing polarized sunglasses. Brief Description of the Drawings Fig. 1 is a schematic diagram illustrating an example of application of a vehicle display device according to a first embodiment to a vehicle. Fig. 2 is a block diagram illustrating an example of a structure of the vehicle display device according to the first embodiment. Fig. 3 is a schematic diagram showing an example of a facial image of a driver P1. Fig. 4 is a schematic diagram showing an example of a facial image of a driver P2. Fig. 5 is a flowchart expressing a procedure of a polarized sunglasses wearing determination method implemented by a control unit in the first embodiment. Fig. 6 is a block diagram illustrating an example of a structure of a vehicle display device according to a second embodiment. Fig. 7 is a flowchart expressing a procedure of a polarized sunglasses wearing determination method implemented by a control unit in the second embodiment. Fig. 8 is a block diagram illustrating an example of a structure of a vehicle display device according to a third embodiment. Fig. 9 is a flowchart expressing a procedure of a polarized sunglasses wearing determination method implemented by a control unit in the third embodiment. Fig. 10 is a schematic diagram illustrating an example of a determination range used in the determination of wearing the polarized sunglasses. Fig. 11 is a schematic diagram illustrating another example of the determination range used in the determination of wearing the polarized sunglasses. Fig. 12 is a schematic diagram illustrating another example of the determination range used in the determination of wearing the polarized sunglasses. Description of embodiments

[0008] Vehicle display devices according to embodiments of the present invention will be described in detail below with reference to the drawings. Note that the embodiments given below do not limit the present invention. In other words, the components in the following embodiments include components that can be easily conceived by those skilled in the art or that are substantially the same, and various omissions, substitutions, and changes may be made within the scope of not deviating from the gist of the invention. First embodiment

[0009] A vehicle display device according to this embodiment will be described with reference to Fig. 1 to Fig. 5. A vehicle display device 1 is arranged in a vehicle 100 such as an automobile, as shown in Fig. 1. In the vehicle 100, a steering wheel 101 is arranged in front of a driver P, an instrument panel 102 is arranged in front of the steering wheel 101, and a front windshield FW is arranged in front of the instrument panel 102. The instrument panel 102 is a member that partitions the front cabin space of the vehicle 100 and is a location where an instrument 104 such as a speedometer is arranged. The instrument panel 102 includes an opening part 102a through which display light, to be projected from a HUD unit 20 described below, passes. The front windshield FW forms the boundary between the interior and exterior of the vehicle 100 and transmits the scenery ahead of the vehicle 100 in a traveling direction.

[0010] The vehicle display device 1 includes a camera unit 10 and the HUD unit 20. The camera unit 10 detects the line of sight of the driver P. The camera unit 10 is provided on the dashboard 102 of the vehicle 100 and directed toward the driver P. The camera unit 10 includes a camera 11 and a polarizer 30, as shown in Fig. 2 is shown.

[0011] The camera 11 is an example of a photography unit and photographs a facial area including the face of the driver P and continuously captures the photographed facial images. The camera 11 has a lens 12, and the lens 12 is directed toward the face of the driver P. The camera 11 is activated when an accessory (ACC) or ignition (IG) power of the vehicle 100 is turned on and photographs the facial images of the driver P until these power sources are turned off. The camera 11 captures still images or moving images (hereinafter referred to simply as "images"). The camera 11 outputs the photographed facial images to a control unit 22.

[0012] The polarizer 30 is an optical element that has the property of transmitting only light that oscillates in one direction and blocking light that oscillates in other directions. Polarizers are generally used in optical filters used for photography, polarized sunglasses, and the like, as they cut off glare from sunlight reflected off water or road surfaces. In this embodiment, the polarizer 30 is arranged in front of the lens 12 of the camera 11, converts the incident light into linearly polarized light, and emits the light toward the camera 11. The polarizer 30 is arranged on the opposite side of the lens 12 in an optical axis direction AX of the lens 12.Although the polarizer 30 is arranged with a gap from the lens 12 in the illustrated example, the arrangement is not limited thereto, and the polarizer 30 may be arranged without a gap from the lens 12. The polarizer 30 in this embodiment is arranged so that the polarization direction becomes a horizontal direction orthogonal to a vertical direction.

[0013] The HUD unit 20 makes it possible to view the scenery in front of the vehicle 100 through the front windshield FW, and simultaneously view display information contained in the display light reflected on a projection object 103, such as the front windshield FW, as a virtual image S. The display information includes, for example, information about the vehicle 100, such as vehicle speed information, navigation information, gearshift position information, and air conditioning setting information. The HUD unit 20 projects the display light containing the display information onto the front windshield FW and forms an optical path so that the display light reflected on the front windshield FW is directed toward the driver P's viewpoint.The driver P sees the display information displayed on the front windshield FW as the virtual image S while viewing the scenery in front of the vehicle 100 through the front windshield FW. The HUD unit 20 is arranged in the instrument panel 102 and includes a projection unit 21 and the control unit 22.

[0014] The projection unit 21 projects the display light containing the display information onto the front windshield FW, which transmits light. The projection unit 21 has a display area T for displaying the display information, and the display area T is positioned above an upper end of the steering wheel 101 of the vehicle 100 in the vertical direction. The projection unit 21 includes a display unit and an aspherical mirror (not shown). The display unit emits the display light containing the display information. The display unit includes a liquid crystal panel (not shown) that displays the display information, a backlight (not shown) arranged on a rear surface of the liquid crystal panel, and the like. The display unit emits the display light from the liquid crystal panel when illuminated by the backlight.The aspherical mirror has optical properties for forming the virtual image S at a position at a predetermined distance. The aspherical mirror is provided facing the display unit and held in such a manner that the inclination with respect to the front windshield FW is adjustable. The aspherical mirror reflects the display light emitted from the display unit and projects the display light toward the front windshield FW through the opening part 102a in the instrument panel 102. The display light projected from the aspherical mirror is reflected on the front windshield FW and reaches an eye point E of the driver P. This allows the driver P to view the virtual image S formed in front of the front windshield FW in the overall length direction of the vehicle 100.

[0015] The control unit 22 controls the camera unit 10 and the projection unit 21, and is mainly composed of a microprocessor (not shown) containing, for example, an arithmetic processing device including a CPU or the like, a ROM, a RAM, and the like. The control unit 22 adjusts the inclination of the aspherical mirror with respect to the front windshield FW and displays the virtual image S as the display information in the display area T. With the display information displayed on the liquid crystal panel, the control unit 22 emits the display light, which illuminates the backlight from the rear surface of the liquid crystal and contains the display information, toward the aspherical mirror.

[0016] The control unit 22 has a line-of-sight detection function of detecting the line of sight of the driver P based on a facial image. The control unit 22 detects the line of sight of the driver P based on, for example, the position of the iris of the eye in the facial image, and outputs the detected line-of-sight information indicating the line of sight of the driver P to the outside. The control unit 22 detects the position of the pupils of the driver P using well-known image processing such as pattern matching of images. The control unit 22 compares, for example, a predetermined eye image with the facial image of the driver P captured by the camera 11 and detects the position of the pupils of the driver P in the facial image of the driver P. The control unit 22 detects the line of sight of the driver P from the detected position of the pupils of the driver P.The control unit 22 is connected, for example, to a warning device or the like that detects fatigue of the driver P and warns him or her, and outputs the detection results of the line of sight to the warning device.

[0017] The control unit 22 has a wearing determination function of determining whether the driver is wearing polarized sunglasses based on the facial image captured by the camera 11. The control unit 22 has a calculation unit 25, a determination unit 26, and a storage unit 27 as configurations corresponding to the wearing determination function.

[0018] The calculation unit 25 has a function of calculating a brightness value corresponding to each facial image based on a plurality of facial images continuously captured by the camera 11, and storing the calculated brightness values ​​in the storage unit 27 as brightness value information in association with a time series. The calculation unit 25 performs image processing using a known method to calculate the brightness value of each facial image. The calculation unit 25 stores the calculated brightness values ​​in the storage unit 27 as the brightness value information along with time information indicating the time at which the facial image was photographed. The brightness value information includes at least time information indicating the time at which the facial image was photographed and the brightness value of the facial image.The storage unit 27 stores therein a plurality of pieces of brightness value information.

[0019] The determination unit 26 has a function of comparing the current brightness value information with the past brightness value information in the brightness information pieces stored in the storage unit 27, and determining that the driver P is wearing the polarized sunglasses when the current brightness value information decreases. Specifically, the determination unit 26 compares the current brightness value information and the past brightness value information corresponding to the past brightness value information in the brightness value information pieces stored in the storage unit 28, and determines that the driver P is wearing the polarized sunglasses when the current brightness value becomes smaller than the past brightness value.The current brightness value is the brightness value corresponding to the facial image whose time information included in each piece of brightness value information is the most recent in the pieces of brightness information stored in the storage unit 27. The old brightness value is the brightness value corresponding to the facial image whose time information included in each piece of brightness value information is at least immediately before the current brightness value information in the pieces of brightness value information stored in the storage unit 27.

[0020] The determination unit 26 compares the current brightness value with the old brightness value and determines that the driver P is wearing the polarized sunglasses when the current brightness value becomes smaller than the old brightness value. The face of the driver P is generally illuminated by sunlight, illumination light from around the vehicle, illumination light for a driver monitor, or the like. The polarized sunglasses are usually polarized in the vertical direction. The polarization direction of the polarized sunglasses is normally the vertical direction. Thus, when the driver P wears the polarized sunglasses, only the longitudinally polarized light of the reflected light of the polarized sunglasses is transmitted, and the observed light has a lower brightness due to the transmittance of the polarized sunglasses.When the polarizer 30 is arranged in front of the lens 12 of the camera 11 so that the polarization direction becomes the horizontal direction orthogonal to the vertical direction, in the face image of the driver P2 wearing the polarized sunglasses G2 captured by the camera 11, the brightness of a lens part of the polarized sunglasses G2 decreases, as shown in FIG. Fig. 4. In other words, when the driver P2 wears the polarized sunglasses G2, it becomes difficult to recognize the line of sight of the driver P2 from the facial image captured by the camera 11 according to a known method. On the other hand, when the polarizer 30 is arranged so that the polarization direction becomes the vertical direction, the brightness of a lens part of the polarized sunglasses G1 hardly decreases in the facial image captured by the camera 11, as shown in Fig. 3. Thus, even if the driver P1 wears the polarized sunglasses G1, it is possible to recognize the line of sight of the driver P1 from the facial image captured by the camera 11 by a known method.

[0021] The storage unit 27 is a storage circuit or memory that stores various types of data (information) therein. The storage unit 27 stores computer programs for the control unit 22 to implement various functions therein. The storage unit 27 has a storage capacity capable of storing a plurality of brightness value information corresponding to a plurality of face images captured when the camera 11 photographs for a certain period of time. Regarding the pieces of brightness value information stored in the storage unit 27, the past brightness value information is deleted from the storage unit 27 in order based on the time information included in each piece of brightness value information, for example.

[0022] Next, with reference to Fig. 5, a method for determining the wearing of polarized sunglasses in the first embodiment is described.

[0023] At step S1, the camera 11 photographs the facial area containing the face of the driver P and captures the photographed facial image. The camera 11 outputs one frame of the captured facial image to the control unit 22.

[0024] At step S2, the control unit 22 causes the calculation unit 25 to perform image processing based on the face image output from the camera 11. The control unit 22 performs face recognition using a known method to extract the face region containing the face from a frame of two-dimensional image data. The control unit 22 detects eye regions from the face region using the above-mentioned known method and calculates brightness values ​​in the detected eye regions.

[0025] At step S3, the control unit 22 causes the storage unit 27 to store therein the brightness value calculated by the calculation unit 25 at step S2 as the brightness value information together with the time information indicating the time at which the facial image was photographed.

[0026] At step S4, the control unit 22 causes the determination unit 26 to compare the current brightness information with the past brightness value information in the brightness value information pieces stored in the storage unit 27 and determine whether the current brightness value information is decreasing. Specifically, the control unit 22 compares the current brightness value information with the old brightness value information corresponding to the past brightness value information in the brightness value information pieces stored in the storage unit 27 and determines whether the current brightness value becomes smaller than the old brightness value. If the driver P is not wearing the polarized sunglasses, the current brightness value does not decrease with respect to the old brightness value when the current brightness value is compared with the old brightness value.On the other hand, if the driver P is wearing polarized sunglasses, the current brightness value decreases relative to the previous brightness value. If it is determined that the brightness value is not decreasing, the process returns to step S1. On the other hand, if it is determined that the brightness value is decreasing, the process proceeds to step S5.

[0027] At step S5, the control unit 22 causes the determination unit 26 to determine that the driver P puts on the polarized sunglasses and outputs a result of the determination to the outside, and ends this process.

[0028] As described above, the vehicle display device 1 according to the first embodiment includes the polarizer 30 arranged in front of the lens 12 of the camera 11 that continuously captures the facial images of the driver P, so that the polarization direction becomes the horizontal direction orthogonal to the vertical direction. In the vehicle display device 1, the control unit 22 calculates the brightness value corresponding to each facial image and causes the storage unit 27 to store the calculated brightness values ​​therein as the brightness value information in association with a time series. The control unit 22 then compares the current brightness value information with the past brightness value information in the brightness value information pieces stored in the storage unit 27, and determines, when the current brightness value information decreases, that the driver P is wearing the polarized sunglasses.

[0029] With the above configuration, for example, when the driver P puts on the polarized sunglasses while driving, the current brightness information decreases with respect to the past brightness value information, making it easy to determine that the driver P is putting on the polarized sunglasses. For example, once it is determined that the driver P is putting on the polarized sunglasses, the visibility of the display image can be increased by increasing the brightness of the display image by the projection unit 21 or by changing the polarization angle of the display light. This improves the marketability of the vehicle display device. Second embodiment

[0030] A vehicle display device 1A according to a second embodiment differs from the first embodiment in that the polarizer 30 rotates around the optical axis AX of the lens 12 with respect to the camera 11. The same components as those in the above-mentioned embodiment are denoted by the common reference numerals hereinafter, and redundant explanations of common configurations, actions, and effects are omitted as much as possible (this similarly applies to the following description).

[0031] The vehicle display device 1A according to the second embodiment includes a camera unit 10A arranged in Fig. 6. The camera unit 10A differs from the camera unit 10 described above in that the camera unit 10A includes a servo motor 40, a motor side gear 42, and a gear unit 31. The other configurations of the camera unit 10A are similar to those of the camera unit 10 described above.

[0032] The servo motor 40 is an example of a rotary drive unit that supports the polarizer 30 for rotation around the optical axis AX of the lens 12 of the camera 11 and rotates and drives the polarizer 30 around the optical axis AX. The servo motor 40 is electrically connected to a control unit 22A and is driven based on a drive control signal output from the control unit 22A. The servo motor 40 includes a rotary shaft 41 with a motor side gear 42, which is a spur gear connected to one end portion thereof on the polarizer 30 side. When the servo motor 40 is driven, the motor side gear 42 rotates forward or backward around the rotary shaft 41.

[0033] The gear unit 31 is a spur gear formed in a cylindrical shape when viewed from the optical axis AX direction, with the polarizer 30 mounted inside. The gear unit 31 meshes with the motor side gear 42 and rotates around the optical axis AX by the rotation of the motor side gear 42. The polarizer 30 is rotated and driven by the servo motor 40 through the motor side gear 42 and the gear unit 31. The motor side gear 42 and the gear unit 31 constitute a deceleration mechanism of the servo motor 40. The servo motor 40, the rotary shaft 41, the motor side gear 42, and the gear unit 31 constitute a rotation mechanism that rotates the polarizer 30 around the optical axis AX.

[0034] The control unit 22A differs from the control unit 22 described above in that the control unit 22A controls the rotational drive of the servo motor 40. The control unit 22A outputs the drive control signal for the servo motor 40 to control the rotational drive of the servo motor 40. The control unit 22A controls the rotational drive of the servo motor 40 so that the polarization direction of the polarizer 30 becomes the vertical direction, or so that the polarization direction becomes the horizontal direction, which is orthogonal to the vertical direction.

[0035] Next, with reference to Fig. 7, a method for determining whether polarized sunglasses are worn is described in the second embodiment. Steps S12 to S17 in Fig. 7 are similar to steps S1 to S6 in Fig. 5; therefore, the description of these is omitted.

[0036] At step S11, the control unit 22A controls the rotation drive of the servo motor 40 to rotate the polarizer 30 about the optical axis AX.

[0037] At step S12, the camera 11 photographs the face area including the face of the driver P while the polarizer 30 is rotated around the optical axis AX by the rotational drive of the servo motor 40, thus capturing the photographed face image. The camera 11 outputs one frame of the captured face image to the control unit 22A. The camera 11 captures a plurality of face images while the polarizer 30 is rotated once, for example, under the control of the control unit 22A. The control unit 22A controls the photographing time of the camera 11 and the rotational drive of the polarizer 30 so that the camera 11 captures the face image at the position where the polarization direction of the polarizer 30 becomes the horizontal direction orthogonal to the vertical direction while the polarizer 30 is rotated once.

[0038] The control unit 22A causes the camera 11 to photograph the face area including the face of the driver P while rotating the polarizer 30 around the optical axis AX by the rotational drive of the servo motor 40, and to capture the photographed face image. This makes it possible to capture the face image even at positions other than the position where the polarization direction of the polarizer 30 becomes the horizontal direction, thus enabling the detection of the line of sight of the driver P based on the face image.

[0039] As described above, the vehicle display device 1A according to the second embodiment includes the polarizer 30 in front of the lens 12 of the camera 11, which continuously captures the facial images of the driver P. The polarizer 30 is rotated and driven around the optical axis AX by the rotating mechanism including the servo motor 40. In the vehicle display device 1A, the control unit 22A calculates the brightness value corresponding to each facial image and causes the storage unit 27 to store the calculated brightness value therein as the brightness value information in association with a time series. The storage unit 22A then compares the current brightness value information with the past brightness value information in the brightness value information pieces stored in the storage unit 27, and determines, when the current brightness value information decreases, that the driver P is wearing the polarized sunglasses.

[0040] With the above configuration, in a manner similar to the first embodiment described above, when the driver P puts on the polarized sunglasses while driving, the current brightness value information decreases with respect to the past brightness information, making it easy to determine that the driver P is putting on the polarized sunglasses. In addition, it becomes possible to detect the facial image even at positions other than the position where the polarization direction of the polarizer 30 becomes the horizontal direction, thus enabling the recognition of the line of sight of the driver P based on the facial image. Third embodiment

[0041] A vehicle display device 1B according to a third embodiment differs from the above-described first embodiment in that a liquid crystal element 50 is arranged in front of the lens 12 of the camera 12 instead of the polarizer 30.

[0042] The vehicle display device 1B according to the third embodiment includes a camera unit 10B arranged in Fig. 8. The camera unit 10B differs from the camera unit described above in that the camera unit 10B includes the liquid crystal element 50 instead of the polarizer 30. The other configurations of the camera unit 10B are similar to those of the camera 10 described above.

[0043] The liquid crystal element 50 is arranged in front of the lens 12 of the camera and, in an energized state, converts incident light into linearly polarized light and emits the light toward the camera 11. The liquid crystal element 50 is electrically connected to a control unit 22B and is operated based on the drive control signal output from the control unit 22B, switching to one of the energized state and the de-energized state. The liquid crystal element 50 includes a polarizing plate (not shown) and is arranged such that the polarization direction of the polarizing plate in the energized state becomes the horizontal direction, which is orthogonal to the vertical direction.

[0044] The control unit 22B differs from the control unit 22 described above in that the control unit 22B controls the driving of the liquid crystal element 50. The control unit 22B outputs the liquid crystal element drive signal to switch the energized / deenergized state of the liquid crystal element 50. The control unit 22B switches the energized / deenergized state of the liquid crystal element 50 so that the polarization direction of the liquid crystal element 50 becomes the horizontal direction, or the polarization direction becomes a direction other than the horizontal direction.

[0045] Next, with reference to Fig. 9, a method for determining whether polarized sunglasses are worn in the third embodiment is described. Steps S22 to S27 in Fig. 9 are steps S1 to S6 in Fig. 5; therefore, the description of these is omitted.

[0046] At step S21, the control unit 22B controls the driving of the liquid crystal element 50 so that the liquid crystal element 50 is repeatedly turned on / off. Here, when the liquid crystal element 50 is turned off, the non-energized state is maintained.

[0047] At step S22, the camera 11 photographs the face area including the face of the driver P while driving the liquid crystal element 50 on / off, thus capturing the photographed face image. The camera 11 outputs one frame of the captured face image to the control unit 22B. The camera 11 captures the face image while repeatedly turning the liquid crystal element 50 on / off under the control of the control unit 22B. The control unit 22A controls the driving of the liquid crystal element 50 so that the camera 11 captures the face images at the positions where the polarization direction of the liquid crystal element 50 becomes the horizontal direction and at the positions other than the position where the polarization direction becomes the horizontal direction.

[0048] The control unit 22B causes the camera 11 to photograph the face area including the face of the driver P with the liquid crystal element 50 in the non-energized state and to capture the photographed face image. This makes it possible to capture the face image even at positions other than the position where the polarization direction of the liquid crystal element 50 becomes the horizontal direction, thereby enabling the detection of the line of sight of the driver P based on the face image.

[0049] As described above, the vehicle display device 1B according to the third embodiment includes the liquid crystal element 50 arranged in front of the lens 12 of the camera 11 that continuously captures the facial images of the driver P, so that the polarization direction in the energized state becomes the horizontal direction, which is orthogonal to the vertical direction. In the vehicle display device 1B, the control unit 22B calculates the brightness value corresponding to each facial image and causes the storage unit 27 to store the calculated brightness value therein as the brightness value information in association with a time series. The control unit 22B then compares the current brightness information with the past brightness information in the brightness information pieces stored in the storage unit 27, and determines, when the brightness value information decreases, that the driver P is wearing the polarized sunglasses.

[0050] With the above configuration, in a manner similar to the first embodiment described above, when the driver P puts on the polarized sunglasses while driving, the current brightness value information decreases with respect to the past brightness value information, making it easy to determine that the driver P is putting on the polarized sunglasses. In addition, it becomes possible to detect the facial image even at positions other than the position where the polarization direction of the polarizer 30 becomes the horizontal direction, thereby enabling the recognition of the line of sight of the driver P based on the facial image.

[0051] In the second and third embodiments described above, the control unit 22A, 22B compares the current brightness value with the old brightness value, and determines that the driver P is wearing the polarized sunglasses when the current brightness value becomes smaller than the old brightness value. When the current brightness value becomes larger than the old brightness value after determining that the driver P is wearing the polarized sunglasses, the control unit 22A, B can determine that the driver is taking off the polarized sunglasses. This makes it easy to determine that the driver P is taking off the polarized sunglasses.

[0052] In the first to third embodiments described above, the brightness value is calculated according to the facial image. However, since the facial image includes the background, etc., which is different from the driver P, the brightness value corresponding to the facial image may change due to sunlight or ambient light, even if the driver P is not wearing the polarized sunglasses. Therefore, as shown in Fig. 10 to Fig.As shown in Fig. 12, determination areas (H1, H2, H3) different from the eye area may be set, and the brightness values ​​corresponding to such determination areas (H1 to H3) may be calculated. For example, the determination area H1 has a circular shape with the pupil of the driver P at its center. The diameter of the determination area H1 is preferably set around 30 mm, for example, because the range of eye movement during driving is generally 30 mm or more. The determination area may be circular like the determination area H1, and may additionally be rectangular like the determination area H3. Instead of providing the determination area for each eye, one determination area may be provided for both eyes, like the determination area H2.

[0053] In the first to third embodiments, the determination unit 26 compares the current brightness value with the old brightness value, and determines that the driver P is wearing the polarized sunglasses when the current brightness value becomes smaller than the old brightness value. However, to prevent erroneous determination, the above determination may be performed a plurality of times within a set period of time (for example, three seconds), and if the decreased state of the current brightness continues, the determination unit 26 may determine that the driver P is wearing the polarized sunglasses. List of reference symbols 1 VEHICLE DISPLAY DEVICE 11 CAMERA 12 LENS 22 CONTROL UNIT 25 Calculation unit 26 DETERMINATION UNIT 30 POLARIZER 100 VEHICLES G1, G2 POLARIZED SUNGLASSES QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] WO2020 / 194853

[0003]

Claims

[1] Vehicle display device comprising: a camera that continuously captures facial images containing a face of a driver of a vehicle; a polarizer arranged in front of a lens of the camera, converting incident light into linearly polarized light, and emitting the light towards the camera; and a control unit that determines whether the driver is wearing polarized sunglasses based on the captured facial image, wherein the polarizer is arranged so that a polarization direction becomes a horizontal direction which is orthogonal to a vertical direction, the control unit contains: a calculation unit that calculates a brightness value corresponding to each of the facial images and causes a storage unit to store therein the calculated brightness value in association with a time series as brightness value information, and a determination unit that compares current brightness value information with past brightness value information in a plurality of brightness value information pieces stored in the storage unit and, when the current brightness value information decreases, determines that the driver puts on the polarized sunglasses, and the control unit outputs a result of the determination to the outside. [2] Vehicle display device comprising: a camera that continuously captures facial images containing a face of a driver of a vehicle; a polarizer arranged in front of a lens of the camera, converting incident light into linearly polarized light, and emitting the light towards the camera; a rotary drive unit that holds the polarizer rotatable about an optical axis of the lens of the camera and rotates and drives the polarizer about the optical axis; and a control unit that determines whether the driver is wearing polarized sunglasses based on the captured facial images, wherein the camera captures the facial images in a rotary drive state in which the polarizer is rotated and driven by the rotary drive unit, the control contains: a calculation unit that calculates a brightness value corresponding to each of the facial images and causes a storage unit to store therein the calculated brightness value in association with a time series as brightness value information, and a determination unit that compares current brightness value information with past brightness value information in a plurality of brightness value information pieces stored in the storage unit and, when the current brightness value information decreases, determines that the driver puts on the polarized sunglasses, and the control unit outputs a result of the determination to the outside. [3] Vehicle display device comprising: a camera that continuously captures facial images containing a face of a driver of a vehicle; a liquid crystal element arranged in front of a lens of the camera, which, in an energized state, converts incident light into linearly polarized light and emits the light towards the camera; a liquid crystal driving unit that switches the liquid crystal element to one of the energized state and a non-energized state; and a control unit that determines whether the driver is wearing polarized sunglasses based on the captured facial images, wherein the liquid crystal element is arranged so that a polarization direction becomes a horizontal direction orthogonal to a vertical direction in the energized state, the camera captures the facial images while the liquid crystal drive unit repeatedly switches the energized and de-energized states of the liquid crystal element, the control unit contains: a calculation unit that calculates a brightness value corresponding to each of the facial images and causes a storage unit to store therein the calculated brightness value in association with a time series as brightness value information, and a determination unit that compares current brightness value information with past brightness value information in a plurality of brightness value information pieces stored in the storage unit and, when the current brightness value information decreases, determines that the driver puts on the polarized sunglasses, and the control unit outputs a result of the determination to the outside. [4] The vehicle display device according to claim 2 or 3, wherein the determination unit compares the current brightness value information with the past brightness value information after determining that the driver is wearing the polarized sunglasses, and, when the current brightness value information becomes larger than the past brightness value information, determines that the driver takes off the polarized sunglasses.

Citation Information

Patent Citations

  • Imaging device and determination method

    WO2020194853A1