Illumination system for vehicle
The vehicle lighting system addresses the challenge of monotonous uniform light changes by implementing spatially non-uniform light patterns to effectively notify occupants of driver drowsiness, improving notification visibility.
Patent Information
- Application Number
- JP2023082051
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-18
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing vehicle wake-up devices notify occupants of driver drowsiness with monotonous, spatially uniform light changes, making it difficult for occupants to easily notice the notification.
A vehicle lighting system that includes a notification light with a lighting control unit to create spatially non-uniform visual changes in light emission patterns based on the driver's state, using imaging to determine drowsiness levels and controlling light emission patterns accordingly.
Enhances the visibility of notifications by creating attention-grabbing, non-uniform light patterns that alert occupants, particularly the driver, to their drowsiness, facilitating timely responses.
Smart Images

Figure 2024165669000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle lighting system. [Background technology]
[0002] Patent Document 1 discloses an awakening device that alerts the driver when the driver's drowsiness level while driving a vehicle reaches or exceeds a preset threshold by illuminating a light-emitting device mounted inside the vehicle with periodically changing brightness. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2021-87621 Summary of the Invention [Problem to be solved by the invention]
[0004] In the awakening device described in Patent Document 1, the luminance of the entire light emitter is changed uniformly when making an alert, and the change in light is monotonous. Therefore, the awakening device described in Patent Document 1 has room for improvement in terms of making the alert more easily notifiable to the occupant.
[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a vehicle lighting system that allows a vehicle occupant to easily notice a notification. [Means for solving the problem]
[0006] In order to achieve the above-mentioned object, the present invention provides a vehicle lighting system that is mounted on a vehicle and includes an alert light for notifying the state of a driver of the vehicle, a lighting control unit that controls the alert light, and a state determination unit that determines the state of the driver, wherein the lighting control unit controls the alert light so as to cause a spatially non-uniform visual change when the state of the driver determined by the state determination unit is in a predetermined state. Effect of the Invention
[0007] According to the present invention, it is possible to provide a vehicle lighting system that allows a passenger to easily notice a notification. [Brief description of the drawings]
[0008] [Figure 1] 1 is a functional block diagram of a vehicle lighting system according to an embodiment; [Diagram 2] 1 is a perspective view showing an interior of a vehicle equipped with a vehicle lighting system according to an embodiment; [Diagram 3] 3A to 3C are schematic diagrams showing a first example of a non-uniform light emission pattern in the embodiment. [Figure 4] 6A to 6C are schematic diagrams showing a second example of a non-uniform light emission pattern in the embodiment. [Diagram 5] 11A to 11C are schematic diagrams showing a third example of a non-uniform light emission pattern in the embodiment. [Figure 6] 13A to 13C are schematic diagrams showing a fifth example of a non-uniform light emission pattern in the embodiment. [Figure 7] 13 is a schematic diagram showing a sixth example of a non-uniform light emission pattern in the embodiment. FIG. [Figure 8] 5 is a flowchart showing a process performed by a lighting control unit in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] [Embodiment Mode] An embodiment of the present invention will be described with reference to Figures 1 to 8. Note that the embodiment described below is shown as a preferred specific example for carrying out the present invention, and while there are some parts that specifically exemplify various technical matters that are technically preferable, the technical scope of the present invention is not limited to this specific embodiment.
[0010] Fig. 1 is a functional block diagram of a vehicle lighting system 1 according to this embodiment. Fig. 2 is a perspective view showing the interior of a vehicle 10 in which the vehicle lighting system 1 is mounted.
[0011] The vehicle lighting system 1 of this embodiment is mounted on a vehicle 10 such as an automobile. The vehicle lighting system 1 of this embodiment determines the drowsiness level of the driver of the vehicle 10, and when the drowsiness level of the driver is higher than a predetermined threshold, lights up the notification light 2 to notify the occupants of the vehicle 10 of the increase in the drowsiness level of the driver. Although details will be described later, in the vehicle lighting system 1 of this embodiment, the way in which the notification light 2 is illuminated is devised so that the occupants can easily notice the notification. The vehicle lighting system 1 includes the notification light 2, an imaging unit 3 that captures an image of the face of the driver, and a processing unit 4 that controls the notification light 2 based on the image captured by the imaging unit 3.
[0012] The notification lighting 2 is installed in the vehicle 10 and is used to notify occupants that the driver's drowsiness level is high. The notification lighting 2 can be at least a part of a plurality of interior lights installed in the vehicle 10. The notification lighting 2 emits light that is visible to the occupants of the vehicle 10.
[0013] As shown in FIG. 2, in this embodiment, the notification lighting 2 includes a line lighting 21. The line lighting 21 is formed in an elongated shape and has a plurality of light-emitting elements (see reference numeral 211 in FIG. 3, FIG. 4, FIG. 6, and FIG. 7) arranged in the longitudinal direction of the line lighting 21. Such a line lighting 21 is also called an ambient light. In this embodiment, the notification lighting 2 includes a line lighting 21 provided on the instrument panel 101 so as to extend in the left-right direction, and a line lighting 21 provided on each front door 102 and each rear door 103 so as to extend in the front-rear direction. By providing the line lighting 21 around the rear seat such as the rear door 103, it becomes possible for passengers sitting in the rear seats to be notified of the rise in the driver's drowsiness level. When a passenger other than the driver (i.e., a passenger) is notified of the rise in the driver's drowsiness level, the passenger can take measures such as warning the driver. The light emitting element constituting the line illumination 21 can be, for example, an LED (Light Emitting Diode) capable of adjusting the brightness and color.
[0014] The imaging unit 3 is mounted on the vehicle 10 in a position capable of capturing an image of the driver's face (illustration of the imaging unit is omitted in FIG. 2). The location of the imaging unit 3 is not particularly limited as long as it can capture an image of the driver's face, and may be, for example, above and in front of the driver (for example, in an overhead module) or in front of the driver (for example, on the steering column or around the meter). The imaging unit 3 may be, for example, a digital camera equipped with a solid-state imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging unit 3 may be a so-called near-infrared camera. By using the imaging unit 3 as a near-infrared camera, it becomes easier to capture the driver's face even in a situation where the inside of the vehicle is dark, such as at night. The captured image generated by the imaging unit 3 is sent to the feature extraction unit 41 of the processing unit 4.
[0015] The processing unit 4 includes a control area including a processor and a RAM (Random Access Memory) that serves as a calculation area when the processor is operating, and a storage area including a ROM (Read Only Memory), a hard disk, etc., for storing programs executed by the processor. The processing unit 4 may be configured, for example, as an ECU (Electronic Control Unit) that performs various controls of the vehicle 10. The processing unit 4 includes a feature extraction unit 41, a state determination unit 42, and a lighting control unit 43.
[0016] The feature extraction unit 41 analyzes the captured image acquired from the imaging unit 3, and extracts feature amounts related to the driver's drowsiness level. In this embodiment, the feature amounts extracted by the feature extraction unit 41 include at least the driver's line of sight. In addition, the feature amounts related to the driver's drowsiness level may be driver feature amounts used in known techniques for determining the drowsiness level, such as the direction of the face and the degree of eye opening.
[0017] Signals indicating various features of the driver extracted by the feature extraction unit 41 are output to a state determination unit 42. In addition, a signal indicating information related to the line of sight of the driver, among the features of the driver extracted by the feature extraction unit 41, is output to a lighting control unit 43.
[0018] The state determination unit 42 determines the drowsiness level of the driver as the state of the driver based on the various features of the driver extracted by the feature extraction unit 41. The drowsiness level can be determined by a known method. In determining the drowsiness level, the state determination unit 42 may use vital information (e.g., heart rate, etc.) of the driver obtained by a sensor other than the imaging unit 3. In determining the drowsiness level, the state determination unit 42 may also use indirect information that may lead to the driver's drowsiness, such as information on a change in the speed of the vehicle 10 and information on a change in the steering angle. The information on the driver's drowsiness level determined by the state determination unit 42 is output to the lighting control unit 43.
[0019] The lighting control unit 43 determines the drowsiness level of the driver, and changes the light emission pattern of the notification lighting 2 according to the determined drowsiness level. In this embodiment, the lighting control unit 43 determines whether the driver's drowsiness level is Level 0 below the drowsiness threshold, Level 1 equal to or greater than the drowsiness threshold and less than a first threshold, Level 2 equal to or greater than the first threshold and less than a second threshold, or Level 3 equal to or greater than the second threshold. Level 0, Level 1, Level 2, and Level 3 indicate increasing levels of drowsiness of the driver. The range of levels determined by the lighting control unit 43, the number of levels, and the like may be adjusted as appropriate.
[0020] In this embodiment, the lighting control unit 43 turns off the notification lighting 2 when the driver's drowsiness level is level 0. Level 0 is a drowsiness level at which the driver is deemed not to be drowsy, and levels 1 and above are drowsiness levels at which the driver is deemed to be drowsy. When the driver's drowsiness level is level 1, the lighting control unit 43 turns on the notification lighting 2 normally. The normal lighting can be, for example, a lighting pattern in which the entire notification lighting 2 is lit, but is not particularly limited to this. Hereinafter, the lighting pattern of the notification lighting 2 when the driver's drowsiness level is level 1 will be referred to as the "level 1 lighting pattern."
[0021] When the driver's drowsiness level is level 2, the lighting control unit 43 controls the notification lighting 2 so that a spatially non-uniform visual change occurs. Here, the aforementioned Patent Document 1 (i.e., JP 2021-87621 A) discloses an example in which the entire lighting is blinked when the driver's drowsiness level is high, but such a change in light corresponds to an example of a spatially uniform visual change because the light emission state changes in a similar manner regardless of position. On the other hand, in this embodiment, the "spatially non-uniform visual change" means that, for example, the way in which the light emitted from the notification lighting 2 changes in appearance differs depending on the position in the vehicle. Hereinafter, a light emission pattern in which a spatially non-uniform visual change occurs is referred to as a "non-uniform light emission pattern." In addition, the light emission pattern of the notification lighting 2 when the driver's drowsiness level is level 2 is referred to as a "level 2 light emission pattern."
[0022] The first to sixth examples of the non-uniform light emission pattern will be described with reference to Figs. 3 to 7. Fig. 3 is a schematic diagram showing a first example of the non-uniform light emission pattern. Fig. 4 is a schematic diagram showing a second example of the non-uniform light emission pattern. Fig. 5 is a schematic diagram showing a third example of the non-uniform light emission pattern. The fourth example of the non-uniform light emission pattern is omitted. Fig. 6 is a schematic diagram showing a fifth example of the non-uniform light emission pattern. Fig. 7 is a schematic diagram showing a sixth example of the non-uniform light emission pattern. In each of Figs. 3 to 7, the change in the light emission state of the notification light 2 is shown in chronological order from the top. Also, Figs. 3 to 7 are merely schematic diagrams, and the detailed configuration such as the length of the notification light 2 and the number of the light emitting elements 211 can be variously changed.
[0023] The first example shown in FIG. 3 is an example in which the notification illumination 2 is illuminated so that the light flows. More specifically, this example is an example in which the light-emitting region R1 is sequentially shifted in a predetermined direction to produce a flowing appearance of light. When the notification illumination 2 changes from the top position state in FIG. 3 to the center position state, the notification illumination 2 causes a visual change from a lit state to an unlit state in the first light-emitting element 211 from the left, a visual change from an unlit state to a lit state in the fourth light-emitting element 211 from the left, and the visual change is unchanged in the other light-emitting elements 211. In this way, when the notification illumination 2 changes from the top position state to the center position state in FIG. 3, the way of change differs depending on the position, and a spatially non-uniform visual change occurs. Similarly, when the notification illumination 2 changes from the center position state to the bottom position state in FIG. 3, the light also visually changes spatially non-uniformly.
[0024] The lighting control unit 43 may also cause the light-emitting region R1 to circle around the vehicle interior by sequentially causing a plurality of line lights 21 to emit light as shown in Fig. 3. For example, as shown in Fig. 2, the light may circle around the vehicle interior by controlling the notification lights 2 so that light flows in the order of the line light (not shown) in the left rear door, the line light (not shown) in the left front door, the line light 21 in the instrument panel 101, the line light 21 in the right front door 102, and the line light 21 in the right rear door 103. The circle of light may also be produced in the following second to fourth examples.
[0025] 4 is an example in which the notification illumination 2 is illuminated so as to generate a moving light-emitting region R2 and a base light-emitting region R3 that are different from each other in hue, brightness, or saturation, and the moving light-emitting region R2 is moved in a predetermined direction in sequence to create a flowing light effect. That is, in this example, the visual change of each part of the notification illumination 2 is not a change between on and off, but a change in hue, brightness, or saturation.
[0026] The third example shown in FIG. 5 is an example in which the moving light has a gradation of hue, brightness, or saturation, and is otherwise similar to the first or second example.
[0027] In a fourth example, not shown in the drawings, each of the multiple line lights 21 is turned on and blinks as a whole, but the light emission timing of the multiple line lights 21 is shifted to produce a spatially non-uniform visual change. For example, as shown in Fig. 2, the entire line light (not shown) of the left rear door, the entire line light (not shown) of the left front door, the entire line light 21 of the instrument panel 101, the entire line light 21 of the right front door 102, and the entire line light 21 of the right rear door 103 are sequentially turned on to produce an effect of flowing light.
[0028] 6 is another example in which the notification illumination 2 is illuminated so as to cause the light to flow. In this example, the light-emitting region R4 is extended to one side in the longitudinal direction of the line illumination 21 by continuously lighting up a plurality of light-emitting elements 211, thereby creating the effect of causing the light to flow. Note that the light-emitting region R4 may also be extended to both sides in the longitudinal direction of the line illumination 21.
[0029] The sixth example shown in FIG. 7 is an example in which the light emitting region R5 in the line illumination 21 is changed randomly.
[0030] Although examples of non-uniform light emission patterns have been shown above, light emission patterns other than the above-mentioned examples may be adopted as the non-uniform light emission pattern.
[0031] In addition, in this embodiment, the non-uniform light emission pattern is determined based on the line of sight of the driver. For example, when the lighting control unit 43 causes the notification lighting 2 to emit light as in the first to fifth examples, the non-uniform light emission pattern may be set so that the start and end positions of the light flow are located near the line of sight of the driver. Also, a performance may be performed in which the speed of the flowing light changes depending on the distance from the line of sight of the driver. Also, for example, when the lighting control unit 43 causes the notification lighting 2 to emit light randomly as in the sixth example, the light emitting element 211 near the line of sight of the driver may be turned on with high frequency, and the other light emitting elements 211 may be turned on with low frequency. In addition, the non-uniform light emission pattern may be determined based on the line of sight of the driver so as to easily attract the driver's attention. Note that the non-uniform light emission pattern may be determined regardless of the line of sight of the driver.
[0032] The lighting control unit 43 controls the notification lighting 2 to emit light in a non-uniform light emission pattern, similar to the level 2 light emission pattern, even when the driver's drowsiness level is level 3. When the driver's drowsiness level is level 3, the lighting control unit 43 controls the notification lighting 2 to produce an effect that gives a stronger sense of urgency, compared to the level 2 light emission pattern. For example, when the driver's drowsiness level is level 3, the lighting control unit 43 may increase the speed of the flowing light, increase the cycle of the flowing light, increase the luminous intensity of the flowing light, or change the color of the flowing light to a color that makes it easier to feel urgency, compared to the level 2.
[0033] Similarly, when the number of drowsiness levels is level 4 or more, the light emission pattern may be determined so as to present a more urgent appearance as the level increases. In addition, in the present embodiment, an example has been shown in which the light emission pattern of the notification light 2 is a non-uniform light emission pattern at both levels 2 and 3, but this is not limiting, and the light control unit 43 may control the notification light 2 so that the light emission pattern is a non-uniform light emission pattern at at least one level.
[0034] Next, an example of the processing performed by the lighting control unit 43 in this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the processing performed by the lighting control unit 43 in this embodiment. The timing at which the lighting control unit 43 starts the processing is not particularly limited, but may be, for example, when the system power supply or ignition of the vehicle 10 is turned on, or when a predetermined start command is given by the occupant.
[0035] In step S1, the lighting control unit 43 acquires the driver's drowsiness level from the state determination unit 42 and acquires the driver's line of sight from the feature extraction unit 41.
[0036] Next, in step S2, the lighting control unit 43 determines whether the driver is drowsy. In step S2, if the driver's drowsiness level is 0, the lighting control unit 43 determines that the driver is not drowsy, and if the driver's drowsiness exceeds level 0, the lighting control unit 43 determines that the driver is drowsy. If it is determined that the driver is not drowsy in step S2, the lighting control unit 43 turns off the notification illumination 2 in step S9 and ends the process. On the other hand, if it is determined that the driver is drowsy in step S2, the lighting control unit 43 determines the driver's drowsiness level in steps S3 and S4.
[0037] In step S3, the lighting control unit 43 judges whether the driver's drowsiness level is 1. When the drowsiness level is 1, the lighting control unit 43 sets the light emission pattern of the notification light 2 to a level 1 light emission pattern in step S5. On the other hand, when the drowsiness level is not 1, the lighting control unit 43 judges whether the driver's drowsiness level is 2 in step S4. When the drowsiness level is 2, the lighting control unit 43 sets the light emission pattern of the notification light 2 to a level 2 light emission pattern (i.e., a non-uniform light emission pattern) in step S6. On the other hand, when the drowsiness level is not 2, the lighting control unit 43 judges that the driver's drowsiness level is 3, and sets the light emission pattern of the notification light 2 to a level 3 light emission pattern (i.e., a non-uniform light emission pattern with a more urgent effect than the level 2 light emission pattern) in step S7. The driver's line of sight direction acquired in step S1 is used to determine the level 2 light emission pattern and the level 3 light emission pattern, as described above.
[0038] In step S8 after step S5, step S6, or step S7, the lighting control unit 43 determines whether it is time to end the illumination of the notification lighting 2. The end timing may be, for example, when the system power supply or ignition of the vehicle 10 is turned off, or when a predetermined end instruction is given by an occupant. If it is not the end timing, in step S10, the lighting control unit 43 causes the notification lighting 2 to emit light in the illumination pattern set in steps S5 to S7, and ends the process. On the other hand, if it is the end timing, in step S9, the lighting control unit 43 turns off the notification lighting 2, and ends the process.
[0039] (Functions and Effects of the Embodiments) In the vehicle lighting system 1 of this embodiment, the lighting control unit 43 controls the notification lighting 2 so as to produce a spatially non-uniform visual change when the driver's state determined by the state determination unit 42 is in a predetermined state. By devising the light emission pattern of the notification lighting 2 in this way, it becomes easier for the occupants of the vehicle 10 to notice the notification by the notification lighting 2.
[0040] Furthermore, when the state of the driver determined by the state determination unit 42 is in a predetermined state, the lighting control unit 43 causes the notification lighting 2 to emit light so that the light flows. By using such a lighting pattern, the occupants of the vehicle 10 can more easily notice the notification by the notification lighting 2.
[0041] Furthermore, the lighting control unit 43 controls the line lighting 21 to emit flowing light when the state of the driver determined by the state determination unit 42 is in a predetermined state. By using the line lighting 21, flowing light can be easily generated.
[0042] Furthermore, when the state of the driver determined by the state determination unit 42 is in a predetermined state, the lighting control unit 43 determines the light emission pattern of the notification lighting 2 based on the line of sight of the driver extracted by the feature extraction unit 41. By illuminating the notification lighting 2 in accordance with the line of sight of the driver in this way, the driver can more easily notice the notification.
[0043] Furthermore, the feature extraction unit 41 outputs the detection result of the driver's gaze direction to both the lighting control unit 43 and the state determination unit 42, and the state determination unit 42 determines the state of the driver based on at least the driver's gaze direction. In this way, the detection of the driver's gaze direction required for both the lighting control unit 43 and the state determination unit is performed by the common feature extraction unit 41, thereby reducing the software load of the vehicle lighting system 1.
[0044] As described above, according to this embodiment, a vehicle lighting system that allows an occupant to easily notice a notification can be provided.
[0045] [Other embodiments] When the lighting control unit controls the notification lighting to generate light with a non-uniform light emission pattern, only the light-emitting elements of the notification lighting located near the line of sight of the driver may be illuminated, and the light-emitting elements of the notification lighting located at other positions may be illuminated with a lower light emission intensity than the light-emitting elements located near the line of sight of the driver or may be turned off. This can save energy in the entire vehicle lighting system. In addition, when there are multiple passengers, the line of sight of the passengers may also be detected, and only the range that each passenger can see may be illuminated. In this case, not only the driver but also the passengers can recognize the change in the driver's condition (for example, an increase in drowsiness level).
[0046] The position of the notification lighting is not limited to the position exemplified in Fig. 2, and various modifications are possible. As an example, the notification lighting may be arranged near the feet of each passenger. Even in this case, the driver can be woken up when the driver looks down due to drowsiness. In addition, even when the passenger is looking down while operating a smartphone, tablet, or reading, for example, the passenger can be notified of the decrease in the driver's drowsiness level.
[0047] The notification lighting is not limited to those shown in the embodiment. For example, a room light provided in a car, a footlight for illuminating the feet of each passenger, a door courtesy lamp, or other light may be used. In this case, the lighting control unit may cause a spatially non-uniform visual change by shifting the emission timing of the multiple notification lighting, as in the fourth example of the method of emitting the notification lighting shown in the embodiment. Also, a projector or the like may be used as the notification lighting.
[0048] In the embodiment, the state determination unit determines the drowsiness level of the driver as the state of the driver, but this is not limited to this. For example, the state determination unit may determine whether the driver is inattentive driving or not as the state of the driver, and the lighting control unit may control the notification lighting so that a spatially non-uniform visual change occurs when the driver is inattentive driving.
[0049] Although the embodiment of the present invention has been described above, the invention according to the claims is not limited to the above embodiment. It should be noted that not all of the combinations of features described in the embodiment are essential to the means for solving the problems of the invention. The present invention can be modified appropriately without departing from the spirit of the invention. [Explanation of symbols]
[0050] 1. Vehicle lighting system 2...Notification lighting 3. Imaging unit 10…Vehicle 21...Line lighting 41...Feature extraction unit 42...Status determination section 43...Lighting control unit 211...Light emitting element
Claims
1. An indicator light mounted on a vehicle for indicating the state of a driver of the vehicle; A lighting control unit that controls the notification lighting; A state determination unit that determines a state of the driver, the illumination control unit controls the notification illumination so as to cause a spatially non-uniform visual change when the state of the driver determined by the state determination unit is in a predetermined state. Vehicle lighting systems.
2. The illumination control unit causes the notification illumination to emit light so that light flows when the state of the driver determined by the state determination unit is in a predetermined state.
2. The vehicle lighting system according to claim 1.
3. The notification illuminator includes a line illuminator having an elongated shape and a plurality of light-emitting elements arranged in a longitudinal direction thereof, The illumination control unit controls the line illumination so that light flows when the state of the driver determined by the state determination unit is in a predetermined state.
3. The vehicle lighting system according to claim 2.
4. An imaging unit that images the face of the driver; A feature extraction unit that extracts a line of sight direction of the driver from an image captured by the imaging unit, the illumination control unit, when the state of the driver determined by the state determination unit is in a predetermined state, determines a light emission pattern of the notification illumination based on the line of sight direction of the driver extracted by the feature extraction unit.
3. A vehicle lighting system according to claim 1 or 2.
5. The feature extraction unit outputs a determination result of the driver's line of sight direction to both the illumination control unit and the state determination unit, The state determination unit determines the state of the driver based on at least the line of sight of the driver.
5. A vehicle lighting system according to claim 4.
Citation Information
Patent Citations
Awakening device
JP2021087621A
