Light emission control device and method, light emission device, vehicle, and storage medium

Abstract

This invention provides a light emission control device, a light emission device, a vehicle, a light emission control method, and a non-transitory storage medium that improve the recognition effect when notifying vehicle occupants of information. The light emission control device, an ECU, acquires information related to objects around the vehicle and, when an object is present, controls the light emission of multiple light-emitting units installed inside the vehicle in a coordinated manner.

Description

Technical Field

[0001] This disclosure relates to a light-emitting control device, a light-emitting device, a vehicle, a light-emitting control method, and a non-transitory storage medium for controlling a light-emitting part installed in a vehicle. Background Technology

[0002] For example, Japanese Patent Application Publication No. 2015-006830 discloses an information display device that changes the light emission pattern of multiple light sources arranged side by side along the boundary edge between the windshield and the dashboard based on various information such as vehicle driving information and surrounding information.

[0003] In cases where information is communicated to occupants based on the light emitted by the light-emitting unit, there is room for improvement in order to enhance the recognition effect. Summary of the Invention

[0004] This disclosure provides a light emission control device, a light emission device, a vehicle, a light emission control method, and a non-transitory storage medium that can improve the recognition effect when notifying vehicle occupants of information.

[0005] The first type of light-emitting control device includes: an object acquisition unit that acquires information related to objects around the vehicle; and a control unit that, when the object is present, controls the light emission of multiple light-emitting units installed inside the vehicle in a coordinated manner.

[0006] The first type of light emission control device is configured such that when the object acquisition unit acquires information related to an object existing around the vehicle, the control unit causes the light emission of multiple light emission units to be linked.

[0007] Therefore, compared to illuminating only multiple light-emitting parts, the recognition effect for occupants is higher. In other words, this light-emitting control device can improve the recognition effect when information is communicated to vehicle occupants.

[0008] The second type of light emission control device is, in the first type of light emission control device, wherein the control unit controls the light emission of the plurality of light emission units in such a way that the light emission of the plurality of light emission units moves continuously between the light emission units.

[0009] In the second type of light emission control device, the control unit controls the continuous movement of light between multiple light-emitting units when they are linked together. Therefore, this light emission control device can guide the line of sight of vehicle occupants.

[0010] The third type of light emission control device is, in the first or second type of light emission control device, wherein the object acquisition unit further acquires the position of the object relative to the occupant of the vehicle, and the control unit controls the light emission of the light emission unit to continuously move from the position of the object or to the position of the object when viewed from the occupant.

[0011] According to the third-party light-emitting control device, it is possible to guide the vehicle occupants' gaze away from the object by moving the light emitted from the light-emitting part away from the object. Furthermore, according to this light-emitting control device, it is possible to guide the vehicle occupants' gaze towards the object by moving the light emitted from the light-emitting part toward the object.

[0012] The fourth type of light emission control device is a light emission control device in any one of the first to third types, which further includes a field of view acquisition unit. The field of view acquisition unit acquires information related to the central field of view of the occupants of the vehicle, and the control unit makes at least one of the starting point and the ending point of the light emission of the continuously moving light emission unit included within the range of the central field of view.

[0013] In the fourth type of light emission control device, when the field of view acquisition unit acquires information related to the central field of view of the vehicle occupant, control is implemented to ensure that at least one of the starting point and the ending point of the light emission emitted by the light emission unit is included within the range of the central field of view. Therefore, according to this light emission control device, since the light flow from the starting point to the ending point is necessarily included in the central field of view of the occupant, the recognition effect can be further improved.

[0014] The fifth type of light emission control device is, in the fourth type of light emission control device, wherein the control unit determines the path of light emission of the plurality of light emission units in such a way that at least one of the starting point and the ending point is included within the range of the central field of view.

[0015] According to the fifth type of light emission control device, by controlling the path of the light flow from the starting point to the ending point, it is possible to increase the variation in guiding the occupant's line of sight.

[0016] The sixth type of light emission control device is, in the fourth or fifth type of light emission control device, wherein the control unit changes the light emission mode of the light emission unit based on the relationship between the starting point and the ending point and the range of the central field of view.

[0017] In the sixth type of light emission control device, the mode of light emission is changed based on the relationship between the starting and ending points of the light emission and the range of the central field of vision. For example, when the starting point of the light emission is close to the end of the central field of vision, the light emission can be made to flash at a high frequency, thereby making the occupant notice the light emission. Furthermore, in this light emission control device, for example, the light emission can be reduced as the ending point of the light emission approaches the center of the central field of vision, thereby conveying that the guidance of the gaze has ended.

[0018] The seventh type of light emission control device further includes an environment acquisition unit in any one of the first to sixth types of light emission control devices. The environment acquisition unit acquires environmental information of at least one of the interior and exterior of the vehicle. The control unit controls the light emission of the light emission unit based on the environmental information.

[0019] In the seventh type of light emission control device, the light emission of the light emission unit is controlled based on at least one environmental information acquired by the environmental acquisition unit, both inside and outside the vehicle. Here, environmental information refers to information representing the visual perception of the surroundings from the viewpoint of the vehicle occupants. In other words, according to this light emission control device, the light emission is controlled based on the visual perception of the surroundings from the viewpoint of the occupants, thus improving the visual confirmation effect in environments where it is difficult to observe the surroundings.

[0020] The eighth type of light emission control device is that, in the seventh type of light emission control device, the control unit controls the light emission of the light emission unit based on at least one of the contrast ratio and brightness of the vehicle interior, which are environmental information.

[0021] According to the luminous control device of the eighth method, since the luminous emission is controlled based on at least one of contrast and brightness from the occupant's viewpoint, it can provide visual confirmation even in backlit or excessively bright environments.

[0022] The light-emitting device of the ninth type includes: a light-emitting control device of any one of the first to eighth types; and a plurality of the light-emitting parts.

[0023] The light-emitting device according to the ninth method can improve the recognition effect.

[0024] The vehicle of the tenth embodiment includes: a detection unit that detects the object; and a light-emitting device of the ninth embodiment.

[0025] According to the tenth method for vehicles, the recognition effect can be improved.

[0026] The eleventh method of light emission control involves a computer performing the following processing: obtaining information related to objects around the vehicle; and, if the objects are present, controlling the light emission of multiple light-emitting units installed inside the vehicle in a coordinated manner.

[0027] In the eleventh illumination control method, when the computer acquires information related to objects existing around the vehicle, it controls the illumination of multiple light-emitting units in a coordinated manner. Therefore, compared to the case where only multiple light-emitting units are illuminated, the recognition effect for occupants is higher. In other words, according to this illumination control method, the recognition effect when information is notified to the vehicle occupants can be improved.

[0028] The twelfth method of the light emission control program causes the computer to perform the following processing: obtaining information related to objects around the vehicle, and, if the objects are present, controlling the light emission of multiple light-emitting units installed inside the vehicle in a coordinated manner.

[0029] When the computer executing the twelfth method of the light emission control program acquires information related to objects existing around the vehicle, it controls the emission of multiple light-emitting units in a coordinated manner. Therefore, compared to the case where only multiple light-emitting units emit light, the recognition effect for occupants is higher. In other words, according to this light emission control program, the recognition effect when information is notified to the occupants of the vehicle can be improved.

[0030] According to this disclosure, the recognition effect can be improved when the line of sight of vehicle occupants is guided. Attached Figure Description

[0031] Exemplary embodiments of the present invention will be described in detail with reference to the following figures, wherein:

[0032] Figure 1 A block diagram illustrating the hardware structure of the vehicle according to the first embodiment;

[0033] Figure 2 The figure illustrates the arrangement of the light-emitting parts inside the vehicle according to the first embodiment;

[0034] Figure 3 A block diagram illustrating the hardware structure of the ECU in the first embodiment;

[0035] Figure 4A A block diagram illustrating the structure of the ROM of the integrated ECU in the first embodiment;

[0036] Figure 4B This is a block diagram illustrating the functional structure of the integrated ECU in the first embodiment;

[0037] Figure 5A A block diagram illustrating the structure of the ROM of the lamp ECU in the first embodiment;

[0038] Figure 5B This is a block diagram illustrating the functional structure of the lamp ECU in the first embodiment;

[0039] Figure 6 A flowchart illustrating the line-of-sight guidance process performed in the lamp ECU of the first embodiment;

[0040] Figure 7 This is an example of a light-emitting notification in the first embodiment;

[0041] Figure 8 This is an example of a light-emitting notification in the first embodiment;

[0042] Figure 9 A block diagram illustrating the hardware structure of the vehicle according to the second embodiment;

[0043] Figure 10 This is a block diagram illustrating the functional structure of the integrated ECU in the second embodiment;

[0044] Figure 11 This is a block diagram illustrating the functional structure of the lamp ECU in the second embodiment;

[0045] Figure 12 This is a flowchart illustrating the process of line-of-sight guidance processing performed in the lamp ECU of the second embodiment;

[0046] Figure 13 This is an example of a light-emitting notification in the second embodiment;

[0047] Figure 14 A block diagram illustrating the hardware structure of the vehicle according to the third embodiment;

[0048] Figure 15 This is an example of a light-emitting notification in the third embodiment. Detailed Implementation

[0049] An information notification system, including the light-emitting control device disclosed herein, will be described. The information notification system is a system that notifies the occupants of a vehicle, especially the driver, of objects detected within the vehicle. Specifically, this information notification system guides the occupants' gaze to the object by controlling multiple light-emitting units installed within the vehicle in a coordinated manner, for example, by directing light from a predetermined starting point to a predetermined endpoint.

[0050] [First Implementation Method]

[0051] (Overall structure)

[0052] like Figure 1 As shown, the information notification system 10 of the first embodiment is installed in the vehicle 12. This information notification system 10 is configured to include at least a light-emitting device 14, an integrated ECU (Electronic Control Unit) 21, an external identification sensor 30, and an occupant monitoring sensor 32. Furthermore, the light-emitting device 14 includes a lamp ECU 22 and a light-emitting section 40.

[0053] like Figure 2 As shown, the light-emitting unit 40 in this embodiment consists of multiple lamp groups installed inside the vehicle. Each light-emitting unit 40 is a linear lamp and has a structure composed of multiple light-emitting elements arranged together. Examples of such light-emitting elements are LEDs (Light Emitting Diodes) or organic ELs (Electronic Luminescent).

[0054] The light-emitting part 40 in this embodiment includes a central upper light 41, pillar lights 42L and 42R, door upper lights 43L and 43R, central lower light 44, door lower lights 45L and 45R, console lights 46L and 46R, and turn signals 47L, 47C and 47R.

[0055] The central upper light 41 is arranged along the upper part of the front wall 90 of the carriage. The pillar light 42L is arranged along the trim 92A of the front pillar 92 on the left side (hereinafter referred to as "left side") in the vehicle width direction, and the pillar light 42R is arranged along the trim 92A of the front pillar 92 on the right side (hereinafter referred to as "right side") in the vehicle width direction.

[0056] The upper door light 43L is positioned along the upper part of the door trim panel 93A in the left front door 93, and the upper door light 43R is positioned along the upper part of the door trim panel 93A in the right front door 93. The lower central light 44 is positioned along the lower left side of the front wall 90 of the passenger compartment, surrounding the upper part of the central instrument panel 91, and along the lower right side of the front wall 90 of the passenger compartment.

[0057] The lower door light 45L is positioned along the lower part of the door trim panel 93A in the left front door 93, and the lower door light 45R is positioned along the lower part of the door trim panel 93A in the right front door 93. The console light 46L is positioned along the left side of the center console 94, and the console light 46R is positioned along the right side of the center console 94.

[0058] Turn signal 47L is positioned along the upper left side of the steering wheel 95 in the straight-ahead position. Furthermore, turn signal 47C is positioned along the upper center of the steering wheel 95 in the straight-ahead position. Additionally, turn signal 47R is positioned along the upper right side of the steering wheel 95 in the straight-ahead position.

[0059] like Figure 1 As shown, the information notification system 10 according to this embodiment includes a plurality of ECUs 20. The ECUs 20 include at least the integrated ECU 21 and the lamp ECU 22 described above.

[0060] like Figure 3 As shown, the ECU 20 is configured to include a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, an input / output I / F (Interface) 20D, and an in-vehicle communication I / F 20E. The CPU 20A, ROM 20B, RAM 20C, input / output I / F 20D, and in-vehicle communication I / F 20E are connected to each other in a manner that enables them to communicate with each other via an internal bus 20G.

[0061] The CPU 20A, acting as a processor, is the central processing unit that executes various programs or controls different parts. Specifically, the CPU 20A reads programs from the ROM 20B, which serves as memory, and uses the RAM 20C as its working area to execute the programs.

[0062] ROM20B stores various programs and data. In addition, ECU20 can replace ROM20B, or in addition to ROM20B, it can also have a storage device consisting of HDD (Hard Disk Drive) or SSD (Solid State Drive) as storage.

[0063] RAM20C is used as a working area to temporarily store programs or data.

[0064] The input / output I / F20D is an interface for sensors mounted on the vehicle 12, such as those used to connect to external identification sensors 30 and occupant monitoring sensors 32.

[0065] The in-vehicle communication I / F20E is an interface used to connect with each ECU 20. Communication via this interface is based on either CAN (Controller Area Network) protocol or Ethernet (registered trademark). The in-vehicle communication I / F20E communicates with the external bus 20H (see reference). Figure 1 )connect.

[0066] like Figure 1 As shown, the external identification sensor 30, which serves as the detection unit, is a sensor group used for detecting objects and the like around the vehicle 12. This external identification sensor 30 includes, for example, a camera that captures images of the area around the vehicle 12, a millimeter-wave radar that transmits detection waves and receives reflected waves, and a lidar (Laser Imaging Detection and Ranging) that scans the front of the vehicle 12.

[0067] The occupant monitoring sensor 32 is a device for monitoring the status of occupants. The occupant monitoring sensor 32 includes at least a camera mounted on the steering column (not shown) to capture images of the driver.

[0068] (Integrated ECU)

[0069] The integrated ECU 21, as a detection unit, has the function of detecting the driving path of the vehicle 12 and objects around the vehicle 12 based on information obtained from the external identification sensor 30. In addition, the integrated ECU 21 has the function of inferring the driver's central field of vision based on the image of the driver's face obtained from the occupant monitoring sensor 32.

[0070] like Figure 4A As shown, the ROM20B of the integrated ECU21 in this embodiment stores a processing program 100 and field of view data 110.

[0071] Processing program 100 is a program used to control the integrated ECU 21.

[0072] The visual field data 110 stores a central value related to information concerning a person's central visual field. More specifically, the visual field data 110 stores the range of the visual field centered on the viewpoint.

[0073] like Figure 4B As shown, in the integrated ECU21 of this embodiment, the CPU20A functions as a collection unit 200, an object detection unit 210, a field of view inference unit 220, and a supply unit 240 by executing the processing program 100.

[0074] The collection unit 200 collects images of the driving path, pedestrians, vehicles, and other detection information detected by the external identification sensor 30. In addition, the collection unit 200 collects images of the driver captured by the occupant monitoring sensor 32.

[0075] The object detection unit 210 detects objects existing in the direction of travel of the vehicle 12 based on the captured images of the driving path, pedestrians, vehicles, signs and other detection information collected in the collection unit 200.

[0076] The field of vision inference unit 220 infers the driver's central field of vision based on the captured images of the driver collected in the collection unit 200. Specifically, the field of vision inference unit 220 determines the distance between the driver's eyes and the viewpoint of the two eyes based on the positions of the driver's two eyes contained in the captured images, and then infers the central field of vision centered on the driver's viewpoint by referring to the field of vision data 110.

[0077] The providing unit 240 has the function of providing the light ECU 22 with information about the detected object and information about the driver's central field of vision. Here, the object information includes at least the position information of the object relative to the driver's viewpoint, and may also include information about the object's category (e.g., pedestrian, sign, etc.). The providing unit 240 sends the object information and the driver's central field of vision information to the light ECU 22 at predetermined intervals or when an object is detected.

[0078] (Light ECU)

[0079] The lamp ECU22 has the function of controlling the light emission of each light-emitting part 40 constituting the light-emitting device 14. For example... Figure 5A As shown, in the ROM20B of the lamp ECU22 of this embodiment, there is a control program 150, which is a light emission control program, and a display pattern table 160.

[0080] The control program 150 is a program used to control the light emission of each light-emitting part 40.

[0081] The display pattern table 160 contains tabular data that stores the light-emitting paths and light-emitting methods of each light-emitting part 40.

[0082] like Figure 5B As shown, in the lamp ECU22 of this embodiment, the CPU20A functions as an object acquisition unit 250, a field of view acquisition unit 260, a decision unit 280, and a control unit 290 by executing the control program 150.

[0083] The object acquisition unit 250 has the function of acquiring information about objects sent from the integrated ECU 21.

[0084] The field of vision acquisition unit 260 has the function of acquiring information about the driver's center field of vision sent from the integrated ECU 21.

[0085] The determination unit 280 determines the starting point and the ending point when multiple light-emitting units 40 are linked to emit light. Furthermore, the determination unit 280 has the function of determining the propagation path of the light emitted by the multiple light-emitting units 40. Moreover, the determination unit 280 has the function of determining the light emission mode of the light-emitting units 40. Specifically, as the light emission mode, the determination unit 280 determines the speed and color of the light from the starting point to the ending point, as well as the manner of flashing, repetition, etc.

[0086] The control unit 290 has the function of controlling the light emission of the light-emitting unit 40. In this embodiment, when controlling the light emission of the light-emitting unit 40 in a coordinated manner, the control unit 290 switches each light-emitting element of the light-emitting unit 40 one by one from the starting point to the ending point to make it emit light. Furthermore, when the interval between adjacent light-emitting units 40 is defined as the light emission path, the switching time of light emission is adjusted according to the interval distance between each light-emitting unit 40, thereby making the speed of light flow constant. Details regarding the control of the light-emitting unit 40 implemented by the control unit 290 will be described later.

[0087] (Control process)

[0088] use Figure 6 The flowchart will be used to explain the line-of-sight guidance process performed by the lamp ECU22 of this embodiment. The processing in the lamp ECU22 is performed by making the CPU20A of the lamp ECU22 function as an object acquisition unit 250, a field-of-sight acquisition unit 260, a decision unit 280, and a control unit 290.

[0089] exist Figure 6 In step S100, CPU20A obtains information about the object from integrated ECU21.

[0090] In step S101, CPU 20A detects the object O to be notified to the driver. Specifically, CPU 20A detects the object O to be notified to the driver based on the location and category of the detected object.

[0091] In step S102, CPU 20A determines whether there is an object O to be notified to the driver. If CPU 20A determines that there is an object O to be notified to the driver (if "yes" in step S102), it proceeds to step S103. On the other hand, if CPU 20A determines that there is no object O to be notified to the driver (if "no" in step S102), it terminates the gaze guidance process.

[0092] In step S103, CPU20A obtains information about the driver's center field of vision from the integrated ECU21.

[0093] In step S104, the CPU20A determines the starting point and ending point of the light emission from the light-emitting unit 40. Specifically, the CPU20A determines the starting point of the light emission from the light-emitting unit 40 in a manner that includes the starting point in the driver's center field of vision.

[0094] In step S105, CPU20A determines the path of light emission from the light-emitting unit 40. Specifically, as the path of light from the starting point to the ending point, CPU20A determines the path of light emission from the light-emitting unit 40 as the path that aligns with the movement of the driver's line of sight and provides guidance for the driver.

[0095] In step S106, the CPU20A determines the manner in which the light-emitting unit 40 emits light. For example, it determines the manner in which the light-emitting unit flashes at a high frequency when the starting point of the light emission is close to the end of the central field of view.

[0096] In step S107, the CPU 20A implements the notification achieved by the light emission of the light-emitting unit 40. That is, the CPU 20A controls the light-emitting unit 40 according to the determined path and method. Then, the gaze guidance process ends.

[0097] (Example of a glowing notification)

[0098] Next, use Figure 7 as well as Figure 8 Let's illustrate an example of luminous notification achieved through gaze guidance processing.

[0099] Figure 7This is an example of a light-emitting notification performed when the vehicle 12 detects a pedestrian P as an object O that should be reported, while the driver is looking at the center console 94. In this case, the light is emitted starting from the driver's central field of vision, passing through a path that guides the driver's gaze to the left side of the vehicle 12 as they look up, and ending at the position of the pedestrian P relative to the driver's viewpoint. Specifically, the light flows in the following manner: starting from the console light 46L, moving forward towards the front of the vehicle, passing through the left side of the central instrument panel 91 of the lower central light 44, then moving from the center of the upper central light 41 to the left, ending at the position of the pedestrian P.

[0100] Figure 8 This is an example of a light-emitting notification performed when vehicle 12 detects a sign S on the right side as an object O that should be reported while observing the left side of the road. In this case, the light is emitted starting from the driver's central field of vision, which is currently observing the left side of vehicle 12, traversing a path that causes the driver to turn their head to the right, and ending at the position of sign S relative to the driver's viewpoint. Specifically, the light flows in such a way that it starts from the left end of the central upper lamp 41, moves to the right, and then shifts to the pole lamp 42R, ending near the position of sign S above the pole lamp 42R.

[0101] (Summary of implementation methods)

[0102] In this embodiment, the lamp ECU 22 is configured to trigger the simultaneous illumination of multiple light-emitting units 40 when information related to an object O in the vicinity of the vehicle 12 is acquired. Therefore, compared to the case where only multiple light-emitting units 40 are illuminated, the recognition effect for the driver is higher. In other words, according to this embodiment, the recognition effect can be improved.

[0103] In particular, in this embodiment, when the lamp ECU22 causes the multiple light-emitting units 40 to emit light in a coordinated manner, the control is performed by continuously moving the light between the light-emitting units 40. Therefore, according to this embodiment, the driver's line of sight in the vehicle 12 can be guided.

[0104] Furthermore, according to this embodiment, the driver's gaze can be guided towards the object O by moving the light emitted by the plurality of light-emitting units 40 toward the object O. Additionally, the lamp ECU 22 can be controlled to move the light emitted by the plurality of light-emitting units 40 from the position of the object O. In this case, guidance can be implemented to remove the driver's gaze from the object O.

[0105] Furthermore, in this embodiment, the lamp ECU 22, upon acquiring information related to the driver's central field of vision of the vehicle 12, implements control to include the starting point of the light emission from the light-emitting unit 40 within the central field of vision. Therefore, according to this light emission control device, the flow of light from the starting point of emission is included within the driver's central field of vision. Thus, according to this embodiment, it is possible to guide the driver's gaze based on the light emission, thereby further improving the recognition effect. In particular, the lamp ECU 22 of this embodiment determines the path of light emission from the multiple light-emitting units 40 in such a way that the starting point of the light emission from the light-emitting unit 40 is included within the driver's central field of vision. Therefore, according to this embodiment, it is possible to increase the variety of ways to guide the driver's gaze.

[0106] Furthermore, the lamp ECU22 can also be controlled to include the endpoint of the light emission within the central field of vision. This guides the driver to direct their gaze towards the endpoint and assists them in turning their face towards the object O. Additionally, it can be controlled to include both the starting and ending points of the light emission within the central field of vision. In this case, the effects of including both the starting and ending points within the central field of vision can be achieved.

[0107] Furthermore, in the lamp ECU22 of this embodiment, the mode of illumination can be changed based on the relationship between the starting and ending points of the illumination and the range of the central field of vision. For example, the illumination can be made to flash at a high frequency when the starting point of the illumination is close to the end of the central field of vision, thereby making the driver notice the illumination. In addition, in this embodiment, for example, the illumination can be reduced as the ending point of the illumination approaches the center of the central field of vision, thereby making the illumination disappear naturally at the end of the line of sight guidance.

[0108] [Second Implementation]

[0109] The information notification system 10 of the second embodiment is configured to modify the propagation path and light pattern of the light-emitting unit 40 according to the environment inside and outside the vehicle 12. The differences from the first embodiment will be explained below.

[0110] like Figure 9 As shown, the information notification system 10 of this embodiment is configured to include, in addition to the external identification sensor 30 and the occupant monitoring sensor 32, a field-of-view identification sensor 34 as a detection unit.

[0111] The field-of-view recognition sensor 34 includes an infrared camera that captures images of the exterior and interior of the vehicle 12. The field-of-view recognition sensor 34 detects, for example, images of the environment outside and inside the vehicle 12, pedestrians, and other vehicles.

[0112] In addition, such as Figure 10 As shown, in the integrated ECU21 of this embodiment, the CPU20A functions as a collection unit 200, an object detection unit 210, a field of view inference unit 220, an environment judgment unit 230, and a supply unit 240 by executing the processing program 100.

[0113] The environment determination unit 230 has the function of determining the environment outside and inside the vehicle 12 based on images captured by the external identification sensor 30, the occupant monitoring sensor 32, and the field-of-view recognition sensor 34 collected by the collection unit 200. Specifically, the environment determination unit 230 determines the environment outside the vehicle 12 that enters the driver's field of view based on images captured by the external identification sensor 30 and the field-of-view recognition sensor 34. Furthermore, the environment determination unit 230 determines the environment inside the vehicle 12 that enters the driver's field of view based on images captured by the occupant monitoring sensor 32 and the field-of-view recognition sensor 34. Here, "environment" in this embodiment refers to the surrounding visual perception from the viewpoint of the occupant (especially the driver) of the vehicle 12, including illuminance, hue, contrast, and brightness. The providing unit 240 provides the lighting ECU 22 with environmental information, which is determined by the environmental judgment unit 230 as the external environment entering the driver's field of vision and the internal environment entering the driver's field of vision.

[0114] like Figure 11 As shown, in the lamp ECU22 of this embodiment, the CPU20A functions as an object acquisition unit 250, a field of view acquisition unit 260, an environment acquisition unit 270, a decision unit 280, and a control unit 290 by executing the control program 150.

[0115] The environmental acquisition unit 270 has the function of acquiring environmental information outside the vehicle and inside the vehicle from the integrated ECU 21.

[0116] The decision unit 280 of this embodiment has the function of determining the starting point and ending point of the light emission from the light-emitting unit 40, the path of the light emission propagation, and the light emission mode. In addition, the decision unit 280 has the function of correcting the path of the light emission propagation based on the environmental information outside and inside the vehicle acquired by the environmental acquisition unit 270.

[0117] (Control process)

[0118] Next, use Figure 12The flowchart below will be used to explain the line-of-sight guidance process performed using the lamp ECU 22 of this embodiment. The processing in the lamp ECU 22 is performed by the CPU 20A of the lamp ECU 22, which functions as the object acquisition unit 250, the field of view acquisition unit 260, the environment acquisition unit 270, the decision unit 280, and the control unit 290.

[0119] Figure 12 The processing of steps S200 to S205 is the same as the processing of steps S100 to S105 of the line-of-sight guidance processing in the first embodiment.

[0120] In step S206, CPU20A obtains environmental information from the integrated ECU21 regarding the environment outside and inside the vehicle.

[0121] In step S207, CPU20A corrects the propagation path of the light emitted by the light-emitting unit 40 based on environmental information outside and inside the vehicle.

[0122] The processing of steps S208 to S209 is the same as the processing of steps S106 to S107 of the gaze guidance processing in the first embodiment. The CPU 20A ends at step S209, thereby ending the gaze guidance processing.

[0123] (Example of a glowing notification)

[0124] use Figure 13 An example of a light-emitting notification implemented through the gaze guidance process of this embodiment will be described. For example, compared with the one illustrated in the first embodiment... Figure 7 Similarly, it is set that when the driver looks at the center console 94, a light-emitting notification is executed if the vehicle 12 detects a pedestrian P as an object O that should be reported. Then, if the environment inside the vehicle indicates that there is significant backlighting from the windshield 96, the path of the light emitted by the light-emitting unit 40 is corrected from a path closer to the windshield 96 to a path farther from the windshield 96.

[0125] Therefore, as Figure 13 As shown, the light flows in the following manner: starting from the control light 46L, it moves towards the front of the vehicle, and then through the turn signal 47R to make the position of pedestrian P in the turn signal 47C the endpoint.

[0126] (Summary of implementation methods)

[0127] In this embodiment, the lamp ECU 22 controls the illumination of the light-emitting unit 40 based on environmental information inside and outside the vehicle 12 obtained from the integrated ECU 21. As described above, environmental information refers to information representing the visual perception of the surroundings from the viewpoint of the occupants of the vehicle 12. In other words, according to this embodiment, since the illumination is controlled based on the visual perception of the surroundings from the viewpoint of the occupants, the visual confirmation effect in environments where it is difficult to observe the surroundings can be improved.

[0128] In particular, according to this embodiment, since the light emission is controlled based on at least one of contrast and brightness from the driver's point of view, a visual confirmation effect can be provided even in backlit or overly bright environments.

[0129] [Third Implementation Method]

[0130] The information notification system 10 of the third embodiment is configured to utilize, in addition to the light emitted by the light-emitting unit 40, the display in the display unit 50, the sound output from the speaker 60, and the tactile sensation generated by the tactile system device 70 when guiding the view. Hereinafter, the differences from the second embodiment will be explained.

[0131] like Figure 14 As shown, the information notification system 10 of this embodiment, in addition to having the structure of the second embodiment, also includes a display system ECU 23, an audio system ECU 24, and a tactile system ECU 25 as ECU 20, and includes a display unit 50, a speaker 60, and a tactile system device 70. The light-emitting device 14 of this embodiment is configured to include a lamp ECU 22, a light-emitting unit 40, a display system ECU 23 as a display control device, and a display unit 50. Although not shown in the figures, the display system ECU 23 includes a CPU as another processor and a ROM as another memory.

[0132] like Figure 2 As shown, the display unit 50 includes an instrument display 52 located on the front of the steering wheel 95, a head-up display 54 located on the windshield 96, and a central display 56 located on the central instrument panel 91.

[0133] The speakers 60 are located on the left and right sides of the vehicle 12, on the trim piece 92A of the front pillar 92, and on the door trim panel 93A of the front door 93.

[0134] The tactile system device 70 is a device that applies vibrations to the driver's fingers and is disposed, for example, on the steering wheel 95.

[0135] (Example of a glowing notification)

[0136] Next, an example of a light-emitting notification implemented through the gaze guidance process of this embodiment will be described.

[0137] Figure 15 For, as illustrated in the first embodiment Figure 7 Similarly, this is an example of a light-emitting notification performed when the vehicle 12 detects pedestrian P as an object O that should be reported when the driver looks at the center console 94. In this embodiment, in addition to the light-emitting unit 40, the light-emitting notification also uses a display (in other words, light emission) implemented by an image in the display unit 50. Specifically, the light flows in such a way that, through the coordinated operation of the display system ECU 23 and the lamp ECU 22, it starts from the console lamp 46L and moves towards the front of the vehicle, passing through the central display 56 from the center of the central upper lamp 41 to the left, and ends at the position overlapping with pedestrian P in the head-up display 54.

[0138] When only the light-emitting unit 40 is used for illumination, the path of light transmission is determined by the layout of the interior decoration and the arrangement of the light-emitting units 40 on the left and right sides of that layout. In contrast, according to this embodiment, by utilizing the image displayed by the display unit 50 in addition to the light-emitting unit 40, illumination can be implemented through a path that complements the path of light transmission of the light-emitting unit, thus achieving a path that results in a natural appearance. Furthermore, according to this embodiment, by flexibly utilizing the head-up display 54, illumination can be performed at a position closer to the object O seen from the windshield 96.

[0139] Furthermore, when using the speaker 60 to notify the driver of an object O, it can be used in conjunction with the light emitted by the light-emitting unit 40. For example, in the first embodiment, an example is taken where the left-side indicator ECU 22, which observes the driving path, detects the right-side marker S as an object O that should be reported. In this case, as... Figure 8 As shown, by simultaneously emitting light from left to right and outputting sound in sequence from the left speaker 60 to the right speaker 60, it is possible to assist in guiding the line of sight.

[0140] Furthermore, when the driver is notified of an object O that should be reported using the tactile system device 70, it can be used in conjunction with the light emitted by the light-emitting unit 40. For example, in Figure 8 In one example, by applying vibrations in the tactile system device 70 of the steering wheel 95 in sequence from left to right while emitting light from left to right, it is possible to assist in guiding the line of sight.

[0141] [Remark]

[0142] Although the lamp ECU 22 is configured as a light-emitting control device in the information notification system 10 of the various embodiments described above, it is not limited to this, and the integrated ECU 21 can also be configured as a light-emitting control device. In this case, when the same function as in the second embodiment is achieved, the integrated ECU 21, in addition to the collection unit 200, object detection unit 210, field of view inference unit 220, environment judgment unit 230, and providing unit 240, also includes an object acquisition unit 250, a field of view acquisition unit 260, an environment acquisition unit 270, a decision unit 280, and a control unit 290.

[0143] Furthermore, although the information notification system 10 in each embodiment achieves illumination notification through the integrated ECU 21 and lamp ECU 22, it is not limited to this and illumination notification can also be achieved through three or more ECUs 20. In this case, when the same function as in the second embodiment is achieved, the collection unit 200, object detection unit 210, field of view inference unit 220, environment judgment unit 230, providing unit 240, object acquisition unit 250, field of view acquisition unit 260, environment acquisition unit 270, decision unit 280, and control unit 290 are distributed among multiple ECUs 20.

[0144] Although the information notification system 10 in the various embodiments described above is applied to guide the driver's line of sight in the vehicle 12, it is not limited thereto and can also be applied to guide the line of sight of passengers other than the driver.

[0145] Furthermore, in the above embodiments, various processes executed by the software (program) read by the CPU20A can also be executed by various processors other than the CPU. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices) whose circuit structure can be changed after manufacturing, and ASICs (Application Specific Integrated Circuits), which are dedicated circuits with circuit structures specifically designed for executing specific processes. Moreover, the various processes described above can be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, and a combination of a CPU and an FPGA). Furthermore, the hardware structure of these various processors is more specifically a circuit composed of circuit elements such as semiconductor elements.

[0146] Furthermore, in the above embodiments, the method of pre-storing (installing) each program in a computer-readable, non-transitory storage medium has been described. For example, the processing program 100 in the integrated ECU 21 is pre-stored in the ROM 20B of the integrated ECU 21, and the control program 150 in the lamp ECU 22 is pre-stored in the ROM 20B of the lamp ECU 22. However, this is not a limitation; each program may also be provided in the form of being pre-stored in a non-transitory storage medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), or USB (Universal Serial Bus) memory. Additionally, the program may also be configured to be downloaded from an external device via a network.

[0147] The processing flow described in the above embodiments is an example. Unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the main idea.

Claims

1. A light-emitting control device, comprising: The object acquisition unit acquires information related to the position of objects around the vehicle relative to the occupants of the vehicle. The control unit controls the light emission of multiple light-emitting units installed inside the vehicle in a manner that, in the presence of the object, causes the light emission of the light-emitting units to move continuously and in linkage between the light-emitting units. The environmental acquisition unit acquires environmental information from at least one of the interior and exterior of the vehicle. The control unit controls the light emission of the light-emitting unit based on at least one of the vehicle interior contrast and brightness, which are environmental information. The control unit controls the light emission of the light-emitting part by adjusting the path of the light emission propagation from a path closer to the windshield to a path farther from the windshield, based on at least one of the contrast ratio and the brightness.

2. A light-emitting device, comprising: The light-emitting control device according to claim 1; Multiple light-emitting parts.

3. A vehicle, comprising: The light-emitting device according to claim 2; The detection department performs detection on the object.

4. A method for controlling light emission, wherein, The following processing is performed by the processor, namely, Obtain information about the position of objects around the vehicle relative to the vehicle's occupants. In the presence of the object, the illumination of multiple light-emitting units installed inside the vehicle is controlled in a manner that links the continuous movement of the light-emitting units. Obtain environmental information from at least one of the vehicle's interior and exterior. The light emission of the light-emitting unit is controlled based on at least one of the contrast and brightness inside the vehicle, which are environmental information. The light emission of the light-emitting part is controlled in such a way that the path of the light emission propagating from the light-emitting part is modified from a path closer to the windshield to a path farther from the windshield, based on at least one of the contrast ratio and the brightness.

5. A non-transitory storage medium storing a light-emitting control program for causing a processor to perform the following processing, namely, Obtain information about the position of objects around the vehicle relative to the vehicle's occupants. In the presence of the object, the illumination of multiple light-emitting units installed inside the vehicle is controlled in a manner that links the continuous movement of the light-emitting units. Obtain environmental information from at least one of the vehicle's interior and exterior. The light emission of the light-emitting unit is controlled based on at least one of the contrast and brightness inside the vehicle, which are environmental information. The light emission of the light-emitting part is controlled in such a way that the path of the light emission propagating from the light-emitting part is modified from a path closer to the windshield to a path farther from the windshield, based on at least one of the contrast ratio and the brightness.

Images