In-vehicle lighting system

Abstract

To provide an in-vehicle lighting system which achieves in-vehicle lighting having higher adaptability to a transition of a landscape outside a vehicle.SOLUTION: An in-vehicle lighting system includes: a camera 11 for capturing a front space of a vehicle; light sources 14L, 14R which are arranged to be adjacent to windshield of the vehicle inside the vehicle and are configured so that a color of irradiation light can be controlled for each portion; and a controller 10 which is connected to the camera 11 and each of the light sources 14L, 14R and controls operations of the light sources 14L, 14R. The controller 10 extracts changes in color in a first direction of an image captured by the camera 11 on the basis of the image, sets a color of irradiation light for each portion of the light sources on the basis of the changes in color, and operates the light sources 14L, 14R.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an in-vehicle lighting device.

Background Art

[0002] In Japanese Patent No. 6389818 (Patent Document 1), when causing lighting units provided at a plurality of locations inside the vehicle to emit light, a color with a high occupancy rate is discriminated in an image obtained by photographing an external image of the vehicle, a theme is selected based on the color with the high occupancy rate, and the lighting units are caused to emit light simultaneously in different colors of the same series related to the theme. An in-vehicle lighting device is described. In this in-vehicle lighting device, for example, when driving under a cherry tree-lined avenue, control is performed such that the first lighting unit is lit in light pink and the second lighting unit is lit in dark pink.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] One of the objects of the specific aspect according to the present disclosure is to realize in-vehicle lighting with a higher degree of adaptability to the changing of the external scenery.

Means for Solving the Problems

[0005] An in-vehicle lighting device according to one aspect of the present disclosure includes a camera that photographs a front space of the vehicle, a light source that is disposed adjacent to a windshield of the vehicle inside the vehicle and is configured to be able to control the color of irradiation light for each part, a controller that is connected to each of the camera and the light source and controls the operation of the light source, and The controller extracts the change in color in the first direction of the image based on the image captured by the camera, and sets the color of the irradiation light for each part of the light source based on the change in color to operate the light source. It is an in-vehicle lighting device.

[0006] According to the above configuration, it is possible to realize in-vehicle lighting with a higher degree of adaptation to the changing scenery outside the vehicle.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0008] FIG. 1(A) is a diagram showing the configuration of an in-vehicle lighting device according to an embodiment. The in-vehicle lighting device includes a controller 10, a camera 11, an image processing unit 12, and light sources 14L (14R). The controller 10 and the image processing unit 12 are interconnected via a communication network of a vehicle control ECU (Electrical Control Unit) 70 that is pre-equipped in the vehicle, for example. The in-vehicle lighting device according to the present embodiment provides illumination light to the interior of the vehicle by controlling the light emitted from the light sources 14L, 14R (see FIG. 2) installed in the vehicle interior by the controller 10. Since the configurations of the light sources 14L and 14R are common, only the light source 14L is shown in FIG. 1(A), and the description of the light source 14R is omitted.

[0009] The controller 10 controls the operation of light irradiation by the light sources 14L, 14R. The controller 10 can be configured using, for example, a computer system as shown in FIG. 1(B), that is, a computer system including a processor (CPU: Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204 such as a flash memory, an input / output interface 205, and the like. The controller 10 according to the present embodiment can exhibit each function described below when a program 206 stored in the storage device 204 in advance is read and executed by the processor.

[0010] The camera 11 captures an image of the space in front of the vehicle (referred to as image data or an image signal, the same applies hereinafter) and outputs the image to the image processing unit 12. The camera 11 is installed, for example, at an appropriate position at the upper part of the windshield in the vehicle interior and captures the scenery outside the vehicle through the windshield. Note that the installation position of the camera 11 is not limited to this, and it may be installed, for example, inside the headlamp of the vehicle.

[0011] The image processing unit 12 performs appropriate image processing (such as brightness adjustment) on the image output from the camera 11. The processed image is transmitted from the image processing unit 12 to the controller 10 via the communication network of the vehicle control ECU 70. Note that the camera 11 and the image processing unit 12 may be integrally configured.

[0012] The light source 14L is connected to the controller 10 and emits light under the control of the controller 10. This light source 14L includes a plurality of lighting units. As an example, the light source 14L of the present embodiment includes eight lighting units, namely, the lighting unit 31, the lighting unit 32, ···, the lighting unit 38. Each lighting unit 31 etc. can individually control the brightness and color of the irradiation light. Each lighting unit 31 etc. is configured to include, for example, one or more light emitting elements (LEDs). Note that the configuration of the light source 14R is the same as that of the light source 14L.

[0013] Each of the light sources 14L and 14R is, for example, configured in a sheet shape and is arranged adjacent to the windshield in the vehicle interior as illustrated in FIG. 2. Specifically, the light source 14L (the first light source) is arranged adjacent to the left side of the windshield when viewed from the vehicle interior with reference to the vehicle traveling direction. And each of the lighting units 31 to 38 of the light source 14L is arranged in order, for example, from the upper side to the lower side in the vehicle interior. Similarly, the light source 14R (the second light source) is arranged adjacent to the right side of the windshield when viewed from the vehicle interior with reference to the vehicle traveling direction. And each of the lighting units 31 to 38 of the light source 14R is arranged in order, for example, from the upper side to the lower side in the vehicle interior.

[0014] The controller 10 includes an image acquisition unit (image acquisition function) 20, an averaging processing unit (averaging processing function) 21, a conversion processing unit (conversion processing function) 22, and a control signal generation unit (control signal generation function) 23 as functions realized by program execution.

[0015] The image acquisition unit 20 acquires an image (an image obtained by the camera 11) transmitted from the image processing unit 12 via the communication network of the vehicle ECU 70.

[0016] The averaging processing unit 21 divides the image acquired by the image acquisition unit 20 into a plurality of regions, and for each of these divided regions, obtains the average value of the colors of the pixels included in the region. The number of divisions at this time is determined according to the number of lighting units included in each of the light sources 14L and 14R. In the present embodiment, since each of the light sources 14L etc. includes 8 lighting units 31 etc., the averaging processing unit 21 divides the image into 8 regions and obtains the average value of the colors in each of them.

[0017] The conversion processing unit 22 converts the average value for each region of the image obtained by the averaging processing unit 21 into an RGB value of a predetermined number of bits (for example, 8 bits). Further, the conversion processing unit 22 adds a value indicating the position of the region in the corresponding image to each of the sets of the converted RGB values.

[0018] Based on the RGB values for each region in the image obtained by the conversion processing unit 22, the control signal generation unit 23 sets the color and luminance of the irradiation light in each of the lighting units 31 to 38 included in each of the light sources 14L and 14R, generates a control signal corresponding to these color and luminance, and outputs the control signal to each of the light sources 14L and 14R.

[0019] FIGS. 3(A) to 3(D) are diagrams for explaining in detail the information processing by the averaging processing unit and the conversion processing unit of the controller. As shown in FIG. 3(A), the averaging processing unit 21 obtains an image to be processed. Specifically, the averaging processing unit 21 generates an image 60L (first image) corresponding to the light source 14L and an image 60R (second image) corresponding to the light source 14R from the image obtained from the camera 11.

[0020] At this time, as schematically shown in FIG. 2, for the image 60L corresponding to the light source 14L, it is preferably cut out from the left region 40L relative to the vehicle traveling direction among the images obtained from the camera 11. Similarly, for the image 60R corresponding to the light source 14R, it is preferably cut out from the right region 40R relative to the vehicle traveling direction among the images obtained from the camera 11. Thereby, the color and luminance of the irradiation light of each of the light sources 14L and 14R can be set in a state closer to the scenery in front of the eyes. Instead of cutting out the images 60L and 60R from the image obtained from the camera 11, the images 60L and 60R may be directly obtained by appropriately switching the shooting range of the camera 11.

[0021] Also, as shown in FIG. 2, each of the regions 40L and 40R is defined as a range excluding the region corresponding to the road 50 in front of the vehicle among the images obtained from the camera 11. By appropriately setting the shooting range of the camera 11, the images 60L and 60R may be shot from the beginning in a range not including the road 50. Thereby, since the color corresponding to the road 50 can be excluded during the averaging process, the color and luminance of the irradiation light of each of the light sources 14L and 14R can be set in a state closer to the scenery in front of the eyes of the occupant (the scenery perceived by the occupant).

[0022] When the image 60L corresponding to the light source 14L and the image 60R corresponding to the light source 14R are obtained in this way, the averaging processing unit 21 divides each of these images 60L and 60R into a plurality of regions. Here, it is divided into eight regions Im0 to Im7 according to the number of lighting units included in each of the light sources 14L and 14R. Each of the regions Im0 to Im7 is divided along the x direction (first direction) corresponding to the vertical direction in front of the vehicle as shown in the figure. Each of the regions Im0 to Im7 contains a plurality of pixel data.

[0023] Here, the entire image 60L is used to obtain each region Im0 to Im7. However, at least a part of the image 60L, specifically, for example, a part on the side closer to the left end in the drawing of the image 60L in the direction orthogonal to the x direction (the left-right direction in the drawing) may be used to obtain each region Im0 to Im7. Similarly, instead of using the entire image 60R to obtain each region Im0 to Im7, at least a part of the image 60R, specifically, a part on the side closer to the right end in the drawing of the image 60R in the direction orthogonal to the x direction (the left-right direction in the drawing) may be used to obtain each region Im0 to Im7.

[0024] Next, the averaging processing unit 21 obtains the average value of the colors of the plurality of pixels included in each region for each of the regions Im0 to Im7. FIG. 3(C) schematically shows the color based on the obtained average value. When the average value of the color of each region Im0 to Im7 is obtained in this way, the conversion processing unit 22 converts the average value of the color of each region Im0 to Im7 into an RGB value. At this time, the conversion processing unit 22 adds numerical values from 0 to 7 as information indicating each region Im0 to Im7 to each RGB value to form a set of data.

[0025] As illustrated in the data structure in FIG. 3(D), the data structure can be in the form of, for example, (x, R, G, B). x is information indicating each region Im1, etc., and R, G, and B are information indicating the intensities of red, green, and blue, respectively. For example, a set of data (0, 150, 255, 254) shown in the drawing is the RGB value corresponding to the region Im0, indicating that the R value is 150, the G value is 255, and the B value is 254. The same applies to other data.

[0026] FIG. 4 is a schematic diagram for explaining the correspondence between the data for each area and the lighting units of each light source. As shown in the figure, the value of x (0 to 7) included in each data is used as information for specifying the lighting units 31 to 38 of each light source 14L (14R). For example, the data (0, 150, 255, 254) shown in the figure is used as data corresponding to the lighting unit 31 specified based on the value of x. The irradiation light of this lighting unit 31 is controlled by the control signal generation unit 23 so as to be a color specified by RGB values 150, 255, and 254. The same applies to the correspondence between other data and the lighting units 32 to 38.

[0027] FIG. 5 is a flowchart showing the operation procedure of the in-vehicle lighting device. Note that, as long as there are no contradictions or inconsistencies in the results of the information processing for each process shown here, the order of these processes can be swapped, and other processes not explicitly shown here can also be added. The series of information processing shown below is executed at regular intervals (for example, every 10 milliseconds).

[0028] The image acquisition unit 20 acquires an image transmitted from the image processing unit 12 via the communication network of the vehicle control ECU 70 (step S11).

[0029] The averaging processing unit 21 generates each of the image 60L corresponding to the light source 14L and the image 60R corresponding to the light source 14R from the image acquired by the image acquisition unit 20 (see FIG. 3(A)), and divides each of these images 60L, 60R according to the number (number of lights) of the lighting units 31 to 38 of each light source 14L, etc. (step S12). As a result, each of the images 60L, 60R is divided into a plurality of regions Im0 to Im7 (see FIG. 3(B)).

[0030] The averaging processing unit 21 obtains the average value of the colors included in each region for each of the plurality of regions Im0 to Im7 obtained by the division (step S13).

[0031] The conversion processing unit 22 converts the average color value into RGB values for each of the regions Im0 to Im7, and generates data with information (x) indicating each region Im1 etc. added thereto (step S14).

[0032] The control signal generation unit 23 uses the data generated by the conversion processing unit 22 to generate a control signal so that the irradiation light of each illumination unit 31 of the light sources 14L and 14R becomes a color specified by RGB values, and outputs it to each of the light sources 14L and 14R. Thereby, emission control of each of the light sources 14L and 14R is performed based on the color specified by the RGB values (step S15). Then, the process returns to step S11.

[0033] According to the above-described embodiment, it is possible to realize in-vehicle lighting with a higher adaptability to the change of the out-of-vehicle scenery. Thereby, since the continuity between the landscape visible through the windshield and the illumination light from each light source is improved, an effect of reducing the sense of confinement in the vehicle felt by the passengers can be obtained.

[0034] Note that the present disclosure is not limited to the content of the above-described embodiment, and various modifications can be made and implemented within the scope of the gist of the present disclosure. For example, in the above-described embodiment, the average color value in each of a plurality of regions is obtained at regular intervals. However, as shown in the conceptual diagram in FIG. 6, a moving average may be obtained for the average color value for each region using images obtained at a plurality of different times as time elapses. In the illustrated example, a case of obtaining a moving average of the average color value for each region from the images obtained at each of times t0, t1, t2 ··· t10 is conceptually shown. By generating a control signal using the color obtained by such a moving average, an effect that the change over time of the color of the irradiation light in the illumination units 31 to 38 of each of the light sources 14L and 14R becomes gentle can be obtained. Therefore, a more comfortable color change can be felt by the passengers.

[0035] In the above-described embodiment, the average value is used as the representative value of the color in each of the plurality of regions. However, the representative value is not limited to this. For example, the most frequent value of the color may be used as the representative value, or the median value of the color may be used as the representative value. Further, for each region, a characteristic color of a symbol that stands out within the region may be extracted, and a color corresponding to this color may be used as the representative value. In this case, for example, the color occupying the largest area may be extracted.

[0036] In the above-described embodiment, an example of each of the light sources 14L and 14R is one having a plurality of light-emitting elements (LEDs). However, the configuration of the light source is not limited to this. For example, a projector-type light source may be used, a light source combining a light guide plate and a light-emitting element may be used, or a light source that irradiates a reflecting surface to perform illumination by indirect light may be used. Also, a light source having a configuration combining a liquid crystal element and a backlight may be used. That is, as long as the color of the irradiation light can be variably controlled, there is no limitation on the configuration of the light source.

[0037] Also, the number of illumination units included in each light source is not limited to 8 in the above-described embodiment. By increasing the number of illumination units, irradiation light can be generated with higher definition. In this case, the change in color in the x-direction based on the image may be extracted at an arbitrary resolution based on the image, and the color of the irradiation light at each light source may be set based on the extracted change in color.

[0038] The present disclosure has the following appended features. (Appended Note 1) A camera that photographs the front space of a vehicle, A light source that is disposed adjacent to the windshield of the vehicle inside the vehicle and is configured to be able to control the color of the irradiation light for each part, A controller that is connected to each of the camera and the light source and controls the operation of the light source, including The controller extracts a change in color in a first direction of the image based on the image photographed by the camera, and sets the color of the irradiation light for each part of the light source based on the change in color to operate the light source. In-vehicle lighting device. (Supplementary Note 2) The controller divides the whole or a part of the image into a plurality of regions along the first direction, obtains a representative value of the color of each region for each of the divided regions, and sets the color of the irradiation light for each part of the light source based on the representative value of the color of each region. The in-vehicle lighting device according to Supplementary Note 1. (Supplementary Note 3) The representative value of the color is the average value, the most frequent value, or the median value of the color for each region. The in-vehicle lighting device according to Supplementary Note 2. (Supplementary Note 4) The light source can individually control the color of the irradiation light and has a plurality of lighting units arranged along one direction. The controller sets the number of the plurality of regions when dividing the image according to the number of the plurality of lighting units. The in-vehicle lighting device according to Supplementary Note 2. (Supplementary Note 5) The first direction corresponds to the vertical direction in the front space of the vehicle. The in-vehicle lighting device according to any one of Supplementary Notes 1 to 4. (Supplementary Note 6) The image is taken in a range that does not include the road existing in the front space of the vehicle. The in-vehicle lighting device according to any one of Supplementary Notes 1 to 5. (Supplementary Note 7) The image is generated from a range excluding the range corresponding to the road existing in the front space of the vehicle after being taken by the camera. The in-vehicle lighting device according to any one of Supplementary Notes 1 to 5. (Supplementary Note 8) The light source has a first light source arranged relatively on the left side of the windshield based on the traveling direction of the vehicle and a second light source arranged relatively on the right side of the windshield based on the traveling direction of the vehicle. The image includes a first image corresponding to the front space on the left side relatively based on the traveling direction of the vehicle and a second image corresponding to the front space on the right side relatively based on the traveling direction of the vehicle. The controller sets the color of the irradiation light for each part of the first light source using the first image, and sets the color of the irradiation light for each part of the second light source using the second image. The in-vehicle lighting device according to any one of Appendices 2 to 7. (Appendix 9) The controller extracts the change in color in the first direction of each of the images captured by the camera at a plurality of different times, obtains the moving average of the change in color, and sets the color of the irradiation light for each part of the light source based on the change in color obtained by the moving average to operate the light source. The in-vehicle lighting device according to any one of Appendices 1 to 8.

Explanation of Signs

[0039] 10: Controller, 11: Camera, 12: Image processing unit, 14L, 14R: Light source, 20: Image data acquisition unit, 21: Averaging processing unit, 22: Conversion processing unit, 23: Control signal generation unit, 31 to 38: Lighting unit, 40L, 40R: Region, 50: Road, 60L, 60R: Image, 70: Vehicle control ECU

Claims

1. A camera that captures an image of the front space of a vehicle, a light source that is arranged adjacent to the windshield of the vehicle inside the vehicle and is configured to be able to control the color of the irradiation light for each part, a controller that is connected to each of the camera and the light source and controls the operation of the light source, comprising: The controller extracts a change in color in a first direction of the image based on the image captured by the camera, and sets the color of the irradiation light for each part of the light source based on the change in color and operates the light source. An in-vehicle lighting device.

2. The controller divides the whole or a part of the image into a plurality of regions along the first direction, obtains a representative value of the color of each of the divided regions, and sets the color of the irradiation light for each part of the light source based on the representative value of the color of each region. The in-vehicle lighting device according to Claim 1.

3. The representative value of the color is an average value, a mode value, or a median value of the color for each region. The in-vehicle lighting device according to Claim 2.

4. The light source is capable of individually controlling the color of the irradiation light and has a plurality of lighting units arranged along one direction. The controller sets the number of the plurality of regions when dividing the image according to the number of the plurality of lighting units. The in-vehicle lighting device according to Claim 2.

5. The first direction corresponds to the vertical direction in the front space of the vehicle. The in-vehicle lighting device according to Claim 1.

6. The image is captured in a range that does not include a road existing in the front space of the vehicle. The in-vehicle lighting device according to Claim 1.

7. After the image is captured by the camera, the image is generated from a range excluding a range corresponding to a road existing in the front space of the vehicle. The in-vehicle lighting device according to Claim 1.

8. The light source has a first light source arranged relatively on the left side of the windshield with respect to the traveling direction of the vehicle and a second light source arranged relatively on the right side of the windshield with respect to the traveling direction of the vehicle. The image includes a first image corresponding to the front space on the left side relatively with respect to the traveling direction of the vehicle and a second image corresponding to the front space on the right side relatively with respect to the traveling direction of the vehicle. The controller sets the color of the irradiation light for each part of the first light source using the first image, and sets the color of the irradiation light for each part of the second light source using the second image. The in-vehicle lighting device according to Claim 2.

9. The controller extracts the color change in the first direction of each of the images captured by the camera at a plurality of different times, obtains a moving average of the color change, and sets the color of the irradiation light for each part of the light source based on the color change obtained by the moving average to operate the light source. The in-vehicle lighting device according to claim 1.

Images