Method for operating a motor vehicle lighting device and motor vehicle lighting device
The method optimizes automotive lighting by using a control unit with machine learning to adapt light patterns based on real-time environmental data, addressing the challenge of situational complexity in digital lighting devices.
Patent Information
- Application Number
- JP2023504065
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-07-20
- Filing Date
- 2021-07-19
- Publication Date
- 2025-07-16
- Estimated Expiration
- 2041-07-19
AI Technical Summary
Existing digital automotive lighting devices struggle to customize light patterns effectively, often failing to consider various environmental and situational factors, including reflections and refractions caused by climatic conditions and other vehicles or objects.
A method involving a matrix arrangement of solid-state light sources, utilizing a control unit trained with machine learning algorithms to convert image data into luminance maps and calculate adaptive light patterns, optimizing light projection based on real-time environmental conditions.
The method provides adaptive light patterns that enhance visual comfort and safety by quickly adjusting to environmental changes, ensuring optimal illumination patterns despite varying conditions.
Smart Images

Figure 0007709515000001 
Figure 0007709515000002 
Figure 0007709515000003
Abstract
Description
Technical Field
[0001] This invention relates to the field of automotive lighting devices, and more specifically, to the management of the light patterns provided by these devices.
Summary of the Invention
[0002] Digital lighting devices are increasingly being adopted by automotive manufacturers for mid-market and high-market products.
[0003] These digital lighting devices typically include solid-state light sources, and the operation of the individual light sources can be customized.
[0004] However, sometimes it is not easy to indicate which parameters are involved in customizing the light pattern. Sometimes it is difficult to consider all situations when illuminating the road in front of the vehicle.
[0005] The invention provides an alternative solution for providing an optimal light pattern for an automotive lighting device by a method for operating the automotive lighting device according to the invention. Preferred embodiments of the invention are defined in the dependent claims.
[0006] Unless otherwise defined, all terms (including technical and scientific terms) used herein are to be construed as having the meaning commonly used in the relevant technical field. Further, common terms are to be construed as having the meaning commonly used in the relevant technical field unless explicitly defined otherwise herein, and it is understood that they are not to be construed in an idealized or overly formal sense.
[0007] In this text, the terms "comprising" and its derivatives (such as "comprises") are not to be understood in an exclusive sense, that is, these terms are not to be construed as excluding the possibility that what is described and defined may include further elements, steps, etc.
[0008] In a first aspect of the invention, the invention provides a method for operating a motor vehicle lighting device comprising a matrix arrangement of light pixels, the method comprising: - obtaining image data of a working zone in front of the motor vehicle lighting device; - converting the image data into a luminance map; - providing a desired light pattern; - calculating an adapted light pattern that provides the desired light pattern when projected onto the luminance map; - projecting the adapted light pattern.
[0009] The term "solid state" refers to light emitted by solid state electroluminescence, which converts electricity into light using semiconductors. Compared to incandescent lighting, solid state lighting produces visible light with reduced heat generation and less energy dissipation. The typically small mass of solid state lighting devices results in greater resistance to shock and vibration compared to fragile glass tubes / light bulbs and elongated filament wires. They also eliminate filament evaporation and potentially increase the lifespan of the lighting device. Some examples of these types of lighting include semiconductor light emitting diodes (LEDs), organic light emitting diodes (OLED), or polymer light emitting diodes (PLED) as the light source, rather than an electric filament, plasma, or gas.
[0010] The method aims to find the optimal light pattern to be projected by the lighting device, taking into account any situation that can be captured by an image. For this purpose, information is obtained directly without any presumption of the surrounding situation. By this method, not only the light projected by other vehicles or objects is considered, but also the specific influence of various climatic issues that can cause the light to be reflected or refracted, thereby providing a completely unique luminance map.
[0011] In some specific embodiments, the steps of the method are executed periodically with a period shorter than 2 seconds, particularly shorter than 0.5 seconds.
[0012] This feature involves quickly adapting to changes in the environmental conditions of the vehicle.
[0013] In some specific embodiments, the step of converting the image data into a luminance map is executed by a control unit, and the control unit is - training the control unit to provide a luminance map with a training data set of the image data, and - testing the control unit by comparing the luminance map provided by the control unit with the measured luminance map, is preconfigured to convert the image data into a luminance map.
[0014] This method of training the control unit is useful because it gives the control unit the ability to provide a luminance map in an improved way.
[0015] In some specific embodiments, the step of calculating the adaptive light pattern is executed by a control unit, and the control unit is - training the control unit to calculate an adaptive light pattern according to a training data set of the desired light pattern and the luminance map, and - testing the control unit by comparing the calculated adaptive light pattern with the measured light pattern, is preconfigured to calculate the adaptive light pattern.
[0016] This method of training the control unit is useful because it gives the control unit the ability to calculate the adaptive light pattern in an improved way.
[0017] In some specific embodiments, the step of training the control unit includes the use of a machine learning algorithm.
[0018] This machine learning algorithm may be used both in the conversion of image data to a luminance map and / or in the calculation of an adaptive light pattern. Each of the two options follows its own machine learning algorithm. When the corresponding result is authenticated, the value of the control unit is used in the corresponding step of the inventive method.
[0019] In some specific embodiments, the luminance map separates the position of the road from the positions of other objects in the working zone.
[0020] This is very important for determining the desired light pattern, because the desired light pattern depends on the size and position of the road.
[0021] In some specific embodiments, the image data includes RGB pixels.
[0022] This is a common and simple way to acquire and manage image data captured by a camera.
[0023] In some specific embodiments, the image data is acquired by an infrared camera.
[0024] Data acquired by an infrared camera is sometimes useful in low visibility conditions.
[0025] In a further aspect of the invention, the invention provides a data processing element including means for performing the steps of the method according to the first aspect of the invention, and a computer program including instructions for causing the control unit to perform the steps of the method according to the first aspect of the invention when the program is executed by the control unit.
[0026] In a further aspect of the invention, the invention is - A matrix configuration of solid-state light sources, and - A camera configured to acquire image data, and - A control unit for executing the steps of the method according to the first aspect of the invention, and To provide an automotive lighting device comprising.
[0027] This lighting device provides the advantageous function of adapting the light pattern to the conditions transmitted by the data acquired by the camera, whereby the new light pattern provided by the control unit improves visual comfort and safety.
[0028] In some specific embodiments, the matrix configuration includes at least 2000 solid-state light sources.
[0029] The matrix configuration is a typical example for this method. The rows can be grouped in the range of the projection distance, and each column of each group represents an angular interval. This angular value depends on the resolution of the matrix configuration, which is typically included in the range of 0.01° per column to 0.5° per column. As a result, many light sources can be managed simultaneously.
Brief Description of the Drawings
[0030] To complete the description and provide a better understanding of the invention, a set of multiple drawings is provided. The said drawings form an essential part of the specification, showing embodiments of the invention, which should not be construed as limiting the scope of the invention, but should be construed merely as examples of how the invention can be implemented. The said drawings include the following figures:
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
DETAILED DESCRIPTION OF THE INVENTION
[0031] In these figures, the following reference numerals are used: 1 Headlamp 2 LED 3 Control unit 4 Camera 5 Adapted optical pattern 100 Automobile vehicle Exemplary embodiments are described in sufficient detail to enable those skilled in the art to embody and implement the systems and processes described herein. It is important to understand that the embodiments can be provided in many alternative forms and should not be construed as limited to the examples described herein.
[0032] Accordingly, the embodiments can be modified in various ways and can take various alternative forms, while a particular embodiment is shown by way of example in the drawings and described in detail below. There is no intention to limit to the particular forms disclosed. On the contrary, all modifications, equivalents, and alternatives within the scope of the appended claims should be included.
[0033] Figure 1 shows an overall perspective view of an automotive lighting device according to the invention.
[0034] This headlamp 1 is mounted on an automobile vehicle 100 and - a matrix configuration of LEDs 2 intended to provide an optical pattern, - a control unit 3 for controlling the operation of the LEDs 2, and - a camera 4 intended to provide some external data, is provided with.
[0035] This matrix configuration is a high-resolution module with a resolution exceeding 2000 pixels. However, there are no restrictions on the technology used to manufacture the projection module.
[0036] The control unit undergoes two training processes before its installation in an automotive headlamp.
[0037] Both training processes include several machine learning steps, and the control unit is trained with training data provided by multiple sensors.
[0038] The first training process relates to the conversion of image data into a luminance map. This first training process - trains the control unit to provide a luminance map with a training data set of image data, and - tests the control unit by comparing the luminance map provided by the control unit with the measured luminance map. is included.
[0039] Various image data are provided, and corresponding luminance maps are created by the aforementioned algorithm.
[0040] The second training process relates to the calculation of an adaptive light pattern. This second training process - trains the control unit to calculate an adaptive light pattern according to a training data set of a desired light pattern and a luminance map, and - tests the control unit by comparing the calculated adaptive light pattern with the measured light pattern. is included.
[0041] In this case, various luminance maps are provided together with various desired light patterns.
[0042] The control unit is trained to create an optimal light pattern that realizes the final desired light pattern in a specific light situation.
[0043] When both training processes are completed, the control unit is mounted on the motor vehicle 100 of FIG. 1, and the light emission control of the headlamp 1 is performed.
[0044] FIG. 2 shows an example of a block diagram of the operation of this lighting device: A preliminary light pattern is provided by the lighting device according to the lighting function selected by the vehicle user. If there is no more light in the vehicle (in the case of a completely dark scenario), the adapted light pattern will coincide with this preliminary pattern. The invention aims to find which adapted light pattern, when combined with the existing emission map, provides the desired light pattern corresponding to the map that would be created by the preliminary light pattern in the case of a completely dark scenario.
[0045] The control unit of the lighting device receives RGB image data acquired by the camera every 0.2 seconds. From this image, objects are classified, and the features of the road and the remaining objects present in the image are extracted. Then, these data are converted into a luminance map by the control unit. The control unit compares the luminance map with the desired light pattern and combines it with the luminance map estimated in the previous step to create an adapted light pattern that provides the desired light pattern to the user.
[0046] The headlamp projects the adapted light pattern, and the adapted light pattern provides sufficient brightness with minimal power consumption.
[0047] This process is repeated every 0.2 seconds.
[0048] Figure 3 shows an example of an image acquired by a camera. This image is used to create a luminance map, and several details are particularly relevant in this luminance map. The first detail is the luminous intensity of the lights of the preceding vehicle, which affects the driver's visual comfort. The second detail is the brightness on the road due to the reflection of the light emitted by streetlights on the wet pavement. These details are considered by the control unit when creating a compliant light pattern projected by the lighting device.
[0049] Figure 4 shows a first image of an example of the method according to the invention. This is a first explanatory image of the luminance map obtained by the control unit. In this luminance map, the light projected by the vehicle and by the street is shown in this figure. The motor vehicle 100 of the invention projects a preliminary light pattern, but this preliminary light pattern interferes with the light patterns provided by other objects.
[0050] Figure 5 shows the vehicle 100 of the invention with the light pattern 5 adapted by the method according to the invention in order to realize the desired light pattern taking into account the luminance map calculated in Figure 4.
Claims
1. A method for operating a motor vehicle lighting device (1) having a matrix arrangement of optical pixels (2), comprising: - obtaining image data of a working zone in front of the motor vehicle lighting device; - converting the image data into a luminance map; - providing a desired light pattern; - calculating an adapted light pattern that adapts the desired light pattern to the luminance map so as to realize the desired light pattern in consideration of the luminance map; - projecting the adapted light pattern (5); wherein the step of converting the image data into a luminance map is performed by a control unit, and the control unit is preconfigured, in a first training process of the control unit, - training the control unit (3) to provide a training data set of image data as a luminance map; - comparing the luminance map provided by the control unit with a measured luminance map; to convert the image data into a luminance map; the step of calculating the adapted light pattern is performed by a control unit, and the control unit is preconfigured, in a second training process of the control unit, - training the control unit (3) to calculate an adapted light pattern according to a training data set of a desired light pattern and a luminance map; - comparing the calculated adapted light pattern with a measured light pattern; to calculate the adapted light pattern.
2. The method according to claim 1, wherein the steps of the method are performed periodically with a period shorter than 2 seconds.
3. The method according to claim 1 or 2, wherein the step of training the control unit includes the use of a machine learning algorithm.
4. The method according to any one of claims 1 to 3, wherein the step of training the control unit includes the use of a machine learning algorithm.
5. The method according to any one of claims 1 to 4, wherein the luminance map separates the position of the road from the positions of other objects in the working zone.
6. The method according to any one of claims 1 to 5, wherein the image data includes RGB pixels.
7. The method according to any one of claims 1 to 6, wherein the image data is acquired by an infrared camera.
8. A data processing device including means for performing the steps of the method according to any one of claims 1 to 7.
9. A computer program including instructions for causing a control unit to perform the steps of the method according to any one of claims 1 to 7 when the program is executed by the control unit.
10. - A matrix configuration of solid-state light sources (2), - A camera (4) configured to acquire image data, - A control unit (3) for performing the steps of the method according to any one of claims 1 to 7, An automotive lighting device comprising.
11. The automotive lighting device (1) according to claim 10, wherein the matrix configuration includes at least 2000 solid-state light sources (2).
Citation Information
Patent Citations
Vehicle lamp fitting system, vehicle lamp fitting control device, and vehicle lamp fitting control method
WO2019003887A1