Component for a vehicle, lighting unit, vehicle and vehicle comprising a component
By integrating the spatial modulator, light source and camera of light in the vehicle lamps, dynamically adjusting the light emitted by the light source to adapt to the surrounding environment, the problem of insufficient visibility of existing vehicle lamps in bad weather is solved, and the contrast and edge enhancement is achieved, and the driver's visibility is improved.
Patent Information
- Application Number
- CN202080086004.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-12-13
- Filing Date
- 2020-11-23
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2040-11-23
AI Technical Summary
It is difficult for existing transportation lamps to effectively improve driver visibility under natural phenomena such as fog and rain. Although adjusting the color of the lamp has a certain improvement effect, it is easy to cause dazzling eyes.
A device is adopted that includes a spatial modulator, light source and camera of light, captures light images of surrounding areas through the camera, and controls the light source and modulator using an image processing algorithm, dynamically adjusts the emitted light to adapt to the surrounding environment, and forms overlapping images to enhance contrast and edges.
By dynamically adjusting the light emitted by the light source, the visibility of the vehicle driver can be effectively improved, especially in severe weather conditions such as fog and rain, which significantly improves the visibility of the surrounding environment without increasing the brightness of the lamp or introducing additional display equipment.
Smart Images

Figure CN114787881B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a light-emitting device for a vehicle. In addition, the present invention relates to a lamp for a vehicle. A vehicle having such a device is also provided. In addition, the present invention relates to a method for using the device. Background Art
[0002] Vehicles with vehicle lighting in the form of headlights are well known in the prior art. During the day or at night, the visibility of the driver of the vehicle may be impaired, for example due to fog, rain or other natural phenomena. In such cases, it is conceivable to increase the brightness of the headlights. However, it has been shown that this does not substantially lead to an improvement in visibility. In addition, legal regulations must be observed, which is why only certain maximum brightnesses of headlights are permitted. It is also known to adjust the light color and, for example, use yellow lights or use fog lights. This leads to improvements in terms of blinding the driver and other people.
[0003] A vehicle with a vehicle window is known from DE 10 2017 219 092 A1. A camera in the vehicle can record a light image via the vehicle window. The part of the vehicle window that is located in the field of view of the camera can be electrically controlled. In this way, optical properties of this part that influence the light transmission can be set. Summary of the invention
[0004] In contrast, the present invention is based on the object of creating a device for a vehicle, a lamp, a vehicle and a method in a cost-effective and simple manner, by means of which visibility, in particular for the vehicle driver, can be improved.
[0005] This object is achieved in terms of the device according to the features of the present application, in terms of the lamp according to the features of the present application, in terms of the vehicle according to the features of the present application, and in terms of the method according to the features of the present application.
[0006] Particularly advantageous configurations can be found in the dependent claims.
[0007] According to the invention, a device, in particular for a vehicle or for a vehicle lamp, is provided, which has a spatial modulator for light. In addition, the device advantageously has a light source, by means of which light can be emitted to, in particular guided to, an optical channel of the device via a modulator. The light that can be emitted by the light source can therefore be guided or deflected to the light output end in a targeted manner via the modulator. The light from the light source can be influenced and / or controlled via the modulator. In addition, the device advantageously has a camera, by means of which a light image or a camera image or light of an area surrounding the device can be captured via the optical channel and via the modulator. In particular, the modulator can guide or deflect the light image entering via the optical channel to the camera, or guide or deflect the light image in a targeted manner. This is accomplished, for example, by guiding the light to the modulator through the optical channel and to the camera via the modulator. More preferably, a control device or a control unit can be provided, by which the light source and / or the modulator can be controlled according to the light image captured by the camera, the light from the light source forming an overlapping image, which is superimposed with the light image captured by the camera after the modulator; the overlapping image is projected into the surrounding area.
[0008] The advantage of this solution is that the light that the light source can emit can be adapted to the surrounding area of the device, that is, adapted to the light image that images the surrounding area and can be captured by the camera. Therefore, for example, poor visibility caused by fog, rain or other natural phenomena can be captured via the light image from the camera, and the modulator and / or the light source can be controlled accordingly to improve visibility, for example, for the vehicle driver of the vehicle using the device. Compared with the prior art, for example, compared with fog lights, the light that the device can emit can be dynamically adapted, rather than being static as in the case of fog lights. The visibility of the surrounding area of the device can therefore be improved in a simple way. In addition, the device is very cheap compared to systems based on, for example, infrared radiation and / or thermal radiation. In addition, in the vehicle, it is not necessary to provide the vehicle driver with a display for displaying the image captured via infrared radiation and / or thermal radiation. In contrast, in the device according to the present invention, the emitted light is adapted in a way according to the captured light image so that the visibility of the surrounding area is improved. In other words, by combining sensors and actuators in the device, natural images of the surrounding area can be captured and enhanced through intelligent lighting.
[0009] In another configuration of the invention, it can be provided that the control device has an image processing algorithm, in particular implemented by a computer. The algorithm is preferably configured so that the light image captured by the camera is analyzable. The light source and / or the modulator can then be advantageously controlled via the control device in accordance with the analysis of the light image.
[0010] In the light image captured by the camera, at least one image property and / or at least one image structure and / or edges and / or contrast can advantageously be determined via an image processing algorithm for analysis. This is very advantageous because, for example, edges and / or contrast of the light image are important elements that influence the visibility of the surrounding area for a person. For example, it is conceivable that the control device then controls the modulator and / or the light source as a function of the captured edges and / or the captured contrast and / or as a function of the at least one image property and / or the at least one image structure in order to improve the visibility of the surrounding area and / or to improve object recognition, in particular for a vehicle driver.
[0011] In another configuration of the invention, it can be provided that the control device controls the modulator and / or the light source in a manner dependent on the captured edges and / or the captured contrast such that the contrast and / or the edges are enhanced at least in the surrounding area that can be captured by the camera.
[0012] The light emitted by the device is preferably continuously adapted by continuously capturing light images and controlling the modulator and / or the light source by means of a control device in accordance with the light images. It is also conceivable to provide or check the adaptability of the modulator and / or the light source at specific, in particular regular, points in time via the control device. It can therefore be provided that the camera captures the light images only at specific, in particular regular points in time.
[0013] The light image that can be captured by the camera preferably corresponds at least partially or completely or substantially completely to a surrounding portion of the surrounding area that can be completely illuminated by the light source.
[0014] The control device can preferably control the modulator and / or the light source in a way according to the captured edge and / or the captured contrast, so that the light emitted by the light source radiates outwardly via the light channel and enhances the contrast and / or edges of the surrounding part that can be perceived by a person (in particular a vehicle driver) in the surrounding area. People can therefore better perceive the contrast and / or edges of the surrounding part, such as the surrounding area in front of the vehicle. In other words, the control device can control the modulator and / or the light source in a way according to the captured edge and / or the captured contrast, so that the modulator forms an overlapping image, which is then covered on the surrounding part and / or projected outwardly.
[0015] In other words, edges and / or contrast are detected in the light image or camera image of the camera by means of an image processing algorithm and reproduced in the headlight or in the light emitted by the light source. In the proposed device, a "real" image of the surrounding area can thus be recorded and used for lighting in such a way that the vehicle driver can perceive the "real" surrounding area with higher contrast and / or improved edges.
[0016] Such image processing algorithms require very little computing time, which is why there is very little waiting time between capturing the light image and controlling the modulator and / or light source. On the other hand, if a radar sensor, for example, is used to capture the surrounding area, the image of a person riding a bicycle in the fog, for example, captured by the radar sensor, needs to be perceived by the vehicle driver via a display. This is done, for example, via an augmented reality head-mounted display (HUD), which makes the danger clearer to the vehicle driver in an artificial way. In order to do this, the driver must look at the HUD. This requires a certain amount of time before the signal from the radar sensor is correctly detected by the driver assistance system. In contrast, using the device according to the present invention, the surrounding area is fully illuminated in an improved manner, as a result of which the vehicle driver can immediately perceive the surrounding area in an improved manner. For example, they can better perceive a person riding a bicycle in the fog. In addition, it is not necessary to make the danger clearer to the vehicle driver, as in the case of having a radar sensor and a HUD, which is why there will be no misjudgment of the sensor with the device according to the present invention.
[0017] In another configuration of the invention, the light channel is preferably formed by at least one lens, in particular by a projection lens. In this way, light from the light source can advantageously be emitted into the surrounding area, and furthermore, the light image can be captured by the camera with high quality.
[0018] It is conceivable to provide a plurality of light channels. It is conceivable, for example, to provide a light channel, in particular a light outlet for light from a light source, and a light channel, in particular a light inlet for light of a camera. The advantage of a single light channel is that the arrangement is simpler and more cost-effective in terms of equipment technology.
[0019] In another configuration of the present invention, the spatial modulator is a spatial micromirror actuator. The latter has, for example, a plurality of mirrors. Each of these mirrors can be tiltable between two mirror positions, in particular tilted at a high frequency, in particular tilted independently of each other, and each forms a light pixel. In the first position of the respective mirror, the light from the light source can be reflected, for example, to the light channel. In contrast, in the second position, for example, the light image entering via the light channel can be directed to the camera. Therefore, the spatial modulator simply has a dual function in terms of device technology, so as to precisely control the light that can be emitted by the light source and, if necessary, to direct the light image to the camera. It is conceivable that the spatial modulator for light is a spatial light modulator (SLM). Alternatively, it is conceivable that the modulator is designed as a digital micromirror actuator (digital micromirror device (DMD)) or a liquid crystal display (LCD) or one or more microelectromechanical systems (MEMS) or liquid crystal on silicon (LCOS) and / or is formed by a monomer material. It is also conceivable that the modulator is designed digitally or analogously.
[0020] In a first position of the modulator's mirror, light from the light source can be directed to the light outlet, which can be referred to as an on state. In a second position (which can be described as an off state), the light is typically directed to a beam dump of the prior art, for example. In the case of the present invention, the camera can be arranged at the position where the beam dump is arranged in the prior art.
[0021] In another preferred configuration of the invention, the camera is designed and arranged to image the reflection plane or modulator plane of the modulator from the tilted axis via a lens in a Scheimpflug configuration. In other words, the image plane, in particular the image plane of the camera chip or the image sensor of the camera, and the main plane of the lens of the camera and the projection plane or focal plane of the modulator are arranged to intersect at a common straight line, for example preferably arranged according to Scheimpflug's law. If a mirror is provided between the camera and the modulator to guide the light image to the mirror via the modulator and from there to the camera, a Scheimpflug configuration can also be provided. The projection plane or focal plane then continues to be the modulator plane. Therefore, in the field of view of the "spatial light modulator" or modulator, the image of the surrounding area can be recorded in a parallax-free manner. In other words, the device, in particular in the form of a light projector, has a dual function. The device can be used simultaneously as an actuator, in particular by combining a modulator with a light source (projector), and as an image sensor, in particular with the aid of a camera.
[0022] This can be used primarily for light functions intended to enhance or mark components of the surrounding area or objects in the surrounding area. For this purpose, it can be advantageous to have the coordinates of the camera sensor (e.g. of the pixel sensor) in a direct, invariant relationship with the coordinates of the projected image, which is the case for a parallax-free combination of sensor and actuator.
[0023] In other words, the Sham configuration can be used to record the camera's light image without parallax, which enables improved analysis by image processing algorithms. The camera's lens is preferably tiltable or pivotable relative to the camera's image sensor in order to properly set up the camera or macro camera.
[0024] In another configuration of the invention, it can be provided that the camera has an image sensor with image pixels. These image pixels can then preferably be assigned to the light pixels of the modulator. Therefore, in particular in the Sham configuration, the image pixels can be assigned to the light pixels unambiguously, in particular without parallax. This allows an extremely simple analysis of the light image via an image processing algorithm. In addition, due to the clear assignment, the modulator can be controlled extremely simply, for example in order to emit overlapping images. In another configuration, corresponding image pixels and / or groups of image pixels can each be assigned to the light pixels of the modulator and / or corresponding groups of light pixels. For example, it is conceivable that groups of four image pixels are respectively assigned to individual light pixels. As already mentioned above, the device is preferably designed so that the assignment and arrangement of image pixels and light pixels is carried out without parallax.
[0025] In the camera function, the image sensor of the camera is preferably read at a specific frame rate, for example between 30 Hz and 60 Hz or in the range of KHz or MHz. The read data is then preferably further processed by an image processing algorithm.
[0026] In a preferred embodiment of the invention, it can be provided that the modulator is controlled so that at least some or all mirrors are in a second switching position in order to record the light image via the camera. The second switching position is the on state or the off state of the mirror. The light function preferably works in the on state, while the camera function works in the off state. In other words, the camera is arranged so that in the second switching position of the mirror, the camera captures the surrounding area of the imaging by the light channel or the reflection of the lens or projection lens in the light channel. The duration of the arrangement of the mirror in the second switching position is preferably selected so that the light source, in particular the projector, is turned off during the image recording to avoid scattered light in the system. In other words, the camera and the light source are controlled so that the light source is turned off when the camera is in use. Preferably, the suppression period during which the light source is turned off, the mirror is in the off state or off position or in the second switching position and the camera records the image is selected to be so short that the camera use and / or modulation cannot be perceived by a person. The suppression period is preferably ≤25ms. In other words, during operation, the mirror of the modulator is briefly set to the corresponding mirror position in order to record the light image with the camera in a way that this is not perceived by an observer of the emitted light image.
[0027] In another configuration of the invention, a mirror can be arranged between the light source and the modulator. Alternatively or additionally, it is conceivable to arrange a mirror between the modulator and the camera. Thus, a flexible and compact configuration of the device can be achieved.
[0028] For a compact arrangement that is simple in terms of device technology, it is conceivable to arrange the modulator on or approximately on the main axis of the light channel, in particular in the form of a lens. The camera and / or the light source can be arranged between the modulator and the light channel of the lens, seen in the direction of the main axis. The main axis of the light emitted by the light source can preferably lie radially to the main axis of the light channel of the lens and / or be arranged parallel to the planar extension of the modulator. It is also conceivable to arrange the main axis of the light source skewed or inclined relative to the main axis of the light channel of the lens. The side of the modulator with the mirror is preferably arranged perpendicular to the main axis, as a result of which the modulator has an extremely high efficiency.
[0029] The modulator and the light channel (for example in the form of a lens) are preferably arranged in a row. This or these mirrors or deflection mirrors are arranged adjacent to the light beam path between the modulator and the light channel and / or outside it. Therefore, in terms of equipment technology, light can be deflected to the modulator and / or from the light source in a simple and cost-effective manner via this or these deflection mirrors. These deflection mirrors are arranged, for example, in a roughly V-shaped manner relative to each other. They can each form a leg of the V, wherein the two legs are spaced apart and do not touch. Alternatively or additionally, this or these deflection mirrors can extend obliquely, for example, between the modulator and the light channel relative to the direction of the main axis. In this case, these mirrors can extend away from the main axis between the modulator and the light channel as the distance from the modulator increases. In addition, these mirrors can be arranged, for example, symmetrically relative to each other. In addition, it is conceivable that the camera and the light source are arranged relative to each other, in particular in a plane.
[0030] The light source or radiation source is preferably at least one light emitting diode (LED). The latter may be in the form of at least one independently housed LED or at least one LED chip with one or more light emitting diodes. A plurality of LED chips may be mounted on a common substrate ("substrate") and form an LED, or they may be attached, for example, to a circuit board (e.g., FR4, metal core circuit board, etc.) ("CoB" = chip on board) independently or jointly. The at least one LED may be equipped with at least one individual and / or common optical unit for beam guidance, for example equipped with at least one Fresnel lens or collimator. Instead of or in addition to inorganic LEDs (e.g. based on AlInGaN or InGaN or AlInGaP), organic LEDs (OLEDs, for example polymer OLEDs) may also be used in general. The LED chip may emit directly or have an upstream phosphor. Alternatively, the light emitting component may be a laser diode or a laser diode device. It is also conceivable to provide an OLED light emitting layer or multiple OLED light emitting layers or OLED light emitting zones. The emission wavelength of the light emitting component may be in the ultraviolet, visible or infrared spectral range. The light emitting component may be additionally equipped with a separate converter. The LED chip preferably emits white light within the ECE white color field standardized for the automotive industry, for example by means of a blue emitter and a yellow / green converter.
[0031] It is furthermore conceivable that the at least one light source is designed as a light-emitting device operating according to the principle of laser activated remote phosphor (LARP), and / or as a halogen lamp, and / or as a gas discharge lamp (high intensity discharge (HID)), and / or in combination with a projector operating according to the principle of digital light processing (DLP), and / or as an IR radiation source, and / or as another device for emitting, reproducing and / or generating electromagnetic radiation in and / or partially in the visible light range and / or close to and / or partially close to the visible light range.
[0032] In another preferred embodiment of the invention, it is conceivable that, in addition to or instead of a white light source or multiple white light sources, at least one light source of a specific color is used. For example, multiple light sources of different colors can also be provided, such as at least one red light source, at least one green light source and at least one blue light source. It is also conceivable to use one or more RGB-LEDs as light sources. Alternatively or additionally, it is conceivable to use light sources with different color temperatures. For example, two white LEDs with different color temperatures can be used. With this design, the color and / or color temperature and / or hue can be adapted in the overlapping images in order to further improve the visibility of the object.
[0033] Alternatively or additionally, an infrared (IR) light source can be provided as the light source. In this case, the camera is advantageously designed as an IR camera. Thus, a light image of the surrounding area of the device can be recorded by the camera when using an IR light source.
[0034] A system with two devices is also conceivable. These devices can then be controlled dependently on each other, for example in order to jointly form a light image or a superimposed image.
[0035] According to the present invention, a lamp, in particular a vehicle lamp, in particular a lamp for a vehicle, is provided, the lamp having at least one device according to one or more of the aforementioned and / or following aspects.
[0036] The lamp can be designed as, for example, a front lamp or a front headlight or a taillight or a tail headlight or a fog lamp. It is also conceivable that the lamp is used alternatively or additionally to obtain a signal light function and / or a lighting function. The signal light function provided is, for example, a turn signal function, and / or a brake light function, and / or a tail light function, and / or a daytime running light function, and / or a position light function, and / or a fog light function, and / or a combination of the above functions and other functions. The lighting function provided can be a turn signal light function, and / or a fog light function, and / or a low beam function, and / or a high beam function, and / or a combination and / or modification of the functions and other functions (for example, adaptive high beam (ADB) or adaptive front lighting system (AFS)). AFS is an adaptive system that preferably adaptively controls all or at least some lighting functions. It can be used, for example, in a low beam function and a high beam function, and can provide highway lights and / or bad weather lights and / or city lights. ADB is preferably used together with a high beam and can provide a glare-free high beam. For example, ADB is part of AFS. Another application aspect of the lamp may be: effect lighting, entertainment lighting, architectural lighting, medical and therapeutic lighting, horticultural lighting.
[0037] The light source of the device can preferably be used in the lamp to obtain one or more of the light functions listed above. The light source can thus have at least a dual function or a multi-function, so as to be used precisely for overlapping images and additionally perform one or more of the functions mentioned. This can be done, for example, by appropriately controlling the modulator and / or the light source.
[0038] In a preferred embodiment, a plurality of light sources are provided. It is conceivable that the respective light sources illuminate the respective sectors of the modulator. It is also conceivable that some sectors or all sectors overlap. The light sources may also each completely illuminate the modulator or its entire surface. One or more sectors of the modulator may be illuminated, for example by a plurality of light sources, in order to illuminate a specific area in the emitted light image, such as a road, with a higher light intensity. These light sources may have the same design. It is also conceivable that these light sources or some of them are designed differently, i.e., for example, different types of light sources are used. If, for example, a laser device is used as the light source, it is conceivable that the device is configured so that the laser can pass or scan each mirror at least in sectors.
[0039] If at least one single light source is provided, the latter can illuminate the entire surface or parts of the modulator, or a light beam (for example a laser beam) can pass through the modulator at least in sections.
[0040] It is conceivable that at least one or more of the following operating situations are provided for the device. In a first operating situation, for example, the light source of the device can be used to improve the display of specific objects or image areas or image parts for the vehicle driver, i.e., to generate overlapping images. This is the case, for example, when daylight is present and therefore no additional light (e.g. low beam or high beam) is required. In a second operating situation, for example, in addition to forming an overlapping image, the light source of the device is additionally used for full-area lighting, for example additionally as low beam, fog light or high beam. This is preferably done when there is only a small amount of daylight or no daylight.
[0041] In a first operating situation, for example, the modulator is preferably controlled with the light source switched on to emit a determined overlapping image. This means, for example, that the corresponding mirror of the modulator is switched, ie, for example, in the on state, with the result that a specific object is made more visible.
[0042] In a second operating situation, for example, at least when the camera is not recording an image, the light source is switched on for full-area illumination, for example as a low beam. In order to form overlapping images, the corresponding mirrors of the modulators are switched, with the result that some of the mirrors are in the on state and the others are in the off state. A portion of the light is therefore emitted outwards via the mirrors in the on state to form overlapping images. It is preferably proposed here that the intensity of the light source is increased when emitting overlapping images. The intensity is then reduced and the mirror is controlled according to the desired function (e.g. low beam). This process described is repeated at a specific frequency (i.e. the mirrors are preferably switched at a specific frequency and the intensity of the light source is increased at a specific frequency), which is preferably selected so that a person (e.g. a vehicle driver) does not perceive the change between these functions.
[0043] In other words, when projecting overlapping images, the light source is pulsed, that is, the DMD runs in a clocked manner, and at the same time the brightness of other LEDs that are not emitted into the overlapping area can be reduced. In this way, an increase in the brightness of the overlapping area can be achieved (and the brightness of the normal area may be reduced).
[0044] Preferably two luminaires are provided which are controlled dependently on each other.
[0045] The applicant is entitled to apply the independent claims to a system having at least two luminaires or having at least two devices.
[0046] According to the invention, a vehicle is provided, which has at least one device according to one or more of the preceding aspects and / or at least one lamp according to one or more of the preceding aspects.
[0047] The vehicle can be an aircraft or a water vehicle or a land vehicle. The land vehicle can be a motor vehicle or a rail vehicle or a bicycle. The vehicle is particularly preferably a truck or a passenger car or a motorcycle. In addition, the vehicle can be designed as a non-autonomous or semi-autonomous or autonomous vehicle.
[0048] According to the invention, a method is provided using a device according to one or more of the preceding aspects. The light source and / or the modulator can then be advantageously controlled by the control device depending on the light image captured by the camera.
[0049] A device or projection headlight with a modulator, in particular with a DMD (digital mirror device) is disclosed. In this case, the projection lens of the device not only images the image content of the modulator in the surrounding area, but also images the surrounding area on the modulator. The modulator can thus direct the image of the surrounding area to the camera and reflect light from the light source into the surrounding area. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] The present invention will be explained in more detail below with reference to exemplary embodiments. In the accompanying drawings:
[0051] Figure 1 shows a schematic representation of an apparatus for a vehicle according to an exemplary embodiment,
[0052] Figures 2a to 3c Each schematically shows Figure 1 surrounding parts of the device. DETAILED DESCRIPTION
[0053] Figure 1A device 1 for a vehicle lamp 2 is shown. The vehicle lamp 2 is schematically shown with a dot-dash line. The vehicle lamp 2 can in turn be part of a vehicle 4, which is marked with the same dot-dash line for the sake of simplicity. The device 1 has a modulator 6, which is arranged on a circuit board 8. For example, the modulator 6 is designed as a digital micromirror actuator, or DMD. On its modulator side 10 facing away from the circuit board 8, the modulator has a plurality of mirrors or micromirrors, which each form a light pixel and can be tilted between two mirror positions. The modulator 6 points with its modulator side 10 to a light channel of the device 1 having a lens 12.
[0054] Furthermore, the device 1 has a light source 14. Light 16 can be emitted via the light source toward a deflection mirror 18. The light 16 is guided via the deflection mirror to the modulator side 10 of the modulator 6. The deflection mirror 18 and the light source 14 are arranged here so that the light 16 is radiated to the deflection mirror 18 approximately radially or perpendicularly with respect to the main axis 20 of the lens 12. The modulator 6 is arranged in a row with the lens 12, seen in the direction of the main axis 20. Furthermore, the light source 14 is arranged between the modulator 6 and the lens 12, radially outside the main axis 20, seen in the direction of the main axis 20. In the first position of the respective mirror of the modulator 6, the respective light incident on its respective mirror is then reflected toward the lens 12 in order to be emitted into the surrounding area.
[0055] also, Figure 1 The device 1 has a camera 22. The camera is designed, for example, as a CCD or CMOS camera with a plurality of sensor pixels. The sensor pixels can be implemented with or without color filters. The camera has an image sensor 24. The latter is, for example, arranged approximately perpendicular to the plane of the modulator side 10 of the modulator 6 and / or extends at a certain parallel distance from the main axis 20. The image sensor preferably faces the main axis 20. In the second position of the mirror of the modulator 6, the light or light image entering the device 1 via the lens 12 can be directed to the deflection mirror 26. The light image can be further directed to the camera 22, in particular to the image sensor 24, via the deflection mirror. So that the image sensor 24 can record the light entering via the lens 12 without parallax, the camera 12 has a pivotable or tiltable lens element or lens 28. Therefore, the camera 22 can image the modulator side 10 of the modulator 6 from the tilt axis via the lens 28 in the Sham configuration. This means that in the second switching position of the mirrors or mirrors of the modulator 6, the camera can then display the light image reflected via the modulator 6 without parallax. A simple assignment of image pixels of the image sensor 24 to light pixels of the modulator 6 is thus possible.
[0056] Furthermore, the device 1 can have a control device or be connected to the control device wirelessly or via a cable. For example, the control device is designed as a control unit 30. The control unit 30 can control, for example, the light source 14 and / or the camera 22 and / or the modulator 6. Furthermore, the control device, in particular in the form of a control unit 30, or another control device arranged in the device 1 or connected to the device 1 via a cable or wirelessly, can have an image processing algorithm 32.
[0057] The image processing algorithm can be used for pattern recognition, wherein, for example, one or more of the following methods can be used: gray value correlation; pattern recognition based on geometry or edges; pattern recognition using feature trees. Alternatively or additionally, it is conceivable to use artificial intelligence (AI) methods, for example for classification, or other methods. If AI methods are not used, the waiting time of the image processing algorithm is likely to be reduced due to the lower computational complexity. In the device 1, the object or image recognition of the image processing algorithm is preferably designed in a way that specific image content, such as edges, can be determined. The light from the light source 14 can then be formed via the modulator 6 in a way that visibility (for example for the vehicle driver) is improved based on the determined image content (for example edges). Compared with object recognition in a driver assistance system, for example, the demand for object recognition of the device 1 can be lower. For a driver assistance system, very reliable object recognition is necessary. Compared with a driver assistance system, improved full-area lighting can be achieved in the device 1, for example, so that the vehicle driver continues to control the vehicle independently. The image processing algorithm can therefore be configured in a relatively simple manner and / or requires relatively little computing power, which achieves less waiting time. If, for example, a computer-implemented neural network is used as the AI method, the requirements regarding training data for training the network are relatively low. The neural network can also be designed to be relatively simple.
[0058] Now, the following will refer to Figure 2a to Figure 2c Explanation Figure 1 Use of the device 1. Figure 2a A detail of the surrounding area of a vehicle 4 is shown, which is the vehicle driver's forward view and the front surrounding area of the vehicle. Here, a road 34 can be seen, on which a person 36 stands. A tree 38 is also shown. Furthermore, it is night and foggy. Figure 1 The light source 14 of the device 1 emits light with the modulator 6 in the direction in front of the vehicle, i.e. at least onto the road 34 and objects (e.g. persons 36) present in the fully illuminated zone. For this purpose, the mirrors or at least some of the mirrors of the modulator 6 are in their first switching position. Now, in order to improve visibility, Figure 2a A light image of a portion of the surrounding area showing details is obtained by Figure 1The lens 12 of the device 1 is directed to the modulator 6. At least some of the mirrors or all of the mirrors are then briefly switched to their second switching position via the control unit 30. The light image is then directed to the image sensor 24 via the deflection mirror 26 and the lens 28 and captured by it. The light image is then analyzed via the image processing algorithm 32 and the contrast is determined. It is then determined by Figure 2b The mirror of the modulator 6 is now controlled by the control unit 30 in such a way that the light 16 from the light source 14 forms the overlapping image 40 after the modulator 6. The overlapping image is then projected via the lens 12 into the surrounding area, preferably at least partially or completely into the area that can be captured by the camera. Figure 2c The results are shown in FIG. 1 . It can be seen that part of the surrounding area is modulated with light distribution (i.e., with Figure 2b The overlapping image 40) is illuminated. The contrast is thus significantly enhanced and can be immediately perceived by the vehicle driver.
[0059] The overlapping image 40 is preferably generated by correspondingly controlling the modulator 6. The camera 22 preferably records the light image or images in the dark state, ie when the light source 14 is switched off. Advantageously, there is therefore no need to synchronize or adapt the overlapping of the light images to the specific area.
[0060] Figure 3a and Figure 3c Another possibility for improving visibility for vehicle drivers is shown. In this case, Figure 3a Corresponds to Figure 2a .and Figure 2a to Figure 2c In contrast, the light image is analyzed by an image processing algorithm 32 in such a way that edges are determinable. Figure 1 The control unit 30 thus determines the overlapping image 42, see Figure 3b , where edge enhancement is performed. Figure 3b The superimposed image 42 is then emitted from the device 1 into the surrounding area by correspondingly controlling the modulator 6 via the control unit 30 . Figure 3c An overlapping image 42 projected into the surrounding area is shown, as well as the surrounding area. The edges of the surrounding part in the projected overlapping image area are more clearly visible to the vehicle driver.
[0061] In these embodiments, the size of the overlapping image can preferably be adjusted, in particular by the control unit. This is preferably done by controlling the modulator accordingly. For example, the size of the overlapping image is adjusted depending on the object size and / or object position of the object or objects to be illuminated more strongly.
[0062] It is conceivable to determine and / or form an overlapping image in which both contrast and edges are enhanced. In addition, it is alternatively or additionally conceivable to produce an overlapping image in which, alternatively or additionally, at least one further property of the light image and / or alternatively or additionally at least one further image structure is determined and enhanced.
[0063] List of Reference Numerals
[0064] Device 1
[0065] Traffic lights 2
[0066] Transportation 4
[0067] Modulator 6
[0068] Circuit board 8
[0069] Modulator side 10
[0070] Lens 12
[0071] Light source 14
[0072] Light 16
[0073] Deflecting mirror 18
[0074] Main axis 20
[0075] Camera 22
[0076] Image sensor 24
[0077] Deflecting mirror 26
[0078] Lens 28
[0079] Control unit 30
[0080] Image processing algorithms 32
[0081] Road 34
[0082] 36 people
[0083] Tree 38
[0084] Overlapping images 40
Claims
1. A device having a spatial modulator (6) for light, the device having a light source (14) with which light can be guided via the modulator (6) to an optical channel (12) of the device (1), and the device having a camera (22) with which a light image of an area surrounding the device (1) can be captured via the optical channel (12) and via the modulator (6), wherein the light image can be guided from the optical channel to the camera (22) via the modulator (6), in, A control device (30) is provided, through which the light source (14) and / or the modulator (6) can be controlled according to the light image captured by the camera (22), the light from the light source (14) forming an overlapping image, the overlapping image being superimposed with the light image captured by the camera (22) after the modulator (6); the overlapping image is projected into the surrounding area.
2. The device according to claim 1, in, The control device (30) has an image processing algorithm (32) which is designed to enable analysis of the light image captured by the camera (22), wherein the light source (14) and / or the modulator (6) are controlled via the control device (30) as a function of the analysis of the light image.
3. The device according to claim 2, in, In the captured light image, at least one image property and / or image structure and / or contrast and / or edges can be determined by the image processing algorithm (32) for analysis.
4. The device according to claim 3, in, The control device (30) controls the modulator (6) in dependence on at least one captured image property and / or image structure and / or captured edges and / or captured contrast.
5. The device according to claim 3 or 4, in, The control device (30) controls the modulator (6) in dependence on the captured edges and / or the captured contrast in a manner such that the contrast and / or the edges on the output side of the device are more perceptible to an observer.
6. The device according to any one of the preceding claims, in, The spatial modulator (6) has a plurality of mirrors, each of which can be tilted between two mirror positions and each forms a light pixel, wherein in a first mirror position of the respective mirror, light from the light source (14) is reflected to the light channel (12), and in a second mirror position, a light image entering via the light channel (12) is directed to the camera (22).
7. The device according to any one of the preceding claims, in, The camera (22) is designed and arranged in such a way that the light image can be captured via the modulator (6) via the lens (28) of the camera (22) in a Sham configuration, wherein the modulator (6) has a reflection plane (10) arranged perpendicular to the main axis (20) of the light channel (12).
8. The device according to claim 6 or 7, in, The camera (22) has an image sensor (24) with image pixels, which are each assigned to one or more photo pixels of the modulator (6), or one or more photo pixels of the modulator (6) are assigned to each image pixel.
9. The device according to any one of the preceding claims, in, The deflection mirror (18) is arranged between the light source (14) and the modulator (6), and / or the deflection mirror (26) is arranged between the modulator (6) and the camera (22).
10. A lighting fixture for a vehicle, wherein the lighting fixture has a device (1) according to one or more of the preceding claims.
11. A vehicle having a device according to one or more of claims 1 to 9 or having a lamp according to claim 10.
12. A method of using a device according to one or more of claims 1 to 9, in, The light source (14) and / or the modulator (6) are controlled by the control device (30) according to the light image captured by the camera (22).
Citation Information
Patent Citations
Method for capturing and processing images of a vehicle's environment, control unit and vehicle equipped for carrying out such a method, and computer program product
DE102017219092A1
Apparatus for Spatially and Spectrally Adaptable Dichromatic White Light Source Using Spatial Light Modulator
US20160377252A1
Dynamic control of projected light relative to a scene
US9855887B1