System and method for interlocking camera-integrated headlamps with lamp controllers

Abstract

To provide a lamp controller interlocking system in which a camera built in a headlamp interlocks with a headlamp light source to focus the headlamp light source with timing when the camera needs light, and to provide a method for the system.SOLUTION: The lamp controller interlocking system of a headlamp with a built-in camera includes: a headlight module integrated with a camera 100 and a light source 300; a camera controller generating a single frame image by composing an image captured in a short exposure section, in which a shutter opening time of the camera is relatively short, and an image captured in a long exposure section, in which the shutter opening time of the camera is relatively long; and a lamp controller 350 controlling the light source to emit relatively more light in the long exposure section more than in the short exposure section in synchronization with timings of the long exposure section and the short exposure section of the camera.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a system and method for interlocking a camera-embedded headlamp with a lamp controller, and more particularly to a system and method for interlocking a camera-embedded headlamp with a lamp controller, in which a camera built into the headlamp interlocks with a headlamp light source and focuses the headlamp light source on the camera when light is needed, thereby improving the quality and recognition rate of images captured by the camera. [Background technology]

[0002] Generally, cameras (or camera modules) are installed in vehicles to improve driver convenience and support, and examples of these include front cameras, rear cameras, around-view monitoring, and drive recorders.

[0003] The images (e.g., image information) captured by the camera are transmitted to a camera control unit that processes the camera images and generates various driver support information such as vehicle information, traffic light information, pedestrian information, and obstacle information.

[0004] The camera installed in the vehicle performs various functions via a single cable, such as supplying power to the camera, sending video signals, and sending and receiving control signals (I2C).

[0005] That is, one cable connected to the camera is input to the camera control unit, which analyzes and processes the image information and outputs the image signal via the vehicle's internal network.

[0006] Meanwhile, in order to link the camera built into the headlamp with the light source and improve the camera's recognition rate, real-time information exchange is required. Conventionally, this has been achieved by analyzing the image transmitted from the camera in a camera controller and transmitting the information via the vehicle's CAN bus.

[0007] However, in this case, there was a problem that real-time synchronization was impossible due to the delay time of the video processing and the delay time of the CAN communication. Summary of the Invention [Problem to be solved by the invention]

[0008] In an embodiment of the present invention, a camera built into a headlamp is linked to a headlamp light source to focus the headlamp light source on the camera when light is needed. In order to resolve the speed difference between the headlamp signal and the camera signal via in-vehicle CAN communication, the lamp controller outputs horizontal and vertical synchronization signals from the image sensor to synchronize the timing of the headlamp and the camera, thereby providing more light to the camera with the same energy, improving camera image quality and increasing energy efficiency.

[0009] The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description. [Means for solving the problem]

[0010] A lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention may include a headlight module in which a camera and a light source are integrated together; a camera controller that synthesizes an image captured in a short exposure section in which the shutter opening time of the camera is relatively short and an image captured in a long exposure section in which the shutter opening time of the camera is relatively long to generate a single frame image; and a lamp controller that synchronizes with the timing of the long exposure section and the short exposure section of the camera and controls the light source to emit relatively more light in the long exposure section than in the short exposure section.

[0011] In one embodiment, the lamp controller may estimate a period from when a horizontal synchronization signal is input to when a vertical synchronization signal is input after a certain time from the start of a preset frame period as a short exposure period, and may estimate a period from when a horizontal synchronization signal is input following the short exposure period to when a vertical synchronization signal is input as a long exposure period.

[0012] In one embodiment, the lamp controller may receive horizontal and vertical synchronization signals of an image captured by the camera from the camera.

[0013] In one embodiment, the output terminals of the horizontal and vertical synchronization signals of the camera may have an insulating structure.

[0014] In one embodiment, the lamp controller may receive horizontal and vertical synchronization signals of an image captured by the camera from the camera controller.

[0015] In one embodiment, the output terminals of the horizontal and vertical synchronization signals of the camera controller may have an insulating structure.

[0016] According to another embodiment of the present invention, a method for linking a lamp controller to a camera-integrated headlamp may include: an image generating step of synthesizing an image captured in a short exposure section in which a shutter opening time of the camera is relatively short and an image captured in a long exposure section in which a shutter opening time of the camera is relatively long, to generate one frame image, via a camera controller provided in a headlight module in which a camera and a light source are integrated; and an illumination step of controlling a light source to emit relatively more light in the long exposure section than in the short exposure section by synchronizing with the timing of the long exposure section and the short exposure section of the camera using a lamp controller.

[0017] In one embodiment, the lighting step may include a step of estimating a timing from when a horizontal synchronization signal is input to when a vertical synchronization signal is input after a certain time from the start point of a preset frame period as a short exposure period, and a step of estimating a timing from when a horizontal synchronization signal is input after the short exposure period to when a vertical synchronization signal is input as a long exposure period.

[0018] In an embodiment, the lighting step may include receiving from the camera a horizontal sync signal and a vertical sync signal of an image captured through the camera.

[0019] In an embodiment, the lighting step may include receiving a horizontal sync signal and a vertical sync signal of an image captured by the camera from the camera controller. [Effects of the Invention]

[0020] This technology allows the camera built into the headlamp to work in conjunction with the headlamp light source, concentrating the headlamp light source on the camera when light is needed. To resolve the speed difference between the headlamp signal and the camera signal via in-vehicle CAN communication, the horizontal and vertical synchronization signals of the image sensor are output to the lamp controller to synchronize the timing of the headlamp and camera, thereby providing more light to the camera with the same energy, improving the quality of the camera image and increasing energy efficiency.

[0021] In addition, various other effects may be provided that can be grasped directly or indirectly through this document. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a diagram illustrating a headlamp constituting a lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention. [Figure 2]1 is a diagram illustrating an image acquisition device constituting a lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention. [Figure 3] 1 is a block diagram illustrating a lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention; [Figure 4] 10 is a diagram illustrating an example of lamp current due to short exposure and long exposure in a lamp controller interlocking system of a headlamp with a built-in camera according to an embodiment of the present invention. [Figure 5] 10 is another block diagram illustrating a lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention. FIG. [Figure 6] 1 is a flowchart illustrating a method for interlocking a camera-integrated headlamp with a lamp controller according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0023] Some embodiments of the present invention will be described in detail below with reference to exemplary drawings. It should be noted that, when assigning reference numerals to components in each drawing, identical components are assigned the same numerals whenever possible, even if they are displayed in different drawings. Furthermore, when describing embodiments of the present invention, if a detailed description of related known structures or functions is deemed to hinder understanding of the embodiments of the present invention, such detailed description will be omitted.

[0024] In describing components of embodiments of the present invention, terms such as "first," "second," "A," "B," "(a)," and "(b)" may be used. Such terms are used merely to distinguish the component from other components and do not limit the nature, order, or sequence of the components. Furthermore, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the present invention pertains. Terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense unless expressly defined in this application.

[0025] Hereinafter, an embodiment of the present invention will be described in detail with reference to FIGS.

[0026] FIG. 1 is a diagram showing a headlamp that constitutes a lamp controller interlocking system for a headlamp with a built-in camera according to an embodiment of the present invention, FIG. 2 is a diagram showing an image acquisition device that constitutes a lamp controller interlocking system for a headlamp with a built-in camera according to an embodiment of the present invention, FIG. 3 is a block diagram showing a lamp controller interlocking system for a headlamp with a built-in camera according to an embodiment of the present invention, FIG. 4 is a diagram showing examples of lamp currents for short exposure and long exposure in the lamp controller interlocking system for a headlamp with a built-in camera according to an embodiment of the present invention, and FIG. 5 is another block diagram showing a lamp controller interlocking system for a headlamp with a built-in camera according to an embodiment of the present invention.

[0027] 1 to 5, a lamp controller interlocking system for a camera-integrated headlamp according to an embodiment of the present invention is installed in a vehicle and may include a headlight module that integrates a camera 100 and a light source 300 such as an LED, a camera controller 150, and a lamp controller 350.

[0028] 2 to 4, the camera 100 may include a lens 10, an aperture 30, a shutter 50, an image sensor 70, an A / D converter (ADC) 90, and an ISP module 95.

[0029] Light reflected from the subject passes through the lens 10 and controls the aperture 30 and shutter 50 so that it can be incident on the image sensor 70 .

[0030] Image sensor 70 may be a solid-state imaging device such as a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS).

[0031] The image sensor 70 can measure the intensity of incident light and output a video signal corresponding to the measured light. The video signal output from the image sensor 70 can be converted into a digital video signal via the ADC 90, and the converted digital video signal can be input to the ISP module 95.

[0032] The ISP (Image Signal Processing) module 95 can perform image processing such as color interpolation, color correction, gamma correction, and auto white balancing on the received image signal, and the image signal that has passed through the IPS module 95 can be displayed inside the vehicle through a separate display device and provided to the driver.

[0033] The image sensor 70 has a narrower range of brightness that can be sensed than the human eye. To overcome this, the image sensor 70 combines images obtained by setting different exposure times (ET) and applies technology to increase the brightness range, thereby generating a high dynamic range (HDR) image.

[0034] The exposure time may be the time that the image sensor 70 is exposed to light, and may depend on the aperture 30 value, the shutter 50 speed, the ISO sensitivity, and the like.

[0035] In the present invention, the operating scenario of the camera 100 is input in advance, and a two-stage exposure policy is set in which a short exposure time (SET) is output first, followed by a long exposure time (LET). The short exposure time may be a relatively shorter exposure time than the long exposure time, and the long exposure time may be a relatively longer exposure time than the short exposure time.

[0036] For reference, a two-stage exposure policy means that two vertical synchronization signals are output within one frame period, which may correspond to a short exposure time and a long exposure time, and a three-stage exposure policy means that three vertical synchronization signals are output within one frame period, which may correspond to a short exposure time, a medium exposure time, and a long exposure time.

[0037] The camera controller 150 can refer to a pre-input operation scenario to control the shutter 50 speed, aperture 30 opening, etc. during shooting, thereby obtaining a short-exposure image shot with a short exposure time and a long-exposure image shot with a long exposure time.

[0038] In addition, in the case of a short-exposure image, the dark areas are insufficient but the bright areas are captured normally, while in the case of a long-exposure image, the cells of the image sensor 70 are saturated but the dark areas are captured normally. Therefore, a high dynamic range (HDR) image can be generated by combining the short-exposure image and the long-exposure image.

[0039] As a data transmission method of the camera 100, the image signal captured by the camera 100 can be expressed as the light intensity of each cell of the image sensor 70.

[0040] Generally, 2D images are organized horizontally and vertically; for example, a full HD video may have a resolution of 1920x1080.

[0041] That is, one image may have 1920 lines, each consisting of 1080 pixels, and the image sensor 70 may send a horizontal synchronization signal (HSYNC signal) each time it transmits one of the 1920 lines, and a vertical synchronization signal (VSYNC signal) each time it transmits one image.

[0042] Referring to FIG. 3, as a wiring structure for real-time synchronization between the camera 100 and the lamp controller 350, the camera 100 and the lamp controller 350 can be directly connected.

[0043] Therefore, the horizontal and vertical synchronization signals output by the camera 100 when capturing an image can be directly output from the camera 100 to the lamp controller 350 .

[0044] Referring to FIG. 4, the lamp controller 350 can analyze the input horizontal and vertical sync signals during a preset frame period.

[0045] In the present invention, according to a preset operating scenario for the shutter open operation of the camera 100, the shutter open time can be controlled so that the short exposure time section is output first, followed by the long exposure time section.

[0046] Therefore, the timing at which the first horizontal synchronization signal is input after a certain time from the start of one frame period can be estimated as the short exposure time 210, and the timing at which the second vertical synchronization signal is input after the short exposure time 210 can be estimated as the long exposure time 250.

[0047] That is, it can be assumed that the shutter is open for a specific exposure time from after the horizontal synchronization signal is output until before the vertical synchronization signal is output.

[0048] Therefore, the lamp controller 350 is linked to the horizontal and vertical synchronization signals input directly from the camera 100, and can cut off the current input to the light source 300 to turn it off during the short exposure period, and can supply current to the light source 300 to turn it on during the long exposure period.

[0049] By linking the lamp controller 350 and the camera 100 to concentrate light in the long exposure period required by the camera 100, the quality of the image captured by the camera 100 is improved, and by turning off the light source 300 in the short exposure period, energy efficiency can be increased.

[0050] That is, the lamp controller 350 synchronizes with the timing of the long and short exposure periods of the camera 100 and controls the light source 300 to emit more light during the long exposure period relative to the short exposure period.

[0051] Referring to FIG. 5, as another type of wiring structure for real-time synchronization between the camera 100 and the lamp controller 350, the camera controller 150 and the camera 100 can be connected using a high-speed communication line (FAKRA), and the camera controller 150 and the lamp controller 350 can be connected to control the light source 300 in accordance with the linkage of the horizontal synchronization signal and the vertical synchronization signal output from the camera 100.

[0052] At this time, the horizontal synchronization signal and vertical synchronization signal output from the camera 100 are serialized and transmitted to the camera controller 150, and the serialized signals in the camera controller 150 can be separated into parallel signals again and transmitted to the lamp controller 350.

[0053] In addition, the output terminals at which the horizontal and vertical synchronization signals are output from the camera 100 and the camera controller 150 may have an insulating structure and may further include a signal amplification circuit.

[0054] Therefore, even if static electricity or the like occurs due to the influence of peripheral components, the camera 100 and the camera controller 150 can be protected from electrical damage, and the output signal can be prevented from being reduced due to environmental influences.

[0055] Hereinafter, a method for interlocking a camera-integrated headlamp with a lamp controller according to another embodiment of the present invention will be described in detail with reference to Fig. 6. Fig. 6 is a flowchart illustrating a method for interlocking a camera-integrated headlamp with a lamp controller according to an embodiment of the present invention.

[0056] In the following, it is assumed that the lamp controller interlocking system of the camera-integrated headlamp of FIG. 3 performs the process of FIG.

[0057] First, an operation scenario of the camera 100 is input in advance, and a two-stage exposure policy can be set in which a short exposure time is output first, followed by a long exposure time (S101).

[0058] Next, if a first horizontal synchronization signal is input after a certain time from the start point of one frame period (S102), it can be assumed that this is the start of a short exposure period (S103).

[0059] Next, when the first vertical synchronization signal is input (S104), it can be estimated that this is the end point of the short exposure section (S105).

[0060] Next, if a second horizontal synchronization signal is input (S106), it can be assumed that this is the start of the long exposure period (S107), and the lamp controller 350 can increase the current to the light source 300 to turn on the light source 300 (S108).

[0061] Next, when a second vertical synchronization signal is input (S109), it can be determined that this is the end point of the long exposure period (S110), and the lamp controller 350 can reduce the current to the light source 300 to turn it off (S111).

[0062] As described above, according to the system and method for linking a camera-embedded headlamp with a lamp controller according to the present invention, the camera built into the headlamp is linked to the headlamp light source, enabling the headlamp light source to be focused on the timing when light is needed by the camera. In order to resolve the speed difference between the headlamp signal and the camera signal via in-vehicle CAN communication, the horizontal and vertical synchronization signals of the image sensor are output to the lamp controller to synchronize the timing of the headlamp and the camera, thereby providing more light to the camera with the same energy, improving the quality of the camera image and increasing energy efficiency.

[0063] Meanwhile, the method for interlocking the camera-integrated headlamp with the lamp controller according to steps S101 to S111 of the present invention may be programmed and stored in a computer-readable recording medium.

[0064] The above description is merely an illustrative example of the technical concept of the present invention, and various modifications and variations can be made by a person having ordinary knowledge in the technical field to which the present invention pertains without departing from the essential characteristics of the present invention.

[0065] Therefore, the embodiments disclosed in the present invention are for illustrative purposes only and are not intended to limit the technical idea of ​​the present invention, and the scope of the technical idea of ​​the present invention should not be limited by such embodiments. The scope of protection of the present invention should be interpreted by the claims, and all technical ideas within the equivalent range should be interpreted as being included in the scope of the present invention.

Claims

1. a headlight module that integrates a camera and a headlamp light source; a camera controller that combines an image captured in a short exposure section in which the shutter opening time of the camera is relatively short and an image captured in a long exposure section in which the shutter opening time of the camera is relatively long to generate one frame image; synchronized with the timing of the long exposure section and short exposure section of the camera; a lamp controller for controlling the headlamp light source to emit relatively more light in the long exposure section than in the short exposure section; Including, The lamp controller is configured to cut off the current input to the headlamp light source during the short exposure period, and to turn on the headlamp light source during the long exposure period.

2. The lamp controller A timing from when a horizontal sync signal is input to when a vertical sync signal is input after a certain time from the start point of one preset frame period is estimated as a short exposure section; 2. The system for linking a camera-integrated headlamp to a lamp controller according to claim 1, wherein the long exposure section is estimated based on the timing at which a vertical synchronization signal is input from the timing at which a horizontal synchronization signal is input following the short exposure section.

3. The lamp controller 2. The system of claim 1, wherein a horizontal sync signal and a vertical sync signal of the image captured by the camera are transmitted from the camera.

4. In the camera, 4. The system for interlocking a camera-integrated headlamp with a lamp controller as claimed in claim 3, wherein the output terminals of the horizontal and vertical synchronizing signals have an insulating structure.

5. The lamp controller 2. The system of claim 1, wherein a horizontal sync signal and a vertical sync signal of the image captured by the camera are transmitted from the camera controller.

6. In the camera controller, 6. The system for interlocking a camera-integrated headlamp with a lamp controller as claimed in claim 5, wherein the output terminals of the horizontal and vertical synchronizing signals have an insulating structure.

7. an image generating step of synthesizing an image captured in a short exposure section in which a shutter opening time of the camera is relatively short and an image captured in a long exposure section in which a shutter opening time of the camera is relatively long, via a camera controller provided in a headlight module in which a camera and a headlamp light source are integrated, to generate one frame image; a lighting step of controlling the headlamp light source by a lamp controller in synchronization with timings of a long exposure section and a short exposure section of the camera so as to emit relatively more light in the long exposure section than in the short exposure section; Including, and supplying current to the headlamp light source to turn it on during the long exposure period.

8. The lighting stage includes: estimating a timing from when a horizontal synchronization signal is input to when a vertical synchronization signal is input after a predetermined time from the start point of one predetermined frame period as a short exposure section; estimating a timing from when a horizontal synchronization signal is input to when a vertical synchronization signal is input after the short exposure period as a long exposure period; The method for interlocking a camera-integrated headlamp with a lamp controller according to claim 7, further comprising:

9. The lighting stage includes:

8. The method of claim 7, further comprising receiving a horizontal sync signal and a vertical sync signal of the image captured by the camera from the camera.

10. The lighting stage includes:

8. The method of claim 7, further comprising the step of transmitting a horizontal sync signal and a vertical sync signal of the image captured by the camera from the camera controller.

11. A computer-readable recording medium having a program recorded thereon for executing the method for linking a headlamp with a built-in camera to a lamp controller according to any one of claims 7 to 10.

Images