Camera control device and vehicle control device
By introducing variable timing control and duty cycle irradiation between the camera and the headlight, the problem of difficulty in shortening the shooting time interval in the prior art is solved, and efficient detection of reflected objects and improving the performance of the driving assistance system is achieved. .
Patent Information
- Application Number
- CN202380027972.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-17
- Filing Date
- 2023-03-08
- Publication Date
- 2024-11-26
AI Technical Summary
When detecting reflected objects through headlight illumination control, the shooting time interval is difficult to shorten, resulting in misjudgment of the object movement, and it is difficult to control the camera and the headlight synchronously, making it impossible to adapt to high-frequency driving assistance needs.
By using a variable timing control unit and a duty cycle irradiation control unit, the shooting timing mode of the camera and the headlight are adjusted to make them out of synchronization to shorten the shooting time interval, and automatically emergency braking is performed using reflected object detection information. Driving Assistance.
It realizes effective detection of reflected objects in a short time, reduces false judgments of pseudo-objects, and improves the performance of the automatic lane-proof system, which is suitable for high-frequency driving assistance applications.
Smart Images

Figure CN119032578A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a camera control device and a vehicle control device that can effectively utilize the vehicle's own camera to control the headlights at night in a vehicle having camera, headlights and Advanced Driver-Assistance Systems (ADAS) functions to improve nighttime recognition accuracy and use the recognition to appropriately perform driving assistance. Background Art
[0002] Nighttime driving is dark and has low visibility. For example, drivers may find dangers later than during the day, such as pedestrians or bicycles without lights. One method of assisting pedestrians or bicycles is to put reflective objects on them, that is, to prevent drivers from finding dangers late by reflecting the light of their own vehicle's headlights on the reflective objects.
[0003] In the industry, there is proposed a method of assisting a driver in nighttime driving by using a vehicle system that has a camera and uses information from the camera to control the illumination of headlights.
[0004] As a technology proposed in the past, there is light distribution control. For example, as in Patent Document 1, the distance between the vehicle and the preceding vehicle is measured and the high beam and low beam are switched according to the distance at night. As the conditions for switching the control of the headlights, there are various proposals such as the presence or absence of not only the preceding vehicle but also the oncoming vehicle.
[0005] To determine whether it is a reflective object or a luminous object, the reflective object and the luminous object can be distinguished by turning off the headlights, that is, by turning off the headlights of your own vehicle for a short time, the objects that disappear when the headlights of your own vehicle are turned off are reflective objects, and the objects that do not disappear are luminous objects.
[0006] Patent document 2 proposes a technology that removes reflective objects and makes it easier to detect oncoming vehicle lights. The headlights and the camera are synchronously controlled at the same time, and the camera is used to shoot only at the same moment when the headlights are turned off, thereby removing reflective objects. As a result, the image captured by the camera is only the luminous object, making it easier to detect the lights of oncoming vehicles.
[0007] Secondly, in order to detect reflective objects and luminous objects separately, Patent Document 3 synchronously controls the headlights and the camera at the same time, and continuously alternates between shooting when the headlights are turned off and on, thereby realizing the detection of reflective objects and luminous objects. Furthermore, by dividing the illumination area of the headlights, the lights are controlled independently for each area, for example, only the extinguishing period of a specific area can be extended to prevent glare. On the other hand, the shooting timing is the extinguishing and lighting timing of the entire area, so when the extinguishing time of a specific area is extended, the interval of shooting is extended.
[0008] Thus, it is proposed to remove the reflective object or to combine the detection of the reflective object with the operation of performing headlight control. Prior art literature Patent Literature
[0009] Patent Document 1: Japanese Patent Laid-Open No. 6-84099 Patent Document 2: Japanese Patent Application Publication No. 2007-76429 Patent Document 3: Japanese Patent Application Publication No. 2011-110999 Summary of the invention Problem that the invention aims to solve
[0010] When detecting a reflective object by controlling the illumination of the headlights, the interval between the shooting timing when the headlights are turned on and off (shooting time interval) is preferably as short as possible. When comparing the image when the headlights are turned on and the image when the headlights are turned off, if the time interval between image acquisitions is long, the movement of the object reflected in the image increases, and sometimes the object disappears from the screen, so it is necessary to determine whether it disappears from the screen because it is a reflective object or because the object moves.
[0011] If the time interval between the shooting timing of lighting up and extinguishing is shortened, it will be difficult to synchronize the shooting timing of the camera and the illumination control of the headlights at the same time. When the camera and the headlights are independent devices and are physically separated and the information between the devices is communicated by CAN, there is a delay of more than tens of milliseconds due to the processing of each device in the microcomputer and the communication delay between the devices under CAN, so it is considered difficult to synchronize the control. Therefore, the shooting timing of the camera and the illumination control of the headlights must be controlled in an asynchronous manner. In Patent Documents 2 and 3, the shooting timing of the camera and the illumination control of the headlights are synchronized, so it is not suitable for shooting at a short time interval between lighting up and extinguishing.
[0012] Furthermore, in order to use the camera not only for light distribution control but also for object detection used in driving assistance such as automatic emergency braking, it is necessary to repeatedly shoot within a specific cycle such as within a 50 ms cycle. Shooting only at the time of turning off as in Patent Document 2 or extending the turning off period or shooting interval to prevent glare as in Patent Document 3 is not suitable for shooting for driving assistance.
[0013] Therefore, in order to detect reflective objects with a camera and use them for object detection for driving assistance, it becomes a problem to provide a method of shortening the shooting timing when lighting and turning off the headlights and controlling the camera shooting and the lighting and turning off of the headlights in an asynchronous manner.
[0014] Therefore, the present invention aims to provide a camera control device and a vehicle control device having a unit for solving the above problem. The purpose is to provide a camera control device for shortening the shooting timing when lighting and turning off and controlling the shooting of the camera and the lighting and turning off of the headlights in an asynchronous manner, the camera control device having three units: (1) a variable timing control unit that makes the shooting timing of the camera variable, (2) an illumination control unit based on a duty cycle, and (3) a control unit, wherein the variable timing control unit makes the shooting timing of the camera variable, the illumination control unit is a unit for controlling the lighting and turning off of the headlights, and the control unit performs phase control for aligning the timing phases because the shooting timing for shortening the shooting timing when lighting and turning off is asynchronous with the illumination control timing of the headlights.
[0015] Furthermore, with the help of the above three units, reflective objects such as pedestrians or bicycles can be detected, so the present invention effectively utilizes this point and aims to provide a vehicle control device having (4) a unit that uses the detection information of reflective objects to perform driving assistance such as automatic emergency braking. Technical means of solving problems
[0016] To achieve the above-mentioned purpose, the camera control device of the present invention is a camera control device that controls a headlight unit and a camera shooting unit, wherein the headlight unit illuminates the front of its own vehicle, and the camera shooting unit shoots the front of its own vehicle, wherein the camera control device sets a lighting and off mode of a specified frequency and duty for the headlight unit, controls the headlight unit in a manner of lighting and off using the lighting and off mode, sets a shooting timing mode different from the lighting and off mode, including a regular first shooting time interval and a second shooting time interval shorter than the first shooting time interval, for the camera shooting unit according to the specified frequency and duty for the headlight unit, and adjusts the time phase of the shooting timing mode of the camera shooting unit, thereby reducing the shooting time interval when the headlight unit switches between being turned on and off.
[0017] Furthermore, the vehicle control device of the present invention determines that the reflecting object determined to be the stationary object is a road boundary when it is arranged at a fixed distance, and controls the alarm or the steering of the own vehicle in a manner to prevent the intrusion into the road boundary. Furthermore, when the reflecting object is the moving object, the vehicle control device of the present invention determines that the moving object is a pedestrian or a bicycle based on the comparison of the relative speed with the own vehicle, predicts the future trajectory based on the past trajectory, calculates the risk of collision with the own vehicle, and issues an alarm or automatic emergency braking control when it is determined that the risk of collision with the own vehicle is high. Effects of the Invention
[0018] As described above, according to the present invention, the following various advanced driver assistance systems (ADAS) can be realized: reflective objects and luminous objects can be detected by periodically turning off the headlights for a short period of time and taking pictures at a short interval at the boundary between turning off and lighting, and by correctly removing pseudo-objects among reflective objects that are seen as objects on the road due to reflections of headlights, etc., erroneous headlight distribution control or automatic emergency braking due to pseudo-objects can be avoided. Furthermore, reflective objects such as curbs or guardrails can be used as road boundaries and as substitutes for lanes when they cannot be detected, thereby improving the performance of the automatic lane departure prevention system.
[0019] Other problems, structures, and effects than those described above will become clear from the following description of the embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 FIG. 1 is a system configuration diagram of the first embodiment of the present invention. Figure 2 The following are examples of the screen display of reflective objects and luminous objects at a curve in the first embodiment of the present invention, wherein (a) is an example of the image when lit at time t1, (b) is an example of the image when unlit at time t1, and (c) is an example of the image when unlit at time t2. Figure 3 1 and 2 are examples of motion vectors in a lighting image in the first embodiment of the present invention, wherein (a) is an example of a lighting image at time t1, and (b) is an example of a lighting image at time t2. Figure 4 1 and 2 are timing diagrams of lights and shooting in the first embodiment of the present invention, wherein (a) is a timing diagram before the phase adjustment of the lighting and extinguishing of the headlights and the shooting timing, and (b) is a timing diagram after the phase adjustment of the lighting and extinguishing of the headlights and the shooting timing. Figure 5 This is a flowchart of phase adjustment of the lighting and extinguishing of the lamp and the photographing timing in the first embodiment of the present invention. Figure 6 This is a flowchart of object recognition in the first embodiment of the present invention. Figure 7 This is a flow chart of lane-road boundary recognition in the first embodiment of the present invention. Figure 8 FIG. 4 is a flow chart of the light distribution control in the first embodiment of the present invention. Fig. 9 FIG. 4 is a flowchart of the automatic emergency braking control in the first embodiment of the present invention. Fig.10FIG. 4 is a flowchart of the automatic lane departure control in the first embodiment of the present invention. Fig.11 FIG. 4 is a timing diagram of the lights and the shots in the second embodiment of the present invention. DETAILED DESCRIPTION
[0021] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
[0022] [First embodiment] In the first embodiment of the present invention, in order to detect a reflective object with a camera for driving assistance, the headlights are turned off for a short time to shorten the shooting timing when turning on and off, and the shooting of the camera and the turning on and off of the headlights are controlled in an asynchronous manner. (1) A variable timing control unit that makes the timing of the shooting of the camera variable, (2) An illumination control unit based on a duty cycle as a unit for controlling the turning on and off of the headlights, (3) A phase control unit for staggering the phase of the shooting timing to adjust the shooting timing for shortening the shooting timing when turning on and off and the illumination control timing of the headlights, and (4) A unit for using the detection information of the reflective object to perform driving assistance such as automatic emergency braking.
[0023] Before describing the configuration of the vehicle system of the first embodiment, Figure 2 to Figure 4 The principle of the first embodiment will be described.
[0024] Figure 2 An example of a screen display showing reflective and luminous objects on a curve. The vehicle is heading toward the curve. Figure 2 (a) shows the image when the headlights are shining at time t1. As the luminous object, there is the headlight 100 of the oncoming vehicle. As the reflective object, there is the reflective object 101 of the curb and the reflective object 102 of the guardrail, which are arranged at fixed intervals. When the visibility of the road boundary is low, the approximate position of the road boundary can be grasped by using these reflective objects arranged at fixed intervals. In addition, there is an object 103 that reflects according to the lighting of the headlights of the own vehicle. Regarding the reflective object 103, there are cases where it is reflected on the reflective plate of a person or a bicycle, and there are also cases where it is a pseudo object that is seen as an object on the road due to the reflection of the headlights. The image when the headlights are off at the same time t1 is Figure 2 In (b), the reflective object will not be reflected in the picture, and only the luminous object, that is, the headlight 100 of the oncoming vehicle, is displayed in the picture. By comparing the lit image ( Figure 2 (a)) and the extinguished image ( Figure 2 (b)) can not only separate the curb and guardrail, but also other reflective objects 103. The image when the headlights are turned off at time t2 after time t1 is Figure 2(c). At this time, the vehicle approaches the curve in the time t2-t1, and the oncoming vehicle moves forward from the curve toward the vehicle in the time t2-t1, so Figure 2 Compared with (b), the position of the headlight 104 of the oncoming vehicle appears at the lower part of the screen. Furthermore, as time goes by, the oncoming vehicle is located outside the screen, so the luminous object, that is, the headlight of the oncoming vehicle, disappears from the screen.
[0025] There is a time difference between the lighting and extinguishing of the headlights, so Figure 2 (a) and (b) will not appear at the same time. The image at time t1 is the image when it is lit, and the image at time t2 when the other time, that is, the time after t1, is the image when it is off. Figure 2 (c) If the time interval t2-t1 is long, the environmental conditions will change significantly and the possibility of the luminous object disappearing from the screen will increase. Therefore, when comparing the lit image and the extinguished image, it can be said that a short time interval is ideal.
[0026] Figure 2 In the case of extinguishing, it is possible to judge whether it is a reflective object by the object that cannot be detected from the image. Figure 3 Demonstrate the discrimination of moving objects, stationary objects, and pseudo-objects among reflective objects.
[0027] Figure 3 Examples of detecting moving objects, stationary objects, and pseudo objects among reflective objects are shown. Moving objects among reflective objects refer to objects with reflective objects attached to any part of a bicycle, such as the rear wheel of a bicycle. Stationary objects among reflective objects refer to objects with reflective objects attached to, for example, electric poles. Pseudo objects refer to objects that appear to be objects even though they are not actually objects, such as the reflection of the vehicle's own vehicle or the reflection of the vehicle's own vehicle's headlights on the road.
[0028] At time t1, the headlights are turned on, and the reflective object 111 and the reflective pseudo object 113 on the inner side of the lane, and the reflective object 112 on the outer side of the lane are detected. Figure 3 At time t2 after time t1, the headlights continue to light up, and the reflective object 114 and the reflective pseudo object 116 on the inner side of the lane and the reflective object 115 on the outer side of the lane are detected respectively ( Figure 3 (b)). The images at time t1 and time t2 can be compared to calculate the moving direction vector according to the position of the reflecting object. The moving vector of the reflecting object in the lane is 117, and the moving vector of the reflecting object outside the lane is 118. The reflecting pseudo object 116 is always in the same position on the screen, so the moving vector 119 is zero ( Figure 3 (b)).
[0029] Thus, a pseudo object can be identified based on the fact that there is no motion vector. In addition, a stationary object and a moving object can be identified based on the direction and size of the motion vector.
[0030] Figure 4 The principle of photographing at variable timing when the headlights are turned on and off according to the first embodiment of the present invention is demonstrated.
[0031] Figure 4 (a) shows the timing diagram of the lighting and extinguishing of the headlights and the phase adjustment of the shooting timing before the adjustment. Figure 4 (b) shows the time diagram after phase adjustment.
[0032] First, the camera issues an instruction of the duty cycle of turning off and on to the headlight. The headlight receives the instruction of the duty cycle and repeatedly turns off and on according to the duty cycle. Figure 4 The duty ratio of the off and on is 1:9, so the off and on are repeated with a time interval of 1 off time and 9 on time.
[0033] The camera has a shutter control with variable shooting timing, and performs shooting at short time intervals and shooting at long time intervals. The time interval of the shutter control of the camera is repeated periodically in an asynchronous manner independent of the headlight. Figure 4 In (a), the time intervals between t1 and t2 and between t2 and t3 are short, and the time intervals between t3 and t4 and between t4 and t5 are long. If the image is taken when the headlights are off, a dark image is obtained, and if the image is taken when the headlights are on, a bright image is obtained. Figure 4 In (a), time t4, time t9, and time t14 are off-time images when the headlights are off, and images at other times are on-time images.
[0034] In order to shorten the time interval between the off and on times for image comparison for judging reflective objects, and to shorten the time interval when the headlights are off in order to obtain multiple images when the headlights are off, the position with a short shooting interval must be matched with the headlight off timing. The on and off of the headlights and the shooting timing are both periodic processes, so the position with a short shooting interval can be matched with the headlight off timing by adjusting the phase of the shooting timing to stagger it.
[0035] Figure 4 (b) shows a time chart after phase adjustment of the on / off of the headlights and the shooting timing. Time t1, time t2, time t6, time t7, time t11, and time t12 are images of the headlights when they are off, and images at other times are images of the headlights when they are on. Figure 4 In (a), one shot was taken when it was off. Figure 4In (b), two shots can be taken when the headlights are off. In addition, shots can be taken near the change of the headlights turning off and on. In this way, by adjusting the phases in the timing of turning on and off the headlights and the shooting timing, which are not synchronized but periodic, a large number of shots can be taken when the headlights are off and near the change of turning off and on, and shots can be taken at regular intervals when the headlights are on.
[0036] That is, if the on / off duty of the headlights, the variable shooting timing of the camera corresponding thereto, and the number of images to be acquired when the headlights are off and when they are on are predetermined, for example, 2 images when the headlights are off and 6 images when the headlights are on, then Figure 4 In (a), there is one image when the light is off and seven images when the light is on. The number of images is different, so the phase of the shooting timing is adjusted. Figure 4 In (b), there are 2 images when the image is off and 6 images when the image is on, which is the same as the number of images when the image is off and the number of images when the image is on, so the phase adjustment is achieved. In this way, the phase adjustment can be self-adjusted (self-tested).
[0037] The configuration of a vehicle system for detecting a reflective object using a camera and for driving assistance according to the first embodiment of the present invention is shown in FIG. Figure 1 The camera is not particularly limited and may be a monocular camera or a stereo camera. In the first embodiment, a stereo camera having two left and right lenses and capable of detecting the distance of an object by triangulation is used.
[0038] The vehicle 1 is composed of a camera shooting unit 2, a camera control unit 3, a vehicle control unit 4, an illuminance meter 5, a CAN 6, a headlight unit 10, a map unit 11, a steering unit 12 and a brake unit 13. The camera shooting unit 2 has a built-in camera lens and an image sensor to shoot the front of the vehicle. The camera control unit 3 performs image processing of the captured image and detects and identifies objects. The vehicle control unit 4 uses the identification information to perform driving assistance such as braking control or steering control. The illuminance meter 5 displays the illuminance outside the vehicle. The CAN 6 performs intra-vehicle communication. The headlight unit 10 controls the headlights that illuminate the front of the vehicle. The map unit 11 has information on the location of the vehicle and its surrounding environment. The steering unit 12 and the brake unit 13 are actuators of the vehicle.
[0039] The function of the camera shooting unit 2 is to shoot images, and it shoots images and outputs RAW images using an LVDS cable. Although omitted in the figure, the camera shooting unit 2 has left and right lenses, an image sensor, a serializer that changes image digital data into a serial signal, and a shutter setting unit 27. The shutter setting unit 27 stores the timing information of the shooting shutter. For example, the information such as a cycle of 350ms, a total of 8 shutters, 2 of which are 25ms, and 6 of which are 50ms (shooting timing mode) is stored (refer to Figure 4 ).
[0040] The camera control unit 3 is connected from the camera shooting unit 2 via an LVDS cable, and is composed of an image processing unit 20, a recognition unit 21, a light control unit 23 and a CAN-IF unit 22. The image processing unit 20 processes the transmitted RAW image, the recognition unit 21 recognizes objects and lanes in the image, the light control unit 23 controls the timing of turning on and off the headlights and switches the light distribution control between high beam and low beam according to the presence or absence of a vehicle, and the CAN-IF unit 22 is connected to the CAN bus to send and receive data.
[0041] The image processing unit 20 has a function of issuing a shutter instruction as a shooting timing to the camera imaging unit 2 and a function of generating an image required for recognition using the transmitted RAW image. The former function is performed by a shooting timing calculation unit 30 that calculates the shooting timing of the camera imaging unit 2 and a shooting phase adjustment unit 31 that shifts the phase of the shooting timing to match the lighting and extinguishing of the lamp and issues a shutter instruction as the shooting timing to the camera imaging unit 2. Although omitted in the figure, the latter function is composed of a deserializer, a disparity image generating unit 33, a brightness image generating unit 32, an image comparing unit 34 and an edge image generating unit 35. The deserializer generates RAW image data based on a serial signal. The disparity image generating unit 33 generates a disparity image with distance information in pixels based on the left and right RAW images. The brightness image generating unit 32 generates a brightness image based on one of the left and right RAW images. The image comparing unit 34 compares two or more images with a time difference. The edge image generating unit 35 generates an edge image based on the gradient of the brightness image.
[0042] The recognition unit 21 is composed of a blackout duty calculation unit 40, a pseudo-object removal unit 41, a moving object determination unit 42, a lane-road boundary detection unit 43, and a light distribution lamp detection unit 44. The blackout duty calculation unit 40 specifies the duty of the time when the headlights are turned on and off. The pseudo-object removal unit 41 removes pseudo-objects such as reflections of the lights of the vehicle itself, which are actually non-existent objects. The moving object determination unit 42 determines whether it is a stationary object or a moving object. The lane-road boundary detection unit 43 detects lanes based on images and uses reflective objects such as lanes, curbs, shoulders, and guardrails to detect road boundaries. The light distribution lamp detection unit 44 detects the headlights and taillights of other vehicles for light distribution control.
[0043] The lamp control unit 23 includes a duty instruction unit 70 for defining the timing of lighting and extinguishing the headlights by a duty ratio, and a light distribution instruction unit 71 for instructing light distribution control to switch between high beam and low beam according to the presence or absence of a vehicle.
[0044] The vehicle control unit 4 is composed of a lane departure control unit 24, an automatic emergency braking control unit 25 and a CAN-IF unit 26. The lane departure control unit 24 determines whether the vehicle has deviated from the lane, and issues an alarm or a steering control instruction to return to the lane when the vehicle has deviated. The automatic emergency braking control unit 25 determines whether the vehicle will collide with an obstacle, and automatically issues an emergency braking instruction when the possibility of a collision is high. The CAN-IF unit 26 is connected to the CAN bus to send and receive data.
[0045] The lane departure control unit 24 is composed of a own vehicle trajectory calculation unit 52, a deviation determination unit 53 and a control unit 51. The own vehicle trajectory calculation unit 52 predicts and calculates the own vehicle trajectory, and the deviation determination unit 53 determines whether to deviate toward the road boundary based on the own vehicle trajectory and road boundary information. When deviating toward the road boundary, the control unit 51 issues an alarm or a steering control instruction.
[0046] The automatic emergency braking control unit 25 is composed of an obstacle trajectory calculation unit 60, a risk calculation unit 61 and a control unit 62. The obstacle trajectory calculation unit 60 calculates the trajectory of the obstacle, the risk calculation unit 61 calculates the trajectory of the own vehicle and calculates the collision risk with the obstacle, and the control unit 62 generates a warning or braking instruction based on the collision risk.
[0047] In this embodiment, the lighting and extinguishing of the light and the camera shooting are independently performed in an asynchronous manner, but both are periodic processing, and a specific number of shots are taken when the light is on and when it is off by adjusting the phase. The example of the light being automatically lit is used, but it is not limited to manual lighting by hand and can also be applied.
[0048] Figure 5 This is a flow chart showing the phase adjustment of the lighting and extinguishing of the display lamp and the timing of shooting.
[0049] First, when controlling the lighting of the lamp, the setting starts from when the brightness level in the illuminance meter 5 has dropped. The illuminance is calculated in the illuminance meter 5 and sent to the camera control unit 3 (S11). When the illuminance is not below the threshold value (S12), the lighting and extinguishing control is not started. When the illuminance is below the threshold value (S12), the lighting and extinguishing control is started. The extinguishing duty calculation unit 40 uses the data stored in the memory to calculate the extinguishing duty (S13). The extinguishing duty represents the cycle time (the time interval between extinguishing and lighting) and the time ratio between extinguishing and lighting. The following operations are performed in the image processing unit 20 and the lamp control unit 23 respectively using the extinguishing duty. In the image processing unit 20, the shutter timing of the shooting time calculation unit 30 is calculated using the extinguishing duty to calculate how many times to shoot when extinguishing and lighting, that is, the shutter timing of shooting, and the shutter timing is instructed to the camera shooting unit 2 (S14). The shutter timing is calculated so that a large number of images are taken in a short time when the light is off, and images are taken at a certain interval (periodically) when the light is on, and images can be taken near the switching between off and on. That is, the camera imaging unit 2 is set to a regular interval and an interval shorter than the interval and a different shooting timing mode from the on and off mode according to the on and off mode of the frequency and duty specified for the headlight unit 10 described later in the shooting timing calculation unit 30. The camera imaging unit 2 sets the shutter timing to the shutter setting unit 27 according to the shutter timing (shooting timing mode) transmitted from the image processing unit 20, and shoots at the set timing (S15). The light control unit 23 receives the off duty in parallel with the image processing unit 20, and instructs the headlight unit 10 to set the off duty in the duty indication unit 70 (S16). That is, the on and off mode of the frequency (corresponding to the time interval between off and on) and duty is set to the headlight unit 10 in the duty indication unit 70. In addition, the light distribution instruction unit 71 controls the headlight unit 10 (light distribution) in such a way that the light on and off pattern is used. The headlight unit 10 sets the light off duty (light on and off pattern) in the light distribution duty setting unit 28, and the light distribution control unit 29 periodically turns on and off at the prescribed light off duty (S17). For example, if the period is set to 1 sec and the light off duty is 1:9, the light on and off is repeated with a light off time of 100 ms and a light on time of 900 ms (see Figure 4 (a)).
[0050] Next, the photographing phase adjustment unit 31 performs phase adjustment to adjust the phase of the lighting and extinguishing of the headlights and the photographing timing. The photographing phase adjustment unit 31 shifts the phase of the shutter timing (photographing timing mode) and indicates the phase information to the camera photographing unit 2 (S18). The camera photographing unit 2 sets the phase information to the shutter setting unit 27 and photographs with the phase shifted at the set timing (S19). The photographing phase adjustment unit 31 measures the brightness of specific pixels of each screen (for example, pixels at positions that are not directly illuminated by the headlights but will definitely show a difference due to the lighting and extinguishing of the headlights), and determines whether it is an image when the headlights are on or off based on the brightness, and confirms whether the number of images when the headlights are on and the number of images when the headlights are off, which are periodically photographed at the shutter timing under the corresponding phase, is consistent with the assumption (that is, whether it is the same as the number of images when the headlights are off and the number of images when the headlights are on) (S20). If the number of images when the headlights are on and the number of images when the headlights are off are different (S21), the photographing phase adjustment unit 31 performs phase adjustment again for phase adjustment (S18). In this way, the phase adjustment has a self-adjustment (self-test) function.
[0051] After the phase adjustment is automatically performed at the beginning of the lamp lighting (refer to Figure 4 (b)) uses obstacles (objects) on the screen to perform recognition processing.
[0052] Figure 6 A flowchart showing object recognition is shown. The camera is assumed to be a stereo camera, but there is no particular limitation.
[0053] First, the image processing unit 20 of the camera control unit 3 receives the left and right RAW images from the camera shooting unit 2 (S31). In the brightness image generation unit 32, a brightness image is generated based on the right RAW image (S32) to extract the brightness of the object. The brightness image can use any left or right RAW image. In the shooting phase adjustment unit 31, the brightness of the pixel is measured at a specific pixel of each screen, such as a pixel at a position where the headlight is not directly illuminated but will definitely be different due to the lighting of the headlight. The lighting of the headlight is determined based on a predetermined brightness threshold, and the lighting attribute indicating whether the headlight is on or off is calculated for the brightness image (S33). In addition, the parallax image generation unit 33 generates a parallax image with a distance for each pixel using triangulation based on the left and right RAW images (S34). For the detected object, the parallax image generation unit 33 uses the parallax image to add an ID as an identification number to each object, and adds a relative position attribute containing the distance to the own vehicle (S35).
[0054] Next, the image comparison unit 34 determines the reflective object and the luminous object, and adds the reflective / luminous object attribute. The attribute is updated at any time until it is determined. The object that can be detected in the lit image may be both a luminous object and a reflective object, so it is set as an indefinite attribute and regarded as uncertain. The object that can be detected in the extinguished image is determined to be a luminous object. Since the lighting and extinguishing attributes are added to the image, when one of the images at a certain moment (t1) when the object is photographed and the other at the previous moment (t2) when the object is photographed has a lighting attribute and the other has an extinguishing attribute, an image comparison is performed. The brightness images of the lighting and the extinguishing are compared, and the objects detected in both the extinguishing and lighting conditions are determined (extracted) as luminous objects, and the objects detected only when lit are determined (extracted) as reflective objects. The categories of these luminous objects and reflective objects are added as reflective / luminous object attributes (S36).
[0055] Furthermore, the image comparison unit 34 compares a plurality of brightness images taken at a continuous time, and calculates and adds a motion vector based on the difference in the relative coordinates of the object (S37). The object includes both a reflective object and a luminous object. There are three types of comparisons of the brightness images of the two images: mutually lit, mutually unlit, and lit and unlit. In the comparison of mutually lit, the motion vectors of both the luminous object and the reflective object can be calculated, while in the comparison of mutually unlit and lit and unlit, only the motion vector of the luminous object can be calculated. By using a plurality of trajectory images taken at a continuous time, since the reflective object cannot be detected in the unlit part of the image, the motion vector is calculated by supplementing the brightness image when lit and connecting them. The motion vector between a certain moment (t1) when each object is photographed and the previous moment (t2) when each object is photographed is maintained as an attribute. Regarding the reflective object that is off at time (t1) and lit at time (t2), the object was lit at time (t3) before it was photographed relative to time (t2), so the relative position of time (t1) is predicted using the relative positions of time (t2) and time (t3). The position of time (t1) is unknown, so the relative coordinates of time (t1) are assumed to be uniform linear motion after time (t2) and time (t3), and the motion vector is calculated based on the relative coordinates of time (t1) and time (t2). The example shown here uses time (t3), but in order to improve accuracy, the coordinates of multiple earlier shooting times can also be used, which improves the prediction accuracy.
[0056] For objects that appear to be objects due to the influence of the headlights of the own vehicle, although there are no objects in reality among the reflective objects, the objects with zero motion vectors among the objects with the properties of reflective and luminous objects can be determined as pseudo objects in the pseudo object removal unit 41 and removed (S38). As a result, in the light distribution control of the headlight unit 10 described later (light distribution control for switching from high beam to low beam when an obstacle is detected), pseudo objects such as reflections of the lights of the own vehicle, which are objects that do not actually exist, can be removed from the obstacle objects of the light distribution control. Then, in the moving object determination unit 42, objects having a vector with the same movement amount and opposite movement direction as the own vehicle are determined as stationary objects, and objects with different movement amounts and vectors are determined as moving objects, and the motion vector is added to the object information as a moving object attribute (S39).
[0057] In this way, the object is detected in the camera control unit 3, and the detected object is determined to be a reflective object or a luminous object by comparing the brightness images when the headlights are on and when they are off, and the reflective / luminous object attributes are added, and the parallax image is used to add the relative position attribute including the distance information from the own vehicle, and then the moving body attributes are added by comparing multiple brightness images.
[0058] Next, lane recognition is described. In addition to conventional lane detection, reflectors or delineators on roadside guardrails are used as reflective objects. When a lane cannot be detected due to missing or blurred lanes, the information from reflective objects is used to improve the lane detection rate.
[0059] Figure 7 A flowchart of the lane-road boundary detection unit 43 is shown.
[0060] First, a brightness image is generated in the brightness image generating unit 32 of the image processing unit 20 (S41). An edge image is generated based on the gradient of the brightness image in the edge image generating unit 35 (S42). A lane is detected based on the edge image in the lane-road boundary detecting unit 43, and is calculated as a coordinate point corresponding to a certain relative distance from the own vehicle (S43).
[0061] In addition to the lanes, reflective objects arranged at fixed intervals on the shoulders of the road are also identified as objects, so the information of the objects is used. In the lane / road boundary detection unit 43, a plurality of objects that are reflective objects in the reflective / luminous object attribute, are stationary objects in the moving body attribute, and are detected at equal intervals in the relative position to the own vehicle are extracted as a road boundary group (S44). That is, in the lane / road boundary detection unit 43, when reflective objects determined to be stationary objects are arranged at equal intervals (at a fixed distance) in the relative position to the own vehicle, they are determined to be road boundaries (groups). As lane information, whether to use lane detection information or road boundary groups is selected depending on whether a lane is detected on the screen. When a lane is detected on the screen (S45), the coordinate points of the lane detection are output as lane information in the lane / road boundary detection unit 43 (S46). When no lane is detected on the screen ( S45 ), the lane / road boundary detection unit 43 outputs a coordinate point closer to the own vehicle by a certain distance from the coordinates of the road boundary group as lane information ( S47 ).
[0062] Next, a method of light distribution control is used for explanation, wherein the light distribution control uses the information of the recognized object to control the high beam and low beam of the headlight. The so-called light distribution control refers to the technology of switching to high beam when there is no object and switching to low beam when there is an object, that is, switching between high beam and low beam according to the presence or absence of the object. As a feature of the first embodiment of the present invention, the reflective / luminous object properties of the recognized object are used to remove pseudo objects from the objects of light distribution control for the reflective objects including pseudo objects (pseudo object removal unit 41).
[0063] Figure 8 A flow chart showing the light distribution control.
[0064] If the high beam and low beam are frequently switched in the light distribution control of the headlights, the driver will feel uncomfortable, so objects are accumulated and saved from multiple images to improve the accuracy of obstacle detection (S51). Confirm whether the same object exists in multiple images (S52). In the case of the same object, the reflection / luminous object attribute of the object is used. In the case of a reflective object, it is considered that there is no object (S53). Furthermore, in the case of not being a reflective object (S53), it is determined whether the same object is the headlight or taillight of another vehicle detected by the light distribution lamp detection unit 44 (S54).
[0065] When the three conditions (S52, S53, S54) are satisfied, it is determined that there is a valid object to be set to low beam, and a light distribution instruction to set to low beam is generated in the light distribution instruction unit 71, and the light distribution instruction is sent to the headlight unit 10 (S55). The light distribution control unit 29 of the headlight unit 10 controls the headlight to be set to low beam (S56).
[0066] When any one of the three conditions (S52, S53, S54) is not satisfied, it is determined that there is no valid object to be set to low beam, and control to set to high beam is performed. A light distribution instruction to set to high beam is generated in the light distribution instruction unit 71, and the light distribution instruction is sent to the headlight unit 10 (S57). The light distribution control unit 29 of the headlight unit 10 controls the headlight to set to high beam (S58).
[0067] The reflective object determination condition (S53) and the object determination condition (S54) of the light distribution control can be changed and expanded. For example, in this embodiment, the headlights or taillights of other vehicles are used as the luminous objects, but if the attributes of pedestrians or bicycles can be added, the situation where pedestrians or bicycles are detected as reflective objects can also be added to the conditions.
[0068] Next, the vehicle control unit 4 calculates the automatic emergency braking control and the lane departure control using the object information and the lane information as the recognition result of the camera control unit 3 .
[0069] Fig. 9 A flow chart showing automatic emergency braking control.
[0070] The camera control unit 3 sends the reflective / luminous object attribute, relative position attribute, and moving body attribute as the identified object information (S61). After receiving the identified object information, the automatic emergency braking control unit 25 uses the accumulated object information in the obstacle trajectory calculation unit 60 to predict the trajectory of the obstacle (S62). In the obstacle trajectory calculation unit 60, for the luminous object determined by the reflective / luminous object attribute, the relative position information in the object information is used to predict the trajectory. For the reflective object determined by the reflective / luminous object attribute, since it cannot be detected during the extinguishing period and the relative position is unknown, the position is predicted by linear complementation or polynomial complementation based on the relative position of multiple past times, thereby predicting the trajectory (S63). Since the reflective object corresponds to both a stationary object and a moving object, the moving body attribute is not used. However, the moving body attribute can also be used. For the stationary object determined by the moving body attribute, the trajectory prediction is skipped and it is regarded as stationary in terms of the trajectory of the object, and the relative position with respect to the own vehicle trajectory is calculated. For example, in the obstacle trajectory calculation unit 60, when the reflective object is a moving object, the moving object is judged to be a pedestrian or a bicycle based on the comparison of the relative speed with the own vehicle, and the future trajectory is predicted based on the past trajectory. Then, the risk calculation unit 61 calculates whether the trajectory of the object of the luminous object and the reflective object is on the path of the own vehicle on which the own vehicle is traveling, and the risk of collision (S64). In the control unit 62, an alarm or emergency brake control instruction is issued based on the collision risk of the risk calculation unit 61 (when the risk of collision with the own vehicle is judged to be high) (S65). Thereafter, the brake unit 13 of the actuator receives the emergency brake control instruction via CAN 6, and performs brake control of the own vehicle based on the control instruction.
[0071] Fig.10 A flow chart showing automatic lane departure control.
[0072] The camera control unit 3 sends the attributes of the reflective / luminous object, the attributes of the relative position, the attributes of the moving object, and the recognized lane information (S71) as the recognized object information. The own vehicle trajectory calculation unit 52 predicts the trajectory of the own vehicle based on the steering information of the own vehicle (S72). The trajectory predicted based on the steering information and the recognized lane information are input to the deviation judgment unit 53 to calculate the risk of lane deviation (S73). In the control unit 51, an alarm or steering control instruction is issued in a manner to avoid lane deviation (a manner to prevent intrusion into the road boundary) based on the lane deviation risk of the deviation judgment unit 53 (S74). Thereafter, the steering unit 12 of the actuator receives the steering control instruction via the CAN 6, and performs the steering control of the own vehicle based on the control instruction.
[0073] [Second embodiment] If the on-off duty of the headlights is synchronized with that of other vehicles and is the same duty, the headlights of other vehicles will always be off from the perspective of the own vehicle. Therefore, this situation can be avoided by setting the on-off cycle of the headlights to a multi-duty method with multiple duties.
[0074] The principle of the second embodiment is shown in Fig.11 . Within the two cycles, the ratio of off-to-on in the first cycle is 1:9, and the ratio of off-to-on in the second cycle is 1:4. In other words, the headlights are periodically turned on and off with multiple different duty cycles (1:9 in the first cycle, 1:4 in the second cycle). The shooting timing of the camera is also set to a variable shooting timing to match the on-off duty of the two cycles. By performing phase adjustment, the first cycle takes 2 shots when off and 6 shots when on, and the second cycle takes 3 shots when off and 5 shots when on. Repeat this cycle. Two cycles are an example, and the possibility of synchronization with other vehicles can be significantly reduced by setting a multi-duty method of multiple cycles such as 3 or 4 cycles.
[0075] The system configuration diagram of the second embodiment can be Figure 1 The extinguishing duty calculation unit 40 changes to multiple duty, and accordingly, the duty indication unit 70 of the light control unit 23 and the extinguishing duty setting unit 28 of the headlight unit 10 change to light control corresponding to multiple duty. In addition, the shooting timing of the camera also performs variable shooting corresponding to multiple duty in coordination with the headlight. Specifically, the shooting timing calculation unit 30 of the image processing unit 20, the shooting phase adjustment unit 31, and the shutter setting unit 27 of the camera shooting unit 2 perform variable shutter control corresponding to multiple duty of lighting on and off.
[0076] The first embodiment and the second embodiment of the present invention can also be expanded in the following manner.
[0077] The headlight off duty calculation of the recognition unit 21 can be set to be variable and not fixed to the off duty calculation unit 40. To set the off duty to be variable, for example, it can be set according to a random number when the ignition is turned on. In addition, in order to reduce the frequency of the headlights being turned off, the headlights can be turned off only during a specific period or at a specific location based on the map information of the map unit 11.
[0078] [Summary of the first and second embodiments] As described above, the camera control device (camera control unit 3) of the present embodiment is a camera control device that controls a headlight unit 10 that illuminates the front of the own vehicle and a camera photographing unit 2 that photographs the front of the own vehicle, wherein the camera control device sets a lighting and extinguishing mode (duty indication unit 70) of a specified frequency and duty for the headlight unit 10, controls (the light distribution of) the headlight unit 10 in a manner of lighting and extinguishing using the lighting and extinguishing mode (light distribution indication unit 71), sets a shooting timing mode (shooting timing calculation unit 30) different from the lighting and extinguishing mode, including a regular first shooting time interval and a second shooting time interval shorter than the first shooting time interval, for the camera photographing unit 2 according to the specified frequency and duty for the headlight unit 10, and adjusts the time phase (shooting phase) of the shooting timing mode of the camera photographing unit 2, thereby reducing (shortening) the shooting time interval when the headlight unit 10 switches between being turned off and being turned on (shooting phase adjustment unit 31).
[0079] The camera control device adjusts the time phase of the imaging timing pattern of the camera imaging unit 2 according to the number of images captured by the camera imaging unit 2 at the time of lighting and the number of images captured at the time of non-lighting with the time phase shifted (imaging phase adjustment unit 31).
[0080] The camera control device measures the brightness of specific pixels of each image captured by the camera shooting unit 2 with the time phase offset, uses the brightness to judge the image when it is lit and the image when it is off, and confirms the number of images when it is periodically lit and the number of images when it is off that are captured with the shutter timing at the time phase, thereby adjusting the time phase of the shooting timing mode of the camera shooting unit 2 (shooting phase adjustment unit 31).
[0081] The camera control device compares the first brightness image and the second brightness image captured by the camera shooting unit 2 based on the extinguishing and lighting of the headlight unit 10 to extract the reflective object, and compares multiple brightness images to calculate the movement vector of the reflective object in the image, and determines the reflective object as a stationary object when the movement vector of the reflective object is opposite to the movement vector of the own vehicle, and determines the reflective object as a pseudo object when the movement vector of the reflective object is zero, and determines the reflective object as a moving object otherwise (brightness image generation unit 32, image comparison unit 34, pseudo object removal unit 41, moving body determination unit 42).
[0082] The camera control device sets the duty of the headlight unit 10 to be variable (the turn-off duty calculation unit 40 ).
[0083] The camera control device sets the duty of the headlight unit 10 (the off duty calculation unit 40 ) based on a random number.
[0084] The camera control device periodically turns on and off the headlight unit 10 at a plurality of different duties (the turn-off duty calculation unit 40 , the duty instruction unit 70 , and the light distribution instruction unit 71 ).
[0085] The camera control device turns off the headlight unit 10 only during a specific period or at a specific position based on map information (turn-off duty calculation unit 40 ).
[0086] The camera control device removes the pseudo object among the reflective objects from the obstacle objects in the light distribution control of the headlight unit 10 that switches from high beam to low beam when an obstacle is detected (pseudo object removal unit 41, light distribution instruction unit 71).
[0087] In addition, the vehicle control device (vehicle control unit 4) of the present embodiment is a vehicle control device that controls the own vehicle based on information output from the camera control device, wherein the vehicle control device determines that the reflective object determined to be the stationary object is arranged at a fixed distance as a road boundary, and controls the alarm or the steering of the own vehicle (lane departure control unit 24) in a manner to prevent intrusion into the road boundary.
[0088] In addition, the vehicle control device (vehicle control unit 4) of the present embodiment is a vehicle control device that controls the own vehicle based on information output from the camera control device, wherein, when the reflecting object is the moving object, the vehicle control device determines the moving object to be a pedestrian or a bicycle based on the comparison of the relative speed with the own vehicle, predicts the future trajectory based on the past trajectory, calculates the risk of collision with the own vehicle, and performs an alarm or automatic emergency braking control (automatic emergency braking control unit 25) when it is judged that the risk of collision with the own vehicle is high.
[0089] As described above, according to the present embodiment, the following various advanced driver assistance systems (ADAS) can be realized: reflective objects and luminous objects can be detected by periodically turning off the headlights for a short period of time and taking pictures at a short interval at the boundary between turning off and turning on, and false objects among reflective objects that are seen as objects on the road due to reflections of headlights, etc. can be correctly removed to avoid erroneous headlight distribution control or automatic emergency braking due to false objects. Furthermore, reflective objects such as curbs or guardrails can be used as road boundaries and as substitutes for lanes when they cannot be detected, thereby improving the performance of the automatic lane departure prevention system.
[0090] Furthermore, the present invention includes various modifications and is not limited to the above-described embodiments. For example, the above-described embodiments are described in detail to explain the present invention in an easy-to-understand manner, and are not necessarily limited to having all the described configurations.
[0091] In addition, the above-mentioned various structures, functions, processing units, processing methods, etc. can be implemented in part or in whole by hardware, for example, by designing using integrated circuits. In addition, the above-mentioned various structures, functions, etc. can also be implemented in software by interpreting and executing programs that implement various functions by a processor. Information such as programs, tables, files, etc. that implement various functions can be placed in storage devices such as memories, hard disks, SSDs (Solid State Drives), or recording media such as IC cards, SD cards, and DVDs.
[0092] In addition, the control lines and information lines are shown as those considered necessary for explanation, and not all control lines and information lines may be shown on the product. In fact, it can be considered that almost all components are connected to each other. Explanation of symbols
[0093] 1…Vehicle 2…Camera shooting unit 3…Camera control unit (camera control device) 4…Vehicle control unit (vehicle control device) 5…Luminance meter 6…CAN 10…Headlight 11…Map Department 12…steering department 13…Brake 20…Image Processing Department 21…Identification Department 22, 26…CAN-IF Department 23…Lighting control unit 24…Lane Departure Control 25…Automatic emergency brake control unit 27…Shutter setting section 28…Extinguishing duty setting unit 29…Light distribution control department 30…Photographing timing calculation unit 31…Photographing phase adjustment unit 32…Brightness image generation unit 33…Parallax image generation unit 34…Image comparison unit 35…Edge image generation unit 40… Extinguish duty calculation unit 41…False object removal unit 42…Moving object determination unit 43…Lane and road boundary detection unit 44…Light distribution lamp detection unit 51, 62…Control unit 52…Own vehicle trajectory calculation unit 53…Deviation determination unit 60…Obstacle trajectory calculation unit 61…Risk Calculation Department 70…Occupancy indication unit 71...Light distribution indicator part 100…headlights of the oncoming vehicle at time t1 101 ...Reflection on the reflective object of the curb at time t1 102 ... reflection on the reflective object of the guardrail at time t1 103 ...Reflection of the headlight of the own vehicle at time t1 (pseudo object) 104 ...headlights of the oncoming vehicle at time t2 111 ... reflective object of a bicycle in the lane at time t1 112 ...Reflective object of a stationary object outside the lane at time t1 113 ... a pseudo object formed by the reflection of the headlights in the lane at time t1 114 ... reflective object of a bicycle in the lane at time t2 115 ...Reflective object of a stationary object outside the lane at time t2 116 ... a pseudo object formed by the reflection of the headlights in the lane at time t2 117 ... the movement vector of the reflection object of the bicycle in the lane at time t2-t1 118 ... the moving vector of the reflecting object of the stationary object outside the lane at time t2-t1 119 ...The movement vector of the pseudo object formed by the reflection of the headlight in the lane at time t2-t1.
Claims
1. A camera control device that controls a headlight unit and a camera imaging unit, wherein the headlight unit illuminates the front of a vehicle and the camera imaging unit captures the front of the vehicle, wherein the camera control device is characterized in that: setting a lighting and extinguishing pattern of a predetermined frequency and duty for the headlight unit, and controlling the headlight unit in a manner of lighting and extinguishing using the lighting and extinguishing pattern, A shooting timing mode different from the lighting-on-off mode, in which a regular first shooting time interval and a second shooting time interval shorter than the first shooting time interval are set for the camera shooting unit according to a prescribed frequency and duty cycle for the headlight portion, and the time phase of the shooting timing mode of the camera shooting unit is adjusted, thereby reducing the shooting time interval when the headlight portion is switched between being turned off and turned on.
2. The camera control device according to claim 1, It is characterized in that The camera control device adjusts the time phase of the imaging timing pattern of the camera imaging unit according to the number of images when lit and the number of images when unlit of the images captured by the camera imaging unit with the time phase shifted.
3. The camera control device according to claim 1, It is characterized in that The camera control device measures the brightness of specific pixels of each image captured by the camera shooting unit with the time phase offset, uses the brightness to judge the image when it is lit and the image when it is off, and confirms the number of images when it is periodically lit and the number of images when it is off that are captured with the shutter timing at the time phase, thereby adjusting the time phase of the shooting timing mode of the camera shooting unit.
4. The camera control device according to claim 1, It is characterized in that The camera control device compares a first brightness image and a second brightness image captured by the camera shooting unit based on the extinguishing and lighting of the headlight unit to extract a reflective object, and compares multiple brightness images to calculate a movement vector of the reflective object in the image. When the movement vector of the reflective object is opposite to the movement vector of the own vehicle, the reflective object is determined to be a stationary object; when the movement vector of the reflective object is zero, the reflective object is determined to be a pseudo object; otherwise, the reflective object is determined to be a moving object.
5. The camera control device according to claim 1, It is characterized in that The camera control device sets the duty of the headlight unit to be variable.
6. The camera control device according to claim 5, It is characterized in that The camera control device sets the duty of the headlight unit according to a random number.
7. The camera control device according to claim 1, It is characterized in that The camera control device periodically turns on and off the headlight unit at a plurality of different duty cycles.
8. The camera control device according to claim 1, It is characterized in that The camera control device turns off the headlight unit only during a specific period or at a specific position based on map information.
9. The camera control device according to claim 4, It is characterized in that The camera control device removes the pseudo object among the reflective objects from obstacle objects in the light distribution control in the light distribution control of the headlight unit that switches from high beam to low beam when an obstacle is detected.
10. A vehicle control device, It is characterized in that controlling the own vehicle based on information output from the camera control device according to claim 4, The vehicle control device determines that the reflective object determined as the stationary object is a road boundary when the reflective object is arranged at a fixed distance, and controls an alarm or the steering of the own vehicle so as to prevent the vehicle from intruding into the road boundary.
11. A vehicle control device, It is characterized in that controlling the own vehicle based on information output from the camera control device according to claim 4, In the case where the reflecting object is the moving object, the vehicle control device determines the moving object to be a pedestrian or a bicycle based on the comparison of the relative speed with the own vehicle, predicts the future trajectory based on the past trajectory, calculates the risk of collision with the own vehicle, and performs an alarm or automatic emergency braking control when it is judged that the risk of collision with the own vehicle is high.
Citation Information
Patent Citations
Head lamp system
JP2007076429A
Vehicular headlight system
JP2011110999A
