Shooting control device, shooting control method and program

Abstract

To secure visibility of periphery even when a problem occurs in a head lamp of a vehicle.SOLUTION: A photographing control device comprises: an image data acquisition unit for acquiring image data obtained by photographing the outside of a vehicle; a lamp abnormality detection unit for detecting a trouble of a vehicle lamp; and a display control unit for causing a display unit to display the image data when the trouble of the vehicle lamp is detected.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging control device, an imaging control method, and a program. [Background technology]

[0002] A drive recorder mounted on a vehicle includes, for example, a camera that captures the view ahead, a recording unit that records the video data captured by the camera, and a display unit that displays the video data captured by the camera and the video data recorded in the recording unit. While the vehicle is traveling, the camera captures the view ahead, and the recording unit records the video data captured by the camera. An example of such a drive recorder is described in Patent Document 1 below. Some of these drive recorders have a display unit shared with the main body or other systems, and display and check video data, etc., inside the vehicle. However, during normal operation, such as when the vehicle is traveling or temporarily stopped, the display unit is turned off so as not to interfere with driving, and video data, etc. is displayed when a specified operation is performed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-290462 A Summary of the Invention [Problem to be solved by the invention]

[0004] If a vehicle's lights fail for some reason while the vehicle is traveling at night, the driver's forward visibility will be insufficient on roads without streetlights, etc. This may cause problems for the driver in driving the vehicle.

[0005] The present invention has been made in view of the above, and has an object to ensure peripheral visibility even when a malfunction occurs in the vehicle's headlights. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the shooting control device of the present invention includes a video data acquisition unit that acquires video data captured outside the vehicle, a lighting abnormality detection unit that detects a malfunction in the vehicle lights, and a display control unit that displays the video data on a display unit when a malfunction in the vehicle lights is detected.

[0007] The photography control method of the present invention includes a video data acquisition step of acquiring video data photographed outside the vehicle, a lighting abnormality detection step of detecting a malfunction in the vehicle lights, and a display control step of displaying the video data on a display unit when a malfunction in the vehicle lights is detected.

[0008] The program of the present invention causes a computer operating as an imaging control device to execute a video data acquisition step of acquiring video data captured outside the vehicle, a lighting abnormality detection step of detecting a malfunction in the vehicle lights, and a display control step of displaying the video data on a display unit when a malfunction in the vehicle lights is detected. Effect of the Invention

[0009] According to the present invention, it is possible to ensure peripheral visibility even if a malfunction occurs in the headlights of a vehicle. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a vehicle imaging device having an imaging control device according to this embodiment. [Diagram 2] FIG. 2 is a front view showing the vehicle imaging device. [Diagram 3] FIG. 3 is a rear view showing the vehicle imaging device. [Figure 4] FIG. 4 is a front view showing a modified example of the vehicle imaging device. [Diagram 5] FIG. 5 is a flowchart showing the flow of imaging processing in the imaging control device according to this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an imaging control device, an imaging control method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment.

[0012] [Vehicle camera] FIG. 1 is a block diagram showing an example of the configuration of a vehicle imaging device having an imaging control device according to this embodiment, FIG. 2 is a front view showing the vehicle imaging device, FIG. 3 is a rear view showing the vehicle imaging device, and FIG. 4 is a front view showing a modified example of the vehicle imaging device.

[0013] In this embodiment, as shown in Fig. 1, a vehicle image capturing device 10 acquires image data capturing the outside of a vehicle, and when a problem occurs with a vehicle light, the image data is displayed on a display unit. In this embodiment, the vehicle light is a headlamp.

[0014] The vehicular imaging device 10 is a so-called drive recorder, and may be a device that is portable and usable in a vehicle, in addition to being installed in the vehicle. As shown in Fig. 2 and Fig. 3, the vehicular imaging device 10 is fixed to a vehicle windshield via a mounting part 20. The vehicular imaging device 10 has a camera 210 and an illuminance sensor 270 mounted on the front side. The vehicular imaging device 10 has a display part 240 mounted on the rear side. The camera 210 is, for example, a high-sensitivity camera.

[0015] The vehicle image capturing device 10 is not limited to the above-mentioned configuration. As shown in FIG. 4, the vehicle image capturing device 10 may have an optical camera 210A, an infrared camera 210B, and an illuminance sensor 270 mounted on the front side. The optical camera 210A and the infrared camera 210B can be switched or used in conjunction with each other. For example, the optical camera 210A is used during the day when the vehicle headlights are not needed or at night when the headlights are working normally. On the other hand, the infrared camera 210B is used at night when the vehicle headlights are not functioning properly and the light ahead is insufficient. The vehicle image capturing device 10 may have an infrared illumination light source (not shown) to operate the infrared camera 210B efficiently.

[0016] As shown in Figures 1 and 2, the vehicle imaging device 10 has a camera (imaging unit) 210, a recording unit 220, an operation unit 230, a display unit 240, an acceleration sensor 250, a GPS (Global Positioning System) receiving unit 260, an illuminance sensor 270, and an imaging control device 100.

[0017] The camera 210 is a camera that captures the outside of the vehicle. In this embodiment, the camera 210 is a high-sensitivity camera that is described as being capable of capturing images at about 100° or more in the horizontal direction and at about 55° or more in the vertical direction. However, the camera 210 is not limited to this, and may be a camera that can capture images of the entire 360° sky, or a group of multiple cameras that capture images in each direction.

[0018] The camera 210 is disposed, for example, at the front of the vehicle interior. The camera 210 constantly captures video from when the engine starts until it stops, that is, while the vehicle is operating. The camera 210 constantly captures video while the accessory power of the vehicle is ON. The camera 210 starts capturing video when the accessory power is OFF, in other words, when an event is detected while the vehicle is parked. The camera 210 outputs the captured video data to the video data acquisition unit 120 of the imaging control device 100. The video data is, for example, a moving image composed of images of 30 frames per second.

[0019] The recording unit 220 is used for storing data in the vehicle image capturing device 10. The recording unit 220 is, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a recording unit such as a memory card. Alternatively, the recording unit 220 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 220 records the event recording data or the loop recording data based on a control signal output from the recording control unit 123 of the image capturing control device 100. The event recording data and the loop recording data will be described later.

[0020] The operation unit 230 can accept various operations for the vehicular imaging device 10. For example, the operation unit 230 can accept an operation to manually save the captured video data in the recording unit 220. For example, the operation unit 230 can accept an operation to play the event recording data or the loop recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to erase the event recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to end the loop recording. The operation unit 230 outputs operation information to the operation control unit 125 of the imaging control device 100.

[0021] The operation unit 230 is, for example, a touch panel provided on the display unit 240, and an operation for playing back the event record data stored in the recording unit 220 is performed by touching a list of the event record data displayed on the display unit 240, thereby selecting the event record data and issuing a playback instruction. The list of the event record data is displayed as thumbnails, for example.

[0022] The display unit 240 is, for example, a display device specific to the vehicle imaging device 10, or a display device shared with other systems including a navigation system. The display unit 240 is, for example, a display including a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. In this embodiment, the display unit 240 is formed integrally with the camera 210. The display unit 240 displays an image based on a video signal output from the display control unit 126 of the imaging control device 100. The display unit 240 displays an image captured by the camera 210 or an image recorded in the recording unit 220.

[0023] The acceleration sensor 250 is a sensor that detects acceleration applied to the vehicle. The acceleration sensor 250 outputs a detection result to the event detection unit 127 of the shooting control device 100. The acceleration sensor 250 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the front-rear direction, the left-right direction, and the up-down direction of the vehicle. An impact to the vehicle can be detected by the acceleration in the three axial directions.

[0024] The GPS receiver 260 receives radio waves from a GPS satellite (not shown). The GPS receiver 260 outputs the received radio wave signal to the position information acquisition unit 128 of the imaging control device 100.

[0025] The illuminance sensor 270 measures the illuminance outside the vehicle. In this embodiment, the illuminance sensor 270 measures the illuminance in front of the vehicle. That is, the illuminance sensor 270 measures the illuminance in the range illuminated by the vehicle's headlights. Therefore, the illuminance sensor 270 is preferably provided near the vehicle's headlights, but the location of the illuminance sensor 270 is not limited. The illuminance sensor 270 measures and digitizes the intensity of light. Specifically, the illuminance sensor 270 measures the amount of light per unit area in order to digitize the brightness of the illuminated surface.

[0026] [Shooting control device] The photography control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The photography control device 100 loads a stored program into a memory and executes instructions included in the program. The photography control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the photography control device 100. The photography control device 100 includes a video data acquisition unit 120, a buffer memory 121, a video data processing unit 122, a recording control unit 123, a playback control unit 124, an operation control unit 125, a display control unit 126, an event detection unit 127, a position information acquisition unit 128, and a light abnormality detection unit 129, which are connected to a bus 110.

[0027] The image data acquisition unit 120 acquires image data captured around the vehicle. More specifically, the image data acquisition unit 120 acquires image data output by the camera 210.

[0028] The buffer memory 121 is an internal memory included in the imaging control device 100, and is a memory for temporarily recording a certain period of video data acquired by the video data acquisition unit 120 while updating it.

[0029] The video data processing unit 122 converts the video data temporarily stored in the buffer memory 121 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec, such as H.264 or MPEG-4 (Moving Picture Experts Group). The video data processing unit 122 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 121. As a specific example, the video data processing unit 122 generates 60 seconds of video data as one file in the order of recording from the video data temporarily stored in the buffer memory 121. The video data processing unit 122 outputs the generated video data to the recording control unit 123. The video data processing unit 122 also outputs the generated video data to the display control unit 126. The period of the video data generated as a file is set to 60 seconds as an example, but is not limited to this. The video data referred to here may be data including audio inside and outside the vehicle acquired from a microphone (not shown) in addition to the video captured by the camera 210.

[0030] The recording control unit 123 controls the recording unit 220 to record the video data filed by the video data processing unit 122. The recording control unit 123 records the video data, which is a video image captured at all times and filed by the video data processing unit 122, in the recording unit 220 as overwritable loop recording data during a period during which the loop recording process is executed, such as when the accessory power of the vehicle is ON. More specifically, the recording control unit 123 continues to record the video data generated by the video data processing unit 122 in the recording unit 220 as loop recording data filed at every predetermined period during the period during which the loop recording process is executed. An example of the predetermined period is 60 seconds, but is not limited to this. When the capacity of the recording unit 220 becomes full, the oldest loop recording data is overwritten with new loop recording data and recorded. The loop recording data is also called constant recording data.

[0031] Furthermore, when event detection unit 127 detects an event, recording control unit 123 stores the video data for a predetermined period filed by video data processing unit 122 as event record data that is prohibited from being overwritten in recording unit 220. Furthermore, when event detection unit 127 detects an event, recording control unit 123 stores the video data resulting from the detected event as event record data captured by camera 210.

[0032] The video data resulting from an event, during a period in which loop recording processing is being performed, is video data for a predetermined period before and after the event is detected, an example of the predetermined period being a period of 10 to 60 seconds before and after the event is detected. Also, during a period in which loop recording processing is not being performed, the video data resulting from an event, is video data from the instant shooting is started after the event is detected until a predetermined period has elapsed since shooting started, an example of the predetermined period being a period of 10 to 60 seconds since shooting started.

[0033] The playback control unit 124 plays back the selected event record data or loop record data. The playback control unit 124 performs control so as to play back the event record data or loop record data recorded in the recording unit 220, based on the control signal of the selection operation and the playback operation output from the operation control unit 125.

[0034] The operation control unit 125 acquires operation information of an operation accepted by the operation unit 230. For example, the operation control unit 125 acquires save operation information indicating an operation to manually save video data, selection operation information indicating an operation to select video data, playback operation information indicating an operation to play video data, or deletion operation information indicating an operation to delete video data, and outputs a control signal. For example, the operation control unit 125 acquires end operation information indicating an operation to end loop recording, and outputs a control signal.

[0035] The display control unit 126 controls the display of video data on the display unit 240. The display control unit 126 outputs a video signal that causes the video data to be output to the display unit 240. More specifically, the display control unit 126 causes the display unit 240 to display the video captured by the camera 210, or the event record data or loop record data that is recorded in the recording unit 220 and played back by the playback control unit 124.

[0036] The event detection unit 127 detects an event for the vehicle. The method by which the event detection unit 127 detects an event for the vehicle is arbitrary, but as one example, the event detection unit 127 detects an event based on the detection result of the acceleration sensor 250. In this case, the event detection unit 127 detects an event when an acceleration equal to or greater than a threshold value in the acceleration detected by the acceleration sensor 250 is detected. The acceleration detected by the event detection unit 127 as an event is set to a threshold value that detects the impact of a collision accident on the vehicle, a sudden start, or a sudden brake.

[0037] The position information acquisition unit 128 calculates the current position information of the vehicle by a known method based on the radio waves received by the GPS receiving unit 260. The position information calculated by the position information acquisition unit 128 may be multiplexed and stored together with the event record data or the loop record data.

[0038] The light abnormality detection unit 129 detects a malfunction of the vehicle light. In this embodiment, the light abnormality detection unit 129 detects a malfunction of the headlight of the vehicle. Here, the malfunction of the headlight is the turning off of the headlight due to a malfunction or damage of the lighting device itself such as a lamp constituting the headlight, a fuse damage, a switch malfunction, etc. In addition to these, the malfunction of the headlight includes a decrease in illuminance due to the adhesion of foreign matter such as mud or snow to the headlight. Causes of the malfunction of the headlight include vehicle malfunction, accident, submersion due to flooding or falling, etc. In this embodiment, the light abnormality detection unit 129 detects the malfunction of the headlight based on the measurement result of the illuminance sensor 270. The light abnormality detection unit 129 judges that a malfunction has occurred in the headlight when the illuminance in front of the vehicle becomes equal to or less than a preset judgment value. This judgment value is, for example, a value at which the brightness of the driver's field of vision in front of the vehicle has decreased to a level that interferes with driving, and can be changed as necessary.

[0039] When the light abnormality detection unit 129 detects a malfunction of the headlight, the display control unit 126 causes the display unit 240 to display the video data. That is, when the light abnormality detection unit 129 detects a malfunction of the headlight based on the measurement result of the illuminance sensor 270, the light abnormality detection unit 129 outputs a malfunction occurrence signal of the headlight to the display control unit 126. When the display control unit 126 receives the malfunction occurrence signal from the light abnormality detection unit 129, the display control unit 126 displays the current video data captured by the camera 210 acquired by the video data acquisition unit 120 on the display unit 240. When the state of the headlight of the vehicle is normal, the display control unit 126 turns the display unit 240 to the OFF state and stops displaying the video data so as not to interfere with driving and to suppress power consumption. When the display control unit 126 receives the malfunction occurrence signal from the light abnormality detection unit 129, the display control unit 126 switches the display unit 240 from the OFF state to the ON state and displays the video data currently captured by the camera 210 on the display unit 240.

[0040] In the above description, the light abnormality detection unit 129 is configured to detect a malfunction of the headlight based on the measurement result of the illuminance sensor 270, but is not limited to this configuration. For example, a malfunction sensor may be provided in the headlight or in a line that supplies power to the headlight, and the light abnormality detection unit 129 may determine that a malfunction has occurred in the headlight when the malfunction sensor detects a malfunction in the headlight.

[0041] Note that the occupant may operate the operation unit 230 to cause the display control unit 126 to forcibly display the current video data on the display unit 240. That is, the occupant operates the operation unit 230, causing the operation control unit 125 to output a forced display signal to the display control unit 126. Upon receiving the forced display signal from the operation control unit 125, the display control unit 126 displays the current video data captured by the camera 210 and acquired by the video data acquisition unit 120 on the display unit 240.

[0042] [Shooting control method] Here, a description will be given of a method for controlling photography by the vehicle-mounted photography device 10. Fig. 5 is a flowchart showing the flow of a warning process in the photography control device according to this embodiment.

[0043] 1 and 5, when the vehicle is normal, the display control unit 126 of the imaging control device 100 turns off the display unit 240 and stops displaying video data. When the vehicle is used during the daytime, the headlights are turned off. Even when the vehicle is used during the daytime, when the vehicle travels through a tunnel or inside a building, the headlights are manually or automatically switched from an off state to an on state.

[0044] In step S101, the photography control device 100 judges whether the operation switch of the headlight of the vehicle is in the ON state. In this case, the photography control device 100 judges by receiving a light signal indicating the state of the headlight from a vehicle control device (not shown), for example. Here, if it is judged that the headlight of the vehicle is not in the ON state (No), the routine is exited without doing anything. On the other hand, if it is judged that the headlight of the vehicle is in the ON state (Yes), the process proceeds to step S102. In step S102, the light abnormality detection unit 129 of the photography control device 100 judges whether the illuminance in front of the vehicle has decreased. In this embodiment, the light abnormality detection unit 129 judges whether the forward illuminance is equal to or lower than a judgment value based on the measurement result of the illuminance sensor 270. The judgment of the forward illuminance may be made based on a sudden decrease in illuminance in a short period of time compared with the past illuminance state, and it may be judged that the forward illuminance has decreased. Here, if it is judged that the forward illuminance is not equal to or lower than the judgment value (No), the routine is exited without doing anything.

[0045] On the other hand, if it is determined that the forward illuminance is equal to or lower than the determination value (Yes), then in step S103, the light abnormality detection unit 129 determines that a headlight abnormality has occurred, that is, a malfunction has occurred in the headlight, and outputs a headlight malfunction occurrence signal to the display control unit 126. In step S104, upon receiving the malfunction occurrence signal from the light abnormality detection unit 129, the display control unit 126 turns the display unit 240, which was in the OFF state, to the ON state, and displays on the display unit 240 the current video data captured by the camera 210 and acquired by the video data acquisition unit 120. Therefore, when a malfunction has occurred in the headlight and forward visibility has decreased, the driver can ensure peripheral visibility by the video data displayed on the display unit 240.

[0046] Although display control unit 126 displays the video data captured by camera 210 on display unit 240 when it receives a malfunction occurrence signal, display unit 240 may be stopped when the vehicle safely stops, for example. Also, after displaying the video data captured by camera 210 on display unit 240, display unit 240 may be stopped after a predetermined time has elapsed.

[0047] [effect] In this embodiment, the vehicle is equipped with a video data acquisition unit 120 that acquires video data captured outside the vehicle, a lighting abnormality detection unit 129 that detects a malfunction of the vehicle lighting, and a display control unit 126 that displays the video data on a display unit 240 when a malfunction of the vehicle lighting is detected.

[0048] Therefore, even if the driver's field of vision suddenly becomes dark when a malfunction occurs in the vehicle lights, the video data captured by the camera 210 is displayed on the display unit 240, so the driver can ensure peripheral visibility through the video data displayed on the display unit 240. As a result, the safety of the driver in an emergency situation when driving the vehicle can be improved.

[0049] The vehicle imaging device 10 according to the present invention has been described above, but the invention may be embodied in various different forms other than the above-described embodiment.

[0050] Each component of the illustrated vehicle-mounted imaging device 10 is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the devices may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0051] The configuration of the vehicle image capturing device 10 is realized, for example, as software by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by only hardware, only software, or a combination of both.

[0052] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention.

[0053] In the above embodiment, the light is described as a headlight, but the display unit 240 may be configured to display video data when a malfunction is detected in a taillight or the like. Also, the video data may be recorded as event record data, with the detection of a malfunction in a light being used as an event trigger.

[0054] In the above embodiment, the illuminance sensor 270 was used to determine a decrease in the illuminance of the headlights. However, without using an illuminance sensor, for example, the decrease in illuminance may be determined by obtaining brightness information of the area illuminated by the headlights from the exposure control value and video data when shooting with the camera 210. [Explanation of symbols]

[0055] 10 Vehicle-mounted photographing device 100 Shooting control device 110 Bus 120 Video data acquisition unit 121 Buffer Memory 122 Video data processing section 123 Recording control section 124 Playback control section 125 Operation control section 126 Display control section 127 Event detection unit 128 Location information acquisition unit 129 Lighting Abnormality Detector 210 Camera 220 Recording Department 230 Operation section 240 Display section 250 Acceleration Sensor 260 GPS receiver 270 Light Sensor

Claims

1. a video data acquisition unit that acquires video data capturing an exterior of the vehicle; A light abnormality detection unit that detects a malfunction of a vehicle light; A display unit that displays the video data; a display control unit that controls the display unit to be in an off state when the vehicle light is normal during nighttime driving, and to be in an on state when a malfunction of the vehicle light is detected; An imaging control device comprising:

2. The light abnormality detection unit determines that a malfunction has occurred in the vehicle light when the illuminance ahead of the vehicle becomes equal to or lower than a preset determination value. The imaging control device according to claim 1 .

3. The light abnormality detection unit determines that a malfunction has occurred in the vehicle light when the vehicle light fails. The imaging control device according to claim 1 or 2.

4. A video data acquisition step of acquiring video data capturing an exterior of the vehicle; A light abnormality detection step for detecting a malfunction of a vehicle light; displaying the video data on a display unit; a display control step of controlling the display unit to be in an off state when the vehicle light is normal during nighttime driving, and to be in an on state when a malfunction of the vehicle light is detected; A shooting control method comprising:

5. A video data acquisition step of acquiring video data capturing an exterior of the vehicle; A light abnormality detection step for detecting a malfunction of a vehicle light; displaying the video data on a display unit; a display control step of controlling the display unit to be in an off state when the vehicle light is normal during nighttime driving, and to be in an on state when a malfunction of the vehicle light is detected; A program for causing a computer operating as an imaging control device to execute the above.

Images