Image recording device

Abstract

To provide an image recording apparatus configured to record a captured image to be properly displayed, and suppress reduction in detection accuracy in detecting a moving body.SOLUTION: A drive recorder 10 is operated by being switched between an image recording mode for recording a captured image of a camera 12 and a monitoring mode for detecting a moving body from the captured image. A controller 14 switches an exposure mode of the camera 12 to a display mode for adjusting the captured image to be properly displayed on display means in the image recording mode, and switches the mode to a recognition mode for adjusting the captured image so as to be suitable for image recognition in the monitoring mode. The drive recorder 10 can record, on a recording unit 16, a captured image to be properly displayed, and can suppress reduction in detection accuracy when detecting a moving body in an image recognition unit 22.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an image recording device. [Background technology]

[0002] Patent Document 1 discloses a drive recorder that operates in a recording mode selected from the continuous recording mode, time lapse mode, and motion detection mode, including an event recording mode, a continuous recording mode, a time lapse mode, and a motion detection mode. In this drive recorder, the time lapse mode or the motion detection mode is selected while the vehicle is parked, and when the motion detection mode is selected, video data is recorded when a moving object is detected from a change in the video. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-020553 Summary of the Invention [Problem to be solved by the invention]

[0004] When recording video captured at night, it is preferable to capture the video so that it will be bright when displayed, and for this reason, the exposure time when capturing the video is lengthened. However, images captured with a long exposure time are prone to blurring, and when detecting moving objects in the captured video using image recognition, the presence of blurring leads to a decrease in the accuracy of detecting moving objects in the captured image, leaving room for improvement.

[0005] The present invention has been made in consideration of the above facts, and aims to provide an image recording device that can suppress a decrease in the accuracy of detecting moving objects from captured images and can record captured images that can be displayed appropriately. [Means for solving the problem]

[0006] To achieve the above object, a first aspect of an image recording device includes an imaging means for imaging the surroundings of a vehicle, a recording means for recording the image captured by the imaging means on a recording medium when the device is set to a first operating mode, an image recognition means for detecting a moving object in the image captured by the imaging means by recognition when the device is set to a second operating mode, an exposure mode switching means for switching the exposure mode of the imaging means between a first exposure mode for adjusting the captured image so that it is suitable for display on an image display means and a second exposure mode for adjusting the captured image so that it is suitable for image recognition by the image recognition means, and a control means for controlling the exposure mode switching means to switch to the first exposure mode when switching to the first operating mode, and to the second exposure mode when switching to the second operating mode, and to switch to the first operating mode and the first exposure mode when the image recognition means detects the moving object.

[0007] In the image recording device of the first aspect, in a first operation mode, the recording means records an image captured by the imaging means on a recording medium, and in a second operation mode, the image recognition means detects a moving object in the image captured by the imaging means by image recognition. The control means switches between the first operation mode and the second operation mode. In this case, when the image recognition means detects a moving object in the captured image, the control means switches from the second operation mode to the first operation mode, thereby recording the image captured by the imaging means on a recording medium.

[0008] Here, the exposure mode switching means switches the exposure mode of the imaging means between a first exposure mode that adjusts the captured image so that it is suitable for display on the image display means, and a second exposure mode that adjusts the captured image so that it is suitable for image recognition by the image recognition means. The control means controls the exposure mode switching means to switch the exposure mode of the imaging means to the first exposure mode in the first operation mode, and to switch the exposure mode of the imaging means to the second exposure mode in the second operation mode.

[0009] Thus, when an image captured by the imaging means is recorded on a recording medium, the image can be adjusted to be suitable for display on the image display means. Also, when the image captured by the imaging means is used for image recognition, the image is adjusted to be suitable for image recognition by the image recognition means.

[0010] The image recording device of the second aspect includes, in the first aspect, the control means controlling the vehicle so that operation in the first operation mode is started when a start switch for vehicle operation is turned on, and operation in the second operation mode is started when the start switch is turned off.

[0011] In the second mode, the first operation mode is initiated by turning on a start switch for running the vehicle, and the second operation mode is initiated by turning off the start switch. In this case, in the first operation mode, the imaging means is switched to the first exposure mode, so that a captured image displayed at an appropriate brightness is recorded, and in the second operation mode, the imaging means is switched to the second exposure mode, so that a moving object can be detected with high accuracy.

[0012] The image recording device of a third aspect is the first or second aspect, wherein in the first operation mode, operation of the image recognition means is stopped.

[0013] In the third aspect, in the first operation mode, the operation of the image recognition means is stopped, so that the operation of the image recognition means can be suppressed. [Effects of the Invention]

[0014] According to the present invention, when an image captured by the imaging means is recorded on a recording medium, the captured image is adjusted to be suitable for display on the image display means, and when the image captured by the imaging means is used for image recognition, the captured image is adjusted to be suitable for image recognition by the image recognition means. As a result, the present invention has the effect of suppressing a decrease in the accuracy of detecting a moving object from the captured image and recording a captured image that can be displayed appropriately. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a block diagram showing a schematic configuration of a main part of a drive recorder according to an embodiment of the present invention; [Figure 2] 3 is a flowchart showing an outline of the operation control of the drive recorder. [Figure 3] 10 is a flowchart showing an outline of operation control during parking of a vehicle. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0017] 1 is a block diagram showing a schematic configuration of a drive recorder 10 as an image recording device according to this embodiment. The drive recorder 10 according to this embodiment is installed in a vehicle (not shown), captures images of the surroundings of the vehicle, and records the captured images. When the drive recorder 10 detects a moving object, such as an approaching vehicle, in the captured image of a parked vehicle, it records the captured image on a recording medium.

[0018] 1, the drive recorder 10 includes a camera 12 as an imaging means and a controller 14 (ECU: Electronic Control Unit). The camera 12 is provided with an imaging element (image sensor, not shown) such as a CCD image sensor or a CMOS image sensor, and the camera 12 outputs image data from the imaging element at a preset time interval (frame rate), thereby outputting video data. Note that, for the sake of simplicity, the image data and video data acquired by the camera 12 will be described below as captured images.

[0019] In the drive recorder 10, a camera 12 is installed inside or outside the vehicle. The drive recorder 10 may use one camera 12 or multiple cameras 12. The camera 12 is installed inside the windshield glass at the upper front part of the vehicle compartment so as to capture an image of the area in front of the vehicle. Note that the second and subsequent cameras 12 may be installed inside the rear glass at the rear part of the vehicle compartment so as to capture an image of the area behind the vehicle, or may be installed on both sides of the vehicle body (both sides in the vehicle width direction) so as to capture an image of the area to the side of the vehicle.

[0020] The controller 14 is disposed in a housing (not shown), and the camera 12 is electrically connected to the controller 14. Note that the drive recorder 10 may be configured such that the camera 12 and the controller 14 are separate entities, or may be a so-called integrated type in which the camera 12 is disposed in the housing of the controller 14.

[0021] The controller 14 includes a microcomputer in which a CPU, ROM, RAM, non-volatile storage, etc. are connected via a bus, as well as the required electrical circuits (all not shown). In the controller 14, the CPU reads out programs stored in the ROM and storage, and executes them while expanding them into the RAM, thereby realizing functions according to the programs.

[0022] An image recording program, an image recognition program, an exposure mode switching program, and an operation control program are stored in the ROM and storage of the controller 14. The controller 14 is also provided with a recording unit 16. As a result, the controller 14 is formed with an image recording unit 20 as image recording means, an image recognition unit 22 as image recognition means, an exposure mode switching unit 24 as exposure mode switching means, and an operation control unit 26 as control means.

[0023] The recording unit 16 can use a portable memory card 30 (or a USB memory) provided with a flash memory such as an SD card, a miniSD card, a microSD card, or an xD picture card as a storage medium. In this case, the recording unit 16 uses a writer (or a reader / writer) for writing data to the memory card 30 when the memory card 30 is attached. The recording unit 16 may also use a USB memory or an SSD (Solid State Drive). When an SSD or the like is used as the recording unit 16, an input / output interface is used so that the captured images recorded in the recording unit 16 can be output to the outside.

[0024] The image recording unit 20 reads the captured images taken by the camera 12 and records (writes) the read captured images on the memory card 30. As a result, the captured images by the camera 12 are recorded as video on the memory card 30, and the captured images (video) recorded on the memory card 30 can be displayed on a monitor (display) or the like as a display means. The drive recorder 10 may be provided with a display such as an LCD (or may be electrically connected) so that the captured images recorded on the memory card 30 can be displayed (played back) on the display.

[0025] The image recognition unit 22 reads the captured image captured by the camera 12 and performs image recognition on the read captured image to detect a moving object (moving body) such as a person in the captured image. This allows detection of a person or the like approaching the vehicle while the vehicle is parked and stopped. Note that a known method can be applied to image recognition for detecting a moving object in the captured image, and detailed description thereof will be omitted in this embodiment.

[0026] On the other hand, in the camera 12 applied to this embodiment, the brightness of the captured image is adjusted by adjusting the exposure time of the image sensor. In the controller 14, a display mode and a recognition mode are set as the exposure mode of the camera 12. An exposure mode switching unit 24 switches the exposure mode of the camera 12 between the display mode and the recognition mode.

[0027] The display mode is the first exposure mode, and in the display mode, the exposure time is adjusted so that the captured image has an appropriate brightness when displayed on the display. In the display mode, the exposure time is adjusted so that the subject in the captured image is visible even at night when the image captured by the camera 12 is dark.

[0028] The recognition mode is the second exposure mode, and in the recognition mode, when image recognition is performed using a captured image, the exposure time is adjusted so that moving objects (subjects) in the captured image can be identified. In the recognition mode, the exposure time is adjusted so that the subject in the captured image is visible (without being too bright) even at night or other times when the image captured by the camera 12 is dark. Thus, in the recognition mode, the exposure time is adjusted so that the captured image (subject in the captured image) is not too bright and its contours are not unclear, and the exposure time is adjusted to be shorter than in the display mode. Note that in both the display mode and the recognition mode, the exposure time is adjusted so that the image captured by the camera 12 does not become too bright during the day due to backlighting or the like.

[0029] An IG switch (ignition switch) 32 serving as a start switch provided on the vehicle is connected to the operation control unit 26. The operation control unit 26 detects the on / off (ON / OFF) operation of the IG switch 32 and switches the operation mode of the drive recorder 10 in accordance with the on / off operation of the IG switch 32. Note that if the vehicle has an engine as a driving source for running, the IG switch 32 is used, but if the vehicle has an electric motor as a driving source for running (such as an electric vehicle), a power switch is used as the start switch.

[0030] When the IG switch 32 is turned on, the operation control unit 26 switches the operation of the drive recorder 10 to the image recording mode, and when the IG switch 32 is turned off, the operation control unit 26 switches the operation of the drive recorder 10 to the monitoring mode. In addition, the operation control unit 26 controls the exposure mode switching unit 24 so that the exposure mode of the camera 12 is switched to the display mode in the image recording mode, and the exposure mode of the camera 12 is switched to the recognition mode in the monitoring mode.

[0031] Next, as the operation of this embodiment, the operation of the drive recorder 10 will be described. FIG. 2 is a flowchart showing an outline of the operation mode switching process executed by the controller 14, and FIG. 3 is a flowchart showing an outline of the process in the image recognition mode.

[0032] The drive recorder 10 operates regardless of whether the IG switch 32 is on or off, and the controller 14 executes the process of FIG. 2 at predetermined time intervals to switch the operating mode and perform image recording processing, and executes the process of FIG. 3 to perform monitoring processing and image recording processing during the monitoring processing.

[0033] In the first step 100 of the flowchart in FIG. 2, the controller 14 checks whether the IG switch 32 is turned on. If the IG switch 32 is turned on to run the vehicle, an affirmative determination is made in step 100 and the process proceeds to step 102.

[0034] Controller 14 sets the operation mode to the image recording mode in step 102. At the same time, controller 14 controls exposure mode switching unit 24 to switch the exposure mode of camera 12 to the display mode in step 104. Thereafter, in step 106, controller 14 reads images captured by camera 12 and records the read images in sequence on memory card 30.

[0035] As a result, drive recorder 10 continues to operate in the image recording mode until IG switch 32 is turned off to stop driving the vehicle and park it, and images (video) captured by camera 12 while the vehicle is driving are recorded on the memory card. Also, in drive recorder 10, the exposure mode of camera 12 is set to the display mode, so that high-quality captured images are recorded on memory card 30 so that each subject in the captured image can be easily viewed when displayed on a display or the like.

[0036] On the other hand, when the vehicle stops traveling and is parked, the IG switch 32 is turned off. When the IG switch 32 is turned off, the controller 14 makes a negative determination in step 100 and proceeds to step 108. In step 108, the controller 14 sets (switches) the operation mode to the monitoring mode. As a result, the image recording mode in the drive recorder 10 ends and the drive recorder 10 transitions to the monitoring mode.

[0037] 3 by proceeding to step 108. In the first step 110 of this flowchart, the controller 14 switches the exposure mode of the camera 12 to a recognition mode, and then starts image recognition in step 112. In image recognition, the controller 14 reads in an image captured by the camera 12 and performs image recognition on the read-in image to detect the presence or absence of a moving object.

[0038] As a result, the drive recorder 10 detects people or the like approaching the vehicle while the vehicle is parked. When the IG switch 32 is turned on, the controller 14 ends the monitoring mode and transitions to the image recording mode (see FIG. 2).

[0039] Here, when a person or the like approaches the vehicle, the appearance of a moving object in the captured image is detected by performing image recognition on the image captured by the camera 12. In step 114, the controller 14 checks whether a moving object has been detected by image recognition. If a moving object is detected, the controller 14 makes an affirmative determination in step 114 and proceeds to step 116.

[0040] In step 116, the controller 14 stops image recognition and stops operation in the monitoring mode. In the next step 118, the controller 14 changes the operation mode to the image recording mode.

[0041] At the same time, in step 120, controller 14 switches the exposure mode of camera 12 to the display mode (corresponding to step 104 in FIG. 2), and in step 122 starts recording images captured by camera 12 to memory card 30 (corresponding to step 106 in FIG. 2). As a result, in drive recorder 10, images captured by camera 12 that include moving objects (such as a person approaching the vehicle) are recorded to memory card 30.

[0042] Thereafter, the controller 14 checks in step 124 whether or not to stop recording of the captured image, and when a preset stop timing is reached, an affirmative determination is made in step 124, and the process proceeds to step 126 to stop image recording. Note that the timing to stop image recording can be when a preset time has elapsed (for example, several minutes to several tens of minutes), when the IG switch 32 is turned on, or the like.

[0043] As a result, the drive recorder 10 stops recording images captured by the camera 12 while the vehicle is parked, and the processing of the controller 14 returns to the flowchart of Figure 2, thereby starting operation in the operating mode (image recording mode or monitoring mode) corresponding to the on / off state of the IG switch 32.

[0044] In this way, in drive recorder 10, the exposure mode of camera 12 is switched between a display mode in which the captured image is adjusted to be suitable for display on the image display means, and a recognition mode in which the captured image is adjusted to be suitable for image recognition. Furthermore, the display mode is applied to the exposure mode of camera 12 in the image recording mode, and the recognition mode is applied in the monitoring mode.

[0045] As a result, when an image captured by camera 12 is recorded on memory card 30, it is adjusted so as to be suitable for display on a display. Furthermore, when an image captured by camera 12 is used for image recognition, the captured image is adjusted so as to be suitable for image recognition. Therefore, drive recorder 10 can suppress a decrease in the accuracy of detecting a moving object from an image captured by camera 12, and can record the image captured by camera 12 so as to be appropriately displayed.

[0046] In addition, in drive recorder 10, when IG switch 32 for vehicle driving is turned on, the exposure mode of camera 12 is set to display mode and operation in image recording mode is initiated, and when IG switch 32 is turned off, the exposure mode of camera 12 is set to recognition mode and operation in monitoring mode for detecting moving objects is initiated. As a result, in drive recorder 10, captured images that can be displayed at appropriate brightness are recorded on memory card 30 while the vehicle is driving, and moving objects moving around the vehicle, such as those approaching the vehicle while the vehicle is parked, can be accurately detected.

[0047] Furthermore, in the drive recorder 10, the controller 14 stops image recognition in the image recording mode, so the processing load on the controller 14 can be reduced, and product costs can be reduced compared to when functional components with high processing capabilities are used.

[0048] In the embodiment described above, when the IG switch 32 is turned on, the exposure mode is switched to the display mode and operation in the image recording mode is started, and when the IG switch 32 is turned off, the exposure mode is switched to the recognition mode and operation in the monitoring mode is started. However, when applying the second operation mode, the image recording device may apply the first exposure mode as the exposure mode during the day when the surroundings of the vehicle are relatively bright, and may apply the second exposure mode as the exposure mode during the night when the surroundings of the vehicle are dark.

[0049] That is, the control means may control the exposure mode switching means to switch to the second exposure mode when the vehicle is operating in the second operation mode at night. In this case, the control means may detect the brightness around the vehicle using an illuminance sensor (sunlight sensor) or the like while the vehicle is operating in the second operation mode, and switch the exposure mode of the imaging means to the second exposure mode when the brightness around the vehicle becomes a predetermined level or less. This allows the exposure mode to be switched effectively, enabling accurate image recognition.

[0050] In this embodiment, the image recognition unit 22 detects a moving object from the image captured by the camera 12. However, the image recording device may include a vibration detection means or an acceleration detection means for detecting vibrations or the like applied to the vehicle body, and when a moving object is detected by the image recognition means or when vibrations or the like of the vehicle body are detected by the acceleration detection means or the like during operation in the second operation mode, the operation mode may be switched to the first operation mode and the image captured by the imaging means may be recorded on the recording medium. [Explanation of symbols]

[0051] 10 Drive recorder (image recording device) 12 Camera (imaging means) 14 Controller 20 Image recording unit (image recording means) 22 Image recognition unit (image recognition means) 24 Exposure mode switching unit (exposure mode switching means) 26 Operation control means (control means) 30 Memory card (recording medium) 32 IG switch (start switch)

Claims

1. imaging means for imaging the surroundings of the vehicle; a recording means for recording an image captured by the imaging means on a recording medium when the camera is in a first operation mode; an image recognition unit that recognizes a moving object in an image captured by the imaging unit when the second operation mode is selected; an exposure mode switching means for switching an exposure mode when capturing an image by the image capturing means between a first exposure mode in which the captured image is adjusted to a brightness suitable for display on the image display means and a second exposure mode in which the captured image is adjusted to a brightness suitable for image recognition by the image recognition means; a control means for controlling the exposure mode switching means so that, when controlling switching between the first operation mode and the second operation mode, the exposure mode is switched to the first exposure mode when switching to the first operation mode, the exposure mode is switched to the second exposure mode when switching to the second operation mode, and the exposure mode is switched to the first exposure mode when the moving object is recognized by the image recognition means in the second operation mode and the operation mode is switched to the first operation mode; An image recording device comprising:

2. 2. The image recording device according to claim 1, wherein the control means controls the vehicle so that operation in the first operation mode is started when a start switch for running the vehicle is turned on, and operation in the second operation mode is started when the start switch is turned off.

3. An image recording device as described in claim 1 or claim 2, wherein the image recognition means starts operating when the first operating mode is switched to the second operating mode, and stops operating prior to switching from the second operating mode to the first operating mode.

Images