CONTROL DEVICE, CONTROL SYSTEM, AND METHOD FOR STORING PHOTO IMAGE DATA

Abstract

To inhibit occurrence of a situation in which acquisition of necessary information is disabled by halation in a device for storing a photographed image data based on a result of photographing the periphery of a vehicle.SOLUTION: A controller 1 comprises a control unit 10 that acquires first type photographed image data photographed with exposure setting of a first setting value by a camera 3 and generated and second type photographed image data photographed with exposure setting of a second setting value smaller than the first setting value and generated; and stores the second type photographed image data in a storage unit 11 separately from the first type photographed image data or data based on the first type photographed image data, to make it possible to refer afterward to an image based on the second type photographed image data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a control device, a control system, and a method for storing captured image data, and is particularly suitable for use in a control device that acquires captured image data from a camera that photographs the area around a vehicle, a control system that includes the control device and the camera, and a method for storing captured image data by the control device. [Background technology]

[0002] In recent years, drive recorders that take pictures of the surroundings of a vehicle with a camera, store the captured image data based on the camera's capture results in a storage unit, and enable subsequent reference to images based on the captured image data have become widespread. The captured image data stored by the drive recorder's functions is used to verify the behavior of other vehicles and the surrounding conditions of the vehicle after the fact, for example, when the vehicle is involved in an accident.

[0003] Patent Document 1 describes a technology for drive recorders in which the check data portion (such as license plates, traffic lights, walls, etc.) of captured image data (image data) is compressed at a lower compression rate than other portions before storing the captured image data, thereby reducing the size of the stored data while suppressing deterioration in the quality of important portions. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-175848 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in conventional drive recorders, whiteout occurs in the captured image data, and information in the whiteout-occurring portion is sometimes lost. The loss of information means that when an image based on the captured image data is displayed, information that should be displayed in a certain area of ​​the image becomes invisible due to whiteout. In particular, information (such as a vehicle number) recorded on the license plate of another vehicle located in front of the vehicle can be important information for subsequent verification, but due to the influence of light projected by the headlights of the vehicle, whiteout occurs in the license plate of the vehicle in front in the captured image data, and the information recorded on the license plate is sometimes lost.

[0006] The present invention has been made to solve such problems, and aims to prevent a situation in which necessary information cannot be obtained due to whiteout in a device that stores captured image data based on photographs of the area around a vehicle. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, in the present invention, a first type of captured image data is generated when an image is captured using a camera that captures images of the area around the vehicle with an exposure setting of a first set value, and a second type of captured image data is generated when an image is captured with an exposure setting of a second set value that is smaller than the first set value.The second type of captured image data is then stored in a memory unit separately from the first type of captured image data or data based on the first type of captured image data. Effect of the Invention

[0008] According to the present invention configured as described above, the storage unit stores image data captured with a low exposure setting when the image was captured, that is, image data with suppressed whiteout, separately from the image data captured with a high exposure setting when the image was captured. Therefore, it is possible to obtain information lost due to whiteout in the image data captured with a high exposure setting when the image was captured from the image data captured with a low exposure setting when the image was captured, and it is possible to prevent a situation in which necessary information cannot be obtained due to whiteout in a device that stores image data based on the results of capturing images around a vehicle. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the configuration of a control system and an example of the functional configuration of a control device according to a first embodiment [Diagram 2] 5 is a flowchart showing an example of the operation of the control device according to the first embodiment of the present invention. [Diagram 3] 7 is a diagram illustrating an example of the configuration of a control system and an example of the functional configuration of a control device according to a second embodiment [Figure 4] 10 is a flowchart showing an example of the operation of the control device according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] First Embodiment A first embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a block diagram showing a configuration example of a control system 1 according to this embodiment, and a functional configuration example of a control device 2 provided in the control system 1. The control device 2 is a so-called drive recorder mounted on a vehicle. A camera 3 is connected to the control device 2. The camera 3 is an imaging device that captures an image in front of the vehicle. The camera 3 is provided, for example, on the back side of a rearview mirror.

[0011] The camera 3 according to this embodiment captures images in the following manner. That is, the camera 3 captures images at the capture timings that occur at a set predetermined cycle (frame rate), generates captured image data based on the capture results, and outputs the generated captured image data to the control device 2. At each capture timing, the camera 3 captures images with the exposure setting at a first setting value (however, as will be made clear later, the camera 3 captures images with a setting value different from the first setting value once in ten times). The exposure setting is a collective term for the lens aperture, shutter speed, and ISO sensitivity, which are parameters that adjust the brightness of the captured image data generated by capture.

[0012] A larger exposure setting refers to a state in which the value of each parameter is adjusted so that dark areas in the captured image data have a more appropriate brightness. For example, if the lens aperture and ISO sensitivity are constant, the longer the shutter speed, the larger the exposure setting. Also, for example, if the lens aperture and shutter speed are constant, the higher the ISO sensitivity, the larger the exposure setting. The larger the exposure setting, the more likely it is that so-called blown-out highlights will occur in the captured image data. On the other hand, a smaller exposure setting refers to a state in which the value of each parameter is adjusted so that bright areas in the captured image data have a more appropriate brightness. If the lens aperture and ISO sensitivity are constant, the shorter the shutter speed, the smaller the exposure setting, and if the lens aperture and shutter speed are constant, the lower the ISO sensitivity, the smaller the exposure setting.

[0013] The first setting value is a value set so that the brightness of the captured image data is normal brightness (the setting values ​​of the lens aperture, shutter speed, and ISO sensitivity are adjusted in this way), and is set with emphasis on making the brightness of the captured image data a natural brightness that does not look unnatural, rather than suppressing blown-out highlights. Hereinafter, captured image data captured and generated with the exposure setting at the first setting value will be referred to as "first type of captured image data."

[0014] On the other hand, during the shooting timing, the camera 3 takes a picture with the exposure setting in the state of the second set value once every 10 times instead of taking a picture with the exposure setting in the state of the first set value. The second set value is a value set for the purpose of suppressing overexposure (a value obtained by adjusting the set values of the aperture, shutter speed, and ISO sensitivity in this way), and suppressing overexposure is emphasized and set rather than the brightness of the captured image data being a natural brightness without a sense of discomfort. Therefore, when shooting is performed with the exposure setting in the state of the second set value, the occurrence of overexposure is suppressed as much as possible in the set captured image data. Also, of course, the second set value is smaller than the first set value.

[0015] As a simple operation example assuming that the aperture and ISO sensitivity are constant, for example, the camera 3 executes shooting at a shutter speed of X seconds at each of the consecutive nine shooting timings, and at the next shooting timing, executes shooting at a shutter speed of Y (Y < X) seconds, and repeats this process. Hereinafter, the captured image data generated by shooting with the exposure setting in the state of the second set value is referred to as "second type of captured image data".

[0016] As shown in FIG. 1, the control device 2 includes a control unit 10 as a functional configuration. The control unit 10 can be configured by any of hardware, a DSP (Digital Signal Processor), and software. For example, when configured by software, the control unit 10 is actually configured with a computer's CPU, RAM, ROM, etc., and is realized by the operation of a program stored in a recording medium such as RAM, ROM, a hard disk, or a semiconductor memory. The same applies to the functional blocks of the second embodiment. The control device 2 also includes a storage unit 11 as a storage means.

[0017] Here, the control device 2 functioning as a drive recorder stores the captured image data based on the image capturing results of the camera 3 in the storage unit 11, thereby enabling the image based on the captured image data to be referenced later. The image based on the captured image data means a still image displayed on the display device based on the captured image data, or a moving image displayed on the display device based on successive captured image data. The image based on the captured image data is referenced, for example, when the vehicle is involved in an accident, in order to verify the behavior of other vehicles and the situation around the vehicle. In the conventional drive recorder, whiteout occurs in the stored captured image data, and information on the part where whiteout occurs is sometimes missing. The missing information means that information cannot be seen due to whiteout in the image based on the captured image data.

[0018] In particular, information recorded on the license plate of another vehicle located in front of the vehicle (such as a vehicle number) can be important information for subsequent verification, but due to the influence of the light from the vehicle's headlights, the portion of the license plate of the vehicle in front of the vehicle in the captured image data may be overexposed, resulting in the information recorded on the license plate being missing. In consideration of the above circumstances, the control device 2 according to this embodiment executes the following process. The operation of the control device 2 will be described in detail below.

[0019] As described above, the camera 3 basically outputs the first type of captured image data at a predetermined cycle, while outputting the second type of captured image data once every ten times. The control unit 10 acquires the captured image data output by the camera 3 at a predetermined cycle. Then, every time the control unit 10 acquires the first type of captured image data, the control unit 10 stores the first type of captured image data continuously in a first area of ​​the storage unit 11. On the other hand, every time the control unit 10 acquires the second type of captured image data, the control unit 10 stores the second type of captured image data continuously in a second area (≠ first area) of the storage unit 11.

[0020] For example, suppose the control unit 10 acquires a first type of captured image data at each of timings T1, T2,...T9, acquires a second type of captured image data at the following timing T10, acquires the first type of captured image data at each of subsequent timings T11, T12,...T19, and acquires the second type of captured image data at the following timing T20.

[0021] In this case, at each of timings T1, T2, T9, the control unit 10 continuously stores the first type of photographed image data in the first area of ​​the storage unit 11. At the following timing T10, the control unit 10 stores the second type of photographed image data in the second area (≠ the first area) of the storage unit 11. At each of the following timings T11, T12, T19, the control unit 10 continuously stores the first type of photographed image data acquired at each timing in the first area of ​​the storage unit 11 following the first type of photographed image data stored at timing T9. At the following timing T20, the control unit 10 continuously stores the second type of photographed image data acquired at timing T20 in the second area of ​​the storage unit 11 following the second type of photographed image data stored at timing T10.

[0022] As described above, the camera 3 performs shooting with a small exposure setting once every 10 times during the shooting timing to generate the second type of photographed image data, and the control unit 10 stores the second type of photographed image data in the storage unit 11. This configuration provides the following effects. That is, in an image based on the first type of photographed image data generated and stored during a certain time period, whiteout occurs in a certain area, and information recorded in that area is lost. In this case, in the second type of photographed image data generated and stored during the same time period, there is a high possibility that whiteout does not occur in the corresponding area, and there is a high possibility that information recorded in that area is not lost. Therefore, the user can obtain information from the second type of photographed image data that could not be obtained from the first type of photographed image data.

[0023] For example, consider a situation where a user uses a display device (not shown) connected to the control device 2 to verify the contents of an image based on photographed image data stored in the storage unit 11. In this situation, as a result of verifying the contents of an image based on a first type of photographed image data generated during a certain time period, it is found that the image contains an image of a license plate, and furthermore, the image of the license plate has whiteout, causing information recorded on the license plate (such as the vehicle number) to be missing. In such a case, in an image based on a second type of photographed image data generated during the same time period, there is a high possibility that the image of the license plate does not have whiteout, and the user can obtain the information recorded on the license plate (such as the vehicle number) from the image based on the second type of photographed image data generated during the same time period.

[0024] In particular, in this embodiment, a system is constructed using the existing camera 3 without providing a separate camera dedicated to performing shooting at a small exposure setting, and therefore the above-mentioned effects can be obtained while keeping costs down.

[0025] Fig. 2 is a flowchart showing an example of the operation of the control device 2 according to this embodiment. This flowchart shows a method for storing captured image data by the control device 2. The flowchart in Fig. 2 shows the processing of the control unit 10 when the captured image data is acquired. In other words, the control unit 10 executes the processing shown in the flowchart in Fig. 2 at a predetermined cycle.

[0026] As shown in FIG. 2, the control unit 10 acquires photographed image data from the camera 3 (step SA1). Next, the control unit 10 determines whether the type of photographed image data acquired in step SA1 is a first type or a second type (step SA2). If it is the first type (step SA2: "first type"), the control unit 10 stores the photographed image data acquired in step SA1 (=first type of photographed image data) in the first area (step SA3). If it is the second type (step SA2: "second type"), the control unit 10 stores the photographed image data acquired in step SA1 (=second type of billboard image data) in the second area (step SA4).

[0027] As described above, the control device 2 according to the present embodiment acquires the first type of photographed image data, which is photographed and generated by the camera 3 photographing the periphery of the vehicle with the exposure setting set to a first setting value, and the second type of photographed image data, which is photographed and generated with the exposure setting set to a second setting value smaller than the first setting value, and stores the second type of photographed image data in the storage unit 11 separately from the first type of photographed image data. According to this configuration, the second type of photographed image data, which is photographed and generated with a small exposure setting, that is, photographed image data in which whiteout is suppressed, is stored in the storage unit 11 separately from the first type of photographed image data, which is photographed and generated with a non-small exposure setting. Therefore, it is possible to obtain information lost in the first type of photographed image data due to whiteout from the second type of photographed image data. Therefore, it is possible to prevent a situation in which necessary information cannot be obtained due to whiteout from a device that stores photographed image data based on the photographing result in front of the vehicle.

[0028] <First Modification of First Embodiment> Next, a first modified example of the first embodiment will be described with reference to Fig. 1. In the above-described first embodiment, the control unit 10 stores all of the second type of captured image data acquired from the camera 3 in the storage unit 11. On the other hand, the control unit 10 according to this modified example executes the following process.

[0029] The control unit 10 according to this modification executes the following process when the first type of captured image data is acquired at the shooting timing immediately before the shooting timing at which the second type of captured image data is acquired. The shooting timing immediately before the shooting timing at which the second type of captured image data is acquired is, for example, as follows. That is, for example, in the succession of timings T1, T2, T3, etc., if the second type of captured image data is acquired at timings T10, T20, T30, T40, etc., each of timings T9, T19, T29, T39, etc. corresponds to the shooting timing immediately before the shooting timing at which the second type of captured image data is acquired.

[0030] When the control unit 10 according to this modification acquires the first type of captured image data at a capture timing one before the capture timing at which the second type of captured image data is acquired, the control unit 10 analyzes the acquired first type of captured image data by image processing and determines whether or not an image of a license plate of another vehicle is included. The determination can be performed, for example, by pattern matching using template data prepared in advance or feature matching. The determination can also be performed using a model that uses the captured image data as one of the inputs and outputs a value indicating whether or not an image of a license plate is included (or a value indicating the possibility that an image of a license plate is included). In this case, the model can be a model that has been machine-learned by a predetermined machine learning method (for example, deep learning).

[0031] When the first type of photographed image data includes an image of a license plate, the control unit 10 according to this modification analyzes the image of the license plate by image processing and determines whether or not the image has whiteout. When whiteout has occurred, the control unit 10 according to this modification stores the acquired second type of photographed image data in the second area when the second type of photographed image data is acquired at a subsequent timing. On the other hand, in other cases, that is, when the first type of photographed image data does not include an image of a license plate or includes an image of a license plate but does not have whiteout, the control unit 10 according to this modification discards the acquired second type of photographed image data without storing it in the second storage area when the second type of photographed image data is acquired at a subsequent timing.

[0032] This modification has the following effects. That is, the control system 1 according to this modification prevents information recorded on the license plate of another vehicle from becoming unavailable after the fact (in other words, other information is allowed to be missing due to whiteout). And according to this modification, as in the first embodiment, even if information recorded on the license plate is missing in an image based on the first type of captured image data, the information can be obtained by using the second type of captured image data.

[0033] In addition, this modified example has the following effect. That is, if the first type of photographed image data acquired by the control unit 10 at a certain photographing timing does not include a license plate image, or if the image of the license plate is included but no whiteout occurs, it may be assumed that the second type of photographed image data acquired by the control unit 10 at the next photographing timing also does not include a license plate image, or includes a license plate image but no whiteout occurs. Based on this, this modified example can prevent photographed image data that does not include a license plate image or photographed image data that includes a license plate but no whiteout occurs, that is, photographed image data that is not used to compensate for the loss of information recorded on the license plate in the first type of photographed image data, from being stored in the storage unit 11, and the amount of data stored can be reduced.

[0034] Although the modified example of the first embodiment has been described above, the modified example of the first embodiment may have the following configuration: In other words, in the modified example, the target that was a license plate may be a predetermined type of object other than a license plate, or may be a plurality of types of objects (which may or may not include a license plate).

[0035] In addition, when the control unit 10 acquires a first type of photographed image data at a certain timing and the image data includes an image of a license plate, the control unit 10 may be configured to store a second type of photographed image data acquired at the next timing in the first area, regardless of whether or not the image has blown out highlights.

[0036] Furthermore, the timing for determining whether or not to store the second type of captured image data does not have to be the timing immediately before the capture timing at which the second type of captured image data is acquired, but may be a timing close in time.

[0037] <Second Modification of First Embodiment> Next, a second modified example of the first embodiment will be described. The control unit 10 according to this modified example executes the following process when acquiring the second type of captured image data. That is, the control unit 10 according to this modified example analyzes the second type of captured image data by image processing to detect whether or not overexposure has occurred. The occurrence of overexposure means that the current second setting value may be larger than an appropriate value. In consideration of this, the control unit 10 changes the specific value of the second setting value so that the specific value of the second setting value becomes smaller. The extent to which the second setting value is to be reduced is determined in advance. The specific value of the second setting value is changed, for example, by outputting a control signal to the camera 3 according to a protocol, or by rewriting a setting file referenced by the control mechanism of the camera 3. Note that, in this modified example, the control unit 10 can be configured to change the second setting value when overexposure has occurred for a specific type of object. In this case, the specific type of object can be the license plate of another vehicle.

[0038] <Second embodiment> Next, a second embodiment will be described. In the following description of the second embodiment, the same elements as those in the first embodiment are given the same reference numerals, and detailed description will be omitted. FIG. 3 is a block diagram showing a configuration example of a control system 1A according to this embodiment, and a functional configuration example of a control device 2A provided in the control system 1A. As is clear from a comparison between FIG. 2 and FIG. 3, the control system 1A includes a control device 2A and a camera 3A. The control device 2A includes a control unit 10A and a storage unit 11A.

[0039] The camera 3A according to this embodiment generates and outputs three pieces of photographed image data with different exposure setting values ​​at each photographing timing. The three pieces of photographed image data are data for high dynamic range synthesis, and include photographed image data with the highest exposure setting value (hereinafter referred to as "large exposure photographed image data"), photographed image data with the next highest exposure setting value (hereinafter referred to as "medium exposure photographed image data"), and photographed image data with the lowest exposure setting value (hereinafter referred to as "small exposure photographed image data"). The small exposure photographed image data is data in which the possibility of whiteout occurring is suppressed. The large exposure photographed image data and the medium exposure photographed image data correspond to the "first type of photographed image data" in the claims, and the small exposure photographed image data corresponds to the "second type of photographed image data" in the claims.

[0040] The control unit 10A acquires three pieces of photographed image data from the camera 3A at each photographing timing, and executes the following process. That is, the control unit 10A performs high dynamic range synthesis of the three pieces of photographed image data, performs tone mapping as necessary, and generates composite image data. The control unit 10A stores the composite image data generated at each photographing timing consecutively in the third area of ​​the storage unit 11A. The composite image data corresponds to "data based on the first type of photographed image data" in the claims.

[0041] In parallel with the above process, the control unit 10A executes the following process: That is, the control unit 10A stores the small-exposure photographed image data acquired at each photographing timing continuously in a fourth area (≠ the third area).

[0042] The configuration of this embodiment provides the following effects. That is, suppose that in composite image data generated during a certain time period, whiteout occurs in a certain area, causing a loss of information recorded in that area. In this case, in small-exposure photographed image data generated and stored during the same time period, there is a high possibility that whiteout does not occur in the corresponding area, and there is a high possibility that a loss of information recorded in that area does not occur. Therefore, the user can obtain information that could not be obtained from the composite image data (first type of photographed image data) from the small-exposure photographed image data (second type of photographed image data).

[0043] Furthermore, in this embodiment, the processing is performed using an existing camera 3A having the function of outputting multiple captured image data for high dynamic range synthesis, so there is no need to provide a separate camera dedicated to capturing images at small exposure settings, and the above-mentioned effects can be obtained while keeping costs down.

[0044] Fig. 4 is a flowchart showing an example of the operation of the control device 2A according to this embodiment. The flowchart in Fig. 4 shows the process of the control unit 10A when the captured image data is acquired. That is, the control unit 10A executes the process shown in the flowchart in Fig. 4 at a predetermined cycle.

[0045] As shown in FIG. 4, the control unit 10A acquires large-exposure photographed image data, medium-exposure photographed image data, and small-exposure photographed image data from the camera 3A (step SB1). Next, the control unit 10A generates composite image data based on the three photographed image data acquired in step SB1 (step SB2). Next, the control unit 10A stores the composite image data generated in step SB2 in the third area of ​​the storage unit 11A (step SB3). Next, the control unit 10A stores the small-exposure photographed image data, of the photographed image data acquired in step SB1, in the fourth area (≠ the third area) (step SB4). Note that the processing of steps SB2, SB3, and SB4 can be performed in any order.

[0046] <Modification of the second embodiment> Next, a modified example of the second embodiment will be described. In the above-mentioned second embodiment, the control unit 10A stores all of the small-exposure photographed image data acquired at each photographing timing in the storage unit 11A. In this regard, the control unit 10A according to this modified example stores the small-exposure photographed image data in the storage unit 11A once every several photographing timings (for example, 10 times). With this configuration, it is possible to reduce the amount of data stored in the storage unit 11A.

[0047] Although the embodiments of the present invention have been described above, each embodiment merely shows an example of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited thereby. In other words, the present invention can be embodied in various forms without departing from the gist or main characteristics thereof.

[0048] For example, in the above-mentioned first embodiment (including modified examples), the storage unit 11 in which the control unit 10 stores the captured image data is provided in the control device 2, but the storage unit that stores the captured image data may be a storage unit connected to the control device 2 directly or via a network. As an example, a USB memory connected to the control device 2, an external storage medium connected via a network, a server connected via a network, etc. can function as the storage unit. The above also applies to the second embodiment (including modified examples).

[0049] In the first embodiment, the camera 3 is an imaging device that captures an image of the front of the vehicle, but the camera 3 is not limited to such a camera and may be an imaging device that captures an image of the side or rear of the vehicle. The above also applies to the second embodiment.

[0050] Furthermore, in the above first embodiment, the control unit 10 stores the captured image data in the memory unit 11 without encoding it, but the control unit 10 may be configured to encode the captured image data (or a group of captured image data) using a specified codec and store it as a still image file (or a video file) in a specified format.

[0051] In the first embodiment, the camera 3 is configured to generate the second type of captured image data once every 10 times during the shooting timing, but the frequency of generating captured image data is not limited to the example. The same applies to the frequency of storing the small-exposure captured image data in the modified example of the second embodiment.

[0052] In addition, a part or all of the processes executed by the functional blocks of the control device 2 may be executed by the control device 2 in cooperation with an external device, or by the external device alone. In this case, the control device 2 and the external device cooperate to function as the "control device" in the claims. [Explanation of symbols]

[0053] 1. 1A control system 2, 2A control device 3. 3A Camera 10, 10A Control Device 11, 11A storage section

Claims

1. a control unit that acquires a first type of photographed image data generated by a camera that photographs the periphery of a vehicle with an exposure setting of a first set value and a second type of photographed image data generated by a camera that photographs the periphery of the vehicle with an exposure setting of a second set value that is smaller than the first set value, and stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data, the camera generates the first type of photographed image data at a photographing timing that occurs at a predetermined cycle, and generates the second type of photographed image data in place of the first type of photographed image data once every several times; The control unit is The second type of photographed image data is obtained once every several times. A first type of photographed image data is analyzed by image processing, and when an image of a predetermined object is included in the data, the second type of photographed image data obtained at a timing close to that of the first type of photographed image data is stored in the storage unit. A control device comprising:

2. The predetermined object is a license plate of another vehicle. The control device according to claim 1 .

3. a control unit that acquires a first type of photographed image data generated by a camera that photographs the periphery of a vehicle with an exposure setting of a first set value and a second type of photographed image data generated by a camera that photographs the periphery of the vehicle with an exposure setting of a second set value that is smaller than the first set value, and stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data, the camera generates the first type of photographed image data at a photographing timing that occurs at a predetermined cycle, and generates the second type of photographed image data in place of the first type of photographed image data once every several times; The control unit is The second type of photographed image data is obtained once every several times. A first type of photographed image data is analyzed by image processing, and when an image of a predetermined object is included in the data and whiteout occurs in the image of the predetermined object, the second type of photographed image data obtained at a timing close to that of the first type of photographed image data is stored in the storage unit. A control device comprising:

4. The predetermined object is a license plate of another vehicle.

4. The control device according to claim 3.

5. The control unit analyzes the acquired second type of captured image data by image processing, and changes a specific value of the second setting value.

5. The control device according to claim 1, wherein:

6. A camera that captures an image of the surroundings of a vehicle and a control device connected to the camera, The control device includes: a control unit that acquires a first type of photographed image data generated by the camera using a first exposure setting and a second type of photographed image data generated by the camera using a second exposure setting that is smaller than the first exposure setting, and stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data; The camera includes: The first type of photographed image data is generated at a photographing timing that occurs at a predetermined cycle, while the second type of photographed image data is generated in place of the first type of photographed image data once every several times; The control unit is The second type of photographed image data is obtained once every several times. A first type of photographed image data is analyzed by image processing, and when an image of a predetermined object is included in the data, the second type of photographed image data obtained at a timing close to that of the first type of photographed image data is stored in the storage unit. A control system comprising:

7. A camera that captures images of the surroundings of a vehicle and a control device connected to the camera, The control device includes: a control unit that acquires a first type of photographed image data generated by the camera using a first exposure setting and a second type of photographed image data generated by the camera using a second exposure setting that is smaller than the first exposure setting, and stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data; The camera includes: The first type of photographed image data is generated at a photographing timing that occurs at a predetermined cycle, while the second type of photographed image data is generated in place of the first type of photographed image data once every several times; The control unit is The second type of photographed image data is obtained once every several times. A first type of photographed image data is analyzed by image processing, and when an image of a predetermined object is included in the data and whiteout occurs in the image of the predetermined object, the second type of photographed image data obtained at a timing close to that of the first type of photographed image data is stored in the storage unit. A control system comprising:

8. A first step in which a control unit of the control device acquires a first type of captured image data generated by a camera that captures an image of the periphery of the vehicle with an exposure setting of a first set value, and a second type of captured image data generated by a camera that captures an image of the periphery of the vehicle with an exposure setting of a second set value that is smaller than the first set value; a second step in which the control unit of the control device stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data, the camera generates the first type of photographed image data at a photographing timing that occurs at a predetermined cycle, and generates the second type of photographed image data in place of the first type of photographed image data once every several times; In the first step, the control unit acquires the second type of photographed image data that is generated once every several times, In the second step, the control unit analyzes one of the first type of photographed image data by image processing, and when an image of a predetermined object is included in the data, stores the second type of photographed image data acquired at a timing close to that of the one of the first type of photographed image data in the storage unit.

23. A method for storing photographed image data, comprising:

9. A first step in which a control unit of the control device acquires a first type of captured image data generated by a camera that captures an image of the periphery of the vehicle with an exposure setting of a first set value, and a second type of captured image data generated by a camera that captures an image of the periphery of the vehicle with an exposure setting of a second set value that is smaller than the first set value; a second step in which the control unit of the control device stores the second type of photographed image data in a storage unit separately from the first type of photographed image data or data based on the first type of photographed image data, the camera generates the first type of photographed image data at a photographing timing that occurs at a predetermined cycle, and generates the second type of photographed image data in place of the first type of photographed image data once every several times; In the first step, the control unit acquires the second type of photographed image data that is generated once every several times, In the second step, the control unit analyzes one of the first type of photographed image data by image processing, and when an image of a predetermined object is included in the data and whiteout occurs in the image of the predetermined object, stores the second type of photographed image data acquired at a timing close to that of the one of the first type of photographed image data in the storage unit.

23. A method for storing photographed image data, comprising:

Images