Camera control device, camera control method, and imaging device

The camera control device addresses image clarity issues by adjusting amplification and light emission based on temperature, effectively reducing white spot noise and maintaining brightness in electronic cameras.

JP7594840B2Active Publication Date: 2024-12-05MITSUBISHI ELECTRIC MOBILITY CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023516002
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-23
Publication Date
2024-12-05
Estimated Expiration
2041-04-23

AI Technical Summary

Technical Problem

Existing electronic cameras face issues with image clarity due to increased white spot noise at higher CCD temperatures, leading to decreased brightness when conventional control methods lower amplification factors and increase aperture values.

Method used

A camera control device that adjusts the amplification factor and light emission amount of the image sensor based on temperature, independently of aperture adjustments, to maintain image brightness and reduce white spot noise.

Benefits of technology

The solution effectively suppresses brightness loss and reduces white spot noise in images by dynamically controlling amplification and light emission in response to temperature changes, without relying on aperture adjustments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007594840000001
    Figure 0007594840000001
  • Figure 0007594840000002
    Figure 0007594840000002
  • Figure 0007594840000003
    Figure 0007594840000003
Patent Text Reader

Abstract

A camera control device (14) is configured to comprise: a temperature detection signal acquisition unit (21) that acquires, from a temperature detector (13) for detecting the temperature of an imaging element (12a) for outputting an image signal representing a subject, a temperature detection signal indicating the temperature of the imaging element (12a); and a control unit (22) that, on the basis of the temperature detection signal acquired by the temperature detection signal acquisition unit (21), controls the amplification factor of the image signal outputted from the imaging element (12a) and the light emission amount of a light emitting element (11) for irradiating the subject with light.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a camera control device, a camera control method, and an imaging device. [Background technology]

[0002] There are electronic cameras equipped with a CCD (Charge Coupled Device) as an imaging element. The image signal output from the CCD may contain white spot noise, and the amount of white spot noise contained in the image signal generally increases as the temperature of the CCD increases.

[0003] A technology for reducing white spot noise contained in an image signal is disclosed in an electronic camera in Patent Document 1. In this electronic camera, when the temperature of the CCD is equal to or higher than a predetermined temperature, a control circuit controls the camera to lower the amplification factor of the image signal output from the CCD and to increase the aperture value of the electronic camera. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-96328 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the electronic camera disclosed in Patent Document 1, when the temperature of the CCD is equal to or higher than a predetermined temperature, the control circuit controls to reduce the amplification factor of the image signal, so that the brightness of the image represented by the image signal decreases. Also, when the temperature of the CCD is equal to or higher than a predetermined temperature, the control circuit controls to increase the aperture value, so that the brightness of the image represented by the image signal decreases further. Therefore, the electronic camera has a problem that when the temperature of the CCD is equal to or higher than a predetermined temperature, the image represented by the image signal may become unclear.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a camera control device and a camera control method that can suppress a decrease in brightness of an image represented by an image signal and reduce white spot noise contained in the image signal. [Means for solving the problem]

[0007] The camera control device according to the present disclosure includes a temperature detection signal acquisition unit that acquires a temperature detection signal indicating a temperature of an image sensor from a temperature detector that detects the temperature of an image sensor that outputs an image signal representing a subject, and a gain control unit that controls an amplification factor of an image signal output from the image sensor based on the temperature detection signal acquired by the temperature detection signal acquisition unit. 、 The amount of light emitted by the light-emitting element that irradiates the subject and the aperture value of the camera including the image sensor and a control unit for controlling each of the above. When the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is equal to or higher than the threshold, the control unit performs control to reduce the amplification factor of the image signal output from the image sensor, control to increase the amount of light emitted from the light emitting element, and control to reduce the aperture value of the camera including the image sensor, compared to when the temperature indicated by the temperature detection signal is lower than the threshold. It is something. In addition, the camera control device according to the present disclosure includes a temperature detection signal acquisition unit that acquires a temperature detection signal indicating the temperature of the image sensor from a temperature detector that detects the temperature of the image sensor that outputs an image signal representing a subject, and a control unit that controls the amplification factor of the image signal output from the image sensor and the amount of light emitted from the light-emitting element that irradiates light to the subject based on the temperature detection signal acquired by the temperature detection signal acquisition unit, and the control unit variably sets the amplification factor of the image signal according to the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit, and sets the amount of light emitted from the light-emitting element so that the product of the set amplification factor of the image signal and the amount of light emitted from the light-emitting element is the product of a predetermined standard amplification factor and a predetermined standard light emission amount. Effect of the Invention

[0008] According to the present disclosure, it is possible to suppress a decrease in the luminance of an image represented by an image signal, and to reduce white spot noise contained in the image signal. [Brief description of the drawings]

[0009] [Figure 1] 1 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to a first embodiment. [Diagram 2] 2 is a hardware configuration diagram showing hardware of a camera control device 14 according to the first embodiment. FIG. [Diagram 3] FIG. 1 is a hardware configuration diagram of a computer in the case where the camera control device 14 is realized by software, firmware, or the like. [Figure 4] 4 is a flowchart showing a camera control method which is a processing procedure of the camera control device 14. [Diagram 5] FIG. 11 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to a second embodiment. [Figure 6]FIG. 11 is a hardware configuration diagram showing hardware of a camera control device 14 according to the second embodiment. [Figure 7] 10 is an explanatory diagram showing the correspondence relationships stored in the table section 26. FIG. [Figure 8] FIG. 11 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to a third embodiment. [Figure 9] FIG. 11 is a hardware configuration diagram showing hardware of a camera control device 14 according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] In order to describe the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0011] Embodiment 1 FIG. 1 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to the first embodiment. The driver monitoring system (DMS) shown in Fig. 1 includes an imaging device 1 and an image signal acquisition unit 2. The DMS is a system that performs image recognition processing on a vehicle occupant, which is a subject, and detects the occupant's inattentive driving, etc.

[0012] The imaging device 1 includes a light emitting element 11, a camera 12 including an imaging element 12a, a temperature detector 13, and a camera control device . The imaging device 1 captures an image of a subject and outputs an image signal representing the subject to the image signal acquisition section 2. The image signal acquisition unit 2 acquires the image signal output from the imaging device 1, and outputs the image signal to an image recognition processing unit (not shown) that executes image recognition processing. 1 is installed in a vehicle and captures an image of a vehicle occupant. However, this is merely an example, and the imaging device 1 may be installed in a room or the like in a building and capture an image of a subject present in the room or the like.

[0013] The light emitting element 11 is realized by, for example, an infrared light emitting diode that emits near-infrared light. The light emitting element 11 is installed on the vehicle's instrument panel, dashboard, rearview mirror, etc. The light emitting element 11 irradiates the subject with near-infrared light. 1, the light-emitting element 11 irradiates the subject with near-infrared light. However, this is merely an example, and the light-emitting element 11 may irradiate the subject with visible light, far-infrared light, or the like.

[0014] The camera 12 is realized by, for example, a near-infrared camera. The camera 12 is installed on the instrument panel, dashboard, rear-view mirror, or the like of the vehicle. The camera 12 includes an image sensor 12a, and captures an image of a subject illuminated with near-infrared light by the light emitting element 11. The imaging element 12a is realized by, for example, an image sensor. The imaging element 12a outputs an image signal representing a subject to the image signal acquisition unit 2. The image signal output from the imaging element 12a may contain white spot noise, and the amount of white spot noise contained in the image signal generally increases as the temperature of the imaging element 12a increases. 1, the camera 12 is realized by a near-infrared camera. However, this is merely an example, and for example, if the light-emitting element 11 is a light-emitting element that irradiates visible light, the camera 12 is realized by a visible light camera, and if the light-emitting element 11 is a light-emitting element that irradiates far-infrared light, the camera 12 is realized by a far-infrared camera.

[0015] The temperature detector 13 detects the temperature Temp of the imaging element 12a, and outputs a temperature detection signal indicating the temperature Temp to the camera control device . In the imaging device 1 shown in FIG. 1, the temperature detector 13 detects the temperature of the imaging element 12a itself as the temperature Temp of the imaging element 12a. However, this is merely an example, and the temperature detector 13 may detect the ambient temperature of the imaging element 12a as the temperature Temp of the imaging element 12a. That is, if the difference between the temperature of the imaging element 12a itself and the ambient temperature of the imaging element 12a is within a practically problematic range, the temperature detector 13 may output a temperature detection signal indicating the ambient temperature of the imaging element 12a to the camera control device 14. If the difference between the temperature of the imaging element 12a itself and the ambient temperature of the imaging element 12a exceeds a practically problematic range, the temperature detector 13 may estimate the temperature of the imaging element 12a itself from the ambient temperature and output a temperature detection signal indicating the estimated temperature to the camera control device 14.

[0016] FIG. 2 is a hardware configuration diagram showing the hardware of the camera control device 14 according to the first embodiment. The camera control device 14 shown in FIG. The temperature detection signal acquiring unit 21 is realized by, for example, a temperature detection signal acquiring circuit 31 shown in FIG. The temperature detection signal acquisition unit 21 acquires the temperature detection signal output from the temperature detector 13 . The temperature detection signal acquisition unit 21 outputs the temperature detection signal to the control unit 22 .

[0017] The control unit 22 includes a control signal setting unit 23 , an amplification factor control unit 24 , and a light emission amount control unit 25 . The control unit 22 controls the amplification factor G of the image signal output from the imaging element 12a and the light emission amount L of the light emitting element 11 based on the temperature detection signal acquired by the temperature detection signal acquisition unit 21. That is, when the temperature Temp indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit 21 is equal to or higher than the threshold Th, the control unit 22 performs control to lower the amplification factor G of the image signal output from the image sensor 12a and control to increase the amount of light emission L of the light emitting element 11, compared to when the temperature Temp indicated by the temperature detection signal is lower than the threshold Th. The threshold Th may be stored in an internal memory of the control unit 22, or may be provided from outside the camera control device 14.

[0018] The control signal setting unit 23 is realized by, for example, a control signal setting circuit 32 shown in FIG. Based on the temperature detection signal acquired by the temperature detection signal acquisition unit 21, the control signal setting unit 23 sets a first control signal C1 for controlling the amplification factor G of the image signal output from the image sensor 12a. The control signal setting unit 23 sets a second control signal C2 for controlling the light emission amount L of the light emitting element 11 based on the temperature detection signal acquired by the temperature detection signal acquiring unit 21.

[0019] That is, the control signal setting unit 23 compares the temperature Temp indicated by the temperature detection signal acquired by the temperature detection signal acquiring unit 21 with the threshold value Th. If the temperature Temp is less than the threshold value Th, the control signal setting unit 23 sets the reference amplification factor G ref The first control signal C1 is set to the target amplification factor G. ref is a reference amplification factor set in advance, which may be stored in the internal memory of the control signal setting unit 23, or may be provided from outside the camera control device 14. The control signal setting unit 23 sets a first control signal C1 that indicates that the amplification factor G of the image signal is to be lowered when the temperature Temp is equal to or higher than the threshold value Th than when the temperature Temp is lower than the threshold value Th. In other words, when the temperature Temp is equal to or higher than the threshold value Th, the control signal setting unit 23 sets the reference amplification factor G ref A first control signal C1 is set to indicate that a smaller amplification factor is to be set as the target amplification factor. Furthermore, if the temperature Temp is less than the threshold value Th, the control signal setting unit 23 sets the reference light emission amount L refThe second control signal C2 is set to the target light emission amount L. ref is a reference light emission amount set in advance, which may be stored in the internal memory of the control signal setting unit 23 or may be provided from outside the camera control device 14. The control signal setting unit 23 sets the second control signal C2 which indicates that the light emission amount L of the light emitting element 11 is to be increased when the temperature Temp is equal to or greater than the threshold value Th, compared to when the temperature Temp is less than the threshold value Th. In other words, when the temperature Temp is equal to or greater than the threshold value Th, the control signal setting unit 23 sets the reference light emission amount L ref A second control signal C2 is set, which indicates that the greater amount of light emission is to be the target amount of light emission. The control signal setting unit 23 outputs a first control signal C 1 to the amplification factor control unit 24 , and outputs a second control signal C 2 to the light emission amount control unit 25 .

[0020] The amplification factor control section 24 is realized by, for example, an amplification factor control circuit 33 shown in FIG. The amplification factor control unit 24 controls the amplification factor G of the image signal output from the imaging element 12a in accordance with the first control signal C1 output from the control signal setting unit . The light emission amount control section 25 is realized by, for example, a light emission amount control circuit 34 shown in FIG. The light emission amount control unit 25 controls the light emission amount L of the light emitting element 11 in accordance with the second control signal C2 output from the control signal setting unit .

[0021] In Fig. 1, it is assumed that each of the components of the camera control device 14, that is, the temperature detection signal acquisition unit 21, the control signal setting unit 23, the amplification factor control unit 24, and the light emission amount control unit 25, is realized by dedicated hardware as shown in Fig. 2. In other words, it is assumed that the camera control device 14 is realized by a temperature detection signal acquisition circuit 31, a control signal setting circuit 32, an amplification factor control circuit 33, and a light emission amount control circuit 34. Each of the temperature detection signal acquisition circuit 31, the control signal setting circuit 32, the amplification factor control circuit 33 and the light emission amount control circuit 34 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination of these.

[0022] The components of the camera control device 14 are not limited to those realized by dedicated hardware, and the camera control device 14 may be realized by software, firmware, or a combination of software and firmware. The software or firmware is stored as a program in the memory of a computer. The computer means hardware that executes the program, and includes, for example, a CPU (Central Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP (Digital Signal Processor).

[0023] FIG. 3 is a hardware configuration diagram of a computer in the case where the camera control device 14 is realized by software, firmware, or the like. When the camera control device 14 is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures in the temperature detection signal acquisition unit 21, the control signal setting unit 23, the amplification factor control unit 24, and the light emission amount control unit 25 is stored in the memory 41. Then, a processor 42 of the computer executes the program stored in the memory 41.

[0024] 2 shows an example in which each of the components of the camera control device 14 is realized by dedicated hardware, and Fig. 3 shows an example in which the camera control device 14 is realized by software, firmware, etc. However, this is merely one example, and some of the components in the camera control device 14 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.

[0025] Next, the operation of the driver monitoring system shown in FIG. 1 will be described. FIG. 4 is a flowchart showing a camera control method which is a processing procedure of the camera control device 14. The light emitting element 11 irradiates the subject with near-infrared light. An imaging element 12a included in the camera 12 outputs an image signal representing a subject irradiated with near-infrared light by the light emitting element 11 to the image signal acquisition unit 2. The image signal acquisition unit 2 acquires an image signal from the image sensor 12a and outputs the image signal to an image recognition processing unit (not shown). The image recognition processing unit executes image recognition processing using the image signal to detect distracted driving, etc., of the passenger who is the subject. The image recognition processing by the image recognition processing unit itself is a known technology, and therefore a detailed description thereof will be omitted. In addition, the detection processing for distracted driving, etc., itself is a known technology, and therefore a detailed description thereof will be omitted.

[0026] The temperature detector 13 detects the temperature Temp of the imaging element 12a. The temperature detector 13 outputs a temperature detection signal indicating the temperature Temp to a temperature detection signal acquisition unit 21 of the camera control device 14.

[0027] The temperature detection signal acquisition unit 21 acquires a temperature detection signal from the temperature detector 13 (step ST1 in FIG. 4). The temperature detection signal acquisition unit 21 outputs the temperature detection signal to a control signal setting unit 23 of the control unit 22 .

[0028] The control signal setting unit 23 acquires the temperature detection signal from the temperature detection signal acquiring unit 21 . The control signal setting unit 23 compares the temperature Temp indicated by the temperature detection signal with a threshold value Th. The threshold value Th is set to a lower limit temperature or the like at which white dot noise appears in the image signal. Specifically, the threshold value Th is set to 60 degrees, 65 degrees, 70 degrees, or the like. If the temperature Temp is less than the threshold value Th (step ST2 in FIG. 4: NO), the control signal setting unit 23 sets the reference amplification factor G ref The first control signal C1 is set to the target amplification factor (step ST3 in FIG. 4). Furthermore, if the temperature Temp is less than the threshold value Th (if NO in step ST2 of FIG. 4), the control signal setting unit 23 sets the reference light emission amount L ref The second control signal C2 is set to the target light emission amount (step ST4 in FIG. 4).

[0029] If the temperature Temp is equal to or higher than the threshold value Th (step ST2 in FIG. 4: YES), the control signal setting unit 23 sets a first control signal C1 indicating that the amplification factor G of the image signal is to be lower than when the temperature Temp is lower than the threshold value Th (step ST5 in FIG. 4). That is, the control signal setting unit 23 sets the reference amplification factor G ref Specifically, the control signal setting unit 23 sets the target amplification factor to a value smaller than the reference amplification factor G. ref 0.8 times the amplification factor, or the reference amplification factor G ref Set the amplification factor to 0.7 times, etc.

[0030] In addition, if the temperature Temp is equal to or higher than the threshold value Th (step ST2 in FIG. 4: YES), the control signal setting unit 23 sets a second control signal C2 indicating that the light emission amount L of the light-emitting element 11 is to be increased more than when the temperature Temp is lower than the threshold value Th (step ST6 in FIG. 4). That is, the control signal setting unit 23 sets the reference light emission amount L ref Specifically, the control signal setting unit 23 sets the second control signal C2 indicating that the target light emission amount is set to the reference light emission amount L ref 1.25 times the light output or the reference light output L refSet the light output to 1.5 times the normal level. The control signal setting unit 23 outputs a first control signal C 1 to the amplification factor control unit 24 , and outputs a second control signal C 2 to the light emission amount control unit 25 .

[0031] Upon receiving the first control signal C1 from the control signal setting unit 23, the amplification factor control unit 24 controls the amplification factor G of the image signal output from the imaging element 12a in accordance with the first control signal C1 (step ST7 in FIG. 4). That is, the amplification factor control unit 24 controls the amplification factor G of the image signal so that the amplification factor G of the image signal output from the imaging element 12a coincides with the target amplification factor indicated by the first control signal C1. When the temperature Temp is equal to or higher than the threshold value Th, the amplification factor control unit 24 reduces the amplification factor G of the image signal compared to when the temperature Temp is less than the threshold value Th, so that even if the temperature Temp of the imaging element 12a becomes high, white spot noise contained in the image signal is reduced. In the camera control device 14 shown in FIG. 1, the amplification factor control section 24 controls the amplification factor G of the image signal output from the imaging element 12a, but does not control the aperture value of the camera 12. In the electronic camera disclosed in Patent Document 1, when the temperature of the CCD is equal to or higher than a predetermined temperature, the control circuit not only reduces the amplification factor of the image signal but also controls to increase the aperture value. By the control circuit controlling to increase the aperture value, white spot noise included in the image signal is reduced. However, the control to increase the aperture value is auxiliary control to the control to decrease the amplification factor, and it is possible to sufficiently reduce white spot noise included in the image signal simply by controlling to decrease the amplification factor. Therefore, it is possible to sufficiently reduce white spot noise without controlling to increase the aperture value.

[0032] Upon receiving the second control signal C2 from the control signal setting unit 23, the light emission amount control unit 25 controls the light emission amount L of the light-emitting element 11 in accordance with the second control signal C2 (step ST8 in FIG. 4). That is, the light emission amount control unit 25 controls the light emission amount L of the light-emitting element 11 so that the light emission amount L of the light-emitting element 11 matches the target light emission amount indicated by the second control signal C2. When the temperature Temp is equal to or higher than the threshold value Th, the light emission amount L of the light-emitting element 11 is increased by the light emission amount control unit 25 compared to when the temperature Temp is less than the threshold value Th. Therefore, when the temperature Temp of the imaging element 12a is high, even if the amplification factor G is lowered, a decrease in the brightness of the image represented by the image signal is suppressed.

[0033] In the above-described first embodiment, the camera control device 14 is configured to include a temperature detection signal acquisition unit 21 that acquires a temperature detection signal indicating the temperature of the image sensor 12a from a temperature detector 13 that detects the temperature of the image sensor 12a that outputs an image signal representing a subject, and a control unit 22 that controls the amplification factor of the image signal output from the image sensor 12a and the light emission amount of the light emitting element 11 that irradiates the subject with light, based on the temperature detection signal acquired by the temperature detection signal acquisition unit 21. Therefore, the camera control device 14 can suppress a decrease in the luminance of the image represented by the image signal, and reduce white spot noise included in the image signal.

[0034] Embodiment 2 In embodiment 2, a camera control device 14 is described that is equipped with a table section 26 that records the correspondence between the temperature of the imaging element 12a, the amplification factor of the image signal output from the imaging element 12a, and the amount of light emitted by the light-emitting element 11.

[0035] Fig. 5 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to embodiment 2. In Fig. 5, the same reference numerals as in Fig. 1 indicate the same or corresponding parts, and therefore description thereof will be omitted. Fig. 6 is a hardware configuration diagram showing the hardware of the camera control device 14 according to embodiment 2. In Fig. 6, the same reference numerals as in Fig. 2 denote the same or corresponding parts, and therefore description thereof will be omitted. The camera control device 14 shown in FIG. 5 includes a temperature detection signal acquisition unit 21, a table unit 26, and a control unit 27.

[0036] The table unit 26 is realized by, for example, a storage circuit 35 shown in FIG. The table section 26 records the correspondence between the temperature of the imaging element 12 a, the amplification factor of the image signal output from the imaging element 12 a, and the amount of light emitted by the light emitting element 11.

[0037] FIG. 7 is an explanatory diagram showing the correspondence relationships stored in the table unit 26. As shown in FIG. In the example of Figure 7, the amplification factor of the image signal and the amount of light emitted by the light-emitting element 11 are recorded in the table section 26 when the temperature of the imaging element 12a is less than 60 degrees, when the temperature of the imaging element 12a is 60 degrees or more and less than 70 degrees, when the temperature of the imaging element 12a is 70 degrees or more and less than 80 degrees, and when the temperature of the imaging element 12a is 80 degrees or more.

[0038] The control unit 27 includes a control signal setting unit 28 , an amplification factor control unit 24 , and a light emission amount control unit 25 . The control signal setting unit 28 is realized by, for example, a control signal setting circuit 36 ​​shown in FIG. The control signal setting unit 28 selects from the table unit 26 an amplification factor G corresponding to the temperature Temp indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit 21. Temp and light emission amount L Temp Obtain each of the following. The control signal setting unit 28 determines the obtained amplification factor G Temp The first control signal C1 is set to the target amplification factor, and the obtained light emission amount L Temp The second control signal C2 is set to the target light emission amount. The control signal setting section 28 outputs a first control signal C 1 to the amplification factor control section 24 , and outputs a second control signal C 2 to the light emission amount control section 25 .

[0039] In Fig. 5, it is assumed that each of the temperature detection signal acquisition unit 21, table unit 26, control signal setting unit 28, amplification factor control unit 24, and light emission amount control unit 25, which are components of the camera control device 14, is realized by dedicated hardware as shown in Fig. 6. In other words, it is assumed that the camera control device 14 is realized by a temperature detection signal acquisition circuit 31, a memory circuit 35, a control signal setting circuit 36, an amplification factor control circuit 33, and a light emission amount control circuit 34. Here, the memory circuit 35 may be, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD (Digital Versatile Disc). Each of the temperature detection signal acquisition circuit 31, the control signal setting circuit 36, the amplification factor control circuit 33 and the light emission amount control circuit 34 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these.

[0040] The components of the camera control device 14 are not limited to those realized by dedicated hardware, and the camera control device 14 may be realized by software, firmware, or a combination of software and firmware. When the camera control device 14 is realized by software, firmware, or the like, the table unit 26 is configured on a memory 41 shown in Fig. 3. Programs for causing a computer to execute the respective processing procedures in the temperature detection signal acquisition unit 21, the control signal setting unit 28, the amplification factor control unit 24, and the light emission amount control unit 25 are stored in the memory 41 shown in Fig. 3. Then, a processor 42 shown in Fig. 3 executes the programs stored in the memory 41.

[0041] 6 shows an example in which each of the components of the camera control device 14 is realized by dedicated hardware, while Fig. 3 shows an example in which the camera control device 14 is realized by software, firmware, etc. However, this is merely one example, and some of the components in the camera control device 14 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.

[0042] Next, the operation of the driver monitoring system shown in Fig. 5 will be described. However, since the system is similar to the driver monitoring system shown in Fig. 1 except for the table unit 26 and the control unit 27, the operation of the table unit 26 and the control unit 27 will be mainly described here. The control signal setting unit 28 of the control unit 27 selects from the table unit 26 the amplification factor G corresponding to the temperature Temp indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit 21. Temp and light emission amount L Temp Obtain each of the following. When the correspondence relationship stored in the table unit 26 is the correspondence relationship shown in FIG. 7, if the temperature Temp indicated by the temperature detection signal is, for example, 50 degrees, the control signal setting unit 28 sets the amplification factor G Temp As the reference amplification factor G ref The light emission amount L corresponding to the temperature Temp is obtained. Temp As the reference light emission amount L ref Get the. If the temperature Temp indicated by the temperature detection signal is, for example, 67 degrees, the control signal setting unit 28 sets the amplification factor G corresponding to the temperature Temp as Temp As the reference amplification factor G ref × 0.8, and the light emission amount L corresponding to the temperature Temp is obtained. Temp As the reference light emission amount L ref ×1.25 is obtained.

[0043] The control signal setting unit 28 sets the amplification factor G Temp and light emission amount L Temp When the gain G is obtained, TempThe first control signal C1 is set to the target amplification factor, and the obtained light emission amount L Temp The second control signal C2 is set to the target light emission amount. The control signal setting section 28 outputs a first control signal C 1 to the amplification factor control section 24 , and outputs a second control signal C 2 to the light emission amount control section 25 .

[0044] Upon receiving the first control signal C1 from the control signal setting unit 28, the amplification factor control unit 24 controls the amplification factor G of the image signal output from the imaging element 12a in accordance with the first control signal C1. As the temperature Temp increases, the amplification factor control section 24 reduces the amplification factor G of the image signal, so that white spot noise contained in the image signal is reduced even if the temperature Temp of the imaging element 12a becomes high.

[0045] Upon receiving the second control signal C2 from the control signal setting unit 28, the light emission amount control unit 25 controls the light emission amount L of the light emitting element 11 in accordance with the second control signal C2. As the temperature Temp rises, the light emission amount control unit 25 increases the light emission amount of the light-emitting element 11. Therefore, when the temperature Temp of the imaging element 12a is high, even if the amplification factor G is lowered, the decrease in the brightness of the image represented by the image signal is suppressed.

[0046] In the above-described second embodiment, the camera control device 14 shown in Fig. 5 is configured to include a table unit 26 that records the correspondence relationship between the temperature of the image sensor 12a, the amplification factor of the image signal output from the image sensor 12a, and the amount of light emitted from the light emitting element 11. The control unit 27 of the camera control device 14 shown in Fig. 5 includes a control signal setting unit 28 that acquires from the table unit 26 an amplification factor corresponding to the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit 21, sets a first control signal indicating that the acquired amplification factor is to be a target amplification factor, acquires from the table unit 26 an amount of light emitted corresponding to the temperature indicated by the temperature detection signal, and sets a second control signal indicating that the acquired amount of light emitted is to be a target amount of light emitted, an amplification factor control unit 24 that controls the amplification factor of the image signal output from the image sensor 12a in accordance with the first control signal output from the control signal setting unit 28, and a light emission amount control unit 25 that controls the amount of light emitted from the light emitting element 11 in accordance with the second control signal output from the control signal setting unit 28. Therefore, like the camera control device 14 shown in FIG. 1, the camera control device 14 shown in FIG. 5 can suppress a decrease in the brightness of the image represented by the image signal and reduce white spot noise contained in the image signal.

[0047] In the camera control device 14 shown in FIG. 5, the control unit 27 receives from the table unit 26 an amplification factor G Temp and light emission amount L Temp However, this is merely an example. For example, the control unit 27 may acquire a smaller amplification factor G Temp Then, the control unit 27 sets the amplification factor G in accordance with the change in temperature Temp as shown in the following formula (1). Temp Even if changes, G Temp ×L Temp But, G ref ×L ref The amount of light emitted is L Temp may be set. G Temp ×L Temp =G ref ×L ref (1)

[0048] Embodiment 3 In the third embodiment, a camera control device 14 in which a control unit 51 includes an aperture value control unit 53 will be described.

[0049] Fig. 8 is a configuration diagram showing a part of a driver monitoring system including an imaging device 1 according to embodiment 3. In Fig. 8, the same reference numerals as in Fig. 1 and Fig. 5 indicate the same or corresponding parts, and therefore description thereof will be omitted. Fig. 9 is a hardware configuration diagram showing hardware of the camera control device 14 according to embodiment 3. In Fig. 9, the same reference numerals as in Fig. 2 and Fig. 6 indicate the same or corresponding parts, and therefore description thereof will be omitted. The camera control device 14 shown in FIG.

[0050] The control unit 51 includes a control signal setting unit 52 , an amplification factor control unit 24 , a light emission amount control unit 25 , and an aperture value control unit 53 . The control unit 51 controls the amplification factor G of the image signal output from the imaging element 12a, the light emission amount L of the light emitting element 11, and the aperture value F of the camera 12, based on the temperature detection signal acquired by the temperature detection signal acquisition unit 21.

[0051] The control signal setting unit 52 is realized by, for example, a control signal setting circuit 61 shown in FIG. The control signal setting unit 52 compares the temperature Temp indicated by the temperature detection signal acquired by the temperature detection signal acquiring unit 21 with a threshold value Th. If the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference amplification factor G ref The control signal setting unit 52 sets the first control signal C1 indicating that the amplification factor G of the image signal is to be lower than when the temperature Temp is less than the threshold Th, when the temperature Temp is equal to or higher than the threshold Th. In other words, when the temperature Temp is equal to or higher than the threshold Th, the control signal setting unit 52 sets the first control signal C1 indicating that the amplification factor G of the image signal is to be lower than when the temperature Temp is less than the threshold Th. ref A first control signal C1 is set to indicate that a smaller amplification factor is to be set as the target amplification factor. If the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference light emission amount L ref The control signal setting unit 52 sets the second control signal C2 indicating that the light emission amount L of the light-emitting element 11 is to be set as the target light emission amount when the temperature Temp is equal to or higher than the threshold value Th. In other words, when the temperature Temp is equal to or higher than the threshold value Th, the control signal setting unit 52 sets the second control signal C2 indicating that the light emission amount L of the light-emitting element 11 is to be increased more than when the temperature Temp is lower than the threshold value Th. ref A second control signal C2 is set, which indicates that the greater light emission amount is to be the target light emission amount.

[0052] If the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference aperture value F ref The control signal setting unit 52 sets the third control signal C3 indicating that the aperture value F of the camera 12 is to be smaller when the temperature Temp is equal to or greater than the threshold value Th than when the temperature Temp is less than the threshold value Th. In other words, when the temperature Temp is equal to or greater than the threshold value Th, the control signal setting unit 52 sets the third control signal C3 indicating that the aperture value F of the camera 12 is to be smaller than when the temperature Temp is less than the threshold value Th. ref The third control signal C3 is set to a value smaller than the reference aperture value F. ref is a reference aperture value set in advance, which may be stored in an internal memory of the control signal setting unit 52, or may be provided from outside the camera control device 14. The control signal setting unit 52 outputs a first control signal C 1 to the amplification factor control unit 24 , outputs a second control signal C 2 to the light emission amount control unit 25 , and outputs a third control signal C 3 to the aperture value control unit 53 .

[0053] The aperture value control unit 53 is realized by, for example, an aperture value control circuit 62 shown in FIG. The aperture value control unit 53 controls the aperture value F of the camera 12 in accordance with the third control signal C 3 output from the control signal setting unit 52 .

[0054] In Fig. 8, it is assumed that the temperature detection signal acquisition unit 21, the control signal setting unit 52, the amplification factor control unit 24, the light emission amount control unit 25, and the aperture value control unit 53, which are components of the camera control device 14, are each realized by dedicated hardware as shown in Fig. 9. In other words, it is assumed that the camera control device 14 is realized by a temperature detection signal acquisition circuit 31, a control signal setting circuit 61, an amplification factor control circuit 33, a light emission amount control circuit 34, and an aperture value control circuit 62. Each of the temperature detection signal acquisition circuit 31, the control signal setting circuit 61, the amplification factor control circuit 33, the light emission amount control circuit 34 and the aperture value control circuit 62 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these.

[0055] The components of the camera control device 14 are not limited to those realized by dedicated hardware, and the camera control device 14 may be realized by software, firmware, or a combination of software and firmware. When the camera control device 14 is realized by software, firmware, or the like, programs for causing a computer to execute the respective processing procedures in the temperature detection signal acquisition unit 21, the control signal setting unit 52, the amplification factor control unit 24, the light emission amount control unit 25, and the aperture value control unit 53 are stored in a memory 41 shown in Fig. 3. Then, a processor 42 shown in Fig. 3 executes the programs stored in the memory 41.

[0056] 9 shows an example in which each of the components of the camera control device 14 is realized by dedicated hardware, while Fig. 3 shows an example in which the camera control device 14 is realized by software, firmware, etc. However, this is merely one example, and some of the components in the camera control device 14 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.

[0057] Next, an operation of the driver monitoring system shown in Fig. 8 will be described. However, since the system is similar to the driver monitoring system shown in Fig. 1 except for the control unit 51, the operation of the control unit 51 will be mainly described here.

[0058] The control signal setting unit 52 of the control unit 51 acquires the temperature detection signal from the temperature detection signal acquiring unit 21 . The control signal setting unit 52 compares the temperature Temp indicated by the temperature detection signal with a threshold value Th. If the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference amplification factor G ref A first control signal C1 is set to indicate that the target amplification factor is set to be 1. If the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference light emission amount L ref The second control signal C2 is set to the target light emission amount. Furthermore, if the temperature Temp is less than the threshold value Th, the control signal setting unit 52 sets the reference aperture value F ref The third control signal C3 is set to the target aperture value.

[0059] The control signal setting unit 52 sets a first control signal C1 indicating that, when the temperature Temp is equal to or higher than the threshold value Th, the amplification factor G of the image signal is to be lower than when the temperature Temp is lower than the threshold value Th. That is, the control signal setting unit 52 sets the reference amplification factor G ref A first control signal C1 is set to indicate that a smaller amplification factor is to be set as the target amplification factor.

[0060] When the temperature Temp is equal to or higher than the threshold value Th, the control signal setting unit 52 sets the second control signal C2 which indicates that the amount of light emitted by the light emitting element 11 is to be increased more than when the temperature Temp is lower than the threshold value Th. That is, the control signal setting unit 52 sets the reference light emission amount L ref A second control signal C2 is set, which indicates that the greater amount of light emission is to be the target amount of light emission.

[0061] When the temperature Temp is equal to or higher than the threshold value Th, the control signal setting unit 52 sets the third control signal C3 that indicates that the aperture value F of the camera 12 is to be smaller than when the temperature Temp is lower than the threshold value Th. That is, the control signal setting unit 52 sets the reference aperture value F ref A third control signal C3 is set, which indicates that a smaller aperture value than the target aperture value is to be set. The control signal setting unit 52 outputs a first control signal C 1 to the amplification factor control unit 24 , outputs a second control signal C 2 to the light emission amount control unit 25 , and outputs a third control signal C 3 to the aperture value control unit 53 .

[0062] Upon receiving the first control signal C1 from the control signal setting unit 52, the amplification factor control unit 24 controls the amplification factor G of the image signal output from the imaging element 12a in accordance with the first control signal C1. As the temperature Temp increases, the amplification factor control section 24 reduces the amplification factor G of the image signal, so that white spot noise contained in the image signal is reduced even if the temperature Temp of the imaging element 12a becomes high.

[0063] Upon receiving the second control signal C2 from the control signal setting unit 52, the light emission amount control unit 25 controls the light emission amount L of the light emitting element 11 in accordance with the second control signal C2. As the temperature Temp rises, the light emission amount control unit 25 increases the light emission amount of the light-emitting element 11. Therefore, when the temperature Temp of the imaging element 12a is high, even if the amplification factor G is lowered, the decrease in the brightness of the image represented by the image signal is suppressed.

[0064] Upon receiving the third control signal C3 from the control signal setting unit 52, the aperture value control unit 53 controls the aperture value F of the camera 12 in accordance with the third control signal C3. That is, the aperture value control unit 53 controls the aperture value F of the camera 12 so that the aperture value F of the camera 12 matches a target aperture value indicated by the third control signal C3. When the temperature Temp is equal to or higher than the threshold value Th, the aperture value control unit 53 reduces the aperture value F of the camera 12 compared to when the temperature Temp is less than the threshold value Th, so that even if the amplification factor G is reduced when the temperature Temp of the image sensor 12a is high, the decrease in brightness of the image represented by the image signal is suppressed. However, if the aperture value F of the camera 12 becomes too small, the white spot noise contained in the image signal increases. For this reason, it is necessary to reduce the aperture value F so that the increase in white spot noise caused by the reduction in the aperture value F does not exceed the reduction in white spot noise caused by the reduction in the amplification factor G.

[0065] In the camera control device 14 shown in Fig. 8, when the temperature Temp is equal to or higher than the threshold value Th, not only is the light emission amount L of the light-emitting element 11 increased, but the aperture value F of the camera 12 is reduced. Therefore, compared to the camera control device 14 shown in Fig. 1, the camera control device 14 shown in Fig. 8 can suppress a decrease in the brightness of an image even if the increase in the light emission amount L of the light-emitting element 11 is suppressed.

[0066] In addition, the present disclosure allows free combination of the respective embodiments, modification of any of the components of each embodiment, or omission of any of the components of each embodiment. [Industrial Applicability]

[0067] The present disclosure is suitable for a camera control device, a camera control method, and an imaging device. [Explanation of symbols]

[0068] 1 imaging device, 2 image signal acquisition section, 11 light emitting element, 12 camera, 12a imaging element, 13 temperature detector, 14 camera control device, 21 temperature detection signal acquisition section, 22 control section, 23 control signal setting section, 24 amplification rate control section, 25 light emission amount control section, 26 table section, 27 control section, 28 control signal setting section, 31 temperature detection signal acquisition circuit, 32 control signal setting circuit, 33 amplification rate control circuit, 34 light emission amount control circuit, 35 memory circuit, 36 control signal setting circuit, 41 memory, 42 processor, 51 control section, 52 control signal setting section, 53 aperture value control section, 61 control signal setting circuit, 62 aperture value control circuit.

Claims

1. a temperature detection signal acquisition unit that acquires a temperature detection signal indicating a temperature of an image pickup element from a temperature detector that detects a temperature of the image pickup element that outputs an image signal representing a subject; a control unit that controls, based on the temperature detection signal acquired by the temperature detection signal acquisition unit, an amplification factor of an image signal output from the image sensor, a light emission amount of a light emitting element that irradiates light onto the subject, and an aperture value of a camera including the image sensor; Equipped with The control unit is A camera control device characterized in that, when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is equal to or higher than a threshold value, the device performs control to lower the amplification rate of the image signal output from the imaging element, control to increase the amount of light emitted by the light-emitting element, and control to reduce the aperture value of a camera including the imaging element, compared to when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is lower than the threshold value.

2. The control unit is a control signal setting unit that sets a first control signal indicating that the amplification factor of the image signal is to be reduced when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is equal to or higher than a threshold value, sets a second control signal indicating that the amount of light emitted from the light-emitting element is to be increased, and sets a third control signal indicating that the aperture value of the camera is to be reduced, compared to when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is lower than the threshold value; an amplification factor control unit that controls an amplification factor of an image signal output from the imaging element in accordance with a first control signal output from the control signal setting unit; a light emission amount control unit that controls a light emission amount of the light emitting element in accordance with a second control signal output from the control signal setting unit; 2. A camera control device according to claim 1, further comprising an aperture value control section for controlling an aperture value of the camera in accordance with a third control signal output from the control signal setting section.

3. a temperature detection signal acquisition unit that acquires a temperature detection signal indicating a temperature of an image pickup element from a temperature detector that detects a temperature of the image pickup element that outputs an image signal representing a subject; a control unit, based on the temperature detection signal acquired by the temperature detection signal acquisition unit, controls an amplification factor of an image signal output from the imaging element, a light emission amount of a light emitting element that irradiates light to the subject, and an aperture value of a camera including the imaging element; The control unit is A camera control method characterized by performing control to reduce the amplification rate of the image signal output from the imaging element, to increase the amount of light emitted by the light-emitting element, and to reduce the aperture value of a camera including the imaging element, when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is equal to or higher than a threshold value, compared to when the temperature indicated by the temperature detection signal is below the threshold value.

4. A light emitting element that irradiates light onto a subject; an image sensor that outputs an image signal representing the subject; a temperature detector that detects a temperature of the imaging element and outputs a temperature detection signal indicative of the temperature; a temperature detection signal acquiring unit that acquires a temperature detection signal output from the temperature detector; a control unit that controls an amplification factor of an image signal output from the imaging element, a light emission amount of the light emitting element, and an aperture value of a camera including the imaging element, based on the temperature detection signal acquired by the temperature detection signal acquisition unit; Equipped with The control unit is An imaging device characterized in that, when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is equal to or higher than a threshold value, the device performs control to lower the amplification rate of the image signal output from the imaging element, control to increase the amount of light emitted by the light-emitting element, and control to reduce the aperture value of a camera including the imaging element, compared to when the temperature indicated by the temperature detection signal acquired by the temperature detection signal acquisition unit is lower than the threshold value.

Citation Information

Patent Citations

  • Camera

    JP2003084194A

  • Electronic camera

    JP2004096328A

  • Imaging device, and program

    JP2004304438A

  • Stereo camera, stereo imaging method and program

    JP2009267918A

  • Image sensor, signal processing device, signal processing method, and electronic device

    US20200020726A1