Imaging device and image display system

Abstract

To provide an imaging device capable of accurate and speedy mode switching, and a video display system.SOLUTION: A camera (imaging device) comprises: an imaging control part (imaging part) which images an object to be observed in an exposure state corresponding to lightness measured by an illuminance sensor (lightness measurement part) measuring outside lightness of a vehicle among a plurality of lightness measurement parts measuring lightness in different directions inside and outside the vehicle; a first imaging mode setting part which sets the exposure state of imaging by the imaging control part based upon a plurality of difference values of lightness measured by the plurality of illuminance sensors respectively and the lightness outside of the vehicle among lightness values measured by the plurality of illuminance sensors; and a video output part which outputs a video signal captured in the exposure state set by the first imaging mode setting part.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present disclosure relates to an imaging device and a video display system.

Background Art

[0002] In recent years, various driving support systems using cameras have been mounted on vehicles. Among these driving support systems, for example, there is one that displays an image of the surrounding of the vehicle captured by a camera on an electronic mirror that replaces a rearview mirror or a side mirror.

[0003] In such an electronic mirror, image quality of video equivalent to or higher than that of a conventional mirror is required. In recent years, a wide dynamic range image sensor with an expanded dynamic range of an image sensor used in a camera has been put into practical use, and further improvement in image quality has been achieved.

[0004] For example, in Patent Document 1, according to the brightness around the vehicle, there are a day mode in which the exposure state of the camera is optimally adjusted to a bright place during daytime, a night mode in which the exposure state of the camera is optimally adjusted to a dark place at night, and a twilight mode in which the exposure state of the camera is optimally adjusted to twilight in the evening. Switching between these modes is performed according to the brightness around the vehicle measured by an illuminance meter mounted on the vehicle.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, because the system requires calculation time to switch modes according to the brightness around the vehicle measured by the illuminance meter, there was a problem in that mode switching could not be done instantly in environments where the brightness changes rapidly, such as tunnel entrances and exits or multi-story parking lots. In addition, there was a problem in that the system would be set to a different mode than intended due to the influence of local lighting around the vehicle. For example, if the illuminance meter detected the brightness of lighting installed inside a tunnel, it would measure a higher illuminance than the actual level, causing the system to remain in daytime mode when it should have been in night mode.

[0007] This disclosure aims to provide an imaging device and image display system that enable accurate and rapid mode switching. [Means for solving the problem]

[0008] The imaging device according to this disclosure is characterized by comprising: an imaging unit that generates a video signal by imaging an object under an exposure state corresponding to the brightness measured by a brightness measuring unit that measures the brightness outside the vehicle; a third imaging mode setting unit that sets the exposure state when the imaging unit performs imaging based on the brightness and the signal level of the video signal generated by the imaging unit; and a video output unit that outputs a video signal captured under the exposure state set by the third imaging mode setting unit.

[0009] Furthermore, the imaging device according to this disclosure includes an imaging unit that generates an image signal by capturing an image of the object being observed based on the exposure state corresponding to the brightness measured by the brightness measurement unit that measures the brightness outside the vehicle, among a plurality of brightness measurement units that measure brightness in different directions inside and outside the vehicle, and the difference value of the plurality of brightness measured by the plurality of brightness measurement units. If the difference value threshold is smaller, the brightness measured by multiple brightness measurement units corresponds to the brightness outside the vehicle. A first imaging mode setting unit for setting the exposure state, and 1 It is characterized by comprising: a video output unit that outputs a video signal captured under the exposure conditions set by the imaging mode setting unit; and [Effects of the Invention]

[0010] The imaging device described herein enables accurate and rapid mode switching. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a system configuration diagram showing an example of the overall configuration of the video display system according to the first embodiment. [Figure 2] Figure 2 is an external view showing an example of an electronic mirror included in the video display system according to the first embodiment. [Figure 3] Figure 3 is a hardware block diagram showing an example of the hardware configuration of a video display system. [Figure 4] Figure 4 illustrates a method by which a camera according to the first embodiment sets a video output mode based on the illuminance measured by an illuminance meter and the level of the video signal output by an imaging device. [Figure 5] Figure 5 is a functional block diagram showing an example of the functional configuration of the camera according to the first embodiment. [Figure 6] Figure 6 is a flowchart showing an example of the processing flow performed by the camera according to the first embodiment. [Figure 7] Figure 7 is an external view showing an example of an electronic mirror included in the video display system according to the second embodiment. [Figure 8] Figure 8 illustrates a method by which a camera according to the second embodiment sets a video output mode based on multiple illuminance levels measured by an illuminance meter. [Figure 9] Figure 9 is a functional block diagram showing an example of the functional configuration of a camera according to the second embodiment. [Figure 10] Figure 10 is a flowchart showing an example of the processing flow performed by the camera according to the second embodiment. [Figure 11] Figure 11 illustrates a method by which a camera according to the third embodiment sets a video output mode based on the illuminance outside the vehicle measured by an illuminometer and the level of the video signal output by the camera. [Figure 12]FIG. 12 is a functional block diagram showing an example of the functional configuration of the camera according to the third embodiment. [Figure 13] FIG. 13 is a flowchart showing an example of the flow of processing performed by the camera according to the third embodiment. **Embodiments for Carrying Out the Invention**

[0012] (First Embodiment) Hereinafter, a first embodiment of an imaging device and a video display system according to the present disclosure will be described with reference to the drawings.

[0013] (Overall Configuration of Video Display System) First, the overall configuration of the video display system 10a will be described using FIG. 1. FIG. 1 is a system configuration diagram showing an example of the overall configuration of the video display system according to the first embodiment.

[0014] The video display system 10a is mounted on the vehicle 15 and includes a camera 20a and an electronic mirror 30. The camera 20a is installed, for example, at the rear of the vehicle 15 facing the rear (negative X-axis side) of the vehicle 15. The camera 20a includes an imaging element such as a CMOS or a CCD, for example, and images the rear of the vehicle 15. Note that the camera 20a is an example of the imaging device in the present disclosure. The electronic mirror 30 has both the function of a general mirror-type rearview mirror and the function of displaying the video of the rear of the vehicle 15 imaged by the camera 20a. The structure of the electronic mirror 30 will be described in detail later. Note that the electronic mirror 30 is an example of the display device in the present disclosure.

[0015] Next, the structure of the electronic mirror 30 will be described using FIG. 2. FIG. 2 is an external view showing an example of the electronic mirror included in the video display system according to the first embodiment.

[0016] The electronic mirror 30 encloses a display panel 34 inside the housing 36. The display panel 34 is, for example, an LCD panel or an organic EL panel. The display surface of the display panel 34 is positioned facing the opening of the housing 36. Furthermore, a half-mirror 35 is installed facing the display surface of the display panel 34.

[0017] The electronic mirror 30 is attached to the windshield or roof of the vehicle 15 via the mounting portion 37.

[0018] An operation switch 38 is mounted on the lower part of the housing 36 of the electronic mirror 30. Operating the operation switch 38 switches between the display on the display panel 34 and the reflected image of the rear of the vehicle 15 reflected in the half mirror 35. When the reflected image reflected in the half mirror 35 is displayed, the display panel 34 is turned off.

[0019] An illuminance sensor 40a is installed on the front side (positive X-axis side) of the housing 36 of the electronic mirror 30 facing the vehicle 15. The illuminance sensor 40a is composed of, for example, a photodiode and outputs an electrical signal corresponding to the external brightness. The light-receiving part of the illuminance sensor 40a is installed facing the front side of the vehicle 15. Another sensor with the same function as a photodiode may be used as the illuminance sensor 40a. Furthermore, although an example in which the illuminance sensor 40a is attached to the housing 36 of the electronic mirror 30 is shown here, the mounting position of the illuminance sensor 40a is not limited to the housing 36 of the electronic mirror 30. For example, the illuminance sensor 40a may be installed near the camera 20a, facing the rear of the vehicle 15. Note that the illuminance sensor 40a is an example of a brightness measurement unit in this disclosure.

[0020] (Hardware configuration of the video display system) The hardware configuration of the video display system 10a will be explained using Figure 3. Figure 3 is a hardware block diagram showing an example of the hardware configuration of the video display system.

[0021] The video display system 10a includes a camera 20a, an electronic mirror 30, and an illuminance sensor 40a.

[0022] The camera 20a further includes a light-receiving element 21, a video signal processing processor 22, a system microcontroller 23, a serializer 24, and a connector 25.

[0023] The light-receiving element 21 performs so-called photoelectric conversion, which converts the brightness of the optical image formed on the light-receiving element 21 by the lens (optical system) of the camera 20a into an electrical signal. The light-receiving element 21 further comprises a photoelectric conversion unit 21a, a drive control unit 21b, and an interface unit 21c. The light-receiving element 21 is an assembly of multiple cells. Each cell is also called a pixel, and the more pixels there are, the higher the resolution of the generated video signal.

[0024] The photoelectric conversion unit 21a performs photoelectric conversion, which converts the brightness of the optical image formed on the light-receiving element 21 into an electrical signal.

[0025] The drive control unit 21b controls the exposure time of the photoelectric conversion unit 21a and the timing of the photoelectric conversion performed by the photoelectric conversion unit 21a.

[0026] The interface unit 21c controls the output timing of the video signal.

[0027] The video signal processing processor 22 generates a YC signal (luminance signal (Y) and chromaticity signal (C)) from the video signal generated by the photodetector 21. The video signal processing processor 22 is also called an ISP (Image Signal Processor). The video signal processing processor 22 further comprises a video signal processing unit 22a and an interface unit 22b. The video signal processing unit 22a generates the YC signal by performing dynamic range and NR (Noise Reduction) correction on the video signal generated by the photodetector 21. The interface unit 22b controls the input and output timing of the video signal.

[0028] The system microcontroller 23 works in cooperation with the video signal processing processor 22 to perform pre-set signal processing. Specifically, the system microcontroller 23 sets the imaging conditions for when the light-receiving element 21 takes an image, based on the illuminance measured by the illuminance sensor 40a. The specific details of the signal processing will be described later.

[0029] The serializer 24 converts the video signal output by the video signal processing processor 22 from a parallel signal to a serial signal.

[0030] Connector 25 electrically connects camera 20a and electronic mirror 30.

[0031] The electronic mirror 30 comprises a connector 31, a deserializer 32, an image processing IC 33, and a display panel 34.

[0032] Connector 31 electrically connects the electronic mirror 30 and the camera 20a.

[0033] The deserializer 32 converts the video signal output from camera 20a from a serial signal to a parallel signal.

[0034] The video processing IC 33 performs gradation correction and other operations on the video signal to generate a video signal to be displayed on the display panel 34.

[0035] The display panel 34 displays the video signal generated by the video processing IC 33.

[0036] Although not shown in Figure 3, the electronic mirror 30 includes a half-mirror 35 superimposed on the display panel 34, as explained in Figure 2. The electronic mirror 30 switches between displaying the video signal shown on the display panel 34 and the reflected image of the rear of the vehicle 15 reflected in the half-mirror 35 by operating the operation switch 38.

[0037] The functions of the illuminance sensor 40a are as described above.

[0038] (Setting the exposure state based on the brightness measured by the illuminance sensor and the level of the video signal) Using Figure 4, we will explain how to set the exposure state of the camera 20a based on the brightness measured by the illuminance sensor 40a and the video signal captured by the camera 20a. Figure 4 is a diagram illustrating how the camera according to the first embodiment sets the video output mode based on the illuminance measured by the illuminance meter and the level of the video signal output by the imaging device.

[0039] The illuminance sensor 40a measures the brightness outside the vehicle 15. Therefore, by setting the exposure state of the camera 20a according to the illuminance L measured by the illuminance sensor 40a and performing imaging, a highly visible video signal can be generated regardless of the brightness outside the vehicle 15. The video display system 10a includes a day mode in which the exposure state of the camera 20a is optimally adjusted for bright daytime locations, a night mode in which the exposure state of the camera 20a is optimally adjusted for dark nighttime locations, and a twilight mode in which the exposure state of the camera 20a is optimally adjusted for dusk. Hereinafter, the day mode, night mode, and twilight mode will be collectively referred to as imaging modes.

[0040] The camera 20a further adjusts its exposure state based on the signal level of the video signal captured under an exposure state based on the illuminance L measured by the illuminance sensor 40a. Note that illuminance L is an example of brightness in this disclosure.

[0041] The signal level of the video signal may be, for example, the average value P of the video signal, or a value based on the shape of the frequency distribution (histogram) of the video signal values.

[0042] Figure 4 shows an example of an imaging mode that is set based on the illuminance L measured by the illuminance sensor 40a and the average value P of the video signal captured under the exposure state set according to the illuminance L.

[0043] The system microcontroller 23 of the camera 20a acquires the illuminance L measured by the illuminance sensor 40a, and sets the exposure time according to the illuminance L in the system microcontroller 23 or the video signal processing processor 22. Then, the photoelectric conversion unit 21a performs photoelectric conversion based on the set exposure time.

[0044] The drive control unit 21b of the light-receiving element 21 sets, for example, three exposure times according to the magnitude (brightness) of the illuminance L. Specifically, it sets shorter exposure times for brighter conditions, depending on whether the illuminance L is high (bright), medium, or low (dark).

[0045] The video signal processing unit 22a acquires the video signal captured with a set exposure time and calculates the average value P of the image brightness.

[0046] The system microcontroller 23 acquires the average value P and sets the imaging mode (day mode, twilight mode, and night mode) according to the magnitude of the average value P.

[0047] Figure 4 shows an example of the imaging modes set in this way. For example, if the average value P of the video signal is high (greater than or equal to the brightness threshold Pa) relative to a preset brightness threshold Pa,Pb (Pa > Pb), then day mode is set when the illuminance L is high, twilight mode is set when the illuminance L is medium, and night mode is set when the illuminance L is low. Note that the high, medium, and low levels of illuminance L are determined by comparison with a preset illuminance threshold.

[0048] Additionally, when the average value P of the video signal is moderate (brightness threshold Pb or higher but less than Pa), twilight mode is set when the illuminance L is high or moderate, and night mode is set when the illuminance L is low.

[0049] Additionally, if the average value P of the video signal is low (below the brightness threshold Pc), night mode will be set regardless of the illuminance L.

[0050] Note that the brightness threshold values ​​Pa and Pb vary depending on the specifications of the photodetector 21. For example, if the quantization level of the generated video signal is 8 bits, values ​​such as Pa=90 and Pb=6.5 are used. Also, the example of setting the imaging mode shown in Figure 4 is just one example, and the imaging mode may be set using a different map.

[0051] (Camera function configuration) The functional configuration of the camera 20a according to the first embodiment will be explained using Figure 5. Figure 5 is a functional block diagram showing an example of the functional configuration of the camera according to the first embodiment.

[0052] The camera 20a implements the various functional units shown in Figure 5 within the video signal processing processor 22 and the system microcontroller 23 by executing a program pre-stored in the system microcontroller 23.

[0053] Specifically, the camera 20a includes an illumination acquisition unit 51, an image capture control unit 52, an average value calculation unit 53, a third image capture mode setting unit 54, a halation suppression processing unit 55, a dark area visualization processing unit 56, a video output unit 57, and an operation control unit 58.

[0054] The illuminance acquisition unit 51 acquires the illuminance L measured by the illuminance sensor 40a, which measures the brightness outside the vehicle 15.

[0055] The imaging control unit 52 generates an image signal of the object being observed based on the exposure state set by the third imaging mode setting unit 54. Note that the imaging control unit 52 is an example of an imaging unit in this disclosure.

[0056] The average value calculation unit 53 calculates the average value P of the video signals generated by the imaging control unit 52.

[0057] The third imaging mode setting unit 54 sets the exposure state when the imaging unit performs imaging based on the illuminance L and the signal level of the video signal generated by the imaging control unit 52.

[0058] The halation suppression processing unit 55 performs halation suppression processing to correct the gradation of the video signal so that the number of pixels in the captured video signal that exceeds a predetermined signal level does not exceed a threshold when the number of pixels exceeding a predetermined signal level exceeds a threshold. The halation suppression processing unit 55 is an example of the first gradation correction unit in this disclosure.

[0059] The dark area visualization processing unit 56 raises the signal level of the captured video signal to make the entire image easier to see when the captured video signal falls below a predetermined signal level. The dark area visualization processing unit 56 is an example of a second tone correction unit in this disclosure.

[0060] The video output unit 57 outputs the video signal captured under the exposure conditions set by the third imaging mode setting unit 54 to the electronic mirror 30.

[0061] The motion control unit 58 controls the overall operating state of the camera 20a.

[0062] (The processing flow performed by the camera) Figure 6 illustrates the processing flow performed by the camera 20a according to the first embodiment. Figure 6 is a flowchart showing an example of the processing flow performed by the camera according to the first embodiment.

[0063] The illuminance acquisition unit 51 acquires the illuminance L measured by the illuminance sensor 40a (step S11).

[0064] The imaging control unit 52 performs imaging in an exposure state corresponding to the illuminance L acquired by the illuminance acquisition unit 51 (step S12).

[0065] The average value calculation unit 53 calculates the average value P of the video signal captured by the imaging control unit 52 (step S13).

[0066] The third imaging mode setting unit 54 sets the imaging mode based on the illuminance L and the average value P of the video signal calculated by the average value calculation unit 53 (step S14).

[0067] The imaging control unit 52 performs imaging using the imaging mode set by the third imaging mode setting unit 54 (step S15).

[0068] The third imaging mode setting unit 54 determines whether the current imaging mode is night mode (step S16). If it is determined that the current imaging mode is night mode (step S16: Yes), the process proceeds to step S17. On the other hand, if it is not determined that the current imaging mode is night mode (step S16: No), the process proceeds to step S19.

[0069] In step S16, if it is determined that the current imaging mode is night mode, the halation suppression processing unit 55 performs halation suppression processing to correct the gradation of the video signal so that the number of pixels in the captured video signal that exceeds a predetermined signal level does not exceed a threshold (step S17). However, the specific processing content of the halation suppression processing is not limited to this.

[0070] Next, the dark area visualization processing unit 56 performs dark area visualization processing to increase the signal level of the video signal to make the entire image more visible when the number of pixels in the captured video signal that are below a predetermined signal level exceeds a threshold, i.e., when there is a large low-luminance area (step S18). Note that the process of increasing the signal level of the image to make the entire image more visible is a commonly used method, so a detailed explanation will be omitted.

[0071] The video output unit 57 outputs the video signal to the electronic mirror 30 (step S19).

[0072] The operation control unit 58 determines whether the ignition of the vehicle 15 is OFF (step S20). If it is determined that the ignition of the vehicle 15 is OFF (step S20: Yes), the camera 20a terminates the process shown in Figure 6. On the other hand, if it is not determined that the ignition of the vehicle 15 is OFF (step S20: No), the process returns to step S11.

[0073] (Effects of the first embodiment) As described above, the camera 20a (imaging device) of the first embodiment includes an imaging control unit 52 (imaging unit) that captures an image of the object to be observed and generates a video signal according to the exposure state corresponding to the illuminance L (brightness) measured by an illuminance sensor 40a (brightness measurement unit) that measures the illuminance L (brightness) outside the vehicle 15; a third imaging mode setting unit 54 that sets the exposure state when the imaging control unit 52 performs imaging based on the illuminance L and the signal level of the video signal generated by the imaging control unit 52; and a video output unit 57 that outputs a video signal captured with the exposure state set by the third imaging mode setting unit 54. Therefore, it is possible to provide an imaging device that can switch imaging modes accurately and quickly.

[0074] Furthermore, in the camera 20a (imaging device) of the first embodiment, the third imaging mode setting unit 54 sets the exposure state when the imaging control unit 52 (imaging unit) performs imaging based on the average value P of the signal level of the video signal. Therefore, since the exposure state when performing imaging is set using the signal level of the video signal which quickly detects the brightness of the object to be imaged, the imaging mode can be switched quickly.

[0075] Furthermore, in the camera 20a (imaging device) of the first embodiment, the third imaging mode setting unit 54 sets the exposure state when the imaging control unit 52 (imaging unit) performs imaging to a state corresponding to at least daytime, nighttime, and twilight. Therefore, the visibility of the video signal output by the video output unit 57 can be made to correspond to the typical light environment when the vehicle 15 is in motion.

[0076] Furthermore, the camera 20a (imaging device) of the first embodiment further includes a halation suppression processing unit 55 (first gradation correction unit) that, when the third imaging mode setting unit 54 sets the exposure state for imaging by the imaging control unit 52 (imaging unit) to a state corresponding to nighttime, corrects the gradation of the video signal so that the number of pixels exceeding a predetermined signal level in the captured video signal does not exceed a threshold. Therefore, it is possible to suppress the occurrence of halation in the captured video signal due to the headlights of a following vehicle.

[0077] Furthermore, the camera 20a (imaging device) of the first embodiment further includes a dark area visualization processing unit 56 (second gradation correction unit) that, when the third imaging mode setting unit 54 sets the exposure state for imaging by the imaging control unit 52 (imaging unit) to a state corresponding to nighttime, raises the signal level of the image signal to make the whole image easier to see if the captured image signal falls below a predetermined signal level.Therefore, at night, it is possible to display an image with higher visibility compared to the reflected image captured by a normal rearview mirror.

[0078] (Second embodiment) Next, a second embodiment of the present disclosure, the video display system 10b, will be described. The video display system 10b (not shown) is installed in the vehicle 15 and includes a camera 20b instead of the camera 20a provided in the video display system 10a (see Figure 1). The video display system 10b also includes an electronic mirror 30 as shown in Figure 7. Figure 7 is an external view showing an example of an electronic mirror provided in the video display system according to the second embodiment.

[0079] The structure of the electronic mirror 30 itself is the same as that described in the first embodiment. In addition to the illuminance sensor 40a described above, the electronic mirror 30 of this embodiment is equipped with an illuminance sensor 40b.

[0080] The illuminance sensor 40b is installed at the lower end (the lower end on the negative Z-axis side) of the housing 36 of the electronic mirror 30, with its light-receiving section facing downwards. In other words, the illuminance sensor 40b is installed in a position where it is less likely to be exposed to light from outside the vehicle 15 when the vehicle 15 is traveling in a tunnel or an indoor parking lot. Note that the installation positions of the illuminance sensors 40a and 40b are not limited to those shown in Figure 7. For example, the illuminance sensors 40a and 40b may be installed near the camera 20b.

[0081] The hardware configuration of camera 20b is the same as that of camera 20a, differing only in that it acquires illuminance measured by two illuminance sensors 40a and 40b, and in the implemented program. Therefore, the hardware components of camera 20b will be described using the same reference numerals as described in the first embodiment.

[0082] (Setting the exposure state based on the brightness measured by the illuminance sensor) Using Figure 8, we will explain how to set the appropriate exposure state of the camera 20b based on the illuminances La and Lb measured by the illuminance sensors 40a and 40b. Figure 8 is a diagram illustrating how a camera according to the second embodiment sets the video output mode based on multiple illuminances measured by an illuminance meter.

[0083] Let La be the illuminance measured by illuminance sensor 40a, and Lb be the illuminance measured by illuminance sensor 40b.

[0084] When the difference value ΔL between the illuminance La measured by the illuminance sensor 40a and the illuminance Lb measured by the illuminance sensor 40b is smaller than a predetermined value, the camera 20b sets the exposure state according to the illuminance La measured by the illuminance sensor 40a, i.e., the brightness outside the vehicle 15.

[0085] Specifically, when the difference value ΔL between illuminance La and illuminance Lb is smaller than a predetermined value, camera 20b sets, for example, three exposure times according to the magnitude (brightness) of illuminance La outside the vehicle 15. Specifically, by setting shorter exposure times for brighter conditions according to high (bright), medium, and low (dark) illuminance La, the daytime mode, twilight mode, and nighttime mode described in the first embodiment are set.

[0086] On the other hand, camera 20b sets the imaging mode to night mode regardless of the magnitudes of illuminance La and Lb if the difference value ΔL between illuminance La and illuminance Lb is greater than or equal to a predetermined value. This is because the illuminance La measured by the illuminance sensor 40a fluctuates depending on the lighting conditions outside the vehicle 15. For example, when driving through a tunnel at night, the illuminance La may be large due to the lighting inside the tunnel. If the imaging mode were set based solely on illuminance La, when driving through a tunnel, it would end up being day mode or twilight mode instead of night mode.

[0087] (Camera function configuration) The functional configuration of the camera 20b according to the second embodiment will be explained using Figure 9. Figure 9 is a functional block diagram showing an example of the functional configuration of the camera according to the second embodiment.

[0088] The camera 20b implements the functional units shown in Figure 9 within the video signal processing processor 22 and the system microcontroller 23 by executing a program pre-stored in the system microcontroller 23.

[0089] Specifically, the camera 20b includes an illuminance acquisition unit 61, an image capture control unit 62, an illuminance difference value calculation unit 63, a first image capture mode setting unit 64, a video output unit 65, and an operation control unit 66.

[0090] The illuminance acquisition unit 61 acquires the illuminance La measured by the illuminance sensor 40a, which measures the brightness outside the vehicle 15, and the illuminance Lb measured by the illuminance sensor 40b, which is installed in a position where it is difficult for light from outside the vehicle 15 to reach it.

[0091] The imaging control unit 62 generates an image signal of the object being observed based on the exposure state set by the first imaging mode setting unit 64. Note that the imaging control unit 62 is an example of an imaging unit in this disclosure.

[0092] The illuminance difference calculation unit 63 calculates the difference value ΔL between illuminance La and illuminance Lb.

[0093] The first imaging mode setting unit 64 sets the exposure state for when the imaging control unit 62 performs imaging based on the difference value ΔL of multiple illuminances La and Lb measured by the illuminance sensors 40a and 40b, and the illuminance La of the outside of the vehicle 15 among the multiple illuminances La and Lb measured by the illuminance sensors 40a and 40b.

[0094] The video output unit 65 outputs the video signal captured under the exposure conditions set by the first imaging mode setting unit 64 to the electronic mirror 30.

[0095] The motion control unit 66 controls the overall operating state of the camera 20b.

[0096] Furthermore, the camera 20b may also include the halation suppression processing unit 55 and the dark area visualization processing unit 56 described in the first embodiment.

[0097] (The processing flow performed by the camera) The processing flow performed by the camera 20b according to the second embodiment will be explained using Figure 10. Figure 10 is a flowchart showing an example of the processing flow performed by the camera according to the second embodiment.

[0098] The illuminance acquisition unit 61 acquires multiple illuminance values ​​La and Lb measured by the illuminance sensors 40a and 40b, respectively (step S31).

[0099] The illuminance difference value calculation unit 63 calculates the difference value ΔL (=La-Lb) between illuminance La and illuminance Lb (step S32).

[0100] The first imaging mode setting unit 64 determines whether the difference value ΔL is smaller than the difference value threshold (step S33). If it is determined that the difference value ΔL is smaller than the difference value threshold (step S33: Yes), the process proceeds to step S34. On the other hand, if it is not determined that the difference value ΔL is smaller than the difference value threshold (step S33: No), the process proceeds to step S35.

[0101] In step S33, if it is determined that the difference value ΔL is smaller than the difference value threshold, the first imaging mode setting unit 64 sets the imaging mode based on the illuminance La outside the vehicle 15 (step S34). Then, the process proceeds to step S36. Specifically, the method for setting the imaging mode is to set, for example, to set shorter exposure times for brighter conditions, depending on whether the illuminance La is high (bright), medium, or low (dark).

[0102] On the other hand, if in step S33 the difference value ΔL is not determined to be smaller than the difference value threshold, the first imaging mode setting unit 64 sets the imaging mode to night mode (step S35). Then, the process proceeds to step S36.

[0103] The imaging control unit 62 performs imaging using the imaging mode set by the first imaging mode setting unit 64 (step S36).

[0104] The video output unit 65 outputs the video signal to the electronic mirror 30 (step S37).

[0105] The operation control unit 66 determines whether the ignition of the vehicle 15 is OFF (step S38). If it is determined that the ignition of the vehicle 15 is OFF (step S38: Yes), the camera 20b terminates the process shown in Figure 10. On the other hand, if it is not determined that the ignition of the vehicle 15 is OFF (step S38: No), the process returns to step S31.

[0106] (Effects of the second embodiment) As described above, the camera 20b (imaging device) of the second embodiment includes an imaging control unit 62 (imaging unit) that generates a video signal by imaging an object based on the exposure state corresponding to the illuminance La measured by the illuminance sensor 40a, which measures the brightness outside the vehicle 15, among a plurality of illuminance sensors 40a, 40b (brightness measurement unit) that measure the illuminance (brightness) in different directions inside and outside the vehicle 15; a first imaging mode setting unit 64 that sets the exposure state when the imaging control unit 62 performs imaging based on the difference value ΔL of a plurality of illuminances La, Lb measured by the plurality of illuminance sensors 40a, 40b, and the illuminance La outside the vehicle 15 among the illuminances La, Lb measured by the plurality of illuminance sensors 40a, 40b, and the illuminance La outside the vehicle 15 among the illuminances La, Lb measured by the plurality of illuminance sensors 40a, 40b, and a video output unit 65 that outputs a video signal captured with the exposure state set by the first imaging mode setting unit 64.Therefore, it is possible to prevent the imaging mode from being mistakenly set to daytime mode due to the influence of lighting in tunnels, indoor parking lots, etc.

[0107] Furthermore, in the camera 20b (imaging device) of the second embodiment, the first imaging mode setting unit 64 sets the exposure state according to the illuminance La outside the vehicle 15 from among the illuminance La and Lb measured by the multiple illuminance sensors 40a and 40b when the difference value ΔL of multiple illuminances La and Lb is smaller than the difference value threshold. Therefore, if there is no difference in brightness inside and outside the vehicle 15, the imaging mode is set based on the illuminance La outside the vehicle 15, so that an imaging mode according to the brightness of the driving environment of the vehicle 15 can be set.

[0108] Furthermore, in the camera 20b (imaging device) of the second embodiment, at least one of the multiple illuminance sensors 40a, 40b is installed in a position where it is difficult for light from outside the vehicle 15 to reach it. Therefore, the difference in brightness between the inside and outside of the vehicle 15 can be easily and reliably determined.

[0109] Furthermore, in the camera 20b (imaging device) of the second embodiment, the first imaging mode setting unit 64 sets the exposure state when the imaging control unit 62 (imaging unit) performs imaging to a state corresponding to at least daytime, nighttime, and twilight. Therefore, the visibility of the video signal output by the video output unit 65 can be made to correspond to the typical light environment when the vehicle 15 is in motion.

[0110] (Third embodiment) Next, a third embodiment of the present disclosure, the video display system 10c, will be described. The video display system 10c (not shown) is installed in the vehicle 15 and includes a camera 20c in place of the camera 20a provided in the video display system 10a (see Figure 1). The video display system 10c also includes an electronic mirror 30 as shown in Figure 7.

[0111] (Setting the exposure state based on the brightness measured by the illuminance sensor and the level of the video signal) Using Figure 11, a method for setting the appropriate exposure state of camera 20c based on the illuminance La and Lb measured by illuminance sensors 40a and 40b and the level of the video signal generated by camera 20c will be explained. Figure 11 is a diagram illustrating how a camera according to the third embodiment sets the video output mode based on the illuminance outside the vehicle measured by an illuminometer and the level of the video signal output by the camera.

[0112] Let La be the illuminance measured by illuminance sensor 40a, and Lb be the illuminance measured by illuminance sensor 40b.

[0113] When the difference value ΔL between the illuminance La measured by the illuminance sensor 40a and the illuminance Lb measured by the illuminance sensor 40b is smaller than a predetermined value, the camera 20c sets the exposure state of the camera 20b according to the illuminance La measured by the illuminance sensor 40a, i.e., the brightness outside the vehicle 15.

[0114] Specifically, when the difference value ΔL between illuminance La and illuminance Lb is smaller than a predetermined value, the camera 20c sets, for example, three exposure times according to the magnitude (brightness) of illuminance La outside the vehicle 15. Specifically, by setting shorter exposure times for brighter conditions according to high (bright), medium, and low (dark) illuminance La, the daytime mode, twilight mode, and nighttime mode described in the first embodiment are set.

[0115] On the other hand, if the difference value ΔL between illuminance La and illuminance Lb is greater than or equal to a predetermined value, camera 20c adjusts its exposure state based on the signal level of the video signal captured under the exposure state based on the illuminance La measured by the illuminance sensor 40a. The signal level of the video signal can be, for example, the average value P of the video signal.

[0116] For example, if the average value P of the video signal is high (greater than or equal to the brightness threshold Pa) relative to a preset brightness threshold Pa,Pb (Pa > Pb), then day mode is set when the illuminance La is high, twilight mode when the illuminance La is medium, and night mode when the illuminance La is low. Note that the high, medium, and low levels of illuminance La are determined by comparing it with a preset illuminance threshold.

[0117] Additionally, when the average value P of the video signal is moderate (brightness threshold Pb or higher but less than Pa), twilight mode is set when the illuminance La is high or moderate, and night mode is set when the illuminance La is low.

[0118] Additionally, if the average value P of the video signal is low (below the brightness threshold Pc), night mode will be set regardless of the illuminance L.

[0119] Note that the brightness threshold values ​​Pa and Pb vary depending on the specifications of the photodetector 21. For example, if the quantization level of the generated video signal is 8 bits, values ​​such as Pa=90 and Pb=6.5 are used. Also, the example of setting the imaging mode shown in Figure 11 is just one example, and the imaging mode may be set using a different map.

[0120] (Camera function configuration) The functional configuration of the camera 20c according to the third embodiment will be explained using Figure 12. Figure 12 is a functional block diagram showing an example of the functional configuration of the camera according to the third embodiment.

[0121] The camera 20c implements the various functional units shown in Figure 12 within the video signal processing processor 22 and the system microcontroller 23 by executing a program pre-stored in the system microcontroller 23.

[0122] Specifically, the camera 20c includes an illuminance acquisition unit 71, an image capture control unit 72, an illuminance difference value calculation unit 73, an average value calculation unit 74, a first image capture mode setting unit 75, a second image capture mode setting unit 76, a video output unit 77, and an operation control unit 78.

[0123] The illuminance acquisition unit 71 acquires the illuminance La measured by the illuminance sensor 40a, which measures the brightness outside the vehicle 15, and the illuminance Lb measured by the illuminance sensor 40b, which is installed in a position where it is difficult for light from outside the vehicle 15 to reach it.

[0124] The imaging control unit 72 generates an image signal of the object being observed based on the exposure state set by the first imaging mode setting unit 75 or the second imaging mode setting unit 76. The imaging control unit 72 is an example of an imaging unit in this disclosure.

[0125] The illuminance difference calculation unit 73 calculates the difference value ΔL between illuminance La and illuminance Lb.

[0126] The average value calculation unit 74 calculates the average value P of the video signals generated by the imaging control unit 72.

[0127] The first imaging mode setting unit 75 sets the exposure state for when the imaging control unit 72 (imaging unit) performs imaging, based on the difference value ΔL of multiple illuminances La and Lb measured by multiple illuminance acquisition units 71, and the illuminance La outside the vehicle 15 among the illuminances measured by multiple illuminance acquisition units 71.

[0128] The second imaging mode setting unit 76 sets the exposure state for imaging by the imaging control unit 72 (imaging unit) based on the average value P (signal level) of the video signal captured by the imaging control unit 72 when the difference value ΔL of multiple illuminances La and Lb measured by multiple illuminance acquisition units 71 is greater than the difference value threshold.

[0129] The video output unit 77 outputs the video signal captured under the exposure conditions set by the first imaging mode setting unit 75 or the second imaging mode setting unit 76 to the electronic mirror 30.

[0130] The motion control unit 78 controls the overall operating state of the camera 20c.

[0131] Furthermore, the camera 20c may also include the halation suppression processing unit 55 and the dark area visualization processing unit 56 described in the first embodiment.

[0132] (The processing flow performed by the camera) The processing flow performed by the camera 20c according to the third embodiment will be explained using Figure 13. Figure 13 is a flowchart showing an example of the processing flow performed by the camera according to the third embodiment.

[0133] The illuminance acquisition unit 71 acquires multiple illuminance values ​​La and Lb measured by the illuminance sensors 40a and 40b, respectively (step S41).

[0134] The illuminance difference value calculation unit 73 calculates the difference value ΔL (=La-Lb) between illuminance La and illuminance Lb (step S42).

[0135] The first imaging mode setting unit 75 sets the imaging mode based on the external illumination La of the vehicle 15 (step S43).

[0136] The imaging control unit 72 performs imaging using the imaging mode set by the first imaging mode setting unit 75 (step S44).

[0137] The first imaging mode setting unit 75 determines whether the difference value ΔL is smaller than the difference value threshold (step S45). If it is determined that the difference value ΔL is smaller than the difference value threshold (step S45: Yes), the process proceeds to step S46. On the other hand, if it is not determined that the difference value ΔL is smaller than the difference value threshold (step S45: No), the process proceeds to step S47.

[0138] In step S45, if it is determined that the difference value ΔL is smaller than the difference value threshold, the video output unit 77 outputs the video signal to the electronic mirror 30 (step S46). Then, the process proceeds to step S50.

[0139] On the other hand, if in step S45 the difference value ΔL is not determined to be smaller than the difference value threshold, the average value calculation unit 74 calculates the average value P of the video signal captured by the imaging control unit 72 (step S47).

[0140] The second imaging mode setting unit 76 sets the imaging mode based on the external illumination La of the vehicle 15 and the average value P of the video signal calculated by the average value calculation unit 74 (step S48).

[0141] The imaging control unit 72 performs imaging using the imaging mode set by the second imaging mode setting unit 76 (step S49). After that, the process proceeds to step S46 described above.

[0142] Following step S46, the operation control unit 78 determines whether the ignition of the vehicle 15 is OFF (step S50). If it is determined that the ignition of the vehicle 15 is OFF (step S50: Yes), the camera 20c terminates the process shown in Figure 13. On the other hand, if it is not determined that the ignition of the vehicle 15 is OFF (step S50: No), the process returns to step S41.

[0143] (Effects of the third embodiment) As described above, the camera 20c (imaging device) of the third embodiment is further equipped with a second imaging mode setting unit 76 that sets the exposure state when the imaging control unit 72 (imaging unit) performs imaging based on the average value P (signal level) of the video signal captured by the imaging control unit 72 (imaging unit) when the difference value ΔL of illuminances La and Lb is greater than the difference value threshold, and the video output unit 77 outputs the video signal captured with the exposure state set by the second imaging mode setting unit 76. Therefore, even if there is a difference in brightness inside and outside the vehicle 15, an imaging mode with higher visibility can be set based on the signal level of the captured video.

[0144] Furthermore, in the camera 20c (imaging device) of the third embodiment, the second imaging mode setting unit 76 converts the signal level of the video signal generated by the imaging control unit 72 to signal levels corresponding to at least daytime, nighttime, and twilight. Therefore, the visibility of the video signal output by the video output unit 77 can be made to correspond to the typical light environment when the vehicle 15 is in motion.

[0145] Although embodiments of the present invention have been described above, these embodiments are presented as examples only and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms. Furthermore, various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. Moreover, this embodiment is included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0146] 10a, 10b, 10c Video Display System 15 vehicles 20a, 20b, 20c Camera (imaging device) 22. Video Signal Processing Processor (ISP) 23 System Microcontrollers 30 Electronic mirror (display device) 34 Display Panels 35 Half Mirror 36 cabinets 40a, 40b Illuminance sensor (brightness measurement unit) 51,61 Illuminance acquisition part 52,62 Imaging Control Unit (Imaging Unit) 53 Average Value Calculation Section 54 Third imaging mode setting section 55. Halation suppression processing unit (first tone correction unit) 56 Dark Area Visualization Processing Unit (Second Tone Correction Unit) 57,65 Video output section 58,66 Operation Control Unit 63. Illuminance difference value calculation unit 64,75 First imaging mode setting section 76 Second imaging mode setting section L, La, Lb Illuminance (Brightness) P-mean Pa, Pb brightness threshold ΔL difference value

Claims

1. Among multiple brightness measuring units that measure brightness in different directions inside and outside the vehicle, an imaging unit generates an image signal by capturing an image of the object to be observed based on the exposure state corresponding to the brightness measured by the brightness measuring unit that measures the brightness outside the vehicle, When the difference value of the multiple brightness levels measured by the multiple brightness measurement units is smaller than the difference value threshold, a first imaging mode setting unit sets an exposure state corresponding to the brightness outside the vehicle from among the brightness levels measured by the multiple brightness measurement units. A video output unit that outputs a video signal captured under the exposure conditions set by the first imaging mode setting unit, An imaging device equipped with the following features.

2. The system further includes a second imaging mode setting unit that sets the exposure state when the imaging unit performs imaging based on the signal level of the video signal captured by the imaging unit, if the difference in brightness is greater than the difference threshold. The video output unit outputs a video signal captured under the exposure conditions set by the second imaging mode setting unit. The imaging apparatus according to claim 1.

3. Of the aforementioned plurality of brightness measuring units, at least one is installed in a position where it is less likely to be exposed to light from outside the vehicle. The imaging apparatus according to claim 1 or claim 2.

4. The first imaging mode setting unit is: The signal level of the video signal generated by the imaging unit is converted to at least the signal levels corresponding to daytime, nighttime, and twilight. The imaging apparatus according to any one of claims 1 to 3.

5. The second imaging mode setting unit is, The signal level of the video signal generated by the imaging unit is converted to at least the signal levels corresponding to daytime, nighttime, and twilight. The imaging apparatus according to claim 2.

6. An imaging device according to any one of claims 1 to 5, The system includes a display device that displays the video signal output by the video output unit of the imaging device. Video display system.

7. The aforementioned display device is an electronic mirror mounted on the vehicle, The aforementioned electronic mirror comprises a housing, Of the plurality of brightness measuring units, at least one is positioned at the lower end of the housing of the electronic mirror, The video display system according to claim 6.

Images