Image sensitization and color sensor camera

Abstract

To provide a wide range illumination camera capable of producing color images even at low illumination intensities.SOLUTION: A camera system includes a first imaging sensor, a second imaging sensor, and a controllable mirror system. The mirror system includes a mirror disposed at a fixed position with respect to the first imaging sensor and the second imaging sensor, and a controller to control a signal to be applied to the mirror. The mirror system transmits a first portion of incident light through the mirror to the first imaging sensor, and reflects a second portion of the incident light to the second imaging sensor. A method of producing color images includes the steps of: receiving incident light on a surface of the mirror; controlling the mirror to direct a first portion of the incident light to the first imaging sensor and a second portion of the incident light to the second imaging sensor; receiving first imaging sensor data from the first imaging sensor; and receiving second imaging sensor data from the second imaging sensor.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Examples of embodiments generally relate to camera systems that are used under both high illumination conditions and low illumination conditions, and more specifically, to camera systems that provide color images of images acquired under low illumination conditions. The camera system utilizes an electronically controllable beam splitter to direct a portion of the incident light towards a first image intensifying sensor and a second color discrimination sensor.

Background Art

[0002] High-performance imaging cameras are useful in many fields. Exemplary applications of such systems include providing image input to stationary security systems, military head-up or wearable devices, or additional ground-based or airborne systems. Such imaging cameras may be expected to operate under various illumination conditions, from full daylight to two orders of magnitude below starlight. Currently, there is no single light sensor that can operate over the full range of illumination conditions.

[0003] Many sensors that can operate at higher illumination levels, such as CCD and CMOS sensors, are known. Many of such sensors can also provide color discrimination of the incident light. Common color-sensitive sensors may include CMOS sensors incorporating a Bayer filter that filters the incident light into red, green, and blue images of adjacent pixels within the sensor array. However, even the most sensitive of such sensors can only provide sufficient image resolution at illuminations below about 1 × 10 -4 foot-candles.

[0004] 1 × 10 -5Alternative sensors are known that can acquire image information at much lower illumination levels, such as below foot candelas. Non-limiting examples of such low-light imaging sensors include image intensifiers or electron shock imagers, and single-photon avalanche detectors. In some image sensitization systems, incident light strikes a photocathode, which converts individual photons into a cascade of electrons. The electron cascade can be focused onto a phosphor to convert electrons into light. The light can then be sensed by a light sensor and converted into optical data. It will be understood that image intensifiers can saturate even at moderate levels of incident light, potentially damaging the intensifier's electronics or optics. Generally, such image intensifiers are omnichromatic, meaning that the optical signal produced by the image intensifier does not distinguish the color of the incident light.

[0005] Therefore, it is clear that systems used under a wide range of illumination conditions may rely on the use of both a high-light CMOS or CCD sensor and an image intensifier. Some known systems may rely on multiple apertures, where the light is focused to the high-light sensor through a first aperture and to the low-light sensor through a second aperture. Such systems can be bulky due to the numerous optical systems of the apertures.

[0006] Furthermore, systems are known that have a single aperture to focus incident light onto either a high-light or low-light sensor. In some such systems, a movable mirror may direct the light to the sensor. It will be recognized that the movable mirror adds complexity, and if the mechanical system that moves the mirror becomes misaligned or malfunctions, it can cause failure. Moreover, such systems direct light onto either a low-light or high-light sensor. Thus, either a color image or an amplified monochrome image can be obtained.

[0007] Therefore, a wide-area illumination camera that can produce color images even in low light conditions, has a small footprint, and does not require a mechanical system to focus incident light onto the sensor would be useful. [Overview of the project]

[0008] In one embodiment, the camera system includes a first optical imaging sensor, a second optical imaging sensor, and an electronically controllable mirror system. The electronically controllable mirror system includes an electronically controllable mirror fixed to the first and second optical imaging sensors, and a mirror controller that controls a mirror control signal applied to the electronically controllable mirror. Based on the mirror control signal, the electronically controllable mirror system transmits a first portion of incident light through the electronically controllable mirror to the first optical imaging sensor and reflects a second portion of incident light to the second optical imaging sensor by the electronically controllable mirror.

[0009] In one embodiment, the camera system further includes a camera system controller. The camera system comprises a processor and a memory unit. The memory unit contains instructions, which, when executed by the processor, cause the processor to receive first optical imaging sensor data from a first optical imaging sensor and second optical imaging sensor data from a second optical imaging sensor.

[0010] In one embodiment, the camera system includes a command, which, when executed by the processor, further causes the processor to calculate imaging data from the characteristics of first optical imaging sensor data and the characteristics of second optical imaging sensor data.

[0011] In one embodiment, the camera system includes a command, which, once executed by the processor, causes the processor to transmit the image data to an image display system, a data storage system, or an external system.

[0012] In one embodiment, the camera system includes a command, which, once executed by the processor, causes the processor to send a mirror controller adjustment signal to the mirror controller, at least in part, based on first optical imaging sensor data or second optical imaging sensor data.

[0013] In one embodiment, the camera system includes a command, which, once executed by the processor, further causes the processor to receive a manual operation signal from a user operation input device and to send a manual mirror controller adjustment signal to the mirror controller.

[0014] In one embodiment, the camera system includes a command, which, once executed by the processor, further causes the processor to receive an input signal from an external device and to send an input data mirror controller adjustment signal to the mirror controller.

[0015] In one embodiment of the camera system, the first optical imaging sensor is an intensified imaging sensor.

[0016] In one embodiment of the camera system, the second optical imaging sensor is a color imaging sensor.

[0017] In one embodiment of the camera system, the electronically controllable mirror includes a surface spatially fixed to the body of the electronically controllable mirror for receiving incident light.

[0018] In one embodiment of the camera system, an electronically controllable mirror is continuously adjustable between a maximum percent transmittance state and a minimum percent transmittance state, and the electronically controllable mirror is continuously adjustable between a maximum percent reflectance state and a minimum percent reflectance state.

[0019] In one embodiment of the camera system, the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percentage transmittance state and a mirror control signal value corresponding to the maximum percentage transmittance state.

[0020] In one embodiment of the camera system, the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percentage reflectivity state and a mirror control signal value corresponding to the maximum percentage reflectivity state.

[0021] In one embodiment of the camera system, the mirror control signal is composed of a mirror control voltage.

[0022] In one embodiment, a method for generating a color image includes: receiving incident light on the surface of an electronically controllable mirror; a camera system controller controlling the electronically controllable mirror so that a first portion of the incident light is directed toward a first optical image sensor and a second portion of the incident light is directed toward a second optical image sensor; the camera system controller receiving first optical image sensor data from the first optical image sensor; and the camera system controller receiving second optical image sensor data from the second optical image sensor. In this embodiment, the electronically controllable mirror is positioned in a fixed position relative to the first and second optical image sensors, and the surface of the electronically controllable mirror is spatially fixed relative to the body of the electronically controllable mirror.

[0023] In one embodiment of the method, the step of a camera system controller controlling an electronically controllable mirror includes the step of controlling the electronically controllable mirror based at least in part on first optical imaging sensor data or second optical imaging sensor data.

[0024] In one embodiment, the method further includes the step of a camera system controller calculating imaging data from first optical imaging sensor data and second optical imaging sensor data. According to this embodiment, the imaging data includes the characteristics of the first optical imaging sensor data and the characteristics of the second optical imaging sensor data.

[0025] In one aspect, the method further includes a step in which a camera system controller transmits imaging data to an image display system, an image data storage system, or an external device.

[0026] In one aspect, the method further includes a step in which a camera system controller receives a manual operation signal from a user operation input device; and a step in which the camera system controller controls an electronically controllable mirror based at least in part on the manual operation signal.

[0027] In one aspect, the method further includes a step in which a camera system controller receives an input signal from an external device; and a step in which the camera system controller controls an electronically controllable mirror based at least in part on the input signal from the external device.

Brief Description of the Drawings

[0028] Examples of the present disclosure are best understood from the following detailed description when read in conjunction with the accompanying drawings. In accordance with common practice, various features of the drawings are not drawn to scale or are shown only in partial perspective views. Dimensions of various embodiments are shown enlarged or reduced as appropriate for clarity. The same reference numerals are used between the drawings to represent the same elements. The drawings include the following features and elements, and reference is made to each drawing herein. [Figure 1] FIG. 1 is a partial block diagram of a camera system having a color imaging sensor and an image intensifying sensor according to one aspect of the present disclosure. [Figure 2] FIG. 2 is a block diagram of a computing system used in the camera system of FIG. 1 according to one aspect of the present disclosure. [Figure 3] FIG. 3 is an exemplary graph showing the relationship between the percent light transmittance and percent light reflectance of an electronically controllable mirror and the applied mirror control signal according to one aspect of the present disclosure. [Figure 4]This is a partial block diagram of a camera system having a color imaging sensor and an image sensitizer operating under maximum reflectivity conditions, according to one aspect of the present disclosure. [Figure 5] This is a partial block diagram of a camera system having a color imaging sensor and an image sensitizer that operate under conditions where reflectance and transmittance are mixed, according to one aspect of the present invention. [Figure 6] This is a partial block diagram of a camera system having a color imaging sensor and an image sensitizer operating under maximum transmittance conditions, according to one aspect of the present invention. [Modes for carrying out the invention]

[0029] The following discussion relates to various aspects of the apparatus and methods of the present invention. However, those skilled in the art will understand that the examples disclosed herein have a wide range of applications, and that any description of an aspect is intended to be illustrative only and does not imply that the scope of this disclosure, including the claims, is limited to that aspect.

[0030] As stated above, the drawings are not necessarily to scale. Certain features and components in this specification are shown in an exaggerated or somewhat schematic manner, and for clarity and conciseness, some details of conventional elements may be omitted.

[0031] In the following discussion and claims, the terms “including” and “comprising” are used in an open-ended manner and should thus be interpreted as “including, but not limited to.” The term “to combine” is intended to mean either an indirect or direct connection. Thus, when a first device combines with a second device, the connection may be via a direct connection between the two devices or via an indirect connection established through other devices, components, nodes, and connections. Furthermore, as used herein, the terms “axial” and “in the axial direction” generally mean along or parallel to a given axis (e.g., the x, y, or z direction, or the central axis of a body, outlet, or port), while the terms “radial” and “radially” generally mean perpendicular to a given axis. For example, axial distance refers to a distance measured along or parallel to an axis, while radial distance refers to a distance measured perpendicular to an axis.

[0032] As discussed above, users of camera systems may prefer to acquire color images for better content analysis. Cameras operating in high-light conditions can provide such color images by utilizing color imaging sensors. However, imaging sensors capable of operating in low-light or very low-light conditions typically only provide monochrome images and cannot provide color images. The system disclosed herein utilizes imaging data acquired from both a color imaging sensor and a high-sensitivity imaging sensor. The data from the two types of imaging sensors can be merged into a single image under low-light conditions where color imaging sensor data may not be optimal.

[0033] Referring here to Figure 1, a partial block diagram of a camera system 100 having a color imaging sensor and an image sensitizer is shown. The color imaging sensor and image sensitizer will be discussed below, but it will be understood that the camera system disclosed herein can use any group of imaging sensors having different illumination responses. The camera system 100 includes an imaging optical system 102, a first optical imaging sensor 110, a second optical imaging sensor 120, an electronically controllable mirror system 130, and electronic components for controlling the system. Additional components may be included to display the imaging data on an image display system 150 and store the imaging data on an image data storage system 160, or to send the imaging data to an external device for processing or automatic camera system control.

[0034] The imaging optical system 102 may include any optical components for focusing, filtering, collimating, and otherwise controlling the light passing through the aperture before it is directed towards the optical imaging sensors 110, 120. The imaging optical system 102 may form part of a single camera aperture. Exemplary optical components may include objective lenses, relay lenses, filters, polarizers, and the like.

[0035] The first optical imaging sensor 110 may include an enhanced imaging sensor. Such a sensor can provide first optical imaging data under low-light conditions. Low-light conditions are not limited to, but are approximately 1 × 10⁻⁶. -6 Foot candela ~ approximately 1 x 10 -3 It can be defined as illuminance up to a foot candela. Non-limiting examples of such augmented imaging sensors include image intensifiers, electron shock imagers, image intensifiers coupled to CMOS imaging sensors, single-photon avalanche detectors, and quantum information sensors. In some additional embodiments, narrowband optical filters can be placed on or near the imaging surface of the augmented imaging sensor to provide wavelength-based optical filtering.

[0036] The first optical imaging sensor 110 can receive light that has passed through an electronically controllable mirror 135. The first optical imaging sensor 110 can receive first sensor control signals from the first sensor controller 114. The first sensor controller 114 can supply first sensor control signals to the first optical imaging sensor 110 via a first sensor control line 112. In some embodiments, the first sensor controller 114 may be controlled by data supplied by a camera system controller 140 (further described below with respect to Figure 2) via a first sensor controller interface 118. For example, if the first optical imaging sensor 110 is an image intensifier-based camera system, the controller 140 may position the image intensifier sensor to protect it from accidental exposure to high-light input. Alternatively, the first sensor controller 114 may be a standalone device not controlled by the camera system controller 140.

[0037] The first optical imaging sensor 110 can provide first optical imaging data to the camera system controller 140 via the first optical imaging sensor data line 116. The first optical imaging data may include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the first optical imaging sensor 110. The image characteristic data may include, but is not limited to, the positions of one or more predetermined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. The optical imaging data may be acquired through a single frame or from multiple frames acquired over time by the first optical imaging sensor 110.

[0038] The first optical imaging sensor 110 can also receive first sensor operation control data from the camera system controller 140 via the first optical imaging sensor data line 116. The first optical imaging data can be processed by the camera system controller 140 as part of the method to generate imaging data for display, storage, or analysis by an external device.

[0039] The second optical imaging sensor 120 may include a CMOS or CCD color imaging sensor. Such a sensor can provide second optical imaging data under higher illumination conditions. Higher illumination conditions are not limited to, but approximately 1 × 10⁻⁶ -3 From foot candela to full sunlight (approximately 1 x 10 3 It can be defined as a foot candela. Non-limiting examples of such color imaging sensors include CMOS imaging sensors, charge-coupled devices (CCDs), and single-photon avalanche detectors.

[0040] The second optical imaging sensor 120 may include a second active surface that receives light reflected by an electronically controllable mirror 135. The second optical imaging sensor 120 may require a second sensor control signal from a second sensor controller 124. The second sensor controller 124 may be configured to supply the second sensor control signal to the second optical imaging sensor via a second sensor control signal conductor 122. In some embodiments, the second sensor controller 124 may be controlled by data supplied by the camera system controller 140 via a second sensor controller interface 128. For example, if the second optical imaging sensor 120 is a color imaging sensor, the second sensor control signal may be initially enabled by the camera system controller 140. In this way, the color imaging sensor can provide the camera system controller 140 with second optical imaging data. In one non-limiting example, the second optical imaging data may allow the camera system controller 140 to adjust the first sensor control signal if the illuminance level hitting the color imaging sensor is too low. Alternatively, the second sensor controller 124 may be a standalone device not controlled by the camera system controller 140.

[0041] The second optical imaging sensor 120 can provide second optical imaging data to the camera system controller 140 via the second optical imaging sensor data line 126. The second optical imaging data may include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the second optical imaging sensor 120. The image characteristic data may include, but is not limited to, the positions of one or more predetermined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. The optical imaging data may be obtained from a single frame or from multiple frames captured over time by the first optical imaging sensor 120.

[0042] The second optical imaging sensor 120 can also receive second sensor operation control data from the camera system controller 140 via the second optical imaging sensor data line 126. The second optical imaging data is processed by the camera system controller 140 as part of the process to generate imaging data for display, storage, or analysis by auxiliary devices.

[0043] Figure 1 and the above disclosure suggest that the first optical imaging sensor 110 may include an intensified sensitizing imaging sensor, and the second optical imaging sensor 120 may include a CCD or CMOS color sensor. Alternatively, it will be recognized that the first optical imaging sensor 110 and the second optical imaging sensor 120 may each include a CCD or CMOS color sensor and an intensified sensitizing imaging sensor, respectively. Furthermore, the first optical imaging sensor 110 and the second optical imaging sensor 120 may include alternative optical imaging sensors, such as an IR-sensitive imaging sensor and / or a UV-sensitive imaging sensor. In addition, the first optical imaging sensor 110 and the second optical imaging sensor 120 may include various coatings, such as a polarizing coating and / or an anti-reflective coating.

[0044] Referring again to Figure 1, the electronically controllable mirror system 130 may include an electronically controllable mirror 135 mounted on a transparent mirror mount 133. The amount of light reflected by or passing through the electronically controllable mirror 135 can be controlled by a mirror control signal provided by a mirror controller. In some embodiments, the mirror control signal may be a mirror control voltage. Non-limiting examples of the mirror control voltage may include a DC analog voltage or an AC analog voltage. In one non-limiting example, the AC analog voltage may be a 100-260V 20Hz square wave signal. Another example of the AC analog voltage control signal may be a variable pulse frequency control signal or a variable pulse phase control signal. Alternatively, the mirror control signal may be a mirror control current. Non-limiting examples of the mirror control current may include a DC analog current or an AC analog current. In some non-limiting embodiments, the AC current control signal may include a variable pulse frequency control signal or a variable pulse phase control signal. In yet another alternative example, the mirror control signal may be a digital control signal having the characteristics of any suitable digital signal format. Non-limiting examples of digital mirror control signals include serially encoded digital control signals or parallel control signals. The electronically controllable mirror 135 will be described below in terms of control by voltage, for example, DC voltage (see Figure 3 and the discussion below), but it will be understood that any alternative electronic control signal, including analog voltage or current, or digital control signals, can be similarly applied.

[0045] The electronically controllable mirror 135 and the transparent mirror mount 133 may be mounted within the mirror support 131. The mirror support 131 may function to maintain a fixed and constant position and orientation of the electronically controllable mirror 135 with respect to the active optical surfaces of the first optical imaging sensor 110 and the second optical imaging sensor 120. In some embodiments, the electronically controllable mirror 135 may have a surface that receives incident light and reflects, transmits, or both reflects and transmits a portion of the incident light to the first optical imaging sensor 110 and / or the second optical imaging sensor 120. Furthermore, the reflective or transmitting surface of the electronically controllable mirror 135 may be spatially fixed to the body of the electronically controllable mirror 135 or the transparent mirror mount 133. The mirror support 131 may be composed of any suitable structure or material to allow light passing through the imaging optical system 102 to strike the light-receiving surface of the electronically controllable mirror 135. The mirror support 131 may be made of any suitable structure or material to further enable light that has passed through the electronically controllable mirror 135 to strike the first active surface of the first optical imaging sensor 110, or light that has been reflected by the electronically controllable mirror 135 to strike the second active surface of the second optical imaging sensor 120. For example, the mirror support 131 may be made of a solid light-transmitting material into which the electronically controllable mirror 135 and the transparent mirror mount 133 may be embedded. The position and orientation of the mirror support 131 can be fixed within the camera system 100 using additional mechanical supports.

[0046] In some further embodiments, the electronically controllable mirror 135 may also have additional optical properties. Such optical properties may include optical filtering properties. For example, the electronically controllable mirror 135 may optically filter light passing through it or light reflected from it. Optical filtering functions include, but are not limited to, optical high-pass filtering, optical low-pass filtering, optical band-pass filtering, or optical notch filtering.

[0047] The amount of light that passes through or is reflected from the electronically controllable mirror 135 can be determined by a mirror control signal applied to the electronically controllable mirror 135. As disclosed above, the mirror control signal can be described in terms of a control voltage signal (see Figure 3 below), but alternative mirror control signals including analog voltage or current, or digital control signals may be applied. The mirror control signal applied to the electronically controllable mirror 135 can be supplied by the mirror controller 134 via the mirror control signal conductor 132. The percentage transmittance and percentage reflectance of light that passes through the electronically controllable mirror 135 may be monotonic functions of the mirror control signal applied to the electronically controllable mirror 135. Further details regarding the transmittance / reflectance response of the electronically controllable mirror 135 are described below with reference to Figure 3.

[0048] In one embodiment, the mirror control signal supplied by the mirror controller 134 may be controlled by a mirror controller adjustment signal received from the camera system controller 140 via the mirror controller adjustment interface 138. In one embodiment, the camera system controller 140 may automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from the first optical imaging sensor 110 and / or the second optical imaging sensor 120. Alternatively, the camera system controller 140 may automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from additional optical sensors. In a second embodiment, the camera system controller 140 may transmit a manual mirror controller adjustment signal to control the mirror control signal applied to the electronically controllable mirror 135 based on a manual operation signal received from a user operation input device. In one example, the user operation input device can communicate data with the input interface of the camera system controller 140. In a third embodiment, the manual operation signal received from the user operation input device can directly control the mirror controller 134 without going through the camera system controller 140.

[0049] Images obtained from imaging data calculated by the camera system controller 140 based on first optical imaging sensor data and second optical imaging sensor data can be displayed on the image display system 150. The imaging data can be in any format suitable for display. Non-limiting formats include grayscale, RGB, CMYK, HSI, YCbCr, or other suitable formats. The imaging data can be transmitted to the image display system 150 via the display system interface 158. The display system interface 158 may include any format suitable for transmitting imaging data, including wired formats (non-limiting examples include Ethernet, FireWire, SCSI, MIPI, or USB) or wireless formats (non-limiting examples include WiFi or Bluetooth® format).

[0050] The imaging data calculated by the camera system controller 140 may be transmitted via the imaging data interface 168 for use in one or more image data storage systems 160. The imaging data interface 168 may include any format suitable for transmitting imaging data, including wired formats (such as Ethernet, FireWire, SCSI, MIPI, or USB, as not limited to these) or wireless formats (such as WiFi, telecom, or Bluetooth®, as not limited to these). The image data storage system 160 may include a local data storage system (including removable storage media such as thumb drives, or fixed storage media such as fixed hard drives). The image data storage system 160 may also include a remote data storage system such as a cloud-based data storage system. The image data storage system 160 may be used to archive imaging data over time. In some embodiments, the imaging data stored in the image data storage system 160 may be post-processed to include image enhancement, object recognition, or other operations on the imaging data. In some additional embodiments, the imaging data stored in the image data storage system 160 may be used by an external system such as an airborne or ground mobile system. It will be understood that the camera system controller 140 can communicate the imaging data directly to such an external system. As disclosed above, the imaging data may include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the optical imaging sensor. The image characteristic data may include, but is not limited to, the brightness of the scene and sub-regions, the position of one or more predetermined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. The optical imaging data may be acquired through a single frame or from multiple frames acquired over time by the optical imaging sensor.

[0051] Referring to Figure 2, non-exclusive components of the camera system controller 140 are shown. The camera system controller 140 may include one or more processors 200, memory units 202, 204, device interfaces 209, 208, 216, 226, 258, 268 and camera controller interfaces 218, 228, 238. Various components can communicate with each other via the system bus 206. These components will be described in more detail below.

[0052] One or more processors 200 may include a general-purpose processor and dedicated processors such as a video processor or hardware accelerator. The general-purpose processor can, but is not limited to, be used for overall control of the camera system 100. In one example, a dedicated processor can be used for onboard image processing. In one embodiment, a video processor can be used to create imaging data from first optical imaging sensor data and second optical imaging sensor data. In another example, a hardware accelerator may be used to preprocess the first optical imaging sensor data and the second optical imaging sensor data. In yet another example, a hardware accelerator may be used to postprocess the imaging data. Non-limiting examples of such postprocessing include image enhancement, adjustment of contrast or color palette, or identification of specific features in the imaging data.

[0053] The system bus 206 may include any data bus structure configured to enable directed and bidirectional transmission of data between various components of the camera system controller 140. Non-limiting examples of such data bus structures include ISA, EISA, MCA, PCI, PCMCIA, and SCSI.

[0054] The memory unit may include a volatile memory unit 202 (e.g., RAM, vRAM, or similar device) and a non-volatile memory unit 204 (e.g., a flash drive, ROM, EPROM, EEPROM, or similar device). The memory units 202, 204 may contain instructions, which, when executed by one or more processors 200, cause one or more processors 200 to control various components of the camera system controller 140 and / or various components and systems of the camera system 100. Non-limiting examples of such control signals may include control signals to the first sensor controller 114, the second sensor controller 124, and the mirror controller 134, as well as first and second sensor operation control data for controlling the operation of the first optical imaging sensor 110 and the second optical imaging sensor 120, respectively. Memory units 202 and 204 may also contain instructions, which, when executed by one or more processors 200, cause one or more processors 200 to process the first optical imaging sensor data, the second optical imaging sensor data, and the imaging data. Memory units 202 and 204 may further contain instructions, which, when executed by one or more processors 200, cause one or more processors 200 to control the operation of the device interfaces 209, 208, 216, 226, 258, 268, and the camera controller interfaces 218, 228, 238. A volatile memory unit 202 may further be used for temporary memory storage of data used for processing the first optical imaging sensor data, the second optical imaging sensor data, and the imaging data.

[0055] The device interface may include a first optical imaging sensor interface 216 and a second optical imaging sensor interface 226. The first optical imaging sensor interface 216 may be configured to receive first optical imaging sensor data from a first optical imaging sensor 110 via a first optical imaging sensor data line 116. The first optical imaging sensor interface 216 may also be configured to transmit first sensor operation control data to the first optical imaging sensor 110 via the first optical imaging sensor data line 116. The first sensor operation control data may include, but is not limited to, data for controlling pixel readout timing, pixel blanking, or other operations of the first optical imaging sensor 110. The second optical imaging sensor interface 226 may be configured to receive second optical imaging sensor data from a second optical imaging sensor 120 via a second optical imaging sensor data line 126. The second optical imaging sensor interface 226 may also be configured to transmit second sensor operation control data to the second optical imaging sensor 120 via the second optical imaging sensor data line 126. The second sensor operation control data may include, but is not limited to, data for controlling the pixel readout timing, pixel blanking, or other operations of the second optical imaging sensor 120. It will be understood that the first optical imaging sensor interface 216 and the second optical imaging sensor interface 226 are defined only functionally. The first optical imaging sensor interface 216 and the second optical imaging sensor interface 226 may consist of separate interface components or may be combined into a single interface component.

[0056] Memory units 202, 204 may contain instructions, and when these instructions are executed by one or more processors 200, one or more processors 200 are instructed to combine the first optical image sensor data and the second optical image sensor data to form imaging data based on various characteristics of the first and second optical image sensor data. In this way, the characteristics of images acquired from the first optical image sensor 110 and the second optical image sensor 120 can be combined pixel by pixel into a single image characterized by the imaging data. In a non-limiting example, the first optical image sensor data acquired from the first optical image sensor 110 may include panchromatic image sensor data from an intensified image sensor. Such first image sensor data may be represented by pixel values ​​that provide relative intensity on a grayscale palette. Furthermore, in this example, the second optical image sensor data acquired from the second optical image sensor 120 may include color image sensor data from a CCD or CMOS color image sensor. The second (color) image sensor data may be in any suitable format, such as RGB, CMYK, HSI, YCbCr, or other appropriate format.

[0057] An exemplary method for combining the characteristics of first and second optical image sensor data may include converting the color format of the raw image based on the second optical image sensor data to an HSI (Hue, Saturation, Intensity) format. Hue and saturation data can be obtained from the second optical image sensor data, while intensity data can be obtained from the first optical image sensor data. Alternatively, intensity data can be obtained from a combination of the first and second optical image sensor data. In this way, a color image can be calculated even under low-light conditions where the color image sensor is not operating, as if it were operating under optimal light acquisition conditions. It will be recognized that when the illuminance of the optical image sensor is sufficiently low or very low, the second optical image sensor will not generate useful data. Under such illuminance conditions, the imaging data can be based solely on the first optical image sensor data. Similarly, when the illuminance of the optical image sensor is sufficiently high or very high, the first optical image sensor may be intentionally disabled to prevent damage, and therefore no data is generated from the first optical image sensor. Under these illumination conditions, the imaging data can be based solely on the data from the second optical imaging sensor.

[0058] The device interface may also include a user input device interface 208 and a user output device interface 209. The user input device interface 208 can receive data from the user of the camera system 100. The user input device may include, but is not limited to, a mouse, touchscreen display, keyboard, voice activation device, stylus, joystick, control knob, or other device that the user can use to provide input signals for the operation of the camera system 100. In one non-limiting embodiment, the user may use a keyboard to input operation instructions to the camera system controller 140 relating to the operation of the first sensor controller 114, the second sensor controller 124, and / or the mirror controller 134. In this way, the user can control signals for operating the first optical imaging sensor 110, the second optical imaging sensor 120, or the electronically controllable mirror 135. Furthermore, the user may specify the percentage transmittance and reflectance of the electronically controllable mirror 135. The user can further specify the operation of the first optical imaging sensor 110 and the second optical imaging sensor 120, for example, by setting the frame acquisition rate. The user can also specify the output of the captured data to either the image display system 150 or the image data storage system 160.

[0059] The user output device interface 209 can be used to transmit data to a system or device used by the user. For example, if the camera system controller 140 includes instructions for analyzing imaging data and identifying features within that data, the camera system controller 140 can provide alarm data to a visual or auditory alarm device (e.g., an LED or buzzer) via the output device interface 209 if an undesirable feature is detected. Both the user input device interface 208 and the user output device interface 209 can interface with a standalone computing system or an embedded computing system. Such computing systems may include, but are not limited to, workstations, laptop computers, tablet computers, or smartphones. It will be understood that the user input device interface 208 and the user output device interface 209 can be any type of interface appropriate to their respective purposes, including, among other things, serial interfaces, parallel interfaces, optical interfaces, wireless interfaces, etc. Alternatively, the user input device interface 208 and the user output device interface 209 may be integrated into a single physical user device interface.

[0060] In another embodiment, the user operation input device interface 208 and the user output device interface 209 may be used by an external system for the automated use of the camera system 100. One non-limiting example of such an external system may be an autonomous vehicle. In this embodiment, the external automation system can receive imaging data, determine appropriate changes to the function of the camera system controller 140, and provide appropriate input signals for the operation of the camera system 100 via the user operation input device interface 208. The input signals may include any data that can control the operation of the camera system controller 140, including the control of the electronically controllable mirror 135. The input signals to the camera system controller 140 can be transmitted as input signals to the mirror controller 134, or as mirror controller adjustment signals. Similarly, the external automation system can receive alarm data via the user output device interface 209 as disclosed above. However, it will be understood that the external automation system can receive alarm data and transmit input signals for the operation of the camera system 100 via separate external device input interfaces and separate external device output interfaces. Alternatively, the external automation system can perform both receiving and transmitting data to the camera system controller 140 via a composite external device interface.

[0061] The device interface may further include an image output interface 258 and a data output interface 268. Image data may be transmitted to an image display system 150 via the image output interface 258. The image output interface 258 may communicate with a display system interface 158. Image data may also be transmitted to an image data storage system 160 via the data output interface 268. The data output interface 268 may communicate with an image data interface 168. Both the image output interface 258 and the data output interface 268 may have interface characteristics suitable for their respective functions, as disclosed above.

[0062] Camera controller interfaces 218, 228, and 238 can be used to provide control signals to the associated optical device controllers. Thus, the first sensor controller 114 can be controlled by data supplied by the camera system controller 140 via a data connection between the first sensor camera controller interface 218 and the first sensor controller interface 118. Similarly, the second sensor controller 124 can be controlled by data supplied by the camera system controller 140 via a data connection between the second sensor camera controller interface 228 and the second sensor controller interface 128. For example, data transmitted via the first sensor camera controller interface 218 and the second sensor camera controller interface 228 can enable or disable signals supplied by the first sensor controller 114 and the second sensor controller 124 to their respective optical imaging sensors (110 and 120, respectively). The mirror controller interface 238 can transmit mirror control signal data to the mirror controller 134 via the mirror controller adjustment interface 138. The mirror control signal data instructs the mirror controller 134 to supply a signal to the electronically controllable mirror 135, thereby controlling the transmittance and / or reflectance of light hitting the electronically controllable mirror 135.

[0063] Referring here to Figure 3, Figure 3 shows an exemplary graph 300 that shows the percent transmittance and percent reflectance of light incident on the electronically controllable mirror 135 as functions of an exemplary mirror control signal applied to the electronically controllable mirror 135 by the mirror controller 134. Without loss of generality, the exemplary mirror control signal shown in Figure 3 is the mirror control voltage. However, it will be understood that Figure 3 shows the response to an arbitrary mirror control signal that can produce a monotonic response of the electronically controllable mirror 135 over a range of mirror control signal values. In particular, the percent transmittance response curve 304 is plotted together with the percent reflectance response curve 302. The percent transmittance response curve 304 and the percent reflectance response curve 302 are plotted as linearly dependent on the mirror control voltage applied to the electronically controllable mirror 135 by the mirror controller 134, but it will be understood that alternative percent transmittance response curves and percent reflectance response curves may include a continuously monotonic relationship with respect to the applied mirror control voltage. Thus, for example, the percent reflectance response curve 302 has a constant negative slope with respect to the applied mirror control voltage, and the percent transmittance response curve 304 has a constant positive slope with respect to the applied mirror control voltage. In some alternative examples, it will be recognized that the percent reflectance response curve 302 may have a positive slope with respect to the applied mirror control voltage, and the percent transmittance response curve 304 may have a negative slope with respect to the applied mirror control voltage. In some embodiments, the alternative percent transmittance response curves and percent reflectance response curves may include plateau regions at the low and / or high ends of their respective response curves. It will be recognized that the monotonic portions between such plateau regions of the alternative percent transmittance response curves and percent reflectance response curves can constitute an effective operating zone for controlling the electronically controllable mirror 135.

[0064] Regardless of the exact shapes of the percent transmittance response curve 304 and the percent reflectance response curve 302, both the percent transmittance response curve 304 and the percent reflectance response curve 302 are continuous and monotonic with respect to the mirror control voltage applied to the electronically controllable mirror 135 over their respective effective operating zones. In this way, both the percent reflectance and percent transmittance of light can vary continuously over the range of applied voltages. The mirror control voltage range defining the effective operating zone can be defined by a minimum voltage (Vmin) and a maximum voltage (Vmax).

[0065] The percent reflectance response curve 302 may vary between the minimum percent reflectance (Rmin) and the maximum percent reflectance (Rmax). In one non-limiting example, the minimum percent reflectance (Rmin) may be approximately 10% without an anti-reflective coating and approximately 3% with an anti-reflective coating. In one non-limiting example, the maximum percent reflectance (Rmax) may be greater than approximately 87%. Similarly, the percent transmittance response curve 304 may vary between the minimum percent transmittance (Tmin) and the maximum percent transmittance (Tmax). In one non-limiting example, the minimum percent transmittance (Tmin) may be less than approximately 1%. In one non-limiting example, the maximum percent transmittance (Tmax) may be greater than approximately 87% without an anti-reflective coating and greater than approximately 95% with an anti-reflective coating. In several additional non-limiting examples, the electronically controllable mirror 135 can operate effectively using incident light in the spectral range of approximately 400 nm to approximately 5,000 nm. In some alternative, non-limiting examples, the electronically controllable mirror 135 can operate effectively using incident light in the spectral range of approximately 500 nm to approximately 1,000 nm. In some further additional, non-limiting examples, the electronically controllable mirror 135 can operate effectively using incident light in the spectral range of approximately 400 nm to approximately 1,100 nm. In some further non-limiting examples, the mirror control voltage applied to the electronically controllable mirror 135 can vary continuously between a Vmax value of approximately 260 V and a Vmin value of approximately 100 V.

[0066] The percentage reflectance and percentage transmittance of the electronically controllable mirror 135 can be easily controlled by applying a mirror controller adjustment signal to the mirror controller 134. As discussed above, the mirror controller adjustment signal may be transmitted from the camera system controller 140. In automatic mode, the camera system controller 140 can automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from one or more of the first optical imaging sensor 110, the second optical imaging sensor 120, or other illumination sensors. In one embodiment, the camera system controller 140 can determine the illuminance value of the light falling on all or some of the first optical imaging sensor 110, the second optical imaging sensor 120, or other illumination sensors.

[0067] The camera system controller 140 can store data relating to operating parameters associated with one or more of the first optical imaging sensors 110 or the second optical imaging sensors 120. Such data may include the optimal or maximum range of illumination conditions for the operation of each optical imaging sensor. The camera system controller 140 can determine the amount of illumination directed to the first optical imaging sensors 110 and the second optical imaging sensors 120 from the total illumination hitting the electronically controllable mirror 135. In some embodiments, the camera system controller 140 may include data relating to illumination conditions under which the first optical imaging sensor 110 may fail or be damaged, such as under high illumination conditions. Under such illumination conditions, the mirror controller 134 can receive instructions to generate a mirror control signal to move the electronically controllable mirror 135 away from the first optical imaging sensor 110.

[0068] The camera system controller 140 can generate mirror controller adjustment signals necessary to adjust the transmittance and reflectance of the electronically controllable mirror 135 in order to optimize the first optical image sensor data and the second optical image sensor data. The camera system controller 140 can further store data related to the percent reflectance response curve 302 and the percent transmittance response curve 304 of the electronically controllable mirror 135. Such data can be stored as a lookup table or an analytical formula. The camera system controller 140 can use the response curve data along with the lookup table or analytical formula to generate the value of the mirror controller adjustment signal received by the mirror controller 134. It will be understood that the camera system controller 140 can continuously monitor the total illuminance hitting the electronically controllable mirror 135 over time and continuously adjust the mirror controller adjustment signal when the total illuminance increases (e.g., when sunlight increases) or decreases (e.g., when sunlight decreases). It will be recognized that in order for the camera system controller 140 to continuously adjust the reflectance and transmittance of the incident illumination to the first optical imaging sensor 110 and the second optical imaging sensor 120, an electronically controllable mirror that continuously responds to the applied mirror control signal is required.

[0069] In another example of the automatic operation mode of the camera system 100, the camera system 100 may be activated to direct the light hitting the electronically controllable mirror 135 towards the CMOS or CCD color imaging sensor (either the first optical imaging sensor 110 or the second optical imaging sensor 120). In this way, the image sensitizer is not exposed to high-intensity light during initialization (startup). The camera system controller 140 can determine whether the light hitting the color imaging sensor is below the operating threshold of the color imaging sensor and automatically adjust the mirror controller adjustment signal to direct a certain amount of incident light towards the image sensitizer.

[0070] In another embodiment, the mirror controller adjustment signal may originate from a manual operation signal controlled by the user of the camera system 100. The mirror controller adjustment signal may be transmitted directly to the mirror controller 134 or to the camera system controller 140 via the user operation input device interface 208. The manual operation signal may be limited to a finite number of control values ​​(e.g., via a user-operated switch) or may be continuously variable over a range of values. In another embodiment, the manual operation signal transmitted to the camera system controller 140 via the user operation input device interface 208 may be combined with a mirror controller adjustment signal generated by the camera system controller 140. In this way, the user can manually adjust or override the mirror controller adjustment signal generated by the camera system controller 140.

[0071] Referring here to Figures 4-6, Figures 4-6 illustrate exemplary operation of the camera system 100 based on illumination striking an electronically controllable mirror 135. Figure 4 shows operation 400 of the camera system 100 under high-light conditions. Under high-light conditions, light can enter the camera system 100 via the imaging optical system 102. Light 402, tuned by the imaging optical system 102, can strike the surface of the electronically controllable mirror 135. The electronically controllable mirror 135 can receive mirror control signals to maximize the reflectivity of the tuned light 402. The reflected light 404 can be directed to the active surface of a second optical imaging sensor 120, which may be a CCD or CMOS color sensor. As disclosed above, it will be recognized that the electronically controllable mirror 135 under maximum reflectivity control can still transmit light 406 to the active surface of the first optical imaging sensor 110, although the transmitted light 406 may represent a small amount of light striking the surface of the electronically controllable mirror 135.

[0072] Figure 5 shows the operation 500 of the camera system 100 under moderate illumination conditions. Under moderate illumination conditions, light can enter the camera system 100 via the imaging optical system 102. Light 402 tuned by the imaging optical system 102 can strike the surface of an electronically controllable mirror 135. The electronically controllable mirror 135 can receive a mirror control signal and reflect some of the tuned light 402 and transmit some of it. The reflected light 404 can be directed to the active surface of a second optical imaging sensor 120, which may be a CCD or CMOS color sensor. The transmitted light 506 can be directed to the active surface of a first optical imaging sensor 110, which may be an image sensitizer.

[0073] Figure 6 shows the operation 600 of the camera system 100 under low-light conditions. Under low-light conditions, light can enter the camera system 100 via the imaging optical system 102. Light 402 tuned by the imaging optical system 102 can strike the surface of the electronically controllable mirror 135. The electronically controllable mirror 135 can receive a mirror control signal to transmit the tuned light 402 to the maximum extent. The transmitted light 506 can be directed to the active surface of a first optical imaging sensor 110, which may be an image sensitizer. As disclosed above, it will be recognized that the electronically controllable mirror 135 under maximum transmittance control can still reflect light 604 to the active surface of a second optical imaging sensor 120, although the reflected light 604 may represent a small amount of light striking the surface of the electronically controllable mirror 135.

[0074] As discussed above, the relative arrangement of the image sensitizer and the CCD or CMOS color sensor with respect to the electronically controllable mirror 135 can be interchanged. Thus, the first optical imaging sensor 110 may be a CCD or CMOS color sensor. In this configuration, Figure 6 may relate to high-illumination conditions in which the electronically controllable mirror 135 transmits the maximum adjustment light 402 to the CCD or CMOS color sensor. Similarly, the second optical imaging sensor 120 may be an image sensitizer. In this configuration, Figure 4 may relate to low-illumination conditions in which the electronically controllable mirror 135 reflects the maximum adjustment light 402 to the image sensitizer.

[0075] It is important to note that the configurations and arrangements of various exemplary embodiments are for illustrative purposes only. While this disclosure describes in detail only a few embodiments, it will be readily apparent to those skilled in the art that considering this disclosure many modifications are possible (e.g., changes in the size, dimensions, structure, shape and proportions of various elements, parameter values, mounting arrangements, material use, color, orientation, etc.) without substantially departing from the novel teachings and advantages of the subject matter described herein. For example, elements shown as integrally formed may consist of multiple parts or elements, the positions of elements may be reversed or otherwise changed, and the nature or number of individual elements or positions may be changed or altered. Any order or sequence of process or method steps may be changed or resequenced according to alternative embodiments. Furthermore, features of a particular embodiment may be combined with features of other embodiments as understood by those skilled in the art. Other substitutions, modifications, changes, and omissions can also be made in the design, operating conditions, and arrangements of various exemplary embodiments without departing from the scope of the invention.

[0076] As used herein, terms such as “about,” “approximately,” “substantially,” and “generally” mean plus or minus 10% of the stated value or range. Furthermore, as used herein, the singular forms “a, an” and “the” also include the plural form unless the context clearly indicates otherwise. The term “and / or” includes any combination and all combinations of one or more of the related enumerated items. For example, a reference to “feature” includes multiple such “features.” As used in the context of “X and / or Y,” the term “and / or” shall be interpreted as “X,” or “Y,” or “X and Y.”

[0077] Furthermore, even if a specific number of claims introduced is explicitly stated, a person skilled in the art will recognize that such a statement should typically be interpreted as meaning at least the stated number (for example, the mere statement “two claims” without other modifiers typically means at least two claims, or two or more claims). Moreover, when idiomatic expressions similar to “at least one of A, B, and C, etc.” are used, such constructions are generally intended to be understood by a person skilled in the art (for example, “a system having at least one of A, B, and C, etc.” includes, but is not limited to, systems having only A, only B, only C, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). When idiomatic expressions similar to "at least one of A, B, or C" are used, such constructions are generally intended to be understood by those skilled in the art (for example, "a system having at least one of A, B, and C" includes, but is not limited to, systems having only A, only B, only C, A and B together, A and C together, B and C together, and / or A, B, and C together). It will also be understood by those skilled in the art that, typically, in detailed descriptions, claims, or drawings, separators and / or phrases presenting two or more alternative terms are intended to include the possibility of including one of the terms, either of the terms, or both of the terms, unless the context otherwise indicates. For example, the phrase "A or B" will typically be understood to include the possibilities of "A" or "B" or "A and B".

[0078] The embodiments described and illustrated in the detailed description, drawings, and claims are not intended to be limiting. Other embodiments may be used, or other modifications may be made, without departing from the spirit or scope of the subject matter presented herein. Furthermore, specific aspects of each embodiment may be used in combination with other embodiments of the disclosure, so that the disclosed embodiments can be combined in a manner understood in the art. It will be readily apparent that the aspects of the disclosure described and illustrated herein in general terms may be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are expressly intended herein.

[0079] It should be noted that where the term “example” is used here to describe various embodiments, such embodiments are intended to indicate that they are possible examples, representations, and / or illustrations of possible embodiments (such term is not intended to imply that such embodiments are necessarily special or superlative examples). Furthermore, the terms “substantially” and similar terms as used herein are intended to have a broad meaning consistent with the general and accepted usage by those skilled in the art to which the subject matter of this disclosure relates. Those skilled in the art considering this disclosure should understand that these terms are intended to allow the specific features described and claimed to be described without limiting the scope of those features to the exact numerical ranges that provided for them. Accordingly, these terms should be interpreted as indicating that substantive or insignificant modifications or changes to the subject matter described and claimed (e.g., within plus or minus 5 percent of a given angle or other value) are considered to be within the scope of the invention described in the appended claims. The term “approximately” when used in relation to values ​​means plus or minus 5 percent of the value in question.

[0080] As used herein, terms such as “joined” mean that two members are joined to each other directly or indirectly. Such a joint may be fixed (e.g., permanent) or movable (e.g., removable or detachable). Such a joint may be achieved by the two members or the two members and an additional intermediate member being formed integrally as a single whole, or by the two members or the two members and an additional intermediate member being attached to each other.

[0081] The illustrated architectures, in which different components are contained within or connected to other different components, are merely examples, and it is important to understand that many other architectures can be implemented to achieve the same functionality. Conceptually, any arrangement of components to achieve the same functionality will be effectively "associated" in such a way that the desired functionality is achieved. For this reason, any two components combined herein to achieve a particular functionality can be considered "associated" with each other, regardless of architecture or intermediate components, in such a way that the desired functionality is achieved. Similarly, any two components thus associated can be considered "operably connected" or "operably coupled" with each other to achieve the desired functionality. Furthermore, any two components that can be associated in such a way can be considered "operably coupled" with each other to achieve the desired functionality. Specific examples of components that can be operably coupled include, but are not limited to, physically matable and / or physically interacting components, and / or wirelessly interacting components, and / or wirelessly interacting components, and / or logically interacting components, and / or logically interactable components, and / or electrically interacting components, and / or electrically interactable components, and / or optically interacting components, and / or optically interactable components.

[0082] While the figures in this specification illustrate a specific sequence and configuration of method steps, it should be noted that the order of these steps may differ from those illustrated. For example, two or more steps may be performed simultaneously or partially simultaneously. Furthermore, some method steps performed as individual steps may be combined, steps performed as combined steps may be separated into individual steps, the sequence of a particular process may be reversed or otherwise modified, and the nature or number of individual processes may be changed or altered. The order or sequence of any element or device may be changed or replaced according to alternative embodiments. Accordingly, all such changes are included within the scope of this disclosure as defined by the appended claims.

[0083] Without further explanation, it is expected that those skilled in the art can make full use of the invention described in the claims using the description above. The examples and embodiments disclosed herein should be construed as illustrative only and do not limit the scope of this disclosure in any way. It will be apparent to those skilled in the art that the details of the embodiments described above can be modified without departing from the basic principles discussed. In other words, various modifications and improvements to the embodiments specifically disclosed above are within the scope of the appended claims. For example, any suitable combination of the features of the various embodiments described is contemplated.

[0084] Those skilled in the art will recognize that the components (e.g., actions), apparatus, objects, and their accompanying descriptions described herein are used as examples for the purpose of clarifying concepts, and that various configurations are intended to be modified. Consequently, the specific examples and accompanying discussions used herein are intended to represent a more general class. In general, the use of specific examples is intended to represent that class, and the absence of certain components (e.g., actions), apparatus, and objects should not be interpreted as limiting.

[0085] Furthermore, while several forms are illustrated and described, the applicant's intent is not to limit or restrict the scope of the appended claims to such detail. Numerous modifications, variations, alterations, substitutions, combinations, and equivalents to these forms can be carried out and will be recalled by those skilled in the art without departing from the scope of this disclosure. Moreover, the structure of each element relating to the described forms can be alternatively described as a means for providing the function performed by the element. Also, even when the material of a particular component is disclosed, other materials may be used. Accordingly, it should be understood that the above description and the scope of the appended claims are intended to cover all such modifications, combinations, and variations within the scope of the disclosed forms. The appended claims are intended to cover all such modifications, variations, alterations, substitutions, alterations, and equivalents.

[0086] For the sake of brevity and clarity of disclosure, the selected aspects of disclosure described above are shown in block diagram form rather than in detail. Some of the detailed descriptions provided herein may be presented in the form of instructions that operate on data stored in one or more computer memories or one or more data storage devices (e.g., floppy disks, hard disk drives, solid-state drives, compact discs (CDs), digital video discs (DVDs), digital tapes, etc.). Such descriptions and expressions are intended for use by those skilled in the art to explain and communicate the nature of the work to others skilled in the art. Generally, an algorithm refers to a consistent set of steps that lead to a desired result. Here, “steps” refers to the operation of physical quantities and / or logical states, which may, but do not necessarily, take the form of electrical or magnetic signals that can be stored, transferred, combined, compared, and otherwise operated on. These signals are commonly referred to as bits, values, elements, symbols, characters, terms, numbers, etc. These terms and similar terms may be associated with appropriate physical quantities and are merely convenient labels applied to these quantities and / or states.

[0087] As is evident from the above disclosures, unless otherwise specified, any discussion using terms such as “processing,” “computing,” “calculating,” “determining,” or “displaying” throughout the above disclosures is understood to refer to the operation and processes of a computer system or similar electronic computing device that manipulates and converts data, represented as physical (electronic) quantities in the registers and memory of a computer system, into other data, similarly represented as physical quantities in the memory or registers of a computer system or other information storage, transmission, or display device.

[0088] In a general sense, those skilled in the art will recognize that the various embodiments described herein can be individually and / or collectively implemented by a wide range of hardware, software, firmware, or any combination thereof, and can be considered to consist of various types of “electrical circuits.” As a result, “electrical circuits” as used herein include, but are not limited to, electrical circuits having at least one individual electrical circuit, electrical circuits having at least one integrated circuit, electrical circuits having at least one application-specific integrated circuit, electrical circuits forming general-purpose computing devices configured by computer programs (e.g., a general-purpose computer configured by computer programs that perform at least part of the processes and / or devices described herein, or a microprocessor configured by computer programs that perform at least part of the processes and / or devices described herein), electrical circuits forming memory devices (e.g., in the form of random-access memory), and / or electrical circuits forming communication devices (e.g., modems, communication switches, or optical-electrical devices). Those skilled in the art will understand that the subject matter described herein can be implemented in analog form, digital form, or a combination thereof.

[0089] In the detailed descriptions above, block diagrams, flowcharts, and / or examples have been used to illustrate various forms of devices and / or processes. Those skilled in the art will understand that, as long as such block diagrams, flowcharts, and / or examples contain one or more functions and / or operations, each function and / or operation within such block diagrams, flowcharts, and / or examples can be implemented individually or collectively by various hardware, software, firmware, or any combination thereof. In one form, several parts of the subject matter described herein can be implemented via application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), or other integrated forms. However, those skilled in the art will recognize that some aspects of the forms disclosed herein can be implemented, in whole or in part, equivalently as integrated circuits, one or more computer programs running on one or more computers (e.g., one or more programs running on one or more computer systems), one or more programs running on one or more processors (e.g., one or more programs running on one or more microprocessors), firmware, or substantially any combination thereof, and that, in light of this disclosure, designing circuits and / or coding software and / or firmware is within the scope of the art of those skilled in the art. Furthermore, those skilled in the art will understand that the mechanisms of the subject matter described herein can be distributed (delivered) in various forms as one or more program products, and that exemplary forms of the subject matter described herein apply regardless of the specific type of signal carrier medium actually used to carry out the distribution. Examples of signal transmission media include, but are not limited to, recording media such as floppy disks, hard disk drives, compact discs (CDs), digital video discs (DVDs), digital tapes, and computer memory, and transmitting media such as digital and / or analog communication media (e.g., fiber optic cables, waveguides, wired communication links, wireless communication links, etc. (e.g., transmitters, receivers, transmitting logic, receiving logic, etc.)).

[0090] In other examples, one or more components may be referred to herein as “configured,” “configurable,” “operable,” “adaptable,” “possible,” “conformable,” etc. A person skilled in the art will recognize that “configured” can generally encompass active components and / or inactive components and / or standby components unless otherwise specified in the context.

[0091] While specific aspects of this disclosure are shown and described, changes and modifications can be made based on the teachings herein without departing from the subject matter described herein and its broader aspects, and it will be apparent to those skilled in the art that the appended claims encompass all such changes and modifications within their scope that fall within the true scope of the subject matter described herein. Those skilled in the art will generally understand that the terms used herein, and in particular in the appended claims (e.g., the body of the appended claims), are generally intended to be “open” terms (e.g., the term “includes” should be interpreted as “includes but not limited to,” the term “has” should be interpreted as “has at least,” and the term “includes” should be interpreted as “includes but not limited to,” etc.). Those skilled in the art will further understand that if it is intended that the description of an introduced claim be of a certain number, such intention is explicitly stated in the claim, and if such statement is not present, such intention does not exist. For example, to aid understanding, the following appended claims may include the use of the introductory phrases “at least one” and “one or more” to introduce the description of the claim. However, the use of such phrases should not be interpreted as meaning that the introduction of a claim by the indefinite article "a, an" limits any particular claim containing such an introduction to a claim to one claim containing only one such introduction, even if the same claim contains an introductory phrase such as "one or more" or "at least one" and an indefinite article such as "a, an" (for example, "a, an" should usually be interpreted as meaning "at least one" or "one or more"). The same applies to the use of definite articles used to introduce a claim.

[0092] Those skilled in the art will understand that, with respect to the attached claims, the operations described herein can generally be performed in any order. They should also understand that, while various operation flows are shown sequentially, the operations may be performed in any order other than those illustrated, and may be performed simultaneously. Examples of such alternative orders may include, unless otherwise specified in the context, overlapping, interleaving, interrupting, reordering, incrementing, preparing, supplementing, simultaneous, reversing, or other variant orders. Furthermore, terms such as “responding,” “related,” or other past tense adjectives do not generally exclude such variants unless otherwise specified in the context.

[0093] It is worth noting that any reference to “one aspect,” “a certain aspect,” “one form,” or “a certain form” means that the specific function, structure, or characteristic described in relation to that aspect is included in at least one aspect. Thus, when the phrases “one aspect,” “a certain aspect,” “a certain form,” or “a certain form” appear in various places in this specification, they do not necessarily all refer to the same aspect. Furthermore, specific functions, structures, or characteristics can be combined in any suitable way in one or more aspects.

[0094] With regard to the use of substantially any plural and / or singular terms herein, those skilled in the art can convert from plural to singular and / or singular to plural depending on the context and / or use. For clarity, various singular / plural permutations are not explicitly shown herein.

[0095] In some cases, the use of a system or method may take place within the domain even if its components are located outside the domain. For example, in the context of distributed computing, the use of a distributed computing system may take place within the domain even if parts of the system are located outside the domain (e.g., relays, servers, processors, signaling media, transmitting computers, receiving computers, etc., located outside the domain).

[0096] In summary, we have described the numerous advantages arising from adopting the concepts described herein. The above descriptions of one or more forms are presented for illustrative and explanatory purposes only. They are not intended to be exhaustive or to limit us to the exact forms disclosed. Modifications or changes are possible in light of the above teachings. One or more forms have been selected and described to illustrate the principle and practical applications, so that those skilled in the art can utilize various forms and modifications suitable for the specific intended use. The claims submitted herein are intended to define the overall scope.

Claims

1. A camera system, said camera system, Imaging optical system, A first sensitized optical imaging sensor that provides first sensitized optical imaging sensor data under low light conditions, A second color optical imaging sensor that provides second color optical imaging sensor data under high-illumination conditions, An electronically controllable mirror system for controlling the transmission and / or reflection of light from the imaging optical system, Includes a camera system controller, The electronically controllable mirror system is An electronically controllable mirror positioned at a fixed position relative to the first sensitized optical imaging sensor and the second color optical imaging sensor, Includes a control mirror controller that controls the mirror signal applied to the electronically controllable mirror, The electronically controllable mirror system transmits a first portion of the incident light through the electronically controllable mirror to the first sensitized optical imaging sensor, and reflects a second portion of the incident light to the second color optical imaging sensor by the electronically controllable mirror, based on the mirror control signal. The aforementioned camera system controller is Processor and Includes memory unit, The memory unit includes an instruction, and when the instruction is executed by the processor, the processor receives the instruction. The first sensitized optical imaging sensor receives data from the first sensitized optical imaging sensor. The second color optical imaging sensor receives data from the second color optical imaging sensor, and, The first enhanced optical imaging sensor data and the second color optical imaging sensor data are combined to generate enhanced color imaging data. Camera system.

2. The memory unit further includes instructions, and when such instructions are executed by the processor, the processor further... The camera system according to claim 1, wherein imaging data is calculated from the characteristics of the first intensified optical imaging sensor data and the characteristics of the second color optical imaging sensor data.

3. The memory unit further includes instructions, and when such instructions are executed by the processor, the processor further... The camera system according to claim 2, which causes an image display system, a data storage system, or an external system to transmit the image capture data.

4. The memory unit further includes instructions, and when such instructions are executed by the processor, the processor further... The camera system according to claim 1, wherein a mirror controller adjustment signal is transmitted to the mirror controller based at least partially on the first enhanced optical imaging sensor data or the second color optical imaging sensor data.

5. The memory unit further includes instructions, and when such instructions are executed by the processor, the processor further... The system receives manual operation signals from the user operation input device, and, The camera system according to claim 1, wherein a manual mirror controller adjustment signal is transmitted to the mirror controller.

6. The memory unit further includes instructions, and when such instructions are executed by the processor, the processor further... It receives input signals from an external device, and, The camera system according to claim 1, wherein an input data mirror controller adjustment signal is transmitted to the mirror controller.

7. The camera system according to claim 1, wherein the electronically controllable mirror includes a surface spatially fixed to the body of the electronically controllable mirror for receiving the incident light.

8. The electronically controllable mirror is continuously adjustable between a maximum percentage transmittance state and a minimum percentage transmittance state. The camera system according to claim 1, wherein the electronically controllable mirror is continuously adjustable between a maximum percentage reflectivity state and a minimum percentage reflectivity state.

9. The camera system according to claim 8, wherein the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percentage transmittance state and a mirror control signal value corresponding to the maximum percentage transmittance state.

10. The camera system according to claim 8, wherein the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percentage reflectance state and a mirror control signal value corresponding to the maximum percentage reflectance state.

11. The camera system according to claim 1, wherein the mirror control signal includes a mirror control voltage.

12. A method for generating a color image in a camera system, The camera system includes an imaging optical system, a first sensitized optical imaging sensor, a second color optical imaging sensor, an electronically controllable mirror system for controlling the transmission and / or reflection of light from the imaging optical system, and a camera system controller. This method is The steps include receiving incident light from the imaging optical system on the surface of an electronically controllable mirror, The camera system controller controls the electronically controllable mirror so that a first portion of the incident light strikes the first sensitized optical imaging sensor and a second portion of the incident light strikes the second color optical imaging sensor. The camera system controller receives first sensitized optical imaging sensor data from the first sensitized optical imaging sensor under low light conditions, The camera system controller receives second color optical imaging sensor data from the second color optical imaging sensor under high-light conditions, The process includes the step of combining the first sensitized optical imaging sensor data and the second color optical imaging sensor data to generate sensitized color imaging data, The electronically controllable mirror is positioned in a fixed position relative to the first sensitizing optical imaging sensor and the second color optical imaging sensor. The surface of the electronically controllable mirror is spatially fixed to the body of the electronically controllable mirror. method.

13. The camera system controller controls the electronically controllable mirror, The method according to claim 12, comprising the step of controlling the electronically controllable mirror based at least in part on the first sensitized optical imaging sensor data or the second color optical imaging sensor data.

14. The camera system controller further includes the step of calculating imaging data from the first sensitized optical imaging sensor data and the second color optical imaging sensor data, The method according to claim 12, wherein the imaging data includes the characteristics of the first intensified optical imaging sensor data and the characteristics of the second color optical imaging sensor data.

15. The method according to claim 14, further comprising the step of the camera system controller transmitting the imaging data to an image display system, an image data storage system, or an external device.

16. The first intensified optical imaging sensor has a resolution of 1 × 10 －６ Footcandela ~ 1 x 10 －３ The first enhanced optical imaging sensor can provide data under illumination up to foot candela, and the second color optical imaging sensor is 1 × 10 －３ Footcandela ~ 1 x 10 ３ The camera system according to claim 1, which can provide the second color optical imaging sensor data under illumination up to a foot candela.

17. The first intensified optical imaging sensor has a resolution of 1 × 10 －６ Footcandela ~ 1 x 10 －３ The first enhanced optical imaging sensor provides data under illumination up to foot candela, and the second color optical imaging sensor provides 1 × 10⁻¹⁰ －３ Footcandela ~ 1 x 10 ３ The method according to claim 12, wherein the second color optical imaging sensor data is provided under illumination up to foot candela.

Images