Image intensified and color sensor camera

Abstract

To provide a wide range illumination camera capable of producing color images even at low illumination intensities.SOLUTION: A camera system includes a first imaging sensor, a second imaging sensor, and a controllable mirror system. The mirror system includes a mirror disposed at a fixed position with respect to the first imaging sensor and the second imaging sensor, and a controller to control a signal to be applied to the mirror. The mirror system transmits a first portion of incident light through the mirror to the first imaging sensor, and reflects a second portion of the incident light to the second imaging sensor. A method of producing color images includes the steps of: receiving incident light on a surface of the mirror; controlling the mirror to direct a first portion of the incident light to the first imaging sensor and a second portion of the incident light to the second imaging sensor; receiving first imaging sensor data from the first imaging sensor; and receiving second imaging sensor data from the second imaging sensor.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] Example embodiments relate generally to a camera system for use in both high and low light conditions, and more specifically to a camera system that provides color images for images captured in low light conditions. The camera system utilizes an electronically controllable beam splitter to direct a portion of incident light to a first image intensifying sensor and a second color discriminating sensor. [Background technology]

[0002] High performance imaging cameras are useful in many fields. Exemplary applications of such systems include fixed security systems, heads-up or wearable devices for military applications, or providing image input to additional ground-based or air-based systems. Such imaging cameras can be expected to operate under a variety of illumination conditions, from full daylight to two orders of magnitude below starlight. Currently, no single optical sensor can operate across the full range of illumination conditions.

[0003] Many sensors are known that can operate at higher illumination levels, such as CCD and CMOS sensors. Many such sensors can also provide color discrimination of the incident light. A typical color-sensitive sensor may include a CMOS sensor incorporating a Bayer filter that filters the incident light into red, green, and blue images of adjacent pixels in the sensor array. However, the most sensitive of such sensors has a resolution of about 1×10 -4 Only illumination below a foot-candela can provide sufficient image resolution.

[0004] 1×10 -5Alternative sensors are known that can capture image information at much lower illumination levels, such as below foot-candela. Non-limiting examples of such low-illumination imaging sensors may include image intensifiers or electron bombardment imagers, and single-photon avalanche detectors. In some image intensification systems, incident light strikes a photocathode, which converts individual photons into a cascade of electrons. The electron cascade can be focused on a phosphor to convert the electrons into light. The light can then be sensed by a photosensor and converted into light data. It will be appreciated that image intensifiers can saturate even at moderate levels of incident light, potentially damaging the intensifier's electronics or optics. Generally, such image intensifiers are panchromatic, meaning that the light signal generated by the image intensifier does not distinguish between the colors of the incident light.

[0005] It is therefore apparent that a system for use under a wide range of illumination conditions may rely on the use of both a high-intensity CMOS or CCD sensor and an image intensifier. Some known systems may rely on multiple apertures, where the light is focused onto a high-intensity sensor through a first aperture and onto a low-intensity sensor through a second aperture. Such systems may be bulky due to the large number of aperture optics.

[0006] Systems are also known that have a single aperture where the incident light is focused onto either a high or low intensity sensor. In some such systems, the light may be directed to the sensor by a movable mirror. It will be appreciated that a movable mirror adds complexity and can be a source of failure if the mechanical system that moves the mirror becomes misaligned or inoperable. Furthermore, such systems direct the light to either a low or high intensity sensor. Thus, either a color image or an enhanced monochrome image can be obtained.

[0007] It would therefore be useful to have a wide-area illumination camera that can produce color images even in low light conditions, has a small footprint, and does not require a mechanical system to focus the incoming light onto the sensor. Summary of the Invention

[0008] In one aspect, a camera system includes a first optical imaging sensor, a second optical imaging sensor, and an electronically controllable mirror system including an electronically controllable mirror disposed at a fixed position relative to the first optical imaging sensor and the second optical imaging sensor, and a mirror controller that controls a mirror control signal applied to the electronically controllable mirror. Based on the mirror control signal, the electronically controllable mirror system transmits a first portion of incident light through the electronically controllable mirror to the first optical imaging sensor and reflects a second portion of the incident light by the electronically controllable mirror to the second optical imaging sensor.

[0009] In one aspect, the camera system further includes a camera system controller, the camera system being comprised of a processor and a memory unit including instructions that, when executed by the processor, cause the processor to receive first optical imaging sensor data from the first optical imaging sensor and second optical imaging sensor data from the second optical imaging sensor.

[0010] In one aspect, the camera system includes instructions that, when executed by the processor, further cause the processor to calculate imaging data from a characteristic of the first optical imaging sensor data and a characteristic of the second optical imaging sensor data.

[0011] In one aspect, the camera system includes instructions that, when executed by the processor, further cause the processor to transmit the imaging data to an image display system, a data storage system, or an external system.

[0012] In one aspect, the camera system includes instructions that, when executed by the processor, further cause the processor to send a mirror controller adjustment signal to the mirror controller based at least in part on the first optical imaging sensor data or the second optical imaging sensor data.

[0013] In one aspect, the camera system includes instructions that, when executed by the processor, further cause the processor to receive a manual operation signal from a user operated input device and to send a manual mirror controller adjustment signal to the mirror controller.

[0014] In one aspect, the camera system includes instructions that, when executed by the processor, further cause the processor to receive an input signal from an external device and send the input data mirror controller adjustment signal to the mirror controller.

[0015] In one aspect of the camera system, the first optical imaging sensor is an intensified imaging sensor.

[0016] In one aspect of the camera system, the second optical imaging sensor is a color imaging sensor.

[0017] In one aspect of the camera system, the electronically controllable mirror includes a surface that is spatially fixed relative to a body of the electronically controllable mirror for receiving incident light.

[0018] In one aspect of the camera system, the electronically controllable mirror is continuously adjustable between a maximum percent transmittance state and a minimum percent transmittance state, and the electronically controllable mirror is continuously adjustable between a maximum percent reflectance state and a minimum percent reflectance state.

[0019] In one aspect of the camera system, the mirror control signal is continuously variable between a mirror control signal value corresponding to a minimum percent transmittance state and a mirror control signal value corresponding to a maximum percent transmittance state.

[0020] In one aspect of the camera system, the mirror control signal is continuously variable between a mirror control signal value corresponding to a minimum percent reflectance state and a mirror control signal value corresponding to a maximum percent reflectance state.

[0021] In one aspect of the camera system, the mirror control signal comprises a mirror control voltage.

[0022] In one aspect, a method for generating a color image includes the steps of receiving incident light at a surface of an electronically controllable mirror; controlling the electronically controllable mirror by a camera system controller to direct a first portion of the incident light toward a first optical imaging sensor and a second portion of the incident light toward a second optical imaging sensor; receiving first optical imaging sensor data by the camera system controller from the first optical imaging sensor; and receiving second optical imaging sensor data by the camera system controller from the second optical imaging sensor. According to this aspect, the electronically controllable mirror is disposed at a fixed position relative to the first optical imaging sensor and the second optical imaging sensor, and the surface of the electronically controllable mirror is spatially fixed relative to a body of the electronically controllable mirror.

[0023] In one aspect of the method, the step of the camera system controller controlling the electronically controllable mirror includes controlling the electronically controllable mirror based at least in part on the first optical imaging sensor data or the second optical imaging sensor data.

[0024] In one aspect, the method further includes the camera system controller calculating imaging data from the first optical imaging sensor data and the second optical imaging sensor data, where the imaging data includes a characteristic of the first optical imaging sensor data and a characteristic of the second optical imaging sensor data.

[0025] In one aspect, the method further includes the camera system controller transmitting the imaging data to an image display system, an image data storage system, or an external device.

[0026] In one aspect, the method further includes the steps of: the camera system controller receiving a manual operation signal from a user-operated input device; and the camera system controller controlling the electronically controllable mirror based at least in part on the manual operation signal.

[0027] In one aspect, the method further includes the steps of: the camera system controller receiving an input signal from an external device; and the camera system controller controlling the electronically controllable mirror based at least in part on the input signal from the external device. [Brief description of the drawings]

[0028] Examples of the disclosure are best understood from the following detailed description when read in conjunction with the accompanying drawings, in which: According to common practice, the various features of the drawings are not drawn to scale or are shown only in partial perspective view; Dimensions of the various embodiments are shown suitably expanded or reduced for clarity; Like reference numerals are used to denote like elements between the drawings; The drawings include the following features and elements, and reference will now be made to each of the drawings: [Figure 1] 1 is a partial block diagram of a camera system having a color imaging sensor and an image intensification sensor according to one aspect of the present disclosure. [Diagram 2] FIG. 2 is a block diagram of a computing system for use in the camera system of FIG. 1 according to one aspect of the disclosure. [Diagram 3] 4 is an exemplary graph illustrating the percent light transmittance and percent light reflectance of an electronically controllable mirror versus an applied mirror control signal, according to one aspect of the present disclosure. [Figure 4]1 is a partial block diagram of a camera system having a color imaging sensor and an image intensification sensor operating under maximum reflectance conditions according to one aspect of the present disclosure. [Diagram 5] 1 is a partial block diagram of a camera system having a color imaging sensor and an image intensification sensor operating under mixed reflectance and transmittance conditions in accordance with an aspect of the present invention; [Figure 6] 1 is a partial block diagram of a camera system having a color imaging sensor and an image intensification sensor operating under maximum transmittance conditions, according to one aspect of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] The following discussion is directed to various aspects of the apparatus and methods of the present invention. However, those skilled in the art will appreciate that the examples disclosed herein have broad application, and the description of any aspect is intended to be merely an example of that aspect, and is not intended to suggest that the scope of the disclosure, including the claims, is limited to that aspect.

[0030] As mentioned above, the drawings are not necessarily to scale. Certain features and components herein have been shown exaggerated in scale or in somewhat schematic form and may not show some details of conventional elements for the sake of clarity and conciseness.

[0031] In the following discussion and claims, the terms "including" and "comprising" are used in an open-ended manner and thus should be interpreted to mean "including, but not limited to." Additionally, the term "couple" is intended to mean either an indirect or direct connection. Thus, when a first device couples to a second device, the connection may be through a direct connection between the two devices or through an indirect connection established through other devices, components, nodes, and connections. Additionally, as used herein, the terms "axial" and "axially" generally mean along or parallel to a given axis (e.g., an x, y, or z direction, or a central axis of a body, outlet, or port), while the terms "radial" and "radially" generally mean orthogonal to a given axis. For example, an axial distance refers to a distance measured along or parallel to an axis, and a radial distance refers to a distance measured orthogonal to an axis.

[0032] As discussed above, a user of a camera system may prefer to obtain color images to better analyze the images from a content perspective. A camera operating under high light conditions can utilize a color imaging sensor to provide such color images. However, imaging sensors that can operate under low or very low light conditions typically provide only monochromatic images and cannot provide color images. The system disclosed herein utilizes imaging data obtained from both the color imaging sensor and the intensified imaging sensor. The data from the two types of imaging sensors can be merged into a single image under low light conditions where the color imaging sensor data may not be optimal.

[0033] 1, a partial block diagram of a camera system 100 having a color imaging sensor and an image intensifying sensor is shown. Although color imaging sensors and image intensifying sensors are discussed below, it will be understood that the camera system disclosed herein can use any group of imaging sensors having different illumination responses. The camera system 100 includes imaging optics 102, a first optical imaging sensor 110, a second optical imaging sensor 120, an electronically controllable mirror system 130, and electronic components for controlling the system. Additional components may be included to display imaging data on an image display system 150 and store imaging data in an image data storage system 160, or to send imaging data to an external device for processing or automatic camera system control.

[0034] The imaging optics 102 may include any optical components for focusing, filtering, collimating, and otherwise controlling light passing through the aperture before being directed to the optical imaging sensors 110, 120. The imaging optics 102 may form part of a single camera aperture. Exemplary optical components may include objective lenses, relay lenses, filters, polarizers, etc.

[0035] The first optical imaging sensor 110 may include an intensified imaging sensor. Such a sensor is capable of providing the first optical imaging data under low light conditions. Low light conditions include, but are not limited to, about 1×10 -6 Foot candela ~ approx. 1 x 10 -3 Illuminance may be defined as up to foot candela. Non-limiting examples of such enhanced imaging sensors may include image intensifiers, electron bombardment imagers, image intensifiers coupled to CMOS imaging sensors, single photon avalanche detectors, and quantum information sensors. In some additional aspects, narrow band optical filters may be placed on or near the imaging surface of the enhanced imaging sensor to provide wavelength-based optical filtering.

[0036] The first optical imaging sensor 110 can receive light that has passed through the electronically controllable mirror 135. The first optical imaging sensor 110 can receive a first sensor control signal from a first sensor controller 114. The first sensor controller 114 can provide the first sensor control signal to the first optical imaging sensor 110 via a first sensor control line 112. In some aspects, the first sensor controller 114 can be controlled by data provided by a camera system controller 140 (described further below with respect to FIG. 2) via a first sensor controller interface 118. For example, if the first optical imaging sensor 110 is an image intensifier-based camera system, the controller 140 can place the intensified imaging sensor in a state that protects the intensified imaging sensor from accidental exposure to high light illuminance input. Alternatively, the first sensor controller 114 can be a stand-alone device that is not controlled by the camera system controller 140.

[0037] The first optical imaging sensor 110 can provide first optical imaging data to the camera system controller 140 via the first optical imaging sensor data line 116. The first optical imaging data can include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the first optical imaging sensor 110. The image characteristic data can include, but is not limited to, the location of one or more predefined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. The optical imaging data can be acquired over a single frame or can be acquired from multiple frames captured by the first optical imaging sensor 110 over time.

[0038] The first optical imaging sensor 110 may also receive first sensor operation control data from the camera system controller 140 over the first optical imaging sensor data line 116. The first optical imaging data may be processed by the camera system controller 140 as part of the method to generate imaging data for display, storage, or analysis by an external device.

[0039] The second optical imaging sensor 120 may include a CMOS or CCD color imaging sensor. Such a sensor may provide the second optical imaging data under higher illumination conditions, including, but not limited to, illumination conditions of approximately 1×10 -3 Foot candela to full sunlight (approximately 1×10 3 Color image sensors may be defined as a color resolution (which may be in foot-candles). Non-limiting examples of such color image sensors may include CMOS image sensors, charge-coupled devices (CCDs), and single-photon avalanche detectors.

[0040] The second optical imaging sensor 120 may include a second active surface that receives light reflected by the electronically controllable mirror 135. The second optical imaging sensor 120 may require a second sensor control signal from the second sensor controller 124. The second sensor controller 124 may be configured to provide the second sensor control signal to the second optical imaging sensor via the second sensor control signal conductor 122. In some aspects, the second sensor controller 124 may be controlled by data provided by the camera system controller 140 via the second sensor controller interface 128. For example, if the second optical imaging sensor 120 is a color imaging sensor, the second sensor control signal may be initially enabled by the camera system controller 140. In this manner, the color imaging sensor may provide the camera system controller 140 with second optical imaging data. In one non-limiting example, the second optical imaging data may enable the camera system controller 140 to adjust the first sensor control signal if the illumination level impinging on the color imaging sensor is too low. Alternatively, the second sensor controller 124 may be a stand-alone device that is not controlled by the camera system controller 140 .

[0041] The second optical imaging sensor 120 can provide second optical imaging data to the camera system controller 140 via the second optical imaging sensor data line 126. The second optical imaging data can include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the second optical imaging sensor 120. The image characteristic data can include, but is not limited to, the location of one or more predefined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. The optical imaging data can be obtained from a single frame or from multiple frames captured by the first optical imaging sensor 120 over time.

[0042] The second optical imaging sensor 120 may also receive second sensor operation control data from the camera system controller 140 over second optical imaging sensor data line 126. The second optical imaging data may be processed by the camera system controller 140 as part of the method to generate imaging data for display, storage, or analysis by ancillary devices.

[0043] 1 and the above disclosure suggests that the first optical imaging sensor 110 may include an intensified imaging sensor and the second optical imaging sensor 120 may include a CCD or CMOS color sensor, it will be appreciated that the first optical imaging sensor 110 and the second optical imaging sensor 120 may alternatively include a CCD or CMOS color sensor and an intensified imaging sensor, respectively. Additionally, the first optical imaging sensor 110 and the second optical imaging sensor 120 may include alternative optical imaging sensors, such as, for example, an IR-sensitive imaging sensor and / or a UV-sensitive imaging sensor. Additionally, the first optical imaging sensor 110 and the second optical imaging sensor 120 may include various coatings, such as polarizing coatings and / or anti-reflective coatings.

[0044] Referring again to FIG. 1, the electronically controllable mirror system 130 can include an electronically controllable mirror 135 mounted on a transparent mirror mount 133. The amount of light reflected by or passing through the electronically controllable mirror 135 can be controlled by a mirror control signal provided by a mirror controller. In some embodiments, the mirror control signal can be a mirror control voltage. Non-limiting examples of the mirror control voltage can include a DC analog voltage or an AC analog voltage. In one non-limiting example, the AC analog voltage can be a 100-260V 20Hz square wave signal. Another example of the AC analog voltage control signal can include a variable pulse frequency control signal or a variable pulse phase control signal. Alternatively, the mirror control signal can be a mirror control current. Non-limiting examples of the mirror control current can include a DC analog current or an AC analog current. In some non-limiting embodiments, the AC current control signal can include a variable pulse frequency control signal or a variable pulse phase control signal. In yet another alternative, the mirror control signal can be a digital control signal having characteristics of any suitable digital signal format. Non-limiting examples of digital mirror control signals may include serially encoded digital control signals or parallel control signals. Although the electronically controllable mirror 135 is described below in terms of control by a voltage, e.g., a DC voltage (see FIG. 3 and discussion below), it will be appreciated that any of the alternative electronic control signals, including analog voltages or currents, or digital control signals, are equally applicable.

[0045] The electronically controllable mirror 135 and the transparent mirror mount 133 may be mounted in a mirror support 131. The mirror support 131 may function to maintain a fixed and constant position and orientation of the electronically controllable mirror 135 relative to the active optical surfaces of the first optical imaging sensor 110 and the second optical imaging sensor 120. In some aspects, the electronically controllable mirror 135 may have a surface that receives incident light and reflects, transmits, or both reflects and transmits a portion of the incident light to the first optical imaging sensor 110 and / or the second optical imaging sensor 120. Furthermore, the reflective or transmissive surface of the electronically controllable mirror 135 may be spatially fixed relative to the body of the electronically controllable mirror 135 or the transparent mirror mount 133. The mirror support 131 may be constructed of any suitable structure or material to allow light passing through the imaging optics 102 to strike the light receiving surface of the electronically controllable mirror 135. The mirror support 131 may be constructed of any suitable structure or material to further allow light passing through the electronically controllable mirror 135 to impinge on a first active surface of the first optical imaging sensor 110, or light reflected by the electronically controllable mirror 135 to impinge on a second active surface of the second optical imaging sensor 120. For example, the mirror support 131 may be constructed of a solid, light-transmissive material in which the electronically controllable mirror 135 and the transparent mirror mount 133 may be embedded. Additional mechanical supports may be used to fix the position and orientation of the mirror support 131 within the camera system 100.

[0046] In some further aspects, the electronically controllable mirror 135 may also have additional optical properties. Such optical properties may include optical filtering properties. For example, the electronically controllable mirror 135 may optically filter light passing therethrough or reflected therefrom. Optical filtering functions include, but are not limited to, optical high-pass filtering, optical low-pass filtering, optical band-pass filtering, or optical notch filtering.

[0047] The amount of light that strikes the electronically controllable mirror 135 and is transmitted through or reflected from the electronically controllable mirror 135 may be determined by a mirror control signal applied to the electronically controllable mirror 135. As disclosed above, the mirror control signal may be described in terms of a control voltage signal (see FIG. 3 below), although alternative mirror control signals may be applied, including analog voltages or currents, or digital control signals. The mirror control signal applied to the electronically controllable mirror 135 may be provided by the mirror controller 134 via the mirror control signal conductors 132. The percent transmittance and percent reflectance of the light that strikes the electronically controllable mirror 135 may be a monotonic function of the mirror control signal applied to the electronically controllable mirror 135. Additional details regarding the transmittance / reflectance response of the electronically controllable mirror 135 are discussed further below with respect to FIG. 3.

[0048] In one aspect, the mirror control signal provided by the mirror controller 134 may be controlled by a mirror controller adjustment signal received from the camera system controller 140 via the mirror controller adjustment interface 138. In one aspect, the camera system controller 140 may automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from the first optical imaging sensor 110 and / or the second optical imaging sensor 120. Alternatively, the camera system controller 140 may automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from additional optical sensors. In a second aspect, the camera system controller 140 may send a manual mirror controller adjustment signal to control the mirror control signal applied to the electronically controllable mirror 135 based on a manual operation signal received from a user-operated input device. In one example, the user-operated input device may be in data communication with an input interface of the camera system controller 140. In a third aspect, the manual operation signal received from the user-operated input device may directly control the mirror controller 134 without going through the camera system controller 140.

[0049] An image obtained from the imaging data calculated by the camera system controller 140 based on the first optical imaging sensor data and the second optical imaging sensor data may be displayed on the image display system 150. The imaging data may be in any format suitable for display. Non-limiting formats may include grayscale, RGB, CMYK, HSI, YCbCr, or other suitable formats. The imaging data may be transmitted to the image display system 150 via a display system interface 158. The display system interface 158 may include any format suitable for transmitting imaging data, including a wired format (such as, but not limited to, Ethernet, FireWire, SCSI, MIPI, or USB) or a wireless format (such as, but not limited to, WiFi or Bluetooth formats).

[0050] Imaging data calculated by the camera system controller 140 may be transmitted via an imaging data interface 168 for use in one or more image data storage systems 160. The imaging data interface 168 may include any suitable format for transmitting imaging data, including wired formats (such as, but not limited to, Ethernet, FireWire, SCSI, MIPI, or USB), or wireless formats (such as, but not limited to, WiFi, Telecom, or Bluetooth formats). The image data storage system 160 may include a local data storage system (including removable storage media, such as a thumb drive, or fixed storage media, such as a fixed hard drive). The image data storage system 160 may also include a remote data storage system, such as a cloud-based data storage system. The image data storage system 160 may be used to archive imaging data over time. In some embodiments, the imaging data stored in the image data storage system 160 may be post-processed to include image enhancement, object recognition, or other manipulation of the imaging data. In some additional embodiments, the imaging data stored in the image data storage system 160 may be used by an external system, such as an airborne or ground mobile system. It will be appreciated that the camera system controller 140 can communicate imaging data directly to such external systems. As disclosed above, imaging data may include, but is not limited to, one or more image files or image characteristic data obtained from one or more images captured by the optical imaging sensor. Image characteristic data may include, but is not limited to, the brightness of the scene and small area, the position of one or more predefined objects in the image field, the contours of one or more objects in the image field, or other data characterizing objects in the image field. Optical imaging data may be acquired over a single frame or from multiple frames captured by the optical imaging sensor over time.

[0051] 2, non-limiting components of camera system controller 140 are shown. Camera system controller 140 may include one or more processors 200, memory units 202, 204, device interfaces 209, 208, 216, 226, 258, 268, and camera controller interfaces 218, 228, 238. The various components may be in data communication with one another via a system bus 206. These components are described in more detail below.

[0052] The one or more processors 200 may include general purpose processors and special purpose processors such as video processors or hardware accelerators. The general purpose processors may be used for overall control of the camera system 100, but are not limited thereto. In one example, the special purpose processors may be used for on-board image processing. In one aspect, the video processor may be used to create imaging data from the first optical imaging sensor data and the second optical imaging sensor data. In another example, the hardware accelerator may be used to pre-process the first optical imaging sensor data and the second optical imaging sensor data. In yet another example, the hardware accelerator may be used to post-process the imaging data. Non-limiting examples of such post-processing may include image enhancement, adjusting contrast or color palette, or identifying specific features within the imaging data, etc.

[0053] The system bus 206 may include any data bus structure configured to enable directed and bidirectional transmission of data among the various components of the camera system controller 140. Non-limiting examples of such data bus structures may include ISA, EISA, MCA, PCI, PCMCIA, SCSI, and the like.

[0054] The memory units may include a volatile memory unit 202 (e.g., RAM, vRAM, or similar device) and a non-volatile memory unit 204 (e.g., flash drive, ROM, EPROM, EEPROM, or similar device). The memory units 202, 204 may include instructions that, when executed by the one or more processors 200, cause the one or more processors 200 to control various components of the camera system controller 140 and / or various components and systems of the camera system 100. Non-limiting examples of such control signals may include control signals to the first sensor controller 114, the second sensor controller 124, the mirror controller 134, and first and second sensor operation control data for controlling the operation of the first and second optical imaging sensors 110 and 120, respectively. The memory units 202, 204 may also include instructions that, when executed by the one or more processors 200, cause the one or more processors 200 to process the first optical imaging sensor data, the second optical imaging sensor data, and the imaging data. The memory units 202, 204 may further include instructions that, when executed by the one or more processors 200, cause the one or more processors 200 to control the operation of the device interfaces 209, 208, 216, 226, 258, 268, and the camera controller interfaces 218, 228, 238. The volatile memory unit 202 may further be used for temporary memory storage of data used in processing the first optical imaging sensor data, the second optical imaging sensor data, and the imaging data.

[0055] The device interface may include a first optical imaging sensor interface 216 and a second optical imaging sensor interface 226. The first optical imaging sensor interface 216 may be configured to receive first optical imaging sensor data from the first optical imaging sensor 110 via the first optical imaging sensor data line 116. The first optical imaging sensor interface 216 may also be configured to transmit first sensor operation control data to the first optical imaging sensor 110 via the first optical imaging sensor data line 116. The first sensor operation control data may include, but is not limited to, data for controlling pixel readout timing, pixel blanking, or other operation of the first optical imaging sensor 110. The second optical imaging sensor interface 226 may be configured to receive second optical imaging sensor data from the second optical imaging sensor 120 via the second optical imaging sensor data line 126. The second optical imaging sensor interface 226 may also be configured to transmit second sensor operation control data to the second optical imaging sensor 120 via the second optical imaging sensor data line 126. The second sensor operation control data may include, but is not limited to, data for controlling pixel readout timing, pixel blanking, or other operation of the second optical imaging sensor 120. It will be understood that the first optical imaging sensor interface 216 and the second optical imaging sensor interface 226 are merely functionally defined. The first optical imaging sensor interface 216 and the second optical imaging sensor interface 226 may be composed of separate interface components or may be combined into a single interface component.

[0056] The memory units 202, 204 may include instructions that, when executed by the one or more processors 200, cause the one or more processors 200 to combine the first optical imaging sensor data and the second optical imaging sensor data to form imaging data based on various characteristics of the first optical imaging sensor data and the second optical imaging sensor data. In this manner, characteristics of the images acquired from the first optical imaging sensor 110 and the second optical imaging sensor 120 may be combined pixel by pixel into a single image characterized by the imaging data. In a non-limiting example, the first optical imaging sensor data acquired from the first optical imaging sensor 110 may include panchromatic imaging sensor data from an intensified imaging sensor. Such first imaging sensor data may be represented by pixel values ​​providing relative intensities on a grayscale palette. Furthermore, in this example, the second optical imaging sensor data acquired from the second optical imaging sensor 120 may include color imaging sensor data from a CCD or CMOS color imaging sensor. The second (color) image sensor data may be in any suitable format, such as RGB, CMYK, HSI, YCbCr, or other suitable format.

[0057] An exemplary method of combining characteristics of the first optical imaging sensor data and the second optical imaging sensor data may include converting the color format of the raw image based on the second optical imaging sensor data to HSI (hue, saturation, intensity) format. Hue and saturation data may be obtained from the second optical imaging sensor data, while intensity data may be obtained from the first optical imaging sensor data. Alternatively, intensity data may be obtained from a combination of the first optical imaging sensor data and the second optical imaging sensor data. In this way, a color image may be calculated under low light conditions where the color imaging sensor does not operate, as well as when operating under optimal light capture conditions. It will be appreciated that when the illumination of the optical imaging sensor is sufficiently low or very low, the second optical imaging sensor will not generate useful data. Under such illumination conditions, the imaging data may be based only on the first optical imaging sensor data. Similarly, when the illumination of the optical imaging sensor is sufficiently high or very high, the first optical imaging sensor may be intentionally disabled to prevent damage, and therefore no data of the first optical imaging sensor is generated. Under such illumination conditions, the imaging data may be based solely on data from the second optical imaging sensor.

[0058] The device interface may also include a user operated input device interface 208 and a user output device interface 209. The user operated input device interface 208 may receive data from a user of the camera system 100. The user operated input device may include, but is not limited to, a mouse, a touch screen display, a keyboard, a voice activated device, a stylus, a joystick, a control knob, or other devices that a user may use to provide input signals for operation of the camera system 100. In one non-limiting aspect, a user may use a keyboard to input operational instructions to the camera system controller 140 related to the operation of the first sensor controller 114, the second sensor controller 124, and / or the mirror controller 134. In this manner, the user may control signals for operating the first optical imaging sensor 110, the second optical imaging sensor 120, or the electronically controllable mirror 135. Additionally, the user may specify the percent transmittance and reflectance of the electronically controllable mirror 135. A user can further specify the operation of the first optical imaging sensor 110 and the second optical imaging sensor 120, for example, by setting the frame capture rate. A user can further specify the output of the imaging data to either the image display system 150 or the image data storage system 160.

[0059] The user output device interface 209 can be used to send data to a system or device used by a user. In one example, if the camera system controller 140 includes instructions for analyzing imaging data and identifying features within the imaging data, the camera system controller 140 can provide alarm data via the output device interface 209 to a visual or audio alarm device (e.g., an LED or buzzer) if an undesirable feature is detected. Both the user operated input device interface 208 and the user operated output device interface 209 can interface with a standalone computing system or an embedded computing system. Such computing systems can include, but are not limited to, a workstation, a laptop computer, a tablet computer, or a smartphone. It will be appreciated that the user operated input device interface 208 and the user output device interface 209 can be any type of interface for their respective purposes, such as a serial interface, a parallel interface, an optical interface, a wireless interface, among others. Alternatively, the user operated input device interface 208 and the user output device interface 209 can be integrated into a single physical user device interface.

[0060] In another aspect, the user operated input device interface 208 and the user output device interface 209 may be used by an external system for automated use of the camera system 100. One non-limiting example of such an external system may include an autonomous vehicle. In this aspect, the external automation system may receive the imaging data, determine appropriate changes to the functionality of the camera system controller 140, and provide appropriate input signals for operation of the camera system 100 via the user operated input device interface 208. The input signals may include any data capable of controlling the operation of the camera system controller 140, including control of the electronically controllable mirror 135. The input signals to the camera system controller 140 may be sent as input signals mirror controller adjustment signals to the mirror controller 134. Similarly, the external automation system may receive alarm data as disclosed above via the user output device interface 209. However, it will be appreciated that the external automation system may receive alarm data and send input signals for operation of the camera system 100 via separate external device input interfaces and separate external device output interfaces. Alternatively, an external automation system can both receive and transmit data to the camera system controller 140 via a multiple external device interface.

[0061] The device interface may further include an image output interface 258 and a data output interface 268. The imaging data may be transmitted to the image display system 150 via the image output interface 258. The image output interface 258 may be in data communication with the display system interface 158. The imaging data may also be transmitted to the image data storage system 160 via the data output interface 268. The data output interface 268 may be in data communication with the imaging data interface 168. Both the image output interface 258 and the data output interface 268 may have interface characteristics appropriate to their respective functions, as disclosed above.

[0062] The camera controller interfaces 218, 228, 238 may be used to provide control signals to associated optical device controllers. Thus, the first sensor controller 114 may be controlled by data provided by the camera system controller 140 via a data connection between the first sensor camera controller interface 218 and the first sensor controller interface 118. Similarly, the second sensor controller 124 may be controlled by data provided by the camera system controller 140 via a data connection between the second sensor camera controller interface 228 and the second sensor controller interface 128. For example, data transmitted via the first sensor camera controller interface 218 and the second sensor camera controller interface 228 may enable or disable signals provided by the first sensor controller 114 and the second sensor controller 124 to the respective optical imaging sensors (110 and 120, respectively). The mirror controller interface 238 may transmit mirror control signal data to the mirror controller 134 via the mirror controller adjustment interface 138. The mirror control signal data instructs the mirror controller 134 to provide signals to the electronically controllable mirror 135 so as to control the transmittance and / or reflectance of light impinging on the electronically controllable mirror 135 .

[0063]

[0033] Referring now to Figure 3, Figure 3 illustrates an example graph 300 showing the percent transmittance and percent reflectance of light incident on the electronically controllable mirror 135 as a function of an example mirror control signal applied to the electronically controllable mirror 135 by the mirror controller 134. Without loss of generality, the example mirror control signal illustrated in Figure 3 is a mirror control voltage. However, it will be understood that Figure 3 illustrates a response to any mirror control signal that can produce a monotonic response of the electronically controllable mirror 135 over a range of values ​​of the mirror control signal. In particular, a percent transmittance response curve 304 is illustrated along with a percent reflectance response curve 302. Although the percent transmittance response curve 304 and the percent reflectance response curve 302 are illustrated as being linearly dependent on the mirror control voltage applied to the electronically controllable mirror 135 by the mirror controller 134, it will be understood that alternative percent transmittance response curves and percent reflectance response curves may include continuously monotonic relationships with respect to the applied mirror control voltage. Thus, for example, the percent reflectance response curve 302 has a constant negative slope with respect to the applied mirror control voltage, and the percent transmittance response curve 304 has a constant positive slope with respect to the applied mirror control voltage. It will be appreciated that in some alternatives, the percent reflectance response curve 302 may have a positive slope with respect to the applied mirror control voltage, and the percent transmittance response curve 304 may have a negative slope with respect to the applied mirror control voltage. In some aspects, the alternative percent transmittance and percent reflectance response curves may include plateau regions at the low and / or high ends of the respective response curves. It will be appreciated that the monotonic portions between such plateau regions of the alternative percent transmittance and percent reflectance response curves may constitute valid operating zones for control of the electronically controllable mirror 135.

[0064] Regardless of the exact shapes of the percent transmittance response curve 304 and the percent reflectance response curve 302, both the percent transmittance response curve 304 and the percent reflectance response curve 302 are continuous and monotonic with respect to the mirror control voltage applied to the electronically controllable mirror 135 over their respective useful operating zones. In this manner, both the percent reflectance and percent transmittance of light can be continuously varied over a range of applied voltages. The mirror control voltage range that defines the useful operating zone can be defined by a minimum voltage (Vmin) and a maximum voltage (Vmax).

[0065] The percent reflectance response curve 302 may vary between a minimum percent reflectance (Rmin) and a maximum percent reflectance (Rmax). In one non-limiting example, the minimum percent reflectance (Rmin) may have a value of about 10% in the absence of an anti-reflective coating and a value of about 3% in the presence of an anti-reflective coating. In one non-limiting example, the maximum percent reflectance (Rmax) may have a value greater than about 87%. Similarly, the percent transmittance response curve 304 may vary between a minimum percent transmittance (Tmin) and a maximum percent transmittance (Tmax). In one non-limiting example, the minimum percent transmittance (Tmin) may have a value less than about 1%. In one non-limiting example, the maximum percent transmittance (Tmax) may have a value greater than about 87% in the absence of an anti-reflective coating and a value greater than about 95% in the presence of an anti-reflective coating. In some additional non-limiting examples, the electronically controllable mirror 135 may effectively operate using incident light within a spectral range of about 400 nm to about 5,000 nm. In some alternative non-limiting examples, the electronically controllable mirror 135 can effectively operate using incident light in a spectral range of about 500 nm to about 1,000 nm. In some further non-limiting examples, the electronically controllable mirror 135 can effectively operate using incident light in a spectral range of about 400 nm to about 1,100 nm. In some further non-limiting examples, the mirror control voltage applied to the electronically controllable mirror 135 can be continuously varied between a Vmax value of about 260 V and a Vmin value of about 100 V.

[0066] The percent reflectance and percent transmittance of the electronically controllable mirror 135 can be readily controlled by applying a mirror controller adjustment signal to the mirror controller 134. As discussed above, the mirror controller adjustment signal can originate from the camera system controller 140. In an automatic mode, the camera system controller 140 can automatically control the mirror control signal applied to the electronically controllable mirror 135 based on signals received from one or more of the first optical imaging sensor 110, the second optical imaging sensor 120, or another illumination sensor. In one aspect, the camera system controller 140 can determine an illuminance value of light impinging on all or a portion of the first optical imaging sensor 110, the second optical imaging sensor 120, or another illumination sensor.

[0067] The camera system controller 140 can store data regarding operational parameters associated with one or more of the first optical imaging sensor 110 or the second optical imaging sensor 120. Such data can include an optimal or maximum range of illumination conditions for operation of each optical imaging sensor. The camera system controller 140 can determine the amount of illumination that is directed to the first optical imaging sensor 110 and the second optical imaging sensor 120 out of the total illumination that strikes the electronically controllable mirror 135. In some aspects, the camera system controller 140 can include data regarding illumination conditions that may cause the first optical imaging sensor 110 to fail or be damaged, such as high illumination conditions. Under such illumination conditions, the mirror controller 134 can receive instructions to generate a mirror control signal to place the electronically controllable mirror 135 in a state that directs light away from the first optical imaging sensor 110.

[0068] The camera system controller 140 can generate the mirror controller adjustment signals necessary to adjust the transmittance and reflectance of the electronically controllable mirror 135 to optimize the first optical imaging sensor data and the second optical imaging sensor data. The camera system controller 140 can further store data related to the percent reflectance response curve 302 and the percent transmittance response curve 304 of the electronically controllable mirror 135. Such data can be stored as look-up tables or analytical expressions. The camera system controller 140 can use the response curve data along with the look-up table or analytical expressions to generate values ​​for the mirror controller adjustment signals received by the mirror controller 134. It will be appreciated that the camera system controller 140 can continually monitor the total illuminance impinging on the electronically controllable mirror 135 over time and continually adjust the mirror controller adjustment signals as the total illuminance increases (e.g., as sunlight increases) or decreases (e.g., as sunlight decreases). It will be appreciated that in order for the camera system controller 140 to continuously adjust the reflectance and transmittance of the illumination incident on the first optical imaging sensor 110 and the second optical imaging sensor 120, electronically controllable mirrors that are continuously responsive to applied mirror control signals are required.

[0069] In another example of an automatic operation mode of the camera system 100, the camera system 100 can be activated to direct light impinging on the electronically controllable mirror 135 to a CMOS or CCD color imaging sensor (either the first optical imaging sensor 110 or the second optical imaging sensor 120). In this way, the image intensification sensor is not exposed to high intensity light upon initialization (activation). The camera system controller 140 can determine if the light impinging on the color imaging sensor is below the operating threshold of the color imaging sensor and automatically adjust the mirror controller adjustment signal to direct an amount of the incident light to the image intensification sensor.

[0070] In another aspect, the mirror controller adjustment signal may originate from a manual operation signal controlled by a user of the camera system 100. The mirror controller adjustment signal may be sent directly to the mirror controller 134 or may be sent to the camera system controller 140 via the user-operated input device interface 208. The manual operation signal may be limited to a finite number of control values ​​(e.g., via a user-actuated switch) or may be continuously variable over a range of values. In another aspect, the manual operation signal sent to the camera system controller 140 via the user-operated input device interface 208 may be combined with the mirror controller adjustment signal generated by the camera system controller 140. In this way, the user can manually adjust or override the mirror controller adjustment signal generated by the camera system controller 140.

[0071] 4-6, which illustrate an exemplary operation of the camera system 100 based on illumination impinging on the electronically controllable mirror 135. FIG. 4 illustrates the operation 400 of the camera system 100 under high illumination conditions. Under high illumination conditions, light may enter the camera system 100 via the imaging optics 102. The light 402 conditioned by the imaging optics 102 may impinge on a surface of the electronically controllable mirror 135. The electronically controllable mirror 135 may receive a mirror control signal to maximize the reflectance of the conditioned light 402. The reflected light 404 may be directed to an active surface of the second optical imaging sensor 120, which may be a CCD or CMOS color sensor. As disclosed above, it will be appreciated that the electronically controllable mirror 135 under maximum reflectance control may still transmit light 406 to the active surface of the first optical imaging sensor 110, although the transmitted light 406 may represent a small amount of light impinging on the surface of the electronically controllable mirror 135.

[0072] 5 illustrates the operation 500 of the camera system 100 under moderate illumination conditions. Under moderate illumination conditions, light may enter the camera system 100 via the imaging optics 102. The light 402 conditioned by the imaging optics 102 may strike a surface of the electronically controllable mirror 135. The electronically controllable mirror 135 may receive a mirror control signal to reflect and transmit a portion of the conditioned light 402. The reflected light 404 may be directed to an active surface of the second optical imaging sensor 120, which may be a CCD or CMOS color sensor. The transmitted light 506 may be directed to an active surface of the first optical imaging sensor 110, which may be an image intensification sensor.

[0073] 6 illustrates the operation 600 of the camera system 100 under low light conditions. Under low light conditions, light may enter the camera system 100 through the imaging optics 102. The light 402 conditioned by the imaging optics 102 may strike a surface of the electronically controllable mirror 135. The electronically controllable mirror 135 may receive a mirror control signal to allow maximum transmission of the conditioned light 402. The transmitted light 506 may be directed to an active surface of the first optical imaging sensor 110, which may be an image intensification sensor. As disclosed above, it will be appreciated that the electronically controllable mirror 135 under maximum transmission control may still reflect the light 604 to the active surface of the second optical imaging sensor 120, although the reflected light 604 may represent a small amount of light that strikes the surface of the electronically controllable mirror 135.

[0074] As discussed above, the relative placement of the image intensifying sensor and the CCD or CMOS color sensor with respect to the electronically controllable mirror 135 can be swapped. Thus, the first optical imaging sensor 110 can be a CCD or CMOS color sensor. In this configuration, FIG. 6 can be for high light conditions where the electronically controllable mirror 135 transmits maximum modulated light 402 to the CCD or CMOS color sensor. Similarly, the second optical imaging sensor 120 can be an image intensifying sensor. In this configuration, FIG. 4 can be for low light conditions where the electronically controllable mirror 135 reflects maximum modulated light 402 to the image intensifying sensor.

[0075] It is important to note that the configuration and arrangement of the various exemplary embodiments are illustrative only. Although only a few embodiments have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications (e.g., changes in size, dimensions, structure, shape and proportions of various elements, parameter values, mounting arrangements, use of materials, colors, orientations, etc.) are possible without substantially departing from the novel teachings and advantages of the subject matter described herein. For example, elements shown as integrally formed may be composed of multiple parts or elements, the location of elements may be reversed or otherwise changed, and the nature or number of individual elements or locations may be changed or altered. The order or sequence of any process or method steps may be changed or resequenced according to alternative embodiments. Furthermore, features of certain embodiments may be combined with features of other embodiments as will be understood by those skilled in the art. Other substitutions, modifications, changes, and omissions may also be made in the design, operating conditions, and arrangements of the various exemplary embodiments without departing from the scope of the invention.

[0076] As used herein, the terms "about," "approximately," "substantially," "generally," and the like, mean plus or minus 10% of the stated value or range. Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise. The term "and / or" includes any and all combinations of one or more of the associated listed items. For example, reference to a "feature" includes a plurality of such "features." The term "and / or" used in the context of "X and / or Y" shall be interpreted as "X," or "Y," or "X and Y."

[0077] Moreover, even if a particular number in an introduced claim is explicitly recited, one of ordinary skill in the art will recognize that such recitation should typically be interpreted to mean at least the recited number (e.g., the mere recitation of "two recitations" without other qualifiers typically means at least two recitations, or more than two recitations). Furthermore, when a phrase similar to "at least one of A, B, and C, etc." is used, such a configuration is generally intended in the sense that one of ordinary skill in the art would understand the phrase (e.g., "a system having at least one of A, B, and C, etc." includes, but is not limited to, systems having only A, only B, only C, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). When phrases similar to "at least one of A, B, or C, etc." are used, such a configuration is generally intended in the sense that one of ordinary skill in the art would understand the phrase (e.g., "a system having at least one of A, B, and C, etc." includes, but is not limited to, systems having A only, B only, C only, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). One of ordinary skill in the art will further appreciate that typically, whether in the detailed description, claims, or drawings, separator words and / or phrases presenting two or more alternative terms should be understood to contemplate the possibility of including one of the terms, either of the terms, or both terms, unless the context dictates otherwise. For example, the phrase "A or B" will typically be understood to include the possibilities of "A" or "B" or "A and B."

[0078] The embodiments described and illustrated in the detailed description, drawings, and claims are not intended to be limiting. Other embodiments may be used, and other changes may be made, without departing from the spirit or scope of the subject matter presented herein. Moreover, certain aspects of each embodiment may also be used in combination with other embodiments of the disclosure, and thus the disclosed embodiments may be combined as understood in the art. It will be readily understood that the aspects of the disclosure as generally described and illustrated in the figures herein can be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are expressly contemplated herein.

[0079] It should be noted herein that when the term "example" is used to describe various embodiments, it is intended to indicate that such embodiments are possible examples, representations, and / or illustrations of possible embodiments (such terms are not intended to imply that such embodiments are necessarily particular or superlative examples). Furthermore, the term "substantially" and similar terms as used herein are intended to have a broad meaning consistent with common and accepted usage by those of ordinary skill in the art to which the subject matter of the present disclosure pertains. Those of ordinary skill in the art who review this disclosure should understand that these terms are intended to enable the description of certain features described and claimed without limiting the scope of those features to the precise numerical ranges provided. Thus, these terms should be interpreted as indicating that insubstantial or insignificant modifications or variations of the subject matter described and claimed (e.g., within plus or minus 5 percent of a given angle or other value) are considered to be within the scope of the invention as set forth in the appended claims. The term "approximately" when used in relation to a value means plus or minus 5 percent of the associated value.

[0080] As used herein, terms such as "coupled" mean that two members are directly or indirectly coupled to one another. Such coupling may be fixed (e.g., permanent) or movable (e.g., removable or releasable). Such coupling may be achieved by the two members or the two members and an additional intermediate member being integrally formed with one another as a single unitary body, or by the two members or the two members and an additional intermediate member being attached to one another.

[0081] It should be understood that the illustrated architectures, in which different components are contained within or connected to other different components, are merely examples, and that in fact many other architectures that achieve the same functionality can be implemented. In a conceptual sense, any arrangement of components to achieve the same functionality will effectively be "associated" such that the desired functionality is achieved. Thus, any two components combined herein to achieve a particular functionality can be considered to be "associated" with each other such that the desired functionality is achieved, regardless of the architecture or intermediate components. Similarly, any two components so associated can also be considered to be "operably connected" or "operably coupled" to each other to achieve the desired functionality. Also, any two components that can be so associated can also be considered to be "operably coupled" to each other to achieve the desired functionality. Particular examples of operably coupleable components include, but are not limited to, physically matable and / or physically interacting components, and / or wirelessly interacting components, and / or wirelessly interacting components, and / or logically interacting components, and / or logically interacting components, and / or electrically interacting components, and / or electrically interacting components, and / or optically interacting components, and / or optically interacting components.

[0082] It should be noted that while the figures herein show a particular order and arrangement of method steps, the order of these steps may differ from that depicted. For example, two or more steps may be performed simultaneously or with partial concurrence. Also, some of the method steps performed as separate steps may be combined, steps performed as combined steps may be separated into separate steps, the sequence of certain processes may be reversed or otherwise altered, and the nature or number of separate processes may be changed or modified. The order or sequence of any elements or equipment may be altered or substituted in accordance with alternative embodiments. Accordingly, all such modifications are intended to be included within the scope of this disclosure, as defined by the appended claims.

[0083] Without further elaboration, it is believed that those skilled in the art can use the above description to make the most of the claimed invention. The examples and embodiments disclosed herein should be construed as merely illustrative and not limiting the scope of the present disclosure in any way. Those skilled in the art will appreciate that the details of the above-described embodiments can be modified without departing from the basic principles discussed. In other words, various modifications and improvements of the embodiments specifically disclosed in the above description are within the scope of the appended claims. For example, any suitable combination of features of the various embodiments described is contemplated.

[0084] Those skilled in the art will recognize that the components (e.g., operations), devices, objects, and accompanying descriptions described herein are used as examples for conceptual clarity, and that various configuration changes are contemplated. As a result, the specific examples used herein and the accompanying discussion are intended to be representative of their more general classes. In general, the use of a specific example is intended to be representative of its class, and the absence of a particular component (e.g., operation), device, or object should not be construed as limiting.

[0085] Furthermore, although several embodiments have been illustrated and described, it is not the intention of the applicant to restrict or limit the scope of the appended claims to such details. Numerous modifications, variations, changes, substitutions, combinations, and equivalents to these embodiments may be implemented and will occur to those skilled in the art without departing from the scope of the present disclosure. Furthermore, the structure of each element associated with the described embodiments may alternatively be described as a means for providing the function performed by the element. Also, even when specific component materials are disclosed, other materials may be used. Therefore, it should be understood that the above description and the scope of the appended claims are intended to cover all such modifications, combinations, and variations that are within the scope of the disclosed embodiments. The appended claims are intended to cover all such modifications, variations, changes, substitutions, modifications, and equivalents.

[0086] For brevity and clarity of disclosure, selected aspects of the above disclosure are shown in block diagram form rather than detailed. Some of the detailed descriptions provided herein may be presented in the form of instructions operating on data stored in one or more computer memories or one or more data storage devices (e.g., floppy disks, hard disk drives, solid state drives, compact disks (CDs), digital video disks (DVDs), digital tapes, etc.). Such descriptions and representations are used by those skilled in the art to describe and convey the substance of their work to others skilled in the art. An algorithm generally refers to a self-consistent sequence of steps that lead to a desired result. Here, the "steps" refer to manipulations of physical quantities and / or logical states, which may, but need not, take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It is common to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. These and similar terms may be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities and / or states.

[0087] Unless otherwise specifically stated as is apparent from the above disclosure, throughout the above disclosure, discussions using terms such as "processing" or "computing" or "calculating" or "determining" or "displaying" are understood to refer to operations and processes of a computer system or similar electronic computing device that manipulates and transforms data represented as physical (electronic) quantities in the computer system's registers and memory to other data also represented as physical quantities in the computer system's memory or registers or other information storage, transmission, or display device.

[0088] In a general sense, those skilled in the art will recognize that the various aspects described herein may be individually and / or collectively implemented by a wide range of hardware, software, firmware, or any combination thereof, and may be considered to be comprised of various types of "electrical circuitry." As a result, "electrical circuitry" as used herein includes, but is not limited to, electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, electrical circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program that at least partially executes the processes and / or devices described herein, or a microprocessor configured by a computer program that at least partially executes the processes and / or devices described herein), electrical circuitry forming a memory device (e.g., a form of random access memory), and / or electrical circuitry forming a communication device (e.g., a modem, a communication switch, or an optoelectronic device). Those skilled in the art will appreciate that the subject matter described herein may be implemented in analog or digital form, or a combination thereof.

[0089] In the above detailed description, various forms of devices and / or processes have been described using block diagrams, flow charts, and / or examples. To the extent that such block diagrams, flow charts, and / or examples include one or more functions and / or operations, those skilled in the art will appreciate that each function and / or operation within such block diagrams, flow charts, and / or examples can be implemented individually or collectively by various hardware, software, firmware, or any combination thereof. In one form, some portions of the subject matter described herein can be implemented via an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), or other integrated form. However, those skilled in the art will recognize that some aspects of the embodiments disclosed herein may equivalently be implemented, in whole or in part, as integrated circuits, one or more computer programs running on one or more computers (e.g., one or more programs running on one or more computer systems), one or more programs running on one or more processors (e.g., one or more programs running on one or more microprocessors), firmware, or substantially any combination thereof, and that in light of this disclosure, designing the circuitry and / or writing the software and / or firmware code is within the skill of one of ordinary skill in the art. Furthermore, those skilled in the art will recognize that the subject mechanisms described herein can be distributed in a variety of forms as one or more program products, and that the exemplary embodiments of the subject matter described herein apply regardless of the particular type of signal-bearing medium used to actually effect the distribution. Examples of signal bearing media include, but are not limited to, recordable media such as floppy disks, hard disk drives, compact disks (CDs), digital video disks (DVDs), digital tape, computer memory, and transmission media such as digital and / or analog communications media (e.g., fiber optic cables, wave guides, wired communications links, wireless communications links, and the like (e.g., transmitters, receivers, transmitting logic, receiving logic, etc.)).

[0090] In other examples, one or more components may be referred to herein as being "configured," "configurable," "operable," "adaptable," "enabled," "adapted," etc. Those skilled in the art will recognize that "configured" can generally encompass active components and / or inactive components and / or standby components, unless the context dictates otherwise.

[0091] Although specific aspects of the present disclosure have been shown and described, it will be apparent to one skilled in the art that, based on the teachings herein, changes and modifications can be made without departing from the subject matter described herein and its broader aspects, and thus, the appended claims encompass within their scope all such changes and modifications that are within the true scope of the subject matter described herein. Those skilled in the art will generally understand that the terms used in this specification, and particularly in the appended claims (e.g., the body of the appended claims), are generally intended as "open" terms (e.g., the term "including" should be interpreted as "including but not limited to," the term "having" should be interpreted as "having at least," the term "including" should be interpreted as "including but not limited to," etc.). Those skilled in the art will further understand that when a particular number of introduced claim recitations are intended, such intent will be expressly set forth in the claim, and in the absence of such recitation, no such intent exists. For example, to aid in understanding, the following appended claims may include the use of the introductory phrases "at least one" and "one or more" to introduce the claim recitations. However, the use of such phrases should not be construed as meaning that introducing a claim recitation with the indefinite article "a" or "an" limits a particular claim that contains a claim recitation so introduced to those claims that contain only one such recitation, even if the same claim contains the introductory phrase "one or more" or "at least one" and an indefinite article such as "a" or "an" (e.g., "a" or "an" should ordinarily be interpreted to mean "at least one" or "one or more"). The same applies to the use of definite articles used to introduce claim recitations.

[0092] With respect to the appended claims, those skilled in the art will appreciate that the operations described therein may generally be performed in any order. Also, while various operational flows are shown in a sequential order, it should be understood that various operations may be performed in orders other than those depicted, or may be performed simultaneously. Examples of such alternative orders may include overlapping, interleaving, interrupting, reordering, incrementing, preparing, supplementing, simultaneous, reversing, or other variant orders, unless the context dictates otherwise. Moreover, terms such as "responsive," "related to," or other past tense adjectives generally do not exclude such variants, unless the context dictates otherwise.

[0093] It is worth noting that a reference to "one embodiment," "an embodiment," "one form," or "a form" means that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment. Thus, the appearances of the phrases "one embodiment," "an embodiment," "one form," or "a form" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0094] With respect to the use of substantially any plural and / or singular term herein, those skilled in the art can convert from plural to singular and / or from singular to plural as appropriate to the context and / or application. For the sake of clarity, the various singular / plural permutations have not been explicitly set forth herein.

[0095] In some cases, use of the system or method may occur within a domain even if components are outside the domain. For example, in the context of distributed computing, use of a distributed computing system may occur within a domain even if parts of the system are outside the domain (e.g., relays, servers, processors, signaling media, sending computers, receiving computers, etc., that are outside the domain).

[0096] In summary, numerous advantages have been described that accrue from employing the concepts described herein. The above description of one or more forms has been presented for purposes of illustration and description. It is not intended to be exhaustive or to be limited to the precise forms disclosed. Modifications or variations are possible in light of the above teachings. The one or more forms have been selected and described in order to explain the principles and practical applications, thereby enabling one skilled in the art to utilize various forms and various modifications suited to the particular use contemplated. It is intended that the claims submitted herein define the overall scope.

Claims

1. 1. A camera system, comprising: a first optical imaging sensor; a second optical imaging sensor; and an electronically controllable mirror system; The electronically controllable mirror system comprises: an electronically controllable mirror disposed at a fixed position relative to the first optical imaging sensor and the second optical imaging sensor; a mirror controller for controlling a mirror control signal applied to the electronically controllable mirror; the electronically controllable mirror system transmits a first portion of incident light through the electronically controllable mirror to the first optical imaging sensor and reflects a second portion of the incident light by the electronically controllable mirror to the second optical imaging sensor based on the mirror control signal. Camera system.

2. The camera system further includes a camera system controller, the camera system controller comprising: A processor; a memory unit, The memory unit contains instructions that, when executed by the processor, cause the processor to: receiving first optical imaging sensor data from the first optical imaging sensor; and The camera system of claim 1 , further comprising: receiving second optical imaging sensor data from the second optical imaging sensor.

3. The memory unit further includes instructions that, when executed by the processor, cause the processor to further: The camera system of claim 2 , further comprising: a first optical imaging sensor data characteristic and a second optical imaging sensor data characteristic that cause imaging data to be calculated.

4. The memory unit further includes instructions that, when executed by the processor, cause the processor to further: The camera system of claim 3 , further comprising: a camera unit configured to transmit the imaging data to an image display system, a data storage system, or an external system.

5. The memory unit further includes instructions that, when executed by the processor, cause the processor to further: The camera system of claim 2 , further comprising: causing a mirror controller adjustment signal to be sent to the mirror controller based at least in part on the first optical imaging sensor data or the second optical imaging sensor data.

6. The memory unit further includes instructions that, when executed by the processor, cause the processor to further: receiving a manual operation signal from a user operated input device; and The camera system of claim 2 , further comprising a manual mirror controller adjustment signal transmitted to the mirror controller.

7. The memory unit further includes instructions that, when executed by the processor, cause the processor to further: receiving an input signal from an external device; and The camera system of claim 2 , further comprising: an input data mirror controller that transmits an adjustment signal to the mirror controller.

8. The camera system of claim 1 , wherein the first optical imaging sensor is an intensified imaging sensor.

9. The camera system of claim 1 , wherein the second optical imaging sensor is a color imaging sensor.

10. The camera system of claim 1 , wherein the electronically controllable mirror includes a surface that is spatially fixed relative to a body of the electronically controllable mirror for receiving the incident light.

11. the electronically controllable mirror is continuously adjustable between a maximum percent transmittance state and a minimum percent transmittance state; The camera system of claim 1 , wherein the electronically controllable mirror is continuously adjustable between a maximum percent reflectance state and a minimum percent reflectance state.

12. The camera system of claim 11 , wherein the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percent transmittance state and a mirror control signal value corresponding to the maximum percent transmittance state.

13. 12. The camera system of claim 11, wherein the mirror control signal is continuously variable between a mirror control signal value corresponding to the minimum percent reflectance state and a mirror control signal value corresponding to the maximum percent reflectance state.

14. The camera system of claim 1 , wherein the mirror control signal comprises a mirror control voltage.

15. 1. A method for generating a color image, the method comprising: Receiving incident light at a surface of an electronically controllable mirror; a camera system controller controlling the electronically controllable mirror to direct a first portion of the incident light to impinge on a first optical imaging sensor and a second portion of the incident light to impinge on a second optical imaging sensor; receiving first optical imaging sensor data from the first optical imaging sensor by the camera system controller; the camera system controller receiving second optical imaging sensor data from the second optical imaging sensor; the electronically controllable mirror is disposed in a fixed position relative to the first optical imaging sensor and the second optical imaging sensor; the surface of the electronically controllable mirror is spatially fixed relative to a body of the electronically controllable mirror; method.

16. The step of the camera system controller controlling the electronically controllable mirror includes: The method of claim 15 , comprising controlling the electronically controllable mirror based at least in part on the first optical imaging sensor data or the second optical imaging sensor data.

17. the camera system controller further calculating imaging data from the first optical imaging sensor data and the second optical imaging sensor data; The method of claim 15 , wherein the imaging data includes a characteristic of the first optical imaging sensor data and a characteristic of the second optical imaging sensor data.

18. The method of claim 17 , further comprising the step of the camera system controller transmitting the imaging data to an image display system, an image data storage system, or an external device.

19. receiving a manual operation signal from a user operated input device by the camera system controller; The method of claim 15 , further comprising the step of the camera system controller controlling the electronically controllable mirror based at least in part on the manual operation signal.

20. the camera system controller receiving an input signal from an external device; The method of claim 15 , further comprising the step of: the camera system controller controlling the electronically controllable mirror based at least in part on the input signal from the external device.

Images