Augmented Vision System

Abstract

The present invention relates to an augmented vision system (200) for a platform operator, comprising an enhanced vision device (220) for sensing a predetermined band of electromagnetic, EM, radiation in the operator's field of view and generating an enhanced visual image, a tracking system for detecting the platform operator's field of view, wherein the tracking system comprises at least one EM radiation source (210) operable within the predetermined band of EM radiation, a display system (204) for overlaying the enhanced visual image on the platform operator's field of view (206), and a switching circuit (240) configured to control activation of the enhanced vision device or to control activation of an EM radiation source in the tracking system, such that either the enhanced vision device is sensing EM radiation in the field of view and the EM radiation source (210) in the tracking system is inactive, or the EM radiation source (210) in the tracking system is active and the enhanced vision device is inactive.

Description

[Technical Field]

[0001] The present invention relates to an augmented vision system, and more particularly to an augmented vision system for a platform operator, a vehicle equipped with an augmented vision system, and a method of operating an augmented vision system. [Background technology]

[0002] A camera may be sensitive to certain bands of electromagnetic radiation, such as infrared radiation. For example, if such a camera captures a field of view while exposed to infrared radiation, the infrared radiation may be within the camera's field of view, resulting in a corrupted image. The quality of the image received from the camera may be undesirable. Occasionally, such interaction between electromagnetic radiation and the camera may lead to a catastrophic failure of the entire system. For example, in an aviation system, a pilot may wear a helmet equipped with infrared emitters, and these infrared emitters may interact with a camera whose field of view the helmet is within. This interaction may result in undesirable image quality. If the camera is a night vision camera, the camera operates in low levels of ambient light and is sensitive to infrared radiation. The present invention aims to address the above-mentioned problems with camera systems. Summary of the Invention

[0003] According to one aspect of the present invention, there is provided an augmented vision system for a platform operator, comprising: an enhanced vision device for sensing a predetermined band of electromagnetic, EM, radiation in a field of view of the platform operator and generating enhanced vision imagery; a tracking system for detecting the field of view of the platform operator, wherein the tracking system comprises at least one source of EM radiation operable within the predetermined band of EM radiation; a display system for overlaying the enhanced vision imagery on the field of view of the platform operator; and switching circuitry configured to control activation of the enhanced vision device or to control activation of the EM radiation source in the tracking system, such that either the enhanced vision device is sensing EM radiation in the field of view and the EM radiation source in the tracking system is inactive, or the EM radiation source in the tracking system is active and the enhanced vision device is inactive.

[0004] In this way, undesired interactions between the EM radiation source and the enhanced vision device are prevented. The operating speeds of both the tracking system and the enhanced vision device can be optimized to produce the accurate data needed to operate the platform in a safe, efficient, and effective manner.

[0005] Preferably, the switching circuit defines a first period and a first duty cycle for activation of the enhanced vision device and a second period and a second duty cycle for activation of the EM radiation source of the tracking system to synchronize activation and deactivation.

[0006] In this way, the operating speeds of the individual parts of the augmented vision system can be optimized and controlled in a more sophisticated way without compromising the overall performance of the augmented vision system.

[0007] Preferably, the enhanced vision device comprises a camera with a shutter that cycles between a closed and an open state, and at least one EM radiation source in the tracking system is configured to generate pulses of EM radiation in synchronization with the closed state of the shutter. Preferably, the shutter is an electronic shutter or a mechanical shutter.

[0008] In this way, the at least one EM radiation source is synchronized with a period in the camera shutter during which the camera is not sensitive to extraneous light, avoiding undesired interactions.

[0009] Preferably, the first duty cycle is about 90% and the second duty cycle is about 10%. Preferably, the first period is in the range of 5 to 40 milliseconds.

[0010] In this way, the speed of operation of the at least one EM radiation source is reduced, saving computational costs.

[0011] Preferably, the second period of time is substantially equal to the first period of time.

[0012] In this way, the full cycle of operation (e.g., on and off) of the at least one EM radiation source and the night vision system is substantially equal: a single pulse of the at least one EM radiation source occurs per camera video cycle, thereby optimizing the operating speed of the augmented vision system.

[0013] Preferably, the enhanced vision device is a night vision device. The night vision device optionally comprises at least one of a night vision camera, a night vision eyepiece, and / or night vision goggles. Preferably, the night vision device comprises a short wave infrared camera. Preferably, the predetermined band of EM radiation sensed by the enhanced vision device comprises non-visible EM frequencies.

[0014] Preferably, the tracking system comprises a plurality of EM radiation sources in a predetermined band, the EM radiation sources being configured to be worn by the user. Alternatively or additionally, the plurality of EM radiation sources in a predetermined band are positioned around the user on the platform.

[0015] Preferably, the plurality of EM radiation sources are mounted on a head mounted mount. Preferably, the plurality of EM radiation sources are mounted on a helmet.

[0016] In this way, the augmented vision system assists pilots who must operate their aircraft in low levels of ambient light and extreme conditions by providing timely and accurate virtual symbology. The augmented vision system's tracking system on the helmet ensures that the virtual symbology is overlaid correctly.

[0017] Preferably, the tracking system further comprises an auxiliary system for monitoring the platform operator's head orientation, the augmented vision system thereby monitoring the platform operator's field of view, and preferably the auxiliary system comprises at least one of a gyroscope or an accelerometer.

[0018] In this way, the augmented vision system allows for more efficient operation by substituting tracking data that can be produced faster than using an optical system, such as using an EM radiation tracker. While the accuracy of an optical system may be higher, its generation of tracking data may be slower than an auxiliary system. The auxiliary system ensures that the augmented vision system can run at a faster speed when necessary. The auxiliary system minimizes latency in the tracking data, thereby reducing the risk of virtual symbology accidentally appearing in the wrong location on an overlay in the platform operator's field of view. The auxiliary system also provides tracking data more quickly, at a faster rate, such as, but not limited to, 150 Hz, to other parts of the platform system that require such information. This hybrid of an optical system and an auxiliary system for the tracking system also allows for more accurate prediction of the platform operator's head position, orientation, and movement, which information may aid in the operation of platforms such as, but not limited to, aircraft.

[0019] Preferably, the auxiliary system is operable independently of the enhanced vision device and is configured to operate for a period in the range of 1 to 20 milliseconds.

[0020] In this way, the speed of operation of the auxiliary system is ensured to be independent of the augmented vision device, so that tracking data can be transmitted to a different system on the platform when needed. The auxiliary system also provides a backup system for the augmented vision system in the unlikely event that the EM emitter malfunctions or causes a disruption in tracking data from the EM emitter.

[0021] According to one aspect of the present invention, there is provided a vehicle comprising an augmented vision system according to the preceding paragraph. The vehicle may be an aircraft.

[0022] According to one aspect of the present invention, there is provided a method of operating an augmented vision system for a platform operator, the method comprising: sensing a predetermined band of EM radiation in a field of view of the platform operator and generating an enhanced visual image; detecting the field of view of the platform operator using at least one EM radiation source operable within the predetermined band of EM radiation; and controlling activation of the enhanced vision device or controlling activation of an EM radiation source in a tracking system, such that either the enhanced vision device is sensing EM radiation in the field of view and the EM radiation source in the tracking system is inactive, or the EM radiation source in the tracking system is active and the enhanced vision device is inactive, and outputting the enhanced visual image to the platform operator.

[0023] Preferably, outputting the enhanced visual image comprises presenting the enhanced visual image.

[0024] Preferably, the method further comprises defining a first period and a first duty cycle for activation of the enhanced vision device and defining a second period and a second duty cycle for activation of the EM radiation source of the tracking system to synchronize activation and deactivation.

[0025] Preferably, the method further comprises generating a pulse of EM radiation and synchronizing the pulse of EM radiation with the closure of a shutter of a camera.

[0026] Preferably, the first duty cycle is about 90% and the second duty cycle is about 10%.

[0027] Preferably, the second period of time is substantially equal to the first period of time.

[0028] Preferably, the predetermined band of EM radiation sensed by the enhanced vision device comprises non-visible EM frequencies.

[0029] Preferably, the method further comprises monitoring the field of view of the platform operator via the auxiliary system.

[0030] Preferably, the method further comprises operating the auxiliary system independently of the enhanced vision device for a period in the range of 1 to 20 milliseconds.

[0031] Embodiments of the present invention will now be described, by way of example only, with reference to the drawings in which: [Brief explanation of the drawings]

[0032] [Figure 1] FIG. 1 shows an example of an image captured by a camera sensitive to a band of electromagnetic radiation. [Figure 2] FIG. 2 illustrates one embodiment of an augmented vision system according to the present invention. [Figure 3A-3G] 3A-3G show diagrams illustrating different operations of the augmented vision system. [Figure 4] FIG. 4 shows a diagram illustrating the operation of one embodiment of an augmented vision system according to the present invention. [Figure 5] FIG. 5 shows a diagram illustrating the operation of one embodiment of an augmented vision system according to the present invention. [Figure 6] FIG. 6 shows a flowchart of a method of operating one embodiment of an augmented vision system according to the present invention. [Figure 7] FIG. 7 shows an example of a vehicle according to the invention. [Figure 8] FIG. 8 shows an example of a vehicle according to the invention. DETAILED DESCRIPTION OF THE INVENTION

[0033] The present invention relates to an augmented vision system configured to output an augmented visual image to an operator, which may be a machine, particularly capable of running an artificial intelligence (AI) system, or may be a human, controlling a platform equipped with the augmented vision system.

[0034] FIG. 1 shows an example of an image received from an imaging device, such as a camera. Image 100 illustrates a problem that the present invention helps solve. Image 100 includes a low-quality region 101, typically a saturated blob. This low-quality region 101 can cause undesirable effects, such as glare, to a viewer. For example, but not by way of limitation, in an aviation system, a first pilot may wear a helmet equipped with one or more tracker emitters (IREDs), which can cause this type of low-quality region when emissions from the one or more tracker emitters directly or indirectly interfere with the imaging device. The one or more tracker emitters are part of a tracking system configured to determine and / or predict the position, orientation, and movement of the first pilot's head so that an enhanced image can be provided in an accurate manner. In some scenarios, emissions from the one or more tracker emitters may reflect off a canopy in the cockpit or shine in a manner that affects the field of view of the imaging device. In this case, images generated by an imaging device referenced as 220 in FIG. 2 on the first pilot's helmet may be affected. In another scenario, if the first and second pilots are sitting in the same cockpit, images generated by an imaging device mounted on the second pilot's helmet may be affected by one or more tracker emitters (IREDs). The first and second pilots may be wearing the same type of helmet. In another scenario, images generated by an imaging device mounted in the aircraft cockpit may be affected.

[0035] 2 illustrates one embodiment of an augmented vision system 200 for a platform operator. The platform operator may be a machine, particularly one capable of running an AI system, or may be a human. The augmented vision system 200 comprises an augmented vision device 220 for sensing a predetermined band of electromagnetic, EM, radiation in the field of view of the platform operator. In some embodiments, the predetermined band of EM radiation sensed by the augmented vision device 220 comprises non-visible EM frequencies. In some embodiments, the predetermined band of EM radiation sensed by the augmented vision device 220 comprises visible EM frequencies.

[0036] Augmented vision device 220 generates an augmented visual image 206. Augmented visual image 206 comprises a field of view 208 of the scene and virtual symbology created by augmented vision system 200. The virtual symbology may be created from data collected from different systems on the platform to provide information about the scene, the platform's path, and / or the platform's operation. Augmented vision device 220 comprises a camera with a shutter that cycles between a closed state (e.g., shutter off) and an open state (e.g., shutter on). In the closed state, the camera prevents external light from passing through to its one or more imaging sensors. In the open state, the camera allows external light to pass through to its one or more imaging sensors to capture the scene. In FIG. 2, the cameras are arbitrarily illustrated to show their interaction with at least one EM radiation source 210. The shutter may be an electronic shutter or a mechanical shutter.

[0037] In some embodiments, the enhanced vision device 220 is a night vision device. The night vision device is configured for use in low ambient light environments. The night vision device may include at least one of a night vision camera, a night vision eyepiece, and / or night vision goggles. The night vision device may include a short-wave infrared camera.

[0038] The augmented vision system 200 comprises a tracking system for detecting the field of view of a platform operator. The tracking system comprises at least one EM radiation source 210 operable within a predetermined band of EM radiation. In some embodiments, the predetermined band of EM radiation can be visible EM frequencies. In some embodiments, the predetermined band of EM radiation can be non-visible EM frequencies.

[0039] The present invention applies to different types of cameras that have different sensitivity issues due to different spectrums of EM radiation. The present invention can also accommodate the same camera operated in different environments, taking advantage of the camera's inherent property of having different shutter actions in response to ambient light to capture an image.

[0040] At least one EM radiation source 210 in the tracking system can be configured to generate a pulse of EM radiation. The pulse is synchronized with the closure of the camera shutter. In some embodiments, the duration of the pulse of EM radiation (T4 as shown in FIG. 3G) is configured to be shorter than the duration of time the camera shutter is closed (T3 as shown in FIG. 3E). Thus, when the camera shutter is closed, even for the shortest period of time, there is a small amount of time before and after the pulse of EM radiation. By temporally aligning the pulse of EM radiation with the end of the camera's video cycle, the present invention takes advantage of the period of time created by the shutter being closed at the end of the camera's video, image capture, cycle, when the camera is downloading images and is not sensitive to light.

[0041] The tracking system includes at least one tracker camera 212. The at least one tracker camera 212 is configured to detect EM radiation emitted by the at least one EM radiation source 210. The at least one tracker camera 212 is configured to detect EM radiation directly from the at least one EM radiation source 210 and / or indirectly from reflected EM radiation. The EM radiation from the at least one EM radiation source 210 may be reflected from a platform canopy, and the tracking system may be configured to detect the reflected EM radiation. The at least one tracker camera 212 includes a shutter. The shutter may be an electronic shutter or a mechanical shutter. The at least one tracker camera 212 is configured to operate in synchronization with the at least one EM radiation source 210 such that the at least one tracker camera 212 is configured to open its shutter when the at least one EM radiation source 210 emits EM radiation. In some embodiments, the tracking system includes multiple tracker cameras 212.

[0042] In some embodiments, at least one EM radiation source 210 is mounted on a head-mounted mount. Additionally, at least one tracker camera 212 is mounted on a platform, for example, in the cockpit of an aircraft. The at least one tracker camera 212 is positioned in a manner such that the at least one tracker camera 212 is oriented to detect a predetermined band of EM radiation emitted from the at least one EM radiation source 210. In some embodiments, the tracking system includes multiple EM radiation sources 210 operable within the predetermined band. The multiple EM radiation sources 210 are configured to be worn by a user. The multiple EM radiation sources 210 may be mounted on a head-mounted mount. The head-mounted mount may be a helmet 202. In some embodiments, there are 40 to 60 EM radiation sources 210 on the helmet 202.

[0043] In some embodiments, at least one EM radiation source 210 is located on the platform. Additionally, at least one tracker camera 212 is provided on a head-mounted mount. The at least one tracker camera 212 is positioned in a manner such that the at least one tracker camera 212 is oriented to detect a predetermined band of EM radiation emitted from the at least one EM radiation source 210. In some embodiments, the tracking system includes multiple EM radiation sources 210 operable within the predetermined band. The multiple EM radiation sources 210 are configured to surround the operator. The multiple EM radiation sources 210 can be fixed to the platform. In some embodiments, there are 40 to 60 EM radiation sources 210 on the platform.

[0044] In some embodiments, at least one EM radiation source 210 is mounted on a head-mounted mount. Additionally, at least one tracker camera 212 is mounted on the head-mounted mount. The tracking system includes at least one reflector. The at least one reflector may be mounted on a platform. The at least one reflector reflects EM radiation emitted from the at least one EM radiation source 210. The at least one tracker camera 212 on the head-mounted mount is configured to detect EM radiation in a predetermined band emitted from the at least one EM radiation source 210. In some embodiments, the tracking system includes multiple EM radiation sources 210 operable within the predetermined band. The multiple EM radiation sources 210 are configured to be worn by a user. The multiple EM radiation sources 210 may be mounted on a head-mounted mount. The head-mounted mount may be a helmet 202. In some embodiments, there are 40 to 60 EM radiation sources 210 on the helmet 202.

[0045] The tracking system is configured to monitor the platform operator's field of view. In some embodiments, the tracking system is configured to monitor at least one of the platform operator's head orientation, position, or movement. By monitoring at least one of the platform operator's head orientation, position, and movement, the tracking system provides tracking data (of the platform operator's head) to determine and monitor the platform operator's field of view, and may provide the tracking data to different systems of the platform. The tracking system is configured to monitor the platform operator's field of view by using an optical system. The optical system comprises at least one EM radiation source 210 and at least one tracker camera 212. Alternatively or additionally, the tracking system is configured to monitor the platform operator's field of view by using an auxiliary system 230.

[0046] In some embodiments, the tracking system further comprises an auxiliary system 230. The auxiliary system 230 is configured to monitor the field of view of the platform operator. The auxiliary system 230 is configured to monitor the orientation and / or position of the operator's head, thereby monitoring the operator's field of view. The auxiliary system 230 may comprise at least one of an inertial device, such as a gyroscope or an accelerometer, and / or any other position sensing system capable of detecting the position, orientation, movement, direction of movement, and / or speed of movement of the platform operator's head. The gyroscope may be a three-axis gyroscope. The auxiliary system provides means for changing the pulse rate and adjusting the duty cycle D2 of the at least one EM radiation source, resulting in a single pulse (shown in FIG. 3B) of the at least one EM radiation source per camera video cycle (shown in FIG. 3A) instead of three pulses (shown in FIG. 3C) per camera video cycle. For example, in some embodiments, auxiliary system 230 is configured to operate at 150 / 180 Hz, but the overall pulse rate of at least one EM radiation source is configured to reduce from 150 / 180 Hz to 50 / 60 Hz to match the speed of camera movement. In this way, the dynamic performance of the enhanced vision system is not compromised. The latency and predictive capabilities of the tracking system are not compromised, and tracking data is transmitted to different systems on the platform for purposes that may be other than providing an enhanced vision image.

[0047] In some embodiments, auxiliary system 230 can operate independently of augmented vision device 220. The speed of operation between the at least one EM radiation source and auxiliary system 230 is independent of one another. In some embodiments, auxiliary system 230 is configured to operate at a time period ranging from 1 to 20 milliseconds. In some embodiments, auxiliary system 230 is configured to operate at a time period ranging from 5 to 8 milliseconds. In some embodiments, auxiliary system 230 is configured to operate at a frequency ranging from 100 Hz to 1 kHz. Because auxiliary system 230 produces tracking results relatively faster than using an optical system alone, such as using at least one EM radiation source 210, it can be operated at a faster speed without adding significant cost to augmented vision system 200.

[0048] Augmented vision system 200 includes a display system 204 for overlaying an enhanced visual image onto an operator's field of view 208. Display system 204 may be a visor mounted on a helmet, a head-mounted display, or a head-up display.

[0049] The augmented vision system 200 includes a switching circuit 240. The switching circuit 240 is configured to control activation of the enhanced vision device 220 and / or to control activation of an EM emitter in the tracking system. The switching circuit 240 is configured to activate the enhanced vision device 220 and deactivate the EM emitter 210 in the tracking system to sense EM radiation in the operator's field of view. Alternatively, the switching circuit 240 is configured to activate the EM emitter 210 in the tracking system and deactivate the enhanced vision device 220. The switching circuit 240 is configured to activate the EM emitter 210 such that a pulse of the EM emitter 210 is synchronized with and within a shutter close period of the camera. When the switching circuit 240 is configured to control the EM emitter 210 and the camera, the switching circuit 240 allows for an offset to correspond to the time the camera needs to read its sensor. The switching circuit is configured to communicate with different systems on the platform. The switching circuitry is configured to transmit the tracking data to different systems on the platform.

[0050] In some embodiments, the switching circuit defines a first time period T1 and a first duty cycle D1 for activation of the enhanced vision device 220, as seen in Figures 4 and 5. The switching circuit may define a second time period T2 and a second duty cycle D2 for activation of the EM radiation source of the tracking system, as seen in Figures 4 and 5. The switching circuit defines the first time period T1, the first duty cycle D1, the second time period T2, and the second duty cycle D2 to synchronize activation and deactivation of the enhanced vision device 220 and the tracking system.

[0051] 3A illustrates one embodiment of a total camera duty cycle FD1, which begins when a camera shutter opens and ends when a subsequent camera shutter opens.

[0052] Figure 3B shows the total duty cycle of the tracker, FD 2B 1 shows an embodiment of the total duty cycle FD of the tracker. 2B corresponds to the total duty cycle FD1 of the camera.

[0053] Figure 3C shows the total duty cycle of the tracker, FD 2A 1 shows an embodiment of the tracker emitter, which emits a full tracker duty cycle FD within the time period during which a full camera duty cycle FD1 occurs. 2B It pulses three times as shown by

[0054] 3B and 3C show that the total duty cycle FD of the tracker occurs within the time period during which the total duty cycle FD1 of the camera occurs. 2A In such a case, the camera shutter pulses three times over the total tracker duty cycle FD 2AThe camera may remain open when a signal is received. This results in an inefficient augmented vision system because low-quality areas are introduced into the camera's image. To avoid excessive pulsing of the IRED, the tracking system may use auxiliary system 230 to compensate for the tracking data needed to properly provide an enhanced visual image. Auxiliary system 230 is configured to provide intermittent tracking data from monitoring the platform operator's field of view. In some embodiments, the camera's operating rate is 60 Hz and lasts 16.7 milliseconds, and the auxiliary system's operating rate is 150 Hz and lasts 6.7 milliseconds, while the at least one EM radiation source's operating rate remains the same as the camera's operating rate. In some embodiments, the camera's operating rate is 50 Hz and lasts 20 milliseconds, and the auxiliary system's operating rate is 180 Hz and lasts 5.5 milliseconds, while the at least one EM radiation source's operating rate remains the same as the camera's operating rate. In some embodiments, the augmented vision system 200 comprises at least one EM radiation source 210 that operates at the same speed as the enhanced vision device 220, but the tracking system also operates internally at a higher speed by using an auxiliary system 230 that has a higher speed output, as shown in FIG. 3C.

[0055] 3D illustrates the operation of the camera shutter in high ambient light. FIG. 3E illustrates the operation of the camera shutter in low ambient light. The camera shutter remains open for a relatively short period of time in high ambient light. The camera is configured to operate by opening the camera shutter for a short period of time and closing the camera shutter for a long period of time. The camera is configured to repeatedly open and close the camera shutter.

[0056] The camera shutter remains open for a relatively long period of time in low ambient light. The camera is configured to operate with the camera shutter open for a long period of time and closed for a short period of time. The camera shutter remains open for a longer period of time in low ambient light compared to a camera in high ambient light. Thus, a camera operating in low ambient light is more likely to capture EM radiation. For example, night vision systems operate in very low ambient light and are therefore more likely to produce lower quality images due to EM radiation sensitivity. A switching circuit is configured to control operation of the camera. The switching circuit is configured to control the opening and closing cycle of the camera shutter. The camera captures images during periods when the camera shutter is open.

[0057] Figure 3F illustrates the pulsing of unsynchronized tracker emitters. Comparing Figure 3F with Figures 3D and 3E, the tracker pulses (i.e., emits EM radiation) when the camera shutter is open. The first pulse 352 may not be captured by a camera shutter operating under a high ambient light setting, but the first pulse 352 is captured by a camera shutter operating under a low ambient light setting. In contrast, the second pulse 354 is captured by both cameras operating under high and low ambient light settings. Unsynchronized trackers produce impaired images with poor quality.

[0058] Figure 3G illustrates synchronized tracker emitter pulsing in accordance with the present invention. Comparing Figure 3G with Figures 3D and 3E, both cameras operating under high and low ambient light settings do not capture tracker pulses 362, 364. The tracker generates pulses 362, 364 (i.e., emits EM radiation) when the camera shutter is closed. The augmented vision system in accordance with the present invention provides synchronized activation and deactivation of the camera and tracking system so that the EM radiation does not affect the captured image. Time period T4 indicates when the EM radiation is emitted. Time period T4 may be 200 us. Time period T4 coincides with T3.

[0059] FIG. 4 illustrates one embodiment of an augmented vision system 200 in accordance with the present invention. In particular, FIG. 4 illustrates the operation of at least one EM radiation source, as well as tracker emitter(s) 210 and an enhanced vision device 220, such as a night vision system. While this description relates to one embodiment for use with a night vision system, the operation described in FIG. 4 may also apply to an augmented vision system 200 comprising any type of camera sensitive to a band of EM radiation. The switching circuitry is configured to define a first duty cycle D1 representing a period during which the night vision system is activated (i.e., on). The first duty cycle D1 may be approximately 90%. The switching circuitry 240 is configured to define a second duty cycle D2 representing a period during which the at least one EM radiation source 210 is deactivated (i.e., off). The second duty cycle D2 may be approximately 10%. The first period T1 may be in the range of 5 to 40 milliseconds. The second period T2 may be substantially equal to the first period T1. The first period T1 and the second period T2 each represent a complete cycle of the at least one EM radiation source and the night vision system. FIG. 4 shows at least one EM radiation source 210 operating at the same speed as the enhanced vision device 220. A tracking system comprising an optical system may operate as described in FIG. 4. In some embodiments, the at least one EM radiation source 210 operates at the same speed as the enhanced vision device 220, but the tracking system may also operate internally at a higher speed. In such cases, the tracking system may use an auxiliary system 230, as shown in FIG. 3C, whose output is at a higher speed. A tracking system comprising an optical system and an auxiliary system 230 may also operate as described in FIG. 4.

[0060] FIG. 5 illustrates one embodiment of an augmented vision system 200 in accordance with the present invention. In particular, FIG. 5 illustrates the operation of the tracker emitter(s) 210 and at least one EM radiation source, such as a night vision system. While this description relates to an embodiment for use with a night vision system, the operation described in FIG. 5 may also apply to an augmented vision system 200 comprising any type of camera sensitive to a band of EM radiation. The switching circuitry is configured to define a first duty cycle D1 representing the period during which the night vision system is activated (i.e., on). FIG. 5 illustrates one embodiment in which the operating speed of the at least one EM radiation source 210 is reduced so that two duty cycles of the camera occur per single pulse of EM radiation. The operating speed of the at least one EM radiation source 210 is half the operating speed of the enhanced vision device 220. The operating speed of the at least one EM radiation source 210 is slower than the operating speed of the enhanced vision device 220. The switching circuitry 240 is configured to minimize exposure of the camera to EM radiation. In such cases, switching circuit 240 is configured to use auxiliary system 230 at a higher operating speed. Tracking data generated by auxiliary system 230 is used by the augmented vision system to ensure that the augmented vision system does not have to rely heavily on the optical system to provide a variety of operating configurations. A tracking system including the optical system and auxiliary system 230 may operate as described in FIG. 5.

[0061] FIG. 6 shows a flowchart 600 of a method for operating an embodiment of an augmented vision system in accordance with the present invention. In step 610, a predetermined band of EM radiation is sensed in an operator's field of view. In step 620, an enhanced vision image is generated. In step 630, the platform operator's field of view is detected using at least one EM radiation source operable within the predetermined band of EM radiation. In step 640, activation of the enhanced vision device is controlled and / or activation of an EM radiation source in the tracking system is controlled so that either the enhanced vision device senses EM radiation in the field of view and the tracking system is inactive, or the EM radiation source in the tracking system is active and the enhanced vision device is inactive. In step 650, the enhanced vision image is output to the platform operator. The output may comprise presenting the enhanced vision image. In some embodiments, a first time period T1 and a first duty cycle D1 for activation of the enhanced vision device are defined by a switching circuit to synchronize activation and deactivation. In some embodiments, a second period T2 and a second duty cycle D2 for activation of the tracking system's EM radiation source are defined by a switching circuit to synchronize activation and deactivation. The first duty cycle D1 may be approximately 90%, and the second duty cycle D2 may be approximately 10%. The second period T2 may be substantially equal to the first period T1. A pulse of EM radiation may be generated and synchronized with the closure of a camera shutter. The predetermined band of EM radiation sensed by the enhanced vision device 220 may comprise non-visible EM frequencies. In some embodiments, the platform operator's field of view is monitored by an auxiliary system. The auxiliary system may be operated independently of the enhanced vision device 220. The auxiliary system may be configured to operate at a period ranging from 1 to 20 milliseconds.

[0062] Figures 7 and 8 illustrate vehicles equipped with the augmented vision system 200. Figure 7 shows an airplane 700 equipped with the augmented vision system 200. Figure 8 shows a helicopter 800 equipped with the augmented vision system 200.

Claims

1. 1. An augmented vision system for a platform operator, the augmented vision system comprising: an enhanced vision device for sensing a predetermined band of electromagnetic, EM, radiation in the field of view of the platform operator and generating an enhanced visual image; a tracking system for detecting a field of view of the platform operator, wherein the tracking system comprises at least one EM radiation source operable within the predetermined band of EM radiation; and a display system for overlaying an enhanced visual image onto the field of view of the platform operator; and a switching circuit configured to control activation of the enhanced vision device or to control activation of an EM radiation source in the tracking system; the result, the enhanced vision device is sensing EM radiation in the field of view and the EM radiation source in the tracking system is inactive; or the EM radiation source in the tracking system is active and the enhanced vision device is inactive; or and An augmented vision system comprising:

2. The switching circuitry may include: a first time period (T) for activation of the enhanced vision device; １ ) and the first duty cycle (D １ )and, a second time period (T ２ ) and a second duty cycle (D ２ )and, The augmented vision system of claim 1 , wherein:

3. 3. The augmented vision system of claim 1, wherein the enhanced vision device comprises a camera having a shutter that cycles between a closed state and an open state, and the at least one EM radiation source in the tracking system is configured to generate pulses of EM radiation synchronized with the closed state of the shutter.

4. The augmented vision system of claim 3 , wherein the shutter is an electronic shutter or a mechanical shutter.

5. The first duty cycle (D １ ) is about 90%, and the second duty cycle (D ２ 5. The augmented vision system of claim 1, wherein .gamma.

6. The first period (T １ 6. The augmented vision system of claim 1, wherein the time t1 is in the range of 5 to 40 milliseconds.

7. The second period (T ２ ) is the first period (T １ 7. The augmented vision system of claim 1, wherein the augmented vision system is substantially equal to

8. The augmented vision system of any one of claims 1 to 7, wherein the enhanced vision device is a night vision device, optionally comprising at least one of a night vision camera, a night vision eyepiece and / or night vision goggles.

9. The augmented vision system of claim 8 , wherein the night vision device comprises a short wave infrared camera.

10. The augmented vision system of any preceding claim, wherein the predetermined band of EM radiation sensed by the enhanced vision device comprises non-visible EM frequencies.

11. 11. The augmented vision system of claim 1, wherein the tracking system comprises a plurality of EM radiation sources in the predetermined band, the EM radiation sources being configured to be worn by a user.

12. The augmented vision system of claim 11 , wherein the plurality of EM radiation sources are mounted on a head-mounted mount, optionally a helmet.

13. 13. The augmented vision system of any one of claims 1 to 12, wherein the tracking system further comprises an auxiliary system for monitoring the orientation of the platform operator's head, thereby monitoring the field of view of the platform operator.

14. The augmented vision system of any preceding claim, wherein the auxiliary system comprises at least one of a gyroscope or an accelerometer.

15. 15. The augmented vision system of claim 13 or 14, wherein the auxiliary system is operable independently of the enhanced vision device and is configured to operate for a period in the range of 1 to 20 milliseconds.

16. A vehicle comprising an augmented vision system according to any one of claims 1 to 15.

17. 1. A method of operating an augmented vision system for a platform operator, the method comprising: sensing a predetermined band of EM radiation in a field of view of the platform operator and generating an enhanced visual image; detecting a field of view of the platform operator using at least one EM radiation source operable within the predetermined band of EM radiation; Controlling activation of the enhanced vision device or controlling activation of an EM radiation source in the tracking system; the result, the enhanced vision device is sensing EM radiation in the field of view and the EM radiation source in the tracking system is inactive; or the EM radiation source in the tracking system is active and the enhanced vision device is inactive; or and outputting the enhanced visual image to the platform operator; A method comprising:

18. The method of claim 17 , wherein said outputting said enhanced visual image comprises presenting said enhanced visual image.

19. To synchronize activation and deactivation, a first time period (T) for activation of the enhanced vision device; １ ) and the first duty cycle (D １ ) and a second time period (T ２ ) and a second duty cycle (D ２ ) and 19. The method of claim 17 or 18, further comprising:

20. generating a pulse of EM radiation; synchronizing the pulse of EM radiation with the closure of a camera shutter; The method of any one of claims 17 to 19, further comprising:

21. The first duty cycle (D １ ) is about 90%, and the second duty cycle (D ２ 21. The method of claim 19 or 20, wherein the % of the total mass of the cellulose acetate solution is about 10%.

22. The second period (T ２ ) is the first period (T １ 22. The method according to claim 19, wherein the temperature is substantially equal to 1000°C.

23. 23. The method of any one of claims 17 to 22, wherein the predetermined band of EM radiation sensed by the enhanced vision device comprises non-visible EM frequencies.

24. The method of any one of claims 17 to 23, further comprising monitoring the field of view of the platform operator via an auxiliary system.

25. 25. The method of any one of claims 17 to 24, further comprising operating the auxiliary system independently of the enhanced vision device for a period in the range of 1 to 20 milliseconds.

Images