Controlling operating state of imaging device
By integrating image recognition and automatic shutdown functions into imaging equipment, the problem of illegal use of optical equipment under import and export controls has been solved, and compliant operation and safe use of the equipment have been achieved.
Patent Information
- Application Number
- CN202380024892.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-03
- Filing Date
- 2023-02-28
- Publication Date
- 2024-11-05
AI Technical Summary
The illegal use of certain optical devices is difficult to avoid under import and export controls, which may lead to penalties, and existing technologies lack effective compliance mechanisms.
By integrating image capture, display, hardware processor and memory into the imaging device, image recognition and analysis of the scene can be achieved, identifying prohibited objects and automatically shutting down key features or functions of the device, including markings, displays, infrared light emitters, etc., to comply with import and export control regulations.
This effectively prevents optical equipment from automatically shutting down critical features during unauthorized use, ensuring compliant operation and preventing violations and penalties.
Smart Images

Figure CN118901245A_ABST
Abstract
Description
Background Art
[0001] Certain types of goods and technologies are subject to import and export control regulations. For example, the import and export of certain optical devices are regulated by various departments. The regulations for optical devices used for import and export control are based on how the equipment is classified. For example, military-grade night vision equipment requires a license from the U.S. Department of Defense. Failure to comply with import and export control regulations may result in significant penalties. Summary of the invention
[0002] Aspects of the present disclosure include an imaging device including: an image capture device configured to observe an image of a scene including an object observed by the imaging device; a display for displaying an image of a reticle and an image of the scene; a hardware processor; and a memory storing computer-readable instructions executable by the hardware processor to perform operations. The operations can include: performing image recognition analysis on the image of the scene; determining that an object in the image is a prohibited object; and causing the display to stop displaying the image of the reticle.
[0003] Aspects of an embodiment include a method comprising: displaying a graticule on a display of an imaging device; observing, by the imaging device, an object within a field of view of the imaging device; determining, by an image processor, that the object is a prohibited object; and ceasing to display the graticule on the display of the imaging device.
[0004] Aspects of an embodiment include a non-transitory computer-readable medium storing instructions that can be executed by a hardware processor to perform operations including: displaying a reticle on a display of an imaging device; receiving a signal representing an object in a scene; creating an imaging of the object in the scene from the received signal; performing image recognition analysis on the image of the object in the scene; determining that the object in the image is a prohibited object; and causing the display to stop displaying the image of the reticle.
[0005] In some embodiments, the memory includes a list of objects, and determining that the object in the image is a prohibited object includes comparing the object to the list of objects.
[0006] Some embodiments can include determining that a prohibited object is in a field of view of an imaging device; and after expiration of a threshold amount of time, if the prohibited object is in the field of view, causing the imaging device to shut down.
[0007] Some embodiments can include: incrementing a counter indicating a counter value of a number of times a prohibited object has been identified; comparing the counter value to a threshold; and shutting down the imaging device if the counter value exceeds the threshold.
[0008] Some embodiments can include determining that a prohibited object is in a field of view of the imaging device; and after a threshold timer amount has expired, if the prohibited object is in the field of view, causing the display to turn off.
[0009] Some embodiments can include performing image recognition analysis on an image of a scene; determining that an object is no longer in the image; and causing a reticle to be displayed on a display.
[0010] In some embodiments, the image capture device includes a thermal imaging camera or a night vision camera.
[0011] In some embodiments, the imaging device includes at least one of a thermal imaging device and a night vision device. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 is a schematic block diagram of an example optical device according to an embodiment of the present disclosure.
[0013] Figure 2A -H is a schematic diagram illustrating controlling the display state of a reticle based on object detection according to an embodiment of the present invention.
[0014] Figure 3 is a process flow chart for controlling a reticle display state based on object detection according to an embodiment of the present invention.
[0015] Figure 4 is a process flow diagram for controlling an optical device power state based on object detection for a passing time period in accordance with an embodiment of the present disclosure.
[0016] Figure 5 is a process flow diagram for controlling a reticle display state based on a global positioning system location according to an embodiment of the present disclosure.
[0017] Fig. 6A is a schematic diagram showing a right side cutaway view of an example digital-based thermal scope configured in a conventional optical-based scope form factor in accordance with an embodiment of the present disclosure.
[0018] Figure 6B FIG. 1 is a diagram showing a conventional optical-based scope form factor configuration according to an embodiment of the present disclosure. Fig. 6A An example of a digital based schematic diagram of a top view cutaway of a thermal sight.
[0019] Figure 7 is a block diagram illustrating an example of a computer-implemented system for providing computing functionality associated with the described algorithms, methods, functions, processes, procedures, and programs according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0020] The present disclosure describes an optical device, such as a thermal imaging device or a night vision imaging device, that is capable of shutting down one or more key features if the optical device is being used in a manner that is not in compliance with import and export control laws or is being used in an illegal jurisdiction. For example, if the optical device determines that the object being observed is a person, a vehicle, or other prohibited object, the optical device is capable of shutting down the markings. If a prohibited object is still being observed after the markings are turned off, the optical device is capable of shutting down the display screen, the infrared light emitter, the image processor, and / or the entire optical device.
[0021] In some embodiments, the optical device can include a global positioning system (GPS) or other type of positioning system. The optical device can determine its location and, based on the location of the optical device, shut down one or more critical systems. For example, if the optical device is in a country that is subject to trade sanctions or a country where such an optical device is illegal, the optical device can shut down the reticle, processor, display, infrared transmitter, and / or the entire optical device.
[0022] Figure 1 is a schematic block diagram of an example imaging device 100 according to an embodiment of the present disclosure. The imaging device 100 can be any type of imaging device that includes a projected or displayed reticle. Such imaging devices 100 include thermal imaging rifle scopes, thermal imaging binoculars, thermal imaging dot sights, night vision rifle scopes, night vision binoculars, night vision dot sights, optical scopes, red dot sights, holographic sights, or other types of imaging devices.
[0023] The imaging device 100 can create and present (e.g., display) an image of a scene in real time. The imaging device 100 can include optical components 102, such as a front or objective lens, a focusing lens, an eyepiece, an optical path, a prism, a mirror, etc. The optical components 102 can be used to receive light or thermal radiation or other electromagnetic (EM) signals (collectively, EM signals) from objects constituting the scene. The optical components 102 can be used to focus the incident EM signals and direct the EM signals into the optical path. More details of the optical components 102 are described below. Fig. 6A - Provided in B.
[0024] The imaging device 100 can include an imager 104. The imager 104 can include a thermal imaging device, such as a thermal camera, a thermal sensor, an infrared sensor, a charge coupled device (CCD), or other type of imager. The imager 104 can convert received EM signals into electrical signals for processing. For example, electrical signals representing objects from a scene can be sent from the imager 104 to a processor 106. The processor 106 can be a hardware processor capable of executing instructions stored in a memory 108. The processor 106 can be a computer, such as a Figure 7The processor 106 is capable of performing imaging processing on the received electrical signals from the imager 104 to render the electrical signals into a format for display on the display 116.
[0025] The display 116 can include a liquid crystal display (LCD), a light emitting diode (LED) display, or other types of displays. The display 116 can provide a visual representation of objects in the scene to the operator. In an embodiment, the display 116 can present a reticle or other aiming structure overlaid on the displayed image (the term "reticle" will be used to include any type of aiming structure). The reticle can be used for aiming, target acquisition, windage and altitude determination, and other purposes. The reticle can be a crosshair, a circle or concentric circles, a triangle, a series of lines or dots, a square, or other geometric structure.
[0026] In some embodiments, reticle projection module can physically project the reticle into the optical path of the imaging device. For example, reticle projector 114 can project the reticle onto a mirror that reflects the image of the reticle into the image path.
[0027] In an embodiment, the display 116 can also display information to the operator. For example, the display 116 can display distance information, magnification information, semantic information, object identification information, imaging device mode (white hot vs. dark hot), windage and altitude information, battery level, object tracking information, or other information.
[0028] In some embodiments, processor 106 can perform image recognition and image recognition analysis on electrical signals. Image recognition software 110 can be stored in memory 108 and executed by processor 106. Image recognition software 110 can use one or more image recognition technologies to identify objects in a scene. For example, image recognition software 110 can determine that one of the objects in a scene is a prohibited object, such as a person, a vehicle, a window or a window frame or other prohibited objects. Prohibited objects are any objects that indicate that imaging device 100 is being used in a non-entertainment or non-sports manner, such as for law enforcement or military applications. In some embodiments, object list 112 can be stored in memory 108. Object list 112 can include a list of prohibited objects. Object list 112 can be a part of image recognition software 110.
[0029] Image recognition includes the ability to identify objects, places, people, writing, and / or actions in an image. The processor 106 can use image recognition (also known as machine vision) technology in conjunction with the imager 104 and software to achieve image recognition. The image recognition software 110 can utilize artificial intelligence, machine learning, or other intelligent models. Image recognition functions can include shape recognition, pattern recognition, and / or object detection technology. For example, if the imaging device 100 includes a thermal imaging device or a night vision imaging device, object detection technology can be used to identify and classify the shape of the object.
[0030] For example, a machine learning algorithm can be used for shape recognition and to determine that the recognized shape has a likelihood of being an impermissible (or prohibited) object. The compliance status of the imaging device can then be changed based on the likelihood that the imaging device is being used in a non-compliant manner.
[0031] To implement compliance with import and export control regulations, the imaging device 100 can turn off one or more displayed features in response to detecting that a prohibited object is being observed. For example, the imaging device 100 can determine that the operator is observing a person. A person can be a prohibited object. If the imaging device 100 determines that a person is being observed by the operator, the imaging device 100 can turn off the reticule, other displayed information, the display itself, and / or the entire imaging device 100. In this manner, the imaging device 100 cannot be used in military or law enforcement applications.
[0032] In some embodiments, the compliance state can be dynamic (a compliance state refers to a state when one or more features of an imaging device are turned off to comply with regulations). When using the device for permitted purposes, there are situations where prohibited objects are mistakenly or coincidentally observed. For example, an old car may be abandoned in an area used for hunting. If the imaging device 100 recognizes a car, the imaging device can trigger a compliance state until the imaging device determines that the car is no longer in view. After the imaging device 100 determines that the car is no longer in view, the imaging device 100 can switch to a normal operating state. In this way, the compliance state is dynamic. The normal operating state is an operating state of the imaging device 100 in which all device features are available to the operator.
[0033] For example, the imaging device 100 can stop displaying the markings until the imaging device 100 determines that the car is no longer in the field of view of the imaging device 100. Once the imaging device 100 determines that the car is no longer in the field of view of the imaging device 100, the imaging device 100 can display the markings again.
[0034] The imaging device 100 can use a timer or counter or other mechanism 126 to ensure that the operator does not attempt to bypass the compliance state by moving away from the prohibited object and moving back onto the prohibited object after the normal operating mode is reengaged. The imaging device 100 can also ensure that the operator does not ignore the compliance state by continuing to observe the prohibited object when the compliance state is triggered. For example, if the imaging device 100 is still detecting cars after the markings are turned off and a certain amount of time (e.g., 30 seconds) has passed, the imaging device 100 can turn off the feature so that the imaging device 100 becomes unusable, including turning off the display and / or the entire device.
[0035] The timer / counter 126 can be used to track the amount of time between the first appearance of a prohibited object and another appearance of the same object or another prohibited object. A predetermined threshold amount of time can be set so that when the threshold expires, the imaging device 100 can automatically shut down. For example, after the reticle is turned off, the timer can be started. If the imaging device 100 determines that the prohibited object remains in the field of view, for example, 30 seconds after the reticle is turned off, the display is turned off or the imaging device 100 is turned off, etc.
[0036] The timer / counter 126 can track the number of image frames instead of (or in addition to) the elapsed time.After receiving a certain number of image frames that include prohibited objects, the imaging device 100 can shut itself down.
[0037] The timer / counter 126 can also track the number of occurrences of a prohibited object.After the imaging device 100 determines that a prohibited object has been detected five times, for example, the imaging device 100 can shut itself down.
[0038] Other ways of triggering a compliance state of the imaging device 100 are within the scope of the present disclosure. Generally, if the imaging device 100 determines that it is being used in a non-compliant manner, the imaging device 100 can trigger a compliance state of operation.
[0039] In some embodiments, the imaging device 100 can include a global positioning system (GPS) module 118. The GPS module 118 can be used to identify the location of the imaging device 100 periodically or upon request by a third party. If the imaging device 100 is being used in a jurisdiction that is illegal or otherwise not compliant with the device's regulations, the imaging device 100 can trigger a compliance state. For example, if the imaging device 100 is being used in a country that is sanctioned by the exporting country, the imaging device can use GPS 118 to determine its location and activate a compliance state if it is in an illegal jurisdiction. A jurisdiction list 120 can be stored in the memory 108. As the geopolitical landscape evolves, the jurisdiction list 120 can be updated prior to export and / or periodically.
[0040] In some embodiments, the imaging device 100 can include a communication module 122 that can send a message to a server or controller or other location indicating that the imaging device 100 is being used in an illegal jurisdiction and the GPS location of the imaging device 100. Regulatory agencies can use this information to track illegal sales and shipments of the device.
[0041] The power source 124 can be used to power one or more components of the imaging device 100. The power source 124 can be a battery or other type of power source, as described in more detail below. If the imaging device 100 is used in an uncompliant manner, the power source 124 can respond to a compliance state to shut off power to the imaging device 100.
[0042] Figure 2A -H is a schematic diagram illustrating controlling the display state of a reticle based on object detection according to an embodiment of the present disclosure. Figure 2A In FIG. 1 , imaging device 100 includes display 116. Display 116 is displaying graticule 202. Figure 2B , the imaging device 100 determines that the object being observed is a person 204. The imaging device 100 is able to determine that the person 204 is a prohibited object and trigger a compliance state. Figure 2C In the compliant state, the marking is turned off. Figure 2C 204, but no longer displays the reticle 202). If the imaging device 100 determines that after a predetermined amount of time (for example) the person 204 is still being observed, the display 116 can be extinguished or turned off. Figure 2D Optionally, also Figure 2D As shown in , the screen can display a message to the operator, such as "Unauthorized Use Detected".
[0043] After engaging any compliance state, the imaging device 100 can log an event. After a predetermined number of events of illegal or unauthorized use of the imaging device 100, the imaging device 100 can take action. For example, the imaging device 100 can be permanently disengaged from the markings 202. The imaging device 100 can use the communication module 122 to send a message to a third party regarding the unauthorized use. The imaging device 100 can self-destruct. Other actions can be taken depending on the number of violations and the severity of the violations.
[0044] Figure 2E The imaging device 100 is shown after the reticle has been turned off and the imaging device 100 has determined that the prohibited object is no longer under observation. Figure 2F It is shown that when the imaging device 100 determines that the prohibited object is no longer being observed, the imaging device 100 can return to a normal operating state. Figure 2GAlso shown is the imaging device 100 after the reticle 202 has been turned off and the imaging device 100 has determined that the prohibited object is no longer under observation. In this embodiment, the imaging device 100 keeps the reticle 202 turned off until the imaging device 100 determines that the permitted object is in view. Figure 2H , imaging device 100 determines that animal 206 is being observed, and imaging device 100 turns reticle 202 back on.
[0045] In addition to complying with import and export control regulations, triggering of compliance states can be used in other applications. For example, the compliance state can be activated as a standard safety precaution to warn the operator that a person or other prohibited object is being observed. The display 116 can turn off the markings 202 or enhance the display with color, alarm, shape or other indicators to warn the operator that a prohibited object is being observed. As described above, other compliance states can also be triggered for safety reasons, such as turning off the display 116 or shutting down the entire device.
[0046] Figure 3 300 is a process flow chart for controlling a reticle display state based on object detection according to an embodiment of the present disclosure. At the beginning, an imaging device such as imaging device 100 is capable of operating in a normal operating state. (302) The normal operating state is a state in which all functions of the imaging device are available to an operator. The imaging device is capable of receiving an image signal. (304) For example, the imaging device is capable of receiving light or thermal radiation and converting the light or thermal radiation into an electrical signal representing an object being observed. The imaging device is capable of rendering an image of the object being observed on a display in real time. The imaging device is capable of performing image recognition on the image of the object. (306) If no object violates the operating rules (310), the process continues to capture image data and process the image data, continuing to monitor prohibited objects. (Return to 302)
[0047] If the imaging device determines that the object being viewed is a prohibited object, the imaging device can trigger a compliance operating mode. (312) The compliance operating mode can include one or more of removing the graticule from the display, removing other information from the display, turning off the display, turning off the imager, turning off the IR or light emitting source, and / or turning off the entire device.
[0048] While in the compliant state of operation, the imaging device continues to monitor received signals. (304) The process continues, maintaining the compliant state if the prohibited object remains in the field of view, or returning to the normal operating state if the prohibited object is no longer in the field of view.
[0049] Figure 4400 is a process flow diagram for controlling an optical device power state based on object detection for an elapsed time period according to an embodiment of the present disclosure. As an extension of process flow diagram 300, if unauthorized use of the imaging device continues after a compliance state is triggered, the imaging device can use a timer or counter to take further action. At the beginning, the compliance state is active (wherein one or more functions of the imaging device are turned off). (402) A timer is started at the first instance of the imaging device detecting a prohibited object. (404) In some embodiments, a counter can also be incremented. The counter can track the number of events in which the prohibited object is detected. If the prohibited object continues to be visible after the timer has been started (406), the total elapsed time can be compared to a time threshold. (408) For example, if the prohibited object has been detected for a total of 30 seconds, the imaging device turns itself off (e.g., a time threshold of 29 seconds). (410) The 30 seconds can be in one event or in more than one event. For example, an operator can observe a prohibited object for 15 seconds, walk away from the object, and then return to the object for another 15 seconds. The accumulated amount of time is 30 seconds, which in this example is sufficient to trigger a shutdown.
[0050] After the timer has been started, if the prohibited object disappears from view (406), the timer can be stopped. (412) The accumulated time can be stored in memory and added to a later more accumulated time if the same or a different prohibited object is detected.
[0051] In an embodiment, the counter value can be compared to a threshold number (414). If the counter value exceeds a predetermined threshold, then the imaging device can shut itself off. For example, if a prohibited object has been detected 51 times since the device was turned on, and the counter threshold is 50, then the imaging device will shut itself off. If the counter value does not exceed the threshold, then the imaging device can return to normal operation (416). The process returns to Figure 3 Step 302 (418) of process 300.
[0052] Figure 5 500 is a process flow diagram for controlling a reticle display state based on a global positioning system location according to an embodiment of the present disclosure. In some embodiments, an imaging device can include a global positioning system (GPS) module that can identify the location of the imaging device. The location can include GPS coordinates, country, continent, or other location information. If the imaging device is in a prohibited location, the imaging device can trigger a compliance state of operation.
[0053] In some embodiments, the imaging device can activate a GPS module and determine a GPS location (502). The GPS location can be compared to an updated list of jurisdictions stored in memory (504). If the imaging device determines that it is operating in an unauthorized jurisdiction (506), as described above, the imaging device can trigger a compliance state of operation (508). In an embodiment, if the imaging device enters the compliance state of operation, the imaging device can send an alert with the location information of the imaging device to a third party (510).
[0054] If the imaging device determines that it is operating in an authorized jurisdiction (506), the imaging device remains in a normal operating state (512). The imaging device can then periodically check the location as described in 502.
[0055] In some embodiments, GPS location determination can be performed periodically by the imaging device to ensure compliance. In some embodiments, a third party can request the location of the imaging device. The imaging device can receive a request for a GPS location (514). In some embodiments, the imaging device can perform an authentication process to authenticate the requestor (516). For example, a public / private key or other type of authentication protocol can be used. If the requestor is not authenticated (518), the imaging device can report the unauthorized request to the operator (524).
[0056] If the requester is authenticated (518), the imaging device can use the GPS module to determine its location (502). The imaging device can send the location information to the requester using a communication protocol (520). The imaging device can receive a compliance status signal from the authenticated requester (522). The compliance status signal can cause the imaging device to trigger a compliance status of the operation (508). The imaging device can then send the location information to the requester or other third party (510).
[0057] If the imaging device does not receive a compliance status signal from an authenticated requestor within a certain amount of time, the imaging device maintains a normal operating state. In some embodiments, the requestor can send an ACK or all clear message, which can indicate that the imaging device can maintain a normal operating mode.
[0058] In some embodiments, the imaging device enters a compliance state any time the imaging device makes a position determination. In this way, the imaging device cannot be used (at least completely) during the time period when the imaging device's position is determined. If the imaging device is determined to be in an authorized jurisdiction, the imaging device can be returned to a normal operating state. Otherwise, the imaging device either remains in the current compliance state or enters a more stringent compliance state (e.g., the current compliance state can be line-off, while the more stringent compliance state is the imaging device being turned off entirely).
[0059] Fig. 6A is a schematic diagram illustrating a right side cutaway view 600 of an example digital based thermal scope 602 in accordance with an embodiment of the present disclosure. Fig. 6A The digital based thermal sight 602 shown in FIG. 6 includes a body 604, receiving optics 606, receiving optical sensor 608, processing electronics 610, viewing computer display 612, viewing optics 614, internal rechargeable battery 616, and user replaceable battery 618 (within battery turret 620 and secured with removable battery turret cover 622). Fig. 6A The two additional turret-type assemblies not shown (i.e., 652 and 654) refer to Figure 6B .
[0060] The body 604 is configured to allow mounting on a device (e.g., a gun or a tripod) using a mounting system similar to that used to mount optical-based imaging devices. For example, the body 604 can be mounted to the device at approximately positions 624a and 624b using a ring mounting system.
[0061] At a high level, receiving optics 606 and receiving optical sensor 608 collect incoming electromagnetic radiation (e.g., IR light) for computer processing. Data generated by receiving optical sensor 608 (e.g., a charge coupled device (CCD), complementary metal oxide semiconductor (CMOS), or quantum image sensor (QIS)) is processed by processing electronics 610 into image data for re-creation / representation on viewing computer display 612 (e.g., a color / monochrome liquid crystal display (LCD) or organic light emitting diode (OLED) display, or other similar / suitable display) and viewing through viewing optics 614.
[0062] The internal rechargeable battery 616 is used to provide power to components and functions associated with the illustrated digital-based thermal sight 602. For example, the internal rechargeable battery 616 can be used to power the receiving optical sensor 608, the processing electronics 610 (and associated provided functions), the viewing computer display 612, data transmission interfaces (e.g., Universal Serial Bus (USB), FIREWIRE, and Wi-Fi), control mechanisms (e.g., Figure 6B), and other functionality consistent with the present disclosure (e.g., displaying a reticle on a viewing computer display 612 and wired / wireless integration with a mobile computing device). In some embodiments, the internal rechargeable battery 616 can include lead acid, nickel cadmium (NiCd), nickel metal hydride (NiMH), lithium ion (Li-ion), lithium ion polymer (Li-ion polymer), or other suitable battery technology consistent with the present disclosure. In some embodiments, the internal rechargeable battery 616 can be recharged from power supplied by a data transfer interface (e.g., a USB port) or a user-replaceable battery 618. For example, the processing electronics 610 can be configured to detect a low state of charge of the internal rechargeable battery 616 and draw power from the user-replaceable battery 618 to charge the internal rechargeable battery 616 to a minimum state of charge (if possible).
[0063] In some embodiments, the digital-based thermal sight 602 can be configured to use power from the user-replaceable battery 618 until a minimum state of charge is reached, at which point the digital-based thermal sight 602 can switch to the internal rechargeable battery 616 (if it has a sufficient state of charge) or be gracefully shut down due to lack of power. Once the charged user-replaceable battery 618 is reinstalled, the digital-based thermal sight 602 can switch power consumption back to the user-replaceable battery 618. The user-replaceable battery 618 can be used to extend the allowed usage time of the digital-based thermal sight 602. For example, a user can hot-swap the user-replaceable battery 618 to keep the digital-based thermal sight 602 operating while discharging with a new battery. In other embodiments, the digital-based thermal sight 602 can be configured to use power from the internal rechargeable battery 616 until a minimum state of charge is reached, at which point the digital-based thermal sight 602 can switch to the user-replaceable battery 618 (if present) or be gracefully shut down due to lack of power. In some embodiments, the mode of battery operation (ie, primary battery use and secondary battery use) can be selected by the user according to their specific needs.
[0064] In some embodiments, an external power source can power the digital-based thermal sight 602 and recharge the internal rechargeable battery 616 and the user-replaceable battery 618 (if rechargeable). For example, the processing electronics 610 can be configured to determine whether an external power source is available (e.g., using a USB port or other external port (not shown)) and whether the internal rechargeable battery 616 or the user-replaceable battery 618 is in a low power state. If power is available, power can be directed to recharge the internal rechargeable battery 616 or the user-replaceable battery 618. In some embodiments, the processing electronics 610 can trigger an indicator (e.g., a light emitting diode (LED), an audio chirp, observing a computer display 612, or other visual / audio indicator) that the internal rechargeable battery 616 or the user-replaceable battery 618 is (or about to be) discharged or is being charged. In some embodiments, the processing electronics 610 can be configured to transmit data to a mobile computing device to display a message to the user that the internal rechargeable battery 616 or the user-replaceable battery 618 is discharged and needs to be replaced or recharged. In some embodiments, the rechargeable user-replaceable battery 618 can include lead-acid, nickel-cadmium (NiCad), nickel-metal hydride (NiMH), lithium-ion (Li-ion), lithium-ion polymer (Li-ion polymer), or other suitable battery technology consistent with the present disclosure.
[0065] In some embodiments, the internal rechargeable battery 616 is not user replaceable and must be replaced by an authorized service center. In other embodiments, the body 604 can be configured to be detachable (e.g., at 626) to allow the user to replace the internal rechargeable battery 616. For example, once the rechargeable battery exceeds a certain number of recharge cycles, the battery cannot maintain the desired amount of charge. In this case, the user may need to replace the exhausted internal rechargeable battery 616. In a specific example, once the internal rechargeable battery 616 is installed, the body 604 can be a two-piece configuration that is screwed together (e.g., at 626). In this configuration, the two-piece body 604 can be unscrewed, separated, the internal rechargeable battery 616 is replaced by a new battery, and the two-piece body 604 is screwed back together. Other attachment mechanisms for the two-piece body 604 consistent with the present disclosure are considered to be within the scope of the present disclosure.
[0066] The battery turret 620 is configured to hold user replaceable batteries 618. A removable battery turret cover 622 is used to secure the user replaceable batteries 618 within the battery turret 620. In some embodiments, the user replaceable batteries 618 can be rechargeable or non-rechargeable and in varying form factors, such as 123A, CR2032, AA, and AAA).
[0067] In some embodiments, the battery turret cover 622 can be a pop-up, friction fit, or screw-on cover. In some embodiments, the battery turret cover 622 can be retained to the digital-based thermal sight 602 using a wire loop, elastic band, or other retention mechanism to prevent the battery turret cover 622 from becoming separated from the digital-based thermal sight 602. In a typical embodiment, the battery turret cover 622 (or battery compartment 622) is configured with one or more O-rings or other seals to provide a waterproof and dustproof compartment for the user-replaceable battery 618.
[0068] In some embodiments, the processing electronics 610 can also be configured to provide other functionality consistent with the present disclosure. For example, the processing electronics 610 can be configured to provide Wi-Fi, USB, streaming video, firmware upgrades, connectivity with mobile computing devices, control interfaces, and other functionality consistent with the present disclosure associated with the digital-based thermal sight 602.
[0069] Figure 6B FIG. 1 is a diagram showing a conventional optical-based scope form factor configuration according to an embodiment of the present disclosure. Fig. 6A An example of a digital based schematic diagram of a top view cross-sectional view 650 of a thermal sight 602. Figure 6B As shown, the digital-based thermal sight 602 includes an integrated, push / turn type single control mechanism turret (control) 652 and a data transfer interface turret 654. Other form factors are within the scope of the present disclosure.
[0070] The control 652 can provide integrated control functions associated with the digital-based thermal sight 602. For example, if the digital-based thermal sight 602 is powered off, a long press push of the "cover" configured into the control 652 can power on the digital-based thermal sight 602 (or conversely, if it is powered on, power off the digital-based thermal sight 602). When viewing the optical device 614 through the viewing computer display 612, the rotation and pressing type action of the control 652 can be used to navigate between the displayed graphical user interface menus and select menu items. Any functionality provided by the control 652 consistent with the present disclosure is considered to be within the scope of the present disclosure. In some embodiments, the mobile computing device can be integrated with the digital-based thermal sight 602 (e.g., using Wi-Fi) and provide an interface (e.g., using a software application) to allow alternative configurations of the digital-based thermal sight 602.
[0071] The data transfer interface turret 654 is used to provide a data transfer interface (e.g., USB 658 and Wi-Fi 660) for the digital-based thermal sight 602. For example, in conjunction with the processing electronics 610, the described data transfer interface can provide Wi-Fi, USB, streaming video, firmware upgrades, connectivity with mobile computing devices, control interfaces, and other functions consistent with the present disclosure and associated with the digital-based thermal sight 602. In some embodiments, the data transfer interface (e.g., USB 658) can be used to provide external power to the digital-based thermal sight 602 to power the digital-based thermal sight 602 functions or to recharge the internal rechargeable battery 616 or the user-replaceable battery 618.
[0072] In some embodiments, the data transfer interface turret 654 is configured with a removable turret cover 656. In some embodiments, the turret cover 656 can be a pop-up, friction fit, or screw-on cover. In some embodiments, the turret cover 656 can be retained to the digital-based thermal sight 602 using a wire loop, elastic band, or other retention mechanism to prevent the turret cover 656 from becoming separated from the digital-based thermal sight 602. In a typical embodiment, the turret cover 656 (or data transfer interface turret 654) is configured with one or more O-rings or other seals to provide a waterproof and dustproof compartment for the associated data transfer interface.
[0073] Note that while the present disclosure has described configurations and functionality associated with digital-based imaging devices that are sensitive to thermal electromagnetic radiation (e.g., IR), as will be appreciated by one of ordinary skill in the art, the described subject matter is also applicable to implementations of digital-based imaging devices that are sensitive to any other type of detectable electromagnetic radiation (e.g., ultraviolet (UV) and visible / ambient / daylight). These other implementations are considered to be within the scope of the present disclosure.
[0074] Figure 7 is a block diagram illustrating an example of a computer-implemented system 700 (e.g., representative of or as part of processing electronics 106) for providing computing functionality associated with the described algorithms, methods, functions, processes, procedures, and programs according to an embodiment of the present disclosure. In the illustrated embodiment, system 700 includes computer 702 and network 730.
[0075] The computer 702 shown is intended to encompass any computing device, such as a server, a desktop computer, a laptop / notebook computer, a wireless data port, a smart phone, a personal data assistant (PDA), a tablet computer, one or more processors within these devices, another computing device, or a combination of computing devices, including a physical or virtual instance of a computing device, or a combination of physical or virtual instances of a computing device. Additionally, the computer 702 can include an input device, such as a keypad, a keyboard, a touch screen, another input device, or a combination of input devices capable of accepting user information, and an output device that communicates information associated with the operation of the computer 702, including digital data, visuals, audio, another type of information, or a combination of types of information on a graphical type user interface (UI) (or GUI) or other UI.
[0076] The computer 702 can function as a client, a network component, a server, a database, or another persistence, another role, or a combination of roles for performing the subject matter described in the present disclosure in a distributed computing system. The computer 702 is shown communicatively coupled to a network 730. In some implementations, one or more components of the computer 702 can be configured to operate within an environment, including cloud-based, local, global, another environment, or a combination of environments.
[0077] At a high level, the computer 702 is an electronic computing device operable to receive, send, process, store or manage data and information associated with the described subject matter. According to some embodiments, the computer 702 can also include or be communicatively coupled to a server, including an application server, an email server, a web server, a cache server, a streaming data server, another server, or a combination of servers.
[0078] The computer 702 can receive requests over the network 730 (e.g., from a client software application executing on another computer 702) and respond to the received requests by processing the received requests using the software application or a combination of software applications. In addition, requests can also be sent to the computer 702 from an internal user (e.g., from a command console or through another internal access method), an external or third party, or other entity, person, system, or computer.
[0079] Each component of the computer 702 can communicate using the system bus 703. In some embodiments, any or all components of the computer 702 (including hardware, software, or a combination of hardware and software) can be interfaced on the system bus 703 using an application programming interface (API) 714, a service layer 716, or a combination of API 714 and service layer 716. API 714 can include specifications for routines, data structures, and object classes. API 714 can be independent of or dependent on computer languages, and refers to a complete interface, a single function, or even a set of APIs. Service layer 716 provides software services to computer 702 or other components (whether or not shown) that are communicatively coupled to computer 702. Service layer 716 can be used to access the functions of computer 702 for all service consumers. Software services such as those provided by service layer 716 provide reusable, defined functions through defined interfaces. For example, an interface can be a combination of software written in JAVA, C++, another computing language, or a computing language that provides data in an extensible markup language (XML) format, another format, or a combination of formats. Although shown as an integral component of the computer 702, alternative implementations can show the API 714 or service layer 716 as a separate component relative to or communicatively coupled to other components of the computer 702 (whether shown or not). Furthermore, any or all portions of the API 714 or service layer 716 can be implemented as a sub-module or sub-module of another software module, enterprise application, or hardware module without departing from the scope of the present disclosure.
[0080] Computer 702 includes interface 704. Although shown as a single interface 704, two or more interfaces 704 can be used according to the specific needs, expectations or specific implementation of computer 702. Interface 704 is used by computer 702 to communicate with another computing system (whether shown or not) that is communicatively linked to network 730 in a distributed environment. Typically, interface 704 is operable to communicate with network 730 and includes logic encoded in software, hardware or a combination of software and hardware. More specifically, interface 704 can include software that supports one or more communication protocols associated with communication, so that network 730 or hardware interface 704 is operable to transmit physical signals within and outside of the computer 702 shown. In an example, interface 704 can include USB, FIREWIRE or Wi-Fi technology.
[0081] The computer 702 includes a processor 708. Although illustrated as a single processor 708, two or more processors 708 may be used depending on the particular needs, desires, or particular implementation of the computer 702. In general, the processor 708 executes instructions and manipulates data to perform the operation of the computer 702 and any algorithms, methods, functions, procedures, processes, and programs as described in this disclosure.
[0082] The computer 702 also includes a database 706, which can store the data of the computer 702, another component (whether or not shown) of the network 730, or a combination of the computer 702 and another component. For example, the database 706 can be a memory, conventional or another type of database that stores data consistent with the present disclosure. In some embodiments, according to the specific needs, expectations or specific implementations of the computer 702 and the described functions, the database 706 can be a combination of two or more different database types (e.g., a hybrid memory and conventional database). Although shown as a single database 706, according to the specific needs, expectations or specific implementations of the computer 702 and the described functions, two or more databases of similar or different types can be used. Although the database 706 is illustrated as an integrated component of the computer 702, in alternative embodiments, the database 706 can be outside the computer 702.
[0083] The computer 702 also includes a memory 720 capable of storing data of the computer 702, another component or components (whether or not shown) that are communicatively linked to the network 730, or a combination of the computer 702 and another component. The memory 720 can store any data consistent with the present disclosure. In some embodiments, the memory 720 can be a combination of two or more different types of memory (e.g., a combination of semiconductor and magnetic storage) according to the specific needs, expectations, or specific implementations of the computer 702 and the functions described. Although shown as a single memory 720, two or more memories 720 or similar or different types can be used according to the specific needs, expectations, or specific implementations of the computer 702 and the functions described. Although the memory 720 is illustrated as an integrated component of the computer 702, in alternative embodiments, the memory 720 can be outside the computer 702.
[0084] The application 712 is an algorithmic software engine that provides functionality according to the specific needs, expectations, or specific implementation of the computer 702, particularly with respect to the functionality described in the present disclosure. For example, the application 712 can be used as one or more components, modules, or applications. In addition, although shown as a single application 712, the application 712 can be implemented as multiple applications 708 on the computer 702. In addition, although shown as being integral to the computer 702, in alternative implementations, the application 712 can be external to the computer 702.
[0085] The computer 702 can also include a power supply 718. The power supply 718 can include a rechargeable or non-rechargeable battery that can be configured to be user-replaceable or non-user-replaceable. In some embodiments, the power supply 718 can include power conversion or management circuitry (including recharging, standby, or another power management function). In some embodiments, the power supply 718 can include a power plug to allow the computer 702 to be plugged into a wall outlet or another power source to, for example, power the computer 702 or recharge a rechargeable battery.
[0086] There can be any number of computers 702 associated with or external to the computer system containing the computer 702, each communicating via the network 730. Furthermore, the terms "client," "user," or other appropriate terms may be used interchangeably without departing from the scope of the present disclosure. Furthermore, the present disclosure contemplates that many users can use one computer 702, or that one user can use multiple computers 702.
[0087] Implementations of the described subject matter can include one or more features alone or in combination.
[0088] Example 1 is an imaging device comprising: an image capture device configured to observe an image of a scene including an object observed by the imaging device; a display for displaying an image of a reticle and an image of the scene; a hardware processor; and
[0089] A memory storing computer-readable instructions executable by a hardware processor to perform operations including: performing image recognition analysis on an image of a scene; determining that an object in the image is a prohibited object; and causing a display to stop displaying an image of a reticle.
[0090] Example 2 may include the subject matter of Example 1, further comprising a memory comprising a list of objects; wherein determining that the object in the image is a prohibited object comprises comparing the object to the list of objects.
[0091] Example 3 may include the subject matter of any of Examples 1-2, the operations comprising: determining that a prohibited object is in a field of view of an imaging device; and after expiration of a threshold amount of time, if the prohibited object is in the field of view, causing the imaging device to shut down.
[0092] Example 4 may include the subject matter of any of Examples 1-3, wherein the operations include: incrementing a counter indicating a counter value of the number of times a prohibited object has been identified; comparing the counter value to a threshold; and turning off the imaging device if the counter value exceeds the threshold.
[0093] Example 5 may include the subject matter of any of Examples 1 to 4, the operations comprising: determining that a prohibited object is in a field of view of an imaging device; and after a threshold timer amount expires, if the prohibited object is in the field of view, turning off the display.
[0094] Example 6 may include the subject matter of any of Examples 1-5, the operations comprising: performing image recognition analysis on an image of a scene; determining that the object is no longer in the image; and causing a reticle to be displayed on a display.
[0095] Example 7 may include the subject matter of any of Examples 1-6, wherein the image capture device comprises a camera.
[0096] Example 8 may include the subject matter of any of Examples 1-7, wherein the imaging device comprises at least one of a thermal imaging device and a night vision device.
[0097] Example 9 is a method comprising: displaying a marking line on a display of an imaging device; observing, by the imaging device, an object within a field of view of the imaging device; determining, by an image processor, that the object is a prohibited object; and ceasing to display the marking line on the display of the imaging device.
[0098] Example 10 may include the subject matter of Example 9, further comprising: determining that a prohibited object is in a field of view of the imaging device; and after expiration of a threshold amount of time, if the prohibited object is in the field of view, causing the imaging device to shut down.
[0099] Example 11 may include the subject matter of any of Examples 9-10, further comprising incrementing a counter indicating a counter value of a number of times a prohibited object has been identified; comparing the counter value to a threshold; and if the counter value exceeds the threshold, shutting down the imaging device.
[0100] Example 12 may include the subject matter of any of Examples 9-11, further comprising: determining that a prohibited object is in a field of view of the imaging device; and after a threshold timer amount expires, if the prohibited object is in the field of view, turning off the display.
[0101] Example 13 may include the subject matter of any of Examples 9-12, further comprising: performing image recognition analysis on the image of the scene; determining that the object is no longer in the image; and causing the reticle projector to display the image of the reticle.
[0102] Example 14 is a non-transitory computer-readable medium storing instructions that can be executed by a hardware processor to perform operations including: displaying a reticle on a display of an imaging device; receiving a signal representing an object in a scene; creating an imaging of the object in the scene from the received signal; performing image recognition analysis on the image of the object in the scene; determining that the object in the image is a prohibited object; and causing the display to stop displaying the image of the reticle.
[0103] Example 15 may include the subject matter of Example 14, the operations further comprising: determining that a prohibited object is in a field of view of an imaging device; and after a threshold amount of time has expired, if the prohibited object is in the field of view, causing the imaging device to shut down.
[0104] Example 16 may include the subject matter of any of Examples 14 to 15, wherein the operation further comprises: incrementing a counter indicating a counter value of the number of times a prohibited object has been identified; comparing the counter value to a threshold; and if the counter value exceeds the threshold, turning off the imaging device.
[0105] Example 17 may include the subject matter of any of Examples 14 to 16, the operations further comprising: determining that a prohibited object is in a field of view of the imaging device; and after a threshold timer amount expires, if the prohibited object is in the field of view, turning off the display.
[0106] Example 18 may include the subject matter of any of Examples 14 to 17, the operations further comprising: performing image recognition analysis on the image of the scene; determining that the object is no longer in the image; and causing the display to display a graticule.
Claims
1. An imaging device, comprising: an image capture device configured to observe an image of a scene including an object observed by the imaging device; a display, the display being used to display the image of the marking line and the image of the scene; Hardware processor; as well as A memory storing computer-readable instructions executable by the hardware processor to perform operations including: performing image recognition analysis on the image of the scene; determining that the object in the image is a prohibited object; and The display is caused to stop displaying the image of the reticle.
2. The imaging device according to claim 1, further comprising a memory, the memory comprising a list of objects; wherein: Determining that the object in the image is a prohibited object includes comparing the object to the list of objects.
3. The imaging device according to claim 1, wherein the operation comprises: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold amount of time, if the prohibited object is in the field of view, the imaging device is turned off.
4. The imaging device according to claim 1, wherein the operation comprises: incrementing a counter, the counter indicating a counter value of a number of times a prohibited object has been identified; comparing the counter value to a threshold value; as well as If the counter value exceeds the threshold, the imaging device is turned off.
5. The imaging device according to claim 1, wherein the operation comprises: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold timer amount, if the prohibited object is in the field of view, the display is turned off.
6. The imaging device according to claim 1, wherein the operation comprises: Perform image recognition analysis on the image of the scene; determining that the object is no longer in the image; as well as The marking line is displayed on the display.
7. The imaging device according to claim 1, wherein: The image capture device includes a camera.
8. The imaging device according to claim 1, wherein The imaging device includes at least one of a thermal imaging device and a night vision device.
9. A method comprising: displaying a graticule on a display of an imaging device; observing, by the imaging device, an object within the field of view of the imaging device; determining, by an image processor, that the object is a prohibited object; as well as Displaying the graticule on the display of the imaging device is stopped.
10. The method according to claim 9, further comprising: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold amount of time, if the prohibited object is in the field of view, the imaging device is turned off.
11. The method according to claim 9, further comprising: incrementing a counter, the counter indicating a counter value of a number of times a prohibited object has been identified; comparing the counter value to a threshold value; as well as If the counter value exceeds the threshold, the imaging device is turned off.
12. The method according to claim 9, further comprising: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold timer amount, if the prohibited object is in the field of view, the display is turned off.
13. The method according to claim 9, further comprising: Perform image recognition analysis on the image of the scene; determining that the object is no longer in the image; as well as The reticle projector is caused to display the image of the reticle.
14. A non-transitory computer-readable medium storing instructions executable by a hardware processor to perform operations comprising: displaying a graticule on a display of an imaging device; receiving a signal representing an object in a scene; creating an image of the object in the scene from the received signals; performing image recognition analysis on the images of objects in the scene; determining that the object in the image is a prohibited object; as well as The display is caused to stop displaying the image of the reticle.
15. The non-transitory computer readable medium storing instructions of claim 14, the operations further comprising: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold amount of time, if the prohibited object is in the field of view, the imaging device is turned off.
16. The non-transitory computer readable medium storing instructions of claim 14, the operations further comprising: incrementing a counter, the counter indicating a counter value of a number of times a prohibited object has been identified; comparing the counter value to a threshold value; as well as If the counter value exceeds the threshold, the imaging device is turned off.
17. The non-transitory computer readable medium storing instructions of claim 14, the operations further comprising: determining that the prohibited object is in a field of view of the imaging device; as well as After expiration of a threshold timer amount, if the prohibited object is in the field of view, the display is turned off.
18. The non-transitory computer readable medium storing instructions of claim 14, the operations further comprising: Perform image recognition analysis on the image of the scene; determining that the object is no longer in the image; as well as The display is caused to display the marking line.
