Multiple micro-eye cameras with ai processing and defensive control

Abstract

Aircraft multiple sensitive small micro-eye optical / IR (visible light and / or infrared) cameras distributed in many suitable places in the aircraft so that collectively they are able to visualize and scan all the surroundings. With AI analysis and processing, an integrated panoramic entire-scope view with some stereoscopic perception effect could gained. After few early trial-flights of each aircraft, AI should be able to unit images collected by all cameras into one integrated view of all surrounding universe and build up surrounding concentric virtual sensory shells. These cameras will act as micro eyes to detect all surroundings in space all the time. It spot any approaching anti-aircraft missile as a hot spot increasing rapidly in size and intensity so that AI will immediately activate appropriate protective maneuvers to escape the attaching missile(s) while avoiding accidents with any other surrounding aircrafts (objects). Suitable cable connections added for power supply and information sharing to central data controller processor controlled by AI. For existing aircrafts, it could added as add-on camera clusters with suitable cable connections. For future newly manufactured aircrafts, it should added to design in a better and proper way. This innovation could use also in many other military and civil industries.

Description

[0001] Multiple Micro-Eye Cameras

[0002] With Al processing and defensive control

[0003] To Create Virtual Sensory Shells and for Entire-Scope Vision and Scanning

[0004] For Aircrafts and More

[0005] (Multiple MECs with Al processing / defensive control to create VSS & for ES V / S

[0006] A ~ O fc \

[0007] 1 VI ML 04. IVIUI C /

[0008] Prior Art:

[0009] Aircrafts use many electronic tools like radars, including the recent AESA radar, as well as IR (infrared) sensor plates and high-resolution cameras to be objectively aware of surrounding environment during flights.

[0010] Defects in Prior Art:

[0011] Currently used tools (devices) are quite expensive, especially AESA radar, and each has limited-angle projection or coverage field. In case one tool went defective or out of order for some internal or environmental obscuration reason, aircraft will get blind for its particular field of coverage, as these tools cannot doubled for same field because of costs, size and weight.

[0012] Innovation in current newly innovated art:

[0013] Small size, lightweight and multiplicity at very low costs but sensitive enough to spot immediately any approaching threats from any direction ever. Al immediately activates suitable defensive measures. Multiplicity is a key innovation-advantage as it allows coverage-field overlap and some 3D or stereoscopic perception effect together with very fast, passive and efficient optical Al distance and speed estimation of spotted objects.

[0014] Industrial categories:

[0015] 1. Aviation industry.

[0016] 2. Optical electronics industry.

[0017] 3. Electronics industry.

[0018] 4. IT / AI software industry.

[0019] 5. Industries of rockets, warships, tanks, vehicles, cellphones, security cameras...etc.

[0020] Industrial Feasibility:

[0021] 1. Costs of each one good small optical / IR camera (like an excellent cellphone camera) is less than one US$ in mass production or purchase. So costs of 100 cameras are almost 100 US$ or less.

[0022] 2. Costs of assembling cameras with data cable connections (without labor charges) are just few hundreds of US$.

[0023] 3. Efficient main controller processor is already available, by default, in each modern aircraft.

[0024] 4. Ai / iT team and iabor technicians are already working for aircraft manufacturers and all what needed is to re-manage their efforts to have everything done properly.

[0025] Full Description

[0026] Introduction (Theory):

[0027] "Entire-Scope Vision" and awareness of all surrounding universe at all directions in the same time at all possible light spectrum from infrared to all visible light waves and up to ultraviolet is an impossible dream to achieve for any single optical system. Multiplicity and Al processing of images are the key of success for "Dream" to become "Reality". Image repetition at different angles of view and speed estimation for surrounding spotted objects by Al learning with the help of accompanying radar, altitude measure and other tools. Projection field overlaps improve visual quality and precision. Spotting a distant or nearby object or threat bv multiole cameras together intensifv < the sig Vnal *, u 1n Wgrade resolution

[0028] (pixel), lower threshold for Al to get alert and improve visualization. Al gradually build up concentric virtual sensory (crossings of different visual lines of different

[0029] MECs) shells (complete or incomplete) around aircraft at different distances with repetition frequency according to central processor capacity. Virtual sensory shells (VSS) for the lower half of surrounding universe are first to build up during takeoff and landing. These are most useful to guard against ground anti-aircraft missiles. VSS for other directions built up by special flying maneuvers as flying directly up or directly down or at one side or with upside down. These shells facilitate distance and speed estimation of surrounding objects. Focusing attention is biphasic, general scanning of all MECs at normal situation and focusing to MECs spotting threat at emergency status. This optimization is for not to overload central processor capacity with useless Al data processing. Ai muitipie-images processing integrates the "Entire-Scope Vision".

[0030] Descrmtion:

[0031] Multiple Micro-Eye Cameras with Al processing and defensive control to create Virtual Sensory Shells and for Entire-Scope Vision and Scanning for Aircrafts and More:

[0032] 1. For military aircrafts, multiple sensitive small micro-eye optical / IR (infrared) cameras (Multiple MECs) distributed at surface in many nonmasked suitable places in aircraft body, rear edge of front-radar cover, fixed wings and fixed fins... etc. Early, alternate cameras with half of cameras are infrared sensitive and other half are visible light sensitive. Later, cameras with dual sensitivity could use in less number or more effective coverage. Adding UV sensitive cameras is a possible future demand. Multiple MECs collectively are able to visualize and scan all the surroundings, with Ai analysis and processing, an integrated panoramic entire-scope view with some 3D or stereoscopic perception effect together with very fast, passive and efficient optical Al-processed distance and speed estimation of spotted objects could gained. This estimation done by analyzing Multiple MECs positions and view angles of same object / image. Fixing it only to fixed parts of aircraft is mandatory for fixed view angle and fixed coverage field. After few early trial-flights of each aircraft, Al should be able to unit images collected by all cameras into one micro eyes to detect all surrounding aircrafts (or any object e.g., mountains) in space all the time. Data sharing between different aircrafts in one mission accentuates the 3D or stereoscopic perception of all surrounding universe. It snot anv an I n r roachin wp anti-aircraft missile as a hot spot increasing rapidly in size and intensity so that Al will immediately activates appropriate protective maneuvers to mislead and escape the attaching missile(s) while avoiding accidents with any other surrounding aircrafts (objects). This is additional to and should be much faster / cheaper than any radar including AESA radar that will never be able to cover all potential directions of surroundings and threats without exemptions. Single radar also cannot have 3D or stereoscopic perception.

[0033] 2. Suitable cable connections for power supply and information sharing to central data control processor controlled by Al.

[0034] 3. For existing aircrafts, it could added as add-on MEC clusters with suitable cable connections.

[0035] 4. Electronic pen torch light localizer could use to help Al to recognize the exact position of each ME Camera on aircraft. This is important for stereoscopic perception effect and distance / speed estimation.

[0036] 5. For future newly manufactured aircrafts, it should added to design in a better and proper way.

[0037] G. Multiple MECs innovation could use in rockets, warships, tanks, vehicles... etc., to activate Al controlled different anti-missile defense mechanisms or measures. 7. Multiple MECs in group long-range, land-to-land or air-to-land... etc., rocket attack can make big difference. Each of all attacking rockets with Multiple MECs given small slave Al controller processor and one only given master Al controller processor. With inter-communication, attack couio done in high controi and precision.

[0038] 8. In civil life, Multiple MECs with Al defensive control in civil aircrafts can minimize ground and air crash accidents. In group-air-show, Multiple MECs with Al control and inter-communication can add a lot. In traffic, it can decrease vehic,lcs,accidents by activating some Al controlled defensive measures. If Multiple MECs well positioned in vehicles, traffic authority vehicles or in roads, very fast, passive and efficient optical Al- processed distance and speed estimation of all spotted vehicles could creation of 3D video documents or records for events or accidents with activation of possible warning / defensive measures.

[0039] How to use this invention (Multiple MECs with Al process! ng / defensive control to create VSS & for ES V / S for Ac & More):

[0040] 1. The start is always calibration. Detailed drawing of aircraft external design including locations of numerated MECs fed to Al. Electronic pen torch light localizer used to help Al to recognize the exact position of each ME Camera on aircraft surface. This is important for stereoscopic perception effect and distance / speed estimation. This done by putting its light directly to one ME Camera, one by one, for Al to recognize it particularly. Exact position and number of each fed to Ai eiectronicaiiy or by programming.

[0041] 2. Early few flights are mandatory for Al to recognize and unit all images coming from multiple fixed mosquito-eye cameras from multiple directions into One integrated entite-SCOpe panoramic View of whole universe around the aircraft as well as building possible VSS in all directions with some 3D or stereoscopic effect together with very fast, passive and efficient optical Al-processed distance and speed estimation positions and view angles of same object / image in relation to VSS. In actual operational missions later on, it allows Al to recognize all the time all other accompanying aircrafts in their real-time positions, if mission necessitates more than one aircraft. Data sharing between different aircrafts in one mission accentuates the 3D or stereoscopic perception of aii surrounding universe. Once a threatening anti-aircraft missile is detected as a hot spot rapidly increasing in size and intensity, Al activates automated (even in manned aircrafts as Al response is faster and more precise than human response) complex air marieiivers to mislead and escape the threat avoiuirig crasn accidents with other aircrafts or objects (e.g., mountains). At the same moment, it warns pilot(s), in manned aircrafts (or drone ground station), of threat and start of automated complex escaping maneuvers so that he jump seat once needed. Once threat successfully escaped, Al gives aircraft control back to pilot or ground station. Al rapidly revise recorded videos for accurate localization of around noint from it anti-aircraft mis >sile shot and lock it in to take carp of. Automated shooting to that point, once detected and localized, could programmed, as it is faster than human response. Multiple MECs innovation could use in rockets, warships, tanks, vehicles... etc., to activate Al controlled different anti-missile defense mechanisms or measures. Multiple MECs in group long-range, land / land or air / land... etc., rocket attack can make a big difference. Each of all attacking rockets with Multiple MECs given a small slave Al controller processor and one rocket attack could done in high control and precision. In civil life, Multiple MECs with Al defensive control in civil aircrafts can minimize ground and air crash accidents. In group-air-show, Multiple MFC c i* / ith A l rnntrnl and « i «n «t «ra V>r « -rnmmi inir *a■«tin V*n ran add a Int In traffic it can decrease vehicles' accidents by activating some Al controlled defensive measures. If Multiple MECs well positioned in vehicles, traffic authority vehicles or in roads, very fast, passive and efficient optical Al- processed distance and speed estimation of all spotted vehicles could done. In addition, it can activate Al controlled cellphone or security cameras creation of 3D video records or documents for events or accidents with activation of possible warning or defensive measures Benefits of current invention, Multiple MECs with Al processing / defensive control to create VSS & for ES V / S for Ac & More:

[0042] 1. Simple very useful tool or device that could added to existing aircrafts or incorporated in future aircraft manufacturing at very low costs.

[0043] 2. Real time passive recognition of all aircraft's surroundings at very low costs and high precision.

[0044] 3. Fast immediate passive spotting and recognition of threatening antiaircraft missiles at very low costs and high efficiency.

[0045] 4. Misleading and escaping threatening anti-aircraft missiies to save aircraft at very low costs and high efficiency.

[0046] 5. Unique "Entire-Scope" view with full coverage of all surrounding universe in all directions without a single exemption at very low costs and high efficiency resulting in sensational shells (VSS) with no single blind spot.

[0047] 5. Super added some effective 3D or stereoscopic perception effect at very low costs.

[0048] 7. Very fast, passive and efficient optical Al-processed distance and speed

[0049] 8. This innovation could use in rockets, warships, tanks, vehicles... etc., to activate Al controlled different anti-missile defense mechanisms or measures at very low costs.

[0050] 9. Multiple MECs in group long-range, land / land or air / land... etc., rocket attack can make a big difference. Each of all attacking rockets with Multiple MECs given small slave Al controller processor and one only given master Al controller processor. With inter-communication, attack could done in high control and precision for reasonably low extra costs. lO.ln civil life, Multiple MECs with Al defensive control in civil aircrafts can minimize ground and air crash accidents. In group-air-show, Multiple MECs with Al control and inter-communication can add a lot. In traffic, it can decrease vehicles' accidents by activating some Al controlled defensive measures. If Multiple MECs well positioned in vehicles, traffic authority vehicles or in roads, very fast, passive and efficient optical Al- processed distance and speed estimation of all spotted vehicles could done. It also can activate Al controlled cellphone or security cameras creation of 3D video documents or records for events or accidents with activation of possible warning or defensive measures at reasonably low costs. Drawings' Key:

[0051] Fig. 1 (Diagram of MECs connected to Aircraft's Central Controller Processor):

[0052] 1. Al controlled Central Controller Processor.

[0053] 2. Control Data Cables.

[0054] 3. Power Cable.

[0055] 4. MECs Data / Power cables.

[0056] 5. MECs at different locations and directions.

[0057] Fig. 2: (Diagram showing Al learning from radar information, Altitude Measure I n'fnrrnotlnn and nthor tnnlc7InfOHYtStiOR 3R£! COfTSlstSS it With IRforfRStiOR collected by Multiple MECs to build up Virtual Sensory Shells):

[0058] A. On Ground (Taxing).

[0059] B. At Takeoff (or Landing).

[0060] C. During Flying.

[0061] Fig. 3: (in operation, Multiple MECs with Al processing / defensive control built-up Virtual Shells to mislead and escape it):

[0062] A. Front view.

[0063] B. Top view.

[0064] C. Side view. ii

Claims

Claims:

1. Multiple sensitive small micro-eye optical / IR (for visible light and / or infrared) cameras with Al processing and defensive control to create virtual sensory shells and for entire-scope vision and scanning for aircrafts and more. For military aircrafts, Multiple MECs, alternate or dual sensitivity, distributed at surface in many non-masked suitable places in aircraft body, rear edge of front-radar cover, fixed wings and fixed (for fixed coverage field) fins... etc. Multiple MECs collectively are able to visualize and scan aii the surroundings. ith Ai analysis and processing, an integrated full panoramic entire-scope view with some 3D or stereoscopic perception effect could gained. After few early trial-flights of each aircraft, Al should be able to unit images collected by all cameras into one integrated panoramic view of ail surrounding universe. These cameras will act as micro eyes to detect all surrounding aircrafts (or any object e.g., mountains) in space all the time. Al gradually build up concentric virtual sensory shells around aircraft at different distances. Itin size and intensity so that Al will immediately activate appropriate complex protective maneuvers to mislead and escape the attaching missile(s) while avoiding accidents with any other surrounding aircrafts ( »obiectsk Focusinwg attention is bin J hasic f. ge >neral scanning of all MECs at normal situation and focusing to MECs spotting threat and nearby aircrafts (objects) while scanning other MECs at emergency status. This optimization is for not to overload central processor capacity with useless Al data processing. This is additional to and should be much faster / cheaper than any radar / tool including AESA radar that will never be able to cover all potential directions of surroundings and threats without exemptions. Adding UV sensitive cameras is a possible future demand2. As in item 1, suitable cable connections for power supply and information sharing to central data controller processor controlled by Al for data processing and defensive control.

3. As in item 1, well positioning of Multiple MECs allow very fast, passive and efficient optical Ai-processed distance and speed estimation of spotted objects.

4. As in item 1, wireless data sharing between different aircrafts in one mission accentuates the 3D or stereoscopic perception of all surrounding universe.

5. As in item 1, for existing aircrafts, Multiple MECs could added as add-on camera clusters with suitable cable connections.

6. As in item 1, electronic pen torch light localizer used to help Al to recognize the exact position of each ME Camera on aircraft surface. This is important for stereoscopic perception effect. This done by putting its light directly to one ME Camera, one by one, for Al to recognize each particularly. Exact position of each fed to Al electronically or by programming.

7. As in item 1, Multiple MECs for future newly manufactured aircrafts,8. As in item 1, Multiple MECs innovation could use in rockets, warships, tanks, vehicles... etc., to activate Al controlled different anti-missile defense mechanisms or measures.

9. As in item 1 * . Multio « lp MECs in w proun I lon Wp-ran Ve*p *. land-to-land or air-to- land... etc., rocket attack can make a big difference. Each of all attacking rockets with Multiple MECs given small slave Al controller processor and one only given master Al controller processor. With inter-communication, attack could done in high control and precision.10.As in item 1, in civil life, Multiple MECs with Al defensive control in civil aircrafts can minimize ground and air crash accidents. In group-air-show, Multiple MECs with Al control and inter-communication can add a lot. In traffic, it can help to decrease vehicles' accidents by activating some Al controlled defensive measures. If Multiple MECs well positioned in vehicles, traffic authority vehicles or in roads, very fast, passive and efficient optical Al-processed distance and speed estimation of all spotted vehicles could done. It can also activate Al controlled cellphone or security cameras creation of 3D video documents or records for events or accidents with activation of possible warning or defensive measures.

Images