Systems and methods for inspecting aircraft

Abstract

To provide systems and methods for remotely inspecting an aircraft.SOLUTION: A system 100 for inspecting an aircraft 102 at a first location 112 includes an imaging device 104 configured to acquire one or more images 105 of one of or more surfaces of the aircraft 102 at the first location 112. A control unit 106 is in communication with the imaging device 104. The control unit 106 is configured to receive the one or more images 105. A user interface 108 is in communication with the control unit 106. The user interface 108 is at a second location 114 that differs from the first location 112. The user interface 108 includes a display 110. The control unit 106 is configured to show the one or more images 105 on the display 110. Accordingly, the inspection is performed at the second location 114, e.g., by an individual, using the display 110.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 502,929, filed May 18, 2023, which is incorporated by reference in its entirety into this specification.

[0002]

[0002] Embodiments of the present disclosure generally relate to systems and methods for remotely inspecting aircraft. [Background technology]

[0003]

[0003] Aircraft are used to transport passengers and cargo between various locations. Many aircraft depart and arrive at a typical airport each day.

[0004]

[0004] Aircraft are manually inspected before and after flight. For example, individuals view various parts of the aircraft looking for evidence of damage, such as that caused by other objects, hail, lightning, etc. Manual inspections generally require the use of lifts, which may be at risk of tipping over and causing damage to the aircraft through inadvertent lift contact, etc. Furthermore, the process of such inspections is time consuming and labor intensive. For example, one or more individuals operate the lifts as well as juggle support equipment to access various areas of the aircraft. Additionally, manual documentation of inspection results typically produces non-digital information that may not be easily accessible. Summary of the Invention

[0005]

[0005] There is a need for improved systems and methods for inspecting aircraft. With this need in mind, certain embodiments of the present disclosure provide a system configured to inspect an aircraft at a first location. The system includes an imaging device configured to acquire one or more images of one or more surfaces of the aircraft at the first location. A control unit communicates with the imaging device. The control unit is configured to receive the one or more images. A user interface communicates with the control unit. The user interface is at a second location, different from the first location. The user interface includes a display. The control unit is configured to display the one or more images on the display. The inspection is performed at the second location.

[0006]

[0006] The inspection may include one or more of a general visual inspection of the aircraft, a lightning inspection of the aircraft, or a hail damage inspection of the aircraft.

[0007] In at least one embodiment, the control unit is configured to modify the one or more images based on at least one characteristic of the display.

[0008] In at least one embodiment, the control unit is configured to calculate optical requirements of the display to maintain an optical resolution consistent with the performance of human eye inspection of the aircraft.

[0009]

[0009] In at least one embodiment, the control unit is configured to model human visual performance by applying calculations of the resolution of the human eye to define a baseline for reproducing performance on the display.

[0010] In at least one embodiment, the control unit is configured to split one or more images into a plurality of portions for display on the display.

[0011]

[0011] The control unit may be further configured to store the one or more images in a memory.

[0012] In at least one embodiment, the mobile cart includes the imaging device. In another embodiment, the drone includes the imaging device.

[0013] In at least one embodiment, the control unit is configured to compare the one or more images with one or more reference images of the aircraft to automatically detect one or more anomalies.

[0014]

[0014] In at least one embodiment, the control unit is configured to automatically identify one or more anomalies in one or more images via artificial intelligence or machine learning.

[0015] Certain embodiments of the present disclosure provide a method for inspecting an aircraft at a first location, the method including acquiring one or more images of one or more surfaces of the aircraft at the first location with an imaging device, receiving the one or more images with a control unit in communication with the imaging device, displaying, by the control unit, the one or more images on a display of a user interface at a second location different from the first location, and performing an inspection of the aircraft at the second location by said displaying.

[0016] Certain embodiments of the present disclosure provide a non-transitory computer-readable medium including executable instructions that, when executed, cause one or more control units including a processor to perform operations including receiving one or more images from an imaging device of one or more portions of an aircraft at a first location and displaying the one or more images on a display of a user interface at the second location to enable performance of an inspection at a second location different from the first location. [Brief description of the drawings]

[0017] [Figure 1]

[0017] A schematic block diagram of a system for inspecting an aircraft according to one embodiment of the present disclosure is shown. [Diagram 2]

[0018] 1 shows a simplified diagram of a mobile platform having an imaging device according to one embodiment of the present disclosure. [Diagram 3]

[0019] 1 shows a simplified diagram of a mobile platform having an imaging device according to one embodiment of the present disclosure. [Figure 4]

[0020] 1 shows a simplified description of the capabilities of the human eye. [Diagram 5]

[0021] 1 shows a simplified diagram of an individual some distance away from the surface of an aircraft. [Figure 6]

[0022] 1 shows a simplified description of the size of an object as it results from the human eye. [Figure 7]

[0023] Indicates the letter E on an eye chart. [Figure 8]

[0024] 1 shows a simplified description of human eye resolution in megapixels. [Figure 9]

[0025] 1 shows a simplified illustration of what it is like to view a 44 megapixel image on a fixed resolution monitor. [Figure 10]

[0026] 1 shows a simplified description of viewing distance from a display. [Figure 11]

[0027] 1 illustrates an image of a portion of an aircraft according to one embodiment of the present disclosure. [Figure 12]

[0028] 12 illustrates a segmented version of the image of FIG. 11 according to one embodiment of the present disclosure. [Figure 13]

[0029] FIG. 1 illustrates a perspective front view of an aircraft according to one embodiment of the present disclosure. [Figure 14]

[0030] 1 shows a flowchart of a method according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018]

[0031] The above summary, as well as the following detailed description of certain embodiments, will be better understood when read in conjunction with the accompanying drawings. As used herein, it should be understood that the use of "a" or "an" in the singular form of an element or step does not necessarily exclude a plurality of such elements or steps. Furthermore, references to "one embodiment" are not intended to be interpreted as excluding the existence of additional embodiments that incorporate features described herein. Furthermore, embodiments that "comprising" or "having" one or more elements having a particular condition may include additional elements that do not have such conditions (unless expressly stated otherwise).

[0019]

[0032] Broadly speaking, embodiments of the present disclosure provide a system and method for remotely inspecting an aircraft. The system and method may be used in conjunction with various types of aircraft inspections, such as general visual inspections, lightning strike inspections, hail damage inspections, etc. The system and method provide a remote inspection that reduces overall inspection time, reduces the potential for injury to individuals, and reduces the potential for damage to the aircraft.

[0020]

[0033] The system and method provide image-based remote inspection, and the images can be stored for future reference, used to track potential damage over time, and used to provide a permanent digital record of the condition of the aircraft.

[0021]

[0034] In at least one embodiment, the system and method are configured to identify the capabilities of the human eye and convert it into digital information that can be viewed at a remote workstation. The image capture parameters and monitor technical specifications can be used in the process to recreate the experience in the remotely located aircraft. The transfer of image information can be processed by an inspector anywhere in the world via a cloud system.

[0022]

[0035] Embodiments of the present disclosure provide an inspection experience equivalent to meeting certified aircraft maintenance requirements. Systems and methods may be configured to identify damage types, such as via stored reference images, artificial intelligence, and / or machine learning.

[0023]

[0036] In at least one embodiment, the control unit executes image processing algorithms, which may also provide image overlap percentages, inspection image enhancement, depth and size assessments, etc. In at least one embodiment, the control unit is configured to model human visual performance, such as by applying calculations of human eye resolution, which defines a baseline for replicating performance at the remote work site. System specifications for the remote site hardware and monitor capabilities are used in processing logic by the control unit. The results of the modeling create an image segmentation scheme that utilizes the monitor capabilities and input of the aircraft imagery associated with the work site human eye model.

[0024]

[0037] Several embodiments of the present disclosure provide systems and methods for inspecting an aircraft. The systems and methods include an imaging device configured to capture one or more images of one or more surfaces of the aircraft. A control unit communicates with the imaging device. The control unit is configured to receive the one or more images. A user interface communicates with the control unit. The user interface includes a display. The control unit is configured to display the one or more images (e.g., the processed image(s)) on the display. In at least one embodiment, the imaging device is at the location of the aircraft and the user interface is remote from the location of the aircraft. In at least one embodiment, the control unit is configured to modify the one or more images based on at least one characteristic of the display.

[0025]

[0038] FIG. 1 illustrates a schematic block diagram of a system 100 for inspecting an aircraft 102 according to one embodiment of the present disclosure. The system 100 may be used in connection with various types of inspections, such as general visual inspections, lightning strike inspections, hail damage inspections, etc. The system 100 may also be used during maintenance processes, as well as during manufacturing processes. The system 100 includes an imaging device 104, such as a camera. The camera may be a digital photo camera. As another example, the imaging device 104 may be a video camera. As another example, the imaging device 104 may be an infrared camera.

[0026]

[0039] Imaging device 104 is configured to capture images 105 of various portions of aircraft 102. In at least one embodiment, imaging device 104 is configured to capture digital photographs of various exterior surfaces of aircraft 102. As another example, imaging device 104 may be configured to capture digital video of various surfaces of aircraft 102.

[0027]

[0040] In at least one embodiment, the imaging device 104 may be supported on a mobile platform configured to maneuver the imaging device 104 around the aircraft. As one example, the imaging device 104 may be coupled to a mobile cart, such as by one or more mobile arms, booms, or the like. As another example, the imaging device 104 may be coupled to a drone configured to fly around the aircraft. The imaging device 104 may be moved according to a prescribed path (e.g., a flight path prescribed by an original equipment manufacturer (OEM) or airline associated with the aircraft) to ensure that the inspection is completed in a manner such that certification or other requirements are met.

[0028]

[0041] The imaging device 104 and the aircraft 102 are at a first location 112. That is, the imaging device 104 is at the location of the aircraft 102. As described herein, the imaging device 104 is positioned in proximity to the aircraft 102 (e.g., within visual range of the imaging device 104) to enable the imaging device 104 to capture images 105 of various exterior and / or interior surfaces of the aircraft 102. In at least one embodiment, an image positioning plan for the imaging device 104 defines an image field of view, distance from an object being imaged, gimbal angle settings, and / or other position and orientation requirements.

[0029]

[0042] The control unit 106 communicates with the imaging device 104, such as via one or more wired or wireless connections. The control unit 106 may be located remotely from the imaging device 104. The control unit 106 is configured to receive captured images from the imaging device 104.

[0030]

[0043] The control unit 106 also communicates with a user interface 108, such as via one or more wired or wireless connections. The user interface 108 includes a display 110, such as an electronic monitor or television. In at least one embodiment, the control unit 106 and the user interface 108 are part of a computer workstation. In at least one other example, the control unit 106 and the user interface 108 may be part of a handheld device. The user interface 108 also includes input devices 111, such as one or more of a keyboard, a mouse, a stylus, a touch screen interface, and the like. The input devices 111 enable a user to receive, select, manipulate, and the like, images and data.

[0031]

[0044] The user interface 108 is at a separate second location 114 that is separate from the first location 112. The first location 112 may not be visible from the second location 114. As an example, the first location 112 may be outside an airport gate, while the second location 114 may be a closed room that is not visible from the first location 112. As another example, the first location 112 and the second location 114 may be separated by a large distance, such as tens, hundreds, or thousands of miles apart. The user interface 108 is located remotely from the imaging device 104 and the aircraft 102. That is, the user interface 108 is not at the first location 112, such as at the aircraft's location. Instead, the user interface 108 may be at a central monitoring location remote from the aircraft.

[0032]

[0045] The control unit 106 may be at the first location 112. For example, the imaging device 104 may include the control unit 106. As another example, the control unit 106 may be at the second location 114. As another example, the control unit 106 may be at a third location that is different from the first location 112 and the second location 114.

[0033]

[0046] In at least one embodiment, the control unit 106 is also in communication with a memory 107, such as via one or more wired or wireless connections. The control unit 106 may include a memory 107. The memory 107 stores one or more reference images 109 of a portion of the aircraft 102.

[0034]

[0047] In at least one embodiment, the control unit 106 may also store the images 105 captured by the imaging device 104, such as in memory 107. In this manner, the captured images 105 may be used as further reference images 109 for future inspections. The stored images 105 may be used to track potential damage over time, as well as to provide a permanent digital record of the condition of the aircraft 102.

[0035]

[0048] During operation, the imaging device 104 acquires images 105 of various surfaces of the aircraft 102. The control unit 106 receives the images 105. The images 105 are then displayed on a display 110. Thus, an inspection of the aircraft 102 is performed at a second location 114 that is remote from the first location 112, such as by an individual viewing the images 105 on the display 110.

[0036]

[0049] The control unit 106 is configured to display the image 105 on the display 110 at the second location 114. The image 105 shown on the display 110 at the second location 114 is displayed on the display to match the capabilities of the human eye at the first location 112.

[0037]

[0050] In at least one embodiment, the control unit 106 performs the inspection automatically without human intervention. For example, the control unit 106 compares the image 105 to a reference image 109 to automatically identify anomalies (e.g., differences) therebetween. The control unit 106 then flags the anomalies in the image 105 and outputs an alert to the user interface 108 indicating the anomalies. The alert may include one or more of a graphic, text, audio, and the like. For example, the control unit 106 may automatically highlight, encircle, circle, or indicate with an arrow the anomaly in the image 105.

[0038]

[0051] As used herein, terms such as "control unit," "central processing unit," "CPU," "computer," and the like, may include any processor-based or microprocessor-based system, including systems using microcontrollers, reduced instruction set computers (RISC), application specific integrated circuits (ASIC), logic circuits, and any other circuits or processors including hardware, software, or combinations thereof capable of performing the functions described herein. The above examples are illustrative only and thus are not intended to limit in any way the definition and / or meaning of the above terms. For example, the control unit 106 may be or include one or more processors configured to control operations as described herein.

[0039]

[0052] The control unit 106 is configured to execute a set of instructions stored in one or more data storage units or elements (such as one or more memories) to process data. For example, the control unit 106 may include or be coupled to one or more memories. The data storage units may also store data or other information as desired or needed. The data storage units may take the form of an information source or a physical memory element within a processing machine.

[0040]

[0053] The set of instructions may include various commands that instruct the control unit 106 as a processing machine to perform certain operations (e.g., methods and processes of various embodiments of the subject matter described herein). The set of instructions may take the form of a software program. The software may take various forms such as system software or application software. Furthermore, the software may take the form of a collection of separate programs, a program subset within a larger program, or a portion of a program. The software may also include modular programming in the form of object-oriented programming. The processing of input data by the processing machine may be in response to user commands, in response to results of previous processing, or in response to a request made by another processing machine.

[0041]

[0054] The diagrams of the embodiments herein may depict one or more control or processing units, such as the control unit 106. It should be understood that the processing or control unit may represent a circuit, circuitry, or a portion thereof, that may be implemented as hardware having associated instructions (e.g., software stored in a tangible, non-transitory computer-readable storage medium, such as a computer hard drive, ROM, RAM, etc.) that perform the operations described herein. The hardware may include state machine circuitry that is hardwired to perform the functions described herein. Optionally, the hardware may include electronic circuitry that includes and / or is connected to one or more logic-based devices, such as a microprocessor, processor, controller, etc. Optionally, the control unit 106 may represent a processing circuit, such as a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), microprocessor(s), etc. The circuitry in various examples may be configured to execute one or more algorithms to perform the functions described herein. Such one or more algorithms may include aspects of the embodiments disclosed herein, whether or not they are explicitly identified in a flowchart or method.

[0042]

[0055] As used herein, the terms "software" and "firmware" are used interchangeably and include any computer program stored in a data storage unit (e.g., one or more memories) for execution by a computer, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and non-volatile RAM (NVRAM) memory. The types of data storage units listed above are merely examples and thus are not limiting as to the types of memory that may be used for storage of a computer program.

[0043]

[0056] The system 100 is configured to provide remote, uninstrumented inspection related to the exterior and / or interior of the aircraft 102. The remote inspection is configured to be equivalent to aircraft maintenance performed by a licensed mechanic / inspector at an aircraft inspection location. Some embodiments of the present disclosure use images 105 and designated monitor capabilities at a location remote from the aircraft 102 (e.g., second location 114) using a typical human vision criterion, such as 20 / 20 visual acuity, to complete the human inspection at the inspection location. The control unit 106 provides images 105 of the aircraft 102 acquired by the imaging device 104 at the first location 112 to a display 110 at the second location 114. For example, the control unit 106 displays the images 105 on the display 110.

[0044]

[0057] In at least one embodiment, the control unit 106 calculates the optical requirements of the display 110 (e.g., monitor size, pixel density, distance from the monitor, etc.) to maintain the optical resolution required to match the inspection performance of the human eye. Several embodiments of the present disclosure ensure comparable results between inspections performed remotely and at the inspection location. Generally, the systems and methods described herein enable remote visual inspection of images of the surface of the aircraft 102.

[0045]

[0058] The remote inspection systems and methods described herein have been found to substantially reduce inspection times (e.g., by at least 50%). The systems and methods also (a) enable flexible maintenance planning activities to identify surface anomalies early in the process, (b) reduce costs for airlines, and (c) increase safety (e.g., individuals do not need to travel on or around the aircraft 102).

[0046]

[0059] Known aircraft inspection processes are governed by established and approved practices. Aircraft manufacturers mandate approved maintenance methods to continue safe operations. To perform remote inspections equivalent to current practices with maintainers stationed on the aircraft, the systems and methods described herein ensure results equivalent to inspections performed on-site. Remote aircraft inspection utilizes unique processes and tools for large area inspections and eliminates or otherwise reduces access infrastructure such as lifts and stanchions, thereby reducing exposure to potential safety events. As described herein, the systems and methods analyze: 1) the visual acuity of the human eye, 2) distance from the aircraft, 3) the resolution of the human eye, and 4) the characteristics of the monitor.

[0047]

[0060] 2 shows a simplified diagram of a mobile platform 120 having an imaging device 104 according to one embodiment of the present disclosure. The imaging device 104 is supported on the mobile platform 120, such as a movable cart configured to maneuver the imaging device 104 around an aircraft. For example, the mobile platform 120 includes a base 121 having wheels 122. One or more mobile arms 124 movably couple the imaging device 104 to the base 121.

[0048]

[0061] 3 shows a simplified diagram of a mobile platform 120 having an imaging device 104 according to one embodiment of the present disclosure. The mobile platform 120 is or otherwise includes a drone having an airframe 126 and a propulsion system 128, such as one or more propellers. The drone is configured to fly around an aircraft.

[0049]

[0062] FIG. 4 shows a simplified description of the capabilities of the human eye. Referring to FIGS. 1-4, in at least one embodiment, the control unit 106 can use a remote computer station, such as the user interface 108, to first define the capabilities of the human eye to replicate a human eye test for the aircraft 102. The human eye can clearly see objects of a particular size from a specified distance. A measurement of this ability is defined as visual acuity. A visual acuity test is an eye test that measures an individual's eye's ability to read or see fine details to identify the sharpness and clarity of vision. To perform an inspection of an object, such as one or more portions of the aircraft 102 at the first location 112, the eye's capabilities identify the ability to see imperfections in the surface of the object, such as scratches, grooves, and cracks. Although visual acuity varies among technicians, the control unit 106 can assume 20 / 20 vision, which is a typical measure of normal vision, corrected or uncorrected. 20 / 20 vision is defined as an individual's ability to see objects 20 feet away with a resolution of one arc minute, the same as an average individual can see on an eye chart.

[0050]

[0063] FIG. 5 illustrates a simplified diagram of an individual 130 that is a distance 134 away from the surface 132 of the aircraft 102. Inspections of aircraft are typically performed at a specified distance from the aircraft 102 depending on the type of inspection being performed. For example, a general visual inspection is dictated by industry guidance to be performed within touching distance. With reference to FIGS. 1-5, in at least one non-limiting example, if a general visual inspection is being performed, the control unit 106 may use 30.5 inches as the average arm's reach of a typical man and woman to indicate the distance from the aircraft 102 being inspected. Optionally, the distance 134 may be less than 30.5 inches (e.g., between 20 and 30 inches) or greater than 30.5 inches (e.g., between 31 and 45 inches).

[0051]

[0064] FIG. 6 shows a simplified representation of the resulting object size by the human eye. FIG. 7 shows the letter E on an eye chart. As shown and described with respect to FIG. 6 and FIG. 7, the ability of a person performing the test at 30.5 inches from the object can be calculated. With reference to FIG. 1-FIG. 7, in at least one embodiment, when Theta is 1 arc minute and D is 30.5 inches from the object, the control unit 106 calculates the resulting arc length (S). The resulting object size or space / gap between two edges of the spatial pattern that can be seen with 20 / 20 vision is 0.0089 inches. This represents the size of the object that can be resolved by the human eye.

[0052]

[0065] FIG. 8 shows a simplified illustration of human eye resolution in megapixels. As shown and explained in FIG. 8, the area an individual can observe when standing within arm's reach of an aircraft is 48 inches up and down and 72 inches left and right, which is called the field of view (FOV). In this case, the FOV is defined as a 6 foot by 4 foot rectangle that defines the boundaries of an individual's ability to see in all directions from the inspection location. As explained, the resulting object size that can be resolved by the human eye at 30.5 inches from the object is 0.0089 inches. With reference to FIGS. 1-8, when determining the human eye resolution to cover an area of ​​6 feet by 4 feet, the control unit 106 divides the resulting object size (0.0089 inches) by the FOV of 6 feet by 4 feet, thereby giving the number of pixels that can fit within a 6 foot by 4 foot space. This calculation gives 8089 pixels by 5393 pixels for a total of 43,623,977 pixels, or 44 megapixels.

[0053]

[0066] FIG. 9 shows a simplified illustration of viewing a 44 megapixel (MP) image on a fixed resolution monitor. As shown and described in FIG. 9, the resolution of an exemplary display 110 (such as a monitor) is a measure of the number of pixels the display 110 can display. Higher resolutions produce sharper images. For a human eye positioned 30.5 inches away from an object covering a 48 inch by 72 inch field of view, the monitor resolution would be 44 MP. Thus, the control unit 106 may use a 1:1 representation of 44 MP to preserve the human visual experience.

[0054]

[0067] As an example, to view the full 44 MP image on an 8.3 MP monitor (3840 x 2160 pixels), also known as 4K resolution, control unit 106 removes 35.7 MP from image 105 to create a lower resolution image. Viewing the image on the 8.3 MP monitor represents approximately 1 / 5 of the pixel data. To view all 44 MP of the image on the 8.3 MP display 110, control unit 106 splits image 105 into 5.3 MP portions 105a, 105b, 105c, 105d, and 105e on display 110.

[0055]

[0068] Optionally, a smaller monitor at a particular resolution may provide a sharper image than a larger monitor at the same resolution, but the sharper image on a smaller monitor may make it difficult to see details due to the monitor size.

[0056]

[0069] FIG. 10 shows a simplified illustration of viewing distance from a display 110. As shown and described with respect to FIG. 10, remote testing is performed at a computer station (e.g., user interface 108 shown in FIG. 1) having a display 110 (such as an electronic monitor) positioned at a specified distance from the observer's eyes. The monitor-to-eye distance ensures that the observer can see one pixel of screen resolution in one arc minute. Distance d ensures that the monitor-to-eye distance ensures that the observer can see one pixel of screen resolution in one arc minute. In one embodiment, display 110 is a 4K monitor. It is 21 inches wide (3840 pixels), 12 inches high (2160 pixels), and has 8,217,600 pixels (8.3 MP). Monitor area = 21 inches x 12 inches = 252 square inches. The area of ​​one pixel is 252 square inches / 8,217,600 pixels = 3.06681 x 10 -5 In square inches. S = √Area of ​​1 pixel = √3.06681 x 10 -5 = 0.005538 inches. d = S / Θ = 0.005538 inches / 0.000290888 radians. d = 9.03785 inches is the viewing distance from the display 110.

[0057]

[0070] FIG. 11 illustrates an image 105 of a portion of an aircraft according to one embodiment of the disclosure. FIG. 12 illustrates the image 105 of FIG. 11 in divisions or portions A, B, C, D, E, and F according to one embodiment of the disclosure. With reference to FIGS. 1-12, to present the image 105 on the display 110 as it may be viewed at the location of the aircraft 102, the control unit 106 divides the image 105 for inspection on the display 110. For example, the control unit 106 divides the image 105 into separate portions A-F. The control unit 106 identifies the size, shape, and number of portions A-F using a variety of factors, including, but not limited to, the specifications of the inspection monitor, the size / resolution of the image captured, the type of inspection being performed, and the like. As an example, based on the resolution of the human eye, the control unit 106 divides the 44 MP image 105 (captured by the imaging device 104 at the location of the aircraft 102) into six 7.3 MP portions A-F, as shown in FIG.

[0058]

[0071] In at least one embodiment, the image 105 is displayed on the display 110 and an individual inspects the image 105 for anomalies (such as damage or defects) in the exterior of the aircraft 102. Optionally or additionally, in at least one embodiment, the control unit 106 compares the image 105 to a reference image 109 in the memory 107 (such as stored images of the aircraft as manufactured and / or from previous inspections). Based on the comparison, the control unit 106 can automatically flag differences between the current image 105 and the reference image 109. As another example, the control unit 106 can automatically identify anomalies, such as via artificial intelligence or machine learning. In at least one embodiment, the control unit 106 can also tag an image number associated with the image to provide a unique image identifier that supports other trend analysis processes.

[0059]

[0072] In at least one embodiment, the sequence in which parts A-F are presented on display 110 may be predefined or determined based on artificial intelligence or machine learning. For example, parts with identified or potential defects may be displayed first.

[0060]

[0073] The images may be checked for color, contrast, and resolution by the control unit 106. The control unit 106 may also identify and display the image overlap percentage. Images may be configured to overlap one another, which may provide different perspectives and contrast and easier identification of anomalies.

[0061]

[0074] In at least one embodiment, the control unit 106 may also register the surface coordinates of the aircraft relative to the image 105. Thus, the control unit 106 may provide an identification of which location on the aircraft 102 the image 105 corresponds to.

[0062]

[0075] In at least one embodiment, the control unit 106 can also overlay the locations of frame and rib stations, stringers, longerons, wing spars, etc. onto the image.

[0063]

[0076] In at least one embodiment, the control unit 106 is configured to provide enhanced inspection image coverage.

[0064]

[0077] In at least one embodiment, the control unit 106 is configured to identify defect areas of interest, categorize and classify the defects, evaluate the size and depth of the defects, perform non-contact non-destructive testing, and / or provide a report. The control unit 106 can analyze the images 105 from multiple inspections and identify anomalies within the images using data analysis and trend analysis. In at least one embodiment, the defect or damage information can be converted by the control unit 106 into a three-dimensional model of the aircraft 102 that documents the dent and buckle information (e.g., type, size, location, etc. of the damage).

[0065]

[0078] In at least one embodiment, all or a portion of the systems and methods described herein may be or may otherwise include an artificial intelligence (AI) or machine learning system that may automatically perform the operations of the methods described herein. For example, the control unit 106 may be an artificial intelligence or machine learning system. These types of systems may be trained and / or self-trained from external information to iteratively improve the accuracy of the way data is analyzed to automatically detect anomalies in the images 105. Over time, these systems may improve by identifying such information with increasing accuracy and speed, thereby significantly reducing the likelihood of any potential errors. For example, the AI ​​or machine learning system may learn and identify image segmentation parameters to automatically detect anomalies, defective picture areas, etc. in the images 105. The AI ​​or machine learning systems described herein may include techniques enabled by adaptive predictive capabilities. The techniques exhibit at least some degree of autonomous learning to automate and / or enhance pattern detection (e.g., recognizing irregularities or regularities in data), customization (e.g., generating or modifying rules to optimize record matching), and the like. The system may be trained and retrained using feedback from one or more prior analyses of the data, ensemble data, and / or other such data. Based on this feedback, the system may be trained by adjusting one or more parameters, weights, rules, criteria, etc. used in the same analysis. This process may be performed using the data and / or ensemble data instead of the training data and may be repeated multiple times to iteratively improve the identification and localization of various features in the image 105. The training minimizes conflicts and interferences by implementing an iterative training algorithm, in which the system is retrained with an updated set of data based on feedback examined prior to the most recent training of the system. This provides a robust analytical model that can better identify locations, features, structures, etc. in a cost-effective and efficient manner.

[0066]

[0079] FIG. 13 illustrates a perspective front view of an aircraft 300 according to one embodiment of the disclosure. The aircraft 300 is an embodiment of the aircraft 102 shown in FIG. 1. The aircraft 300 includes a propulsion system 312 including, for example, engines 314. Optionally, the propulsion system 312 may include more engines 314 than shown. The engines 314 are supported by wings 316 of the aircraft 300. In other embodiments, the engines 314 may be supported by a fuselage 318 and / or a tail section 320. The tail section 320 may also support a horizontal stabilizer 322 and a vertical stabilizer 324. The fuselage 318 of the aircraft 300 defines an interior cabin 330. FIG. 13 illustrates an example of the aircraft 300. It is understood that the aircraft 300 may be sized, shaped, and configured differently than that shown in FIG. 13. Optionally, embodiments of the present disclosure may be used with other types of vehicles, such as automobiles, buses, trains, ships, spacecraft, and the like.

[0067]

[0080] FIG. 14 illustrates a flowchart of a method according to an embodiment of the present disclosure. Referring to FIGS. 1-14, the method is for inspecting an aircraft 102 at a first location 112. The method includes, at 400, acquiring one or more images 105 of one or more surfaces of the aircraft 102 at the first location 112 by an imaging device 104. The method further includes, at 402, receiving the one or more images 105 by a control unit 106 in communication with the imaging device 104. The method also includes, at 404, displaying, by the control unit 106, the one or more images 105 on a display 110 of a user interface 108 at a second location 114 different from the first location 112. The method also includes, at 406, performing an inspection of the aircraft 102 at the second location 114 by displaying 404. The method may also include generating and submitting a report regarding the inspection.

[0068]

[0081] In at least one embodiment, the method also includes modifying, by the control unit 106 , the one or more images 105 based on at least one characteristic of the display 110 .

[0069]

[0082] In at least one embodiment, the method also includes calculating, by the control unit 106, the optical requirements of the display 110 to maintain an optical resolution that matches the performance of human eye inspection of the aircraft 102.

[0070]

[0083] In at least one embodiment, the method also includes modeling, by the control unit 106, human visual performance by applying calculations of the resolving power of the human eye to define a baseline for replicating performance on the display 110.

[0071]

[0084] In at least one embodiment, displaying 404 includes dividing, by the control unit 106, one or more images 105 into multiple portions.

[0072]

[0085] The method may also include storing, by the control unit 106 , the one or more images 105 in a memory 107 .

[0073]

[0086] In at least one embodiment, the method also includes comparing, by the control unit 106, the one or more images 105 to one or more reference images 109 of the aircraft 102, and automatically detecting, by the control unit 106, one or more anomalies via the comparison.

[0074]

[0087] In at least one embodiment, the method includes automatically identifying, by the control unit 106, one or more anomalies in the one or more images 105 via artificial intelligence or machine learning.

[0075]

[0088] Furthermore, the present disclosure includes embodiments according to the following clauses.

[0076]

[0089] Article 1. 1. A system configured to inspect an aircraft at a first location, comprising: an imaging device configured to capture one or more images of one or more surfaces of the aircraft at the first location; a control unit in communication with the imaging device, the control unit configured to receive the one or more images; and a user interface in communication with the control unit, the user interface being at a second location different from the first location and including a display; The control unit is configured to display the one or more images on the display, and the inspection is performed at the second location.

[0077]

[0090] Article 2. 2. The system of claim 1, wherein the inspection includes one or more of a general visual inspection of the aircraft, a lightning strike inspection of the aircraft, or a hail damage inspection of the aircraft.

[0078]

[0091] Article 3. 3. The system of claim 1 or 2, wherein the control unit is configured to modify the one or more images based on at least one characteristic of the display.

[0079]

[0092] Article 4. The system of any one of clauses 1 to 3, wherein the control unit is configured to calculate optical requirements of the display to maintain an optical resolution that matches the performance of human eye inspection of the aircraft.

[0080]

[0093] Article 5. The system of any one of clauses 1 to 4, wherein the control unit is configured to model human visual performance by applying calculations of the resolving power of the human eye to define a baseline for reproducing capabilities on the display.

[0081]

[0094] Article 6. 6. The system of any one of clauses 1 to 5, wherein the control unit is configured to divide the one or more images into a plurality of portions for display on the display.

[0082]

[0095] Article 7. 7. The system of any one of clauses 1 to 6, wherein the control unit is further configured to store the one or more images in a memory.

[0083]

[0096] Article 8. 8. The system of any one of clauses 1 to 7, further comprising a mobile cart containing the imaging device.

[0084]

[0097] Article 9. The system described in any one of clauses 1 to 7, further comprising a drone including the imaging device.

[0085]

[0098] Article 10. 10. The system of any one of clauses 1 to 9, wherein the control unit is configured to compare the one or more images with one or more reference images of the aircraft to automatically detect one or more anomalies.

[0086]

[0099] Article 11. 11. The system of any one of clauses 1 to 10, wherein the control unit is configured to automatically identify one or more anomalies in the one or more images via artificial intelligence or machine learning.

[0087]

[0100] Article 12. 1. A method configured to inspect an aircraft at a first location, comprising: acquiring, with an imaging device, one or more images of one or more surfaces of the aircraft at the first location; receiving, by a control unit in communication with the imaging device, the one or more images; displaying, by the control unit, the one or more images on a display of a user interface at a second location different from the first location; and performing the inspection of the aircraft at the second location by displaying.

[0088]

[0101] Article 13. 13. The method of claim 12, further comprising modifying, by the control unit, the one or more images based on at least one characteristic of the display.

[0089]

[0102] Article 14. 14. The method of claim 12 or 13, further comprising calculating, by the control unit, optical requirements of the display to maintain an optical resolution consistent with performance for human eye inspection of the aircraft.

[0090]

[0103] Article 15. 15. The method of any one of clauses 12 to 14, further comprising modelling human visual performance by applying calculations of the resolving power of the human eye to define a baseline for replicating capabilities on the display, by the control unit.

[0091]

[0104] Article 16. 16. The method of any one of clauses 12 to 15, wherein the displaying includes dividing the one or more images into a plurality of portions, by the control unit.

[0092]

[0105] Article 17. 17. The method of any one of clauses 12 to 16, further comprising storing, by the control unit, the one or more images in a memory.

[0093]

[0106] Article 18. comparing, by the control unit, the one or more images to one or more reference images of the aircraft; and 18. The method of any one of clauses 12 to 17, further comprising automatically detecting, by the control unit, one or more anomalies in the one or more images via the comparing.

[0094]

[0107] Article 19. 19. The method of any one of clauses 12 to 18, further comprising automatically identifying, by the control unit, one or more anomalies in the one or more images via artificial intelligence or machine learning.

[0095]

[0108] Article 20. 1. A system configured to inspect an aircraft at a first location, the inspection including one or more of a general visual inspection of the aircraft, a lightning inspection of the aircraft, or a hail damage inspection of the aircraft, the system comprising: an imaging device configured to capture one or more images of one or more surfaces of the aircraft at the first location; a control unit in communication with the imaging device, the control unit configured to receive the one or more images; and a user interface in communication with the control unit, the user interface being at a second location different from the first location and including a display; the control unit is configured to modify the one or more images based on at least one characteristic of the display, the control unit is configured to calculate optical requirements for the display to maintain an optical resolution consistent with performance of a human eye inspection of the aircraft, the control unit is configured to model human visual performance by applying human eye resolution calculations to define a baseline for replicating performance on the display, the control unit is configured to display the one or more images on the display, the control unit is configured to segment the one or more images into a plurality of portions that are displayed on the display, the control unit is configured to automatically identify one or more anomalies in the one or more images via artificial intelligence or machine learning, and the inspection is performed at the second location.

[0096]

[0109] Article 21. A non-transitory computer-readable storage medium containing executable instructions that, in response to being executed, cause one or more control units comprising a processor to perform a plurality of operations, the plurality of operations including: receiving one or more images from an imaging device of one or more portions of the aircraft at a first location; and and displaying the one or more images on a display of a user interface at a second location to enable performance of an inspection at the second location, the second location being different from the first location.

[0097]

[0110] As described herein, embodiments of the present disclosure provide improved systems and methods for inspecting aircraft.

[0098]

[0111] For purposes of describing the embodiments of the present disclosure, various spatial and directional terms may be used, such as top, bottom, lower, middle, sideways, horizontal, vertical, front, etc., but it should be understood that such terms are used only with reference to the orientations shown in the drawings, and that these orientations may be flipped, rotated, or otherwise changed so that top becomes bottom, bottom becomes top, horizontal becomes vertical, and so on.

[0099]

[0112] As used herein, a structure, limitation, or element that is "configured to" perform a task or operation is structurally shaped, configured, or adapted to specifically correspond to the task or operation. For the sake of clarity and to avoid doubt, an object that can merely be modified to perform a task or operation is not, as used herein, "configured / set to" perform a task or operation.

[0100]

[0113] It should be understood that the above description is intended to be illustrative, not limiting. For example, the above-described examples (and / or aspects thereof) may be used in combination with each other. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the various embodiments of the present disclosure without departing from the scope of the present disclosure. The dimensions and types of materials described herein are intended to define aspects of the various embodiments of the present disclosure, but the embodiments are by no means limiting, but are illustrative examples. Many other examples will be apparent to those skilled in the art upon review of the above description. The scope of the various embodiments of the present disclosure should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. In the accompanying claims and the detailed description herein, the words "including" and "in which" are used as the plain English equivalents of the words "comprising" and "wherein," respectively. Moreover, terms such as "first," "second," and "third" are used merely as labels and are not intended to impose numerical requirements on their objects. Moreover, the limitations of the following claims are not written in means-plus-function form, and are not intended to be construed under 35 U.S.C. § 112(f) unless such claim limitations expressly use the phrase "means for" followed by a statement of function lacking further structure.

[0101]

[0114] The description herein uses examples to disclose various embodiments of the disclosure, including the best mode, and to enable any person skilled in the art to practice various embodiments of the disclosure, including making and using any device or system, and practicing any incorporated methods. The patentable scope of the various examples of the disclosure is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if the examples have structural elements that do not differ from the literal language of the claims, or if the examples include equivalent structural elements that differ only insignificantly from the literal language of the claims.

Claims

1. 1. A system (100) configured to inspect an aircraft (102) at a first location (112), comprising: an imaging device (104) configured to acquire one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first location (112); a control unit (106) in communication with the imaging device (104), the control unit (106) configured to receive the one or more images (105); and a user interface (108) in communication with the control unit (106), the user interface (108) being at a second location (114) different from the first location (112), the user interface (108) including a display (110); The control unit (106) is configured to display the one or more images (105) on the display (110), and the inspection is performed at the second location (114).

2. The system of claim 1 , wherein the inspection comprises one or more of a general visual inspection of the aircraft, a lightning strike inspection of the aircraft, or a hail damage inspection of the aircraft.

3. 2. The system (100) of claim 1, wherein the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110).

4. 2. The system of claim 1, wherein the control unit is configured to calculate optical requirements for the display to maintain an optical resolution consistent with performance for human eye inspection of the aircraft.

5. 2. The system of claim 1, wherein the control unit is configured to model human visual performance by applying calculations of the resolving power of the human eye to define a baseline for replicating performance on the display.

6. The system (100) of claim 1, wherein the control unit (106) is configured to divide the one or more images (105) into a plurality of portions for display on the display (110).

7. The system (100) of claim 1, wherein the control unit (106) is further configured to store the one or more images (105) in a memory (107).

8. The system (100) of claim 1, further comprising a mobile cart including the imaging device (104).

9. The system (100) of claim 1 further comprising a drone including the imaging device (104).

10. 2. The system (100) of claim 1, wherein the control unit (106) is configured to compare the one or more images (105) with one or more reference images (109) of the aircraft (102) to automatically detect one or more anomalies.

11. The system (100) of claim 1, wherein the control unit (106) is configured to automatically identify one or more anomalies in the one or more images (105) via artificial intelligence or machine learning.

12. 1. A method for inspecting an aircraft (102) at a first location (112), comprising: acquiring, with an imaging device (104), one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first location (112); receiving the one or more images (105) by a control unit (106) in communication with the imaging device (104); displaying, by the control unit (106), the one or more images (105) on a display (110) of a user interface (108) at a second location (114) different from the first location (112); and performing the inspection of the aircraft (102) at the second location (114) by said indicating.

13. The method of claim 12 , further comprising modifying, by the control unit (106), the one or more images (105) based on at least one characteristic of the display (110).

14. 13. The method of claim 12, further comprising: calculating, by the control unit, optical requirements of the display to maintain an optical resolution consistent with performance for human eye inspection of the aircraft.

15. 13. The method of claim 12, further comprising modeling human visual performance by applying calculations of the resolving power of the human eye to define a baseline for replicating performance on the display by the control unit.

16. The method of claim 12 , wherein the displaying comprises dividing, by the control unit (106), the one or more images (105) into a plurality of portions.

17. The method of claim 12, further comprising storing, by the control unit (106), the one or more images (105) in a memory (107).

18. comparing, by the control unit (106), the one or more images (105) with one or more reference images (109) of the aircraft (102); and The method of claim 12, further comprising automatically detecting, by the control unit (106), one or more anomalies in the one or more images (105) via the comparing.

19. The method of claim 12, further comprising automatically identifying, by the control unit (106), one or more anomalies in the one or more images (105) via artificial intelligence or machine learning.

20. 1. A system (100) configured to inspect an aircraft (102) at a first location (112), the inspection including one or more of a general visual inspection of the aircraft (102), a lightning strike inspection of the aircraft (102), or a hail damage inspection of the aircraft (102), the system (100) comprising: an imaging device (104) configured to acquire one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first location (112); a control unit (106) in communication with the imaging device (104), the control unit (106) configured to receive the one or more images (105); and a user interface (108) in communication with the control unit (106), the user interface (108) being at a second location (114) different from the first location (112), the user interface (108) including a display (110); the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110), the control unit (106) is configured to calculate optical requirements of the display (110) to maintain an optical resolution consistent with performance of a human eye inspection of the aircraft (102), the control unit (106) is configured to model human visual performance by applying human eye resolution calculations to define a baseline for replicating performance on the display (110), the control unit (106) is configured to display the one or more images (105) on the display (110), the control unit (106) is configured to segment the one or more images (105) into a plurality of portions that are displayed on the display (110), the control unit (106) is configured to automatically identify one or more anomalies in the one or more images (105) via artificial intelligence or machine learning, and the inspection is performed at the second location (114).

Images