System and method for remotely inspecting aircraft
Through the remote inspection system, imaging equipment and artificial intelligence are used to detect aircraft abnormalities, the safety hazards and low efficiency of manual inspections in the prior art are solved, and efficient and safe digital inspection results are achieved.
Patent Information
- Application Number
- CN202410452441.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-12-12
- Filing Date
- 2024-04-16
- Publication Date
- 2024-11-22
AI Technical Summary
In the prior art, aircraft inspection requires manual operation of the elevator, which poses safety risks and is time-consuming and labor-intensive. The inspection results are non-digital and difficult to access and manage.
Design a remote inspection system to obtain images of the aircraft surface using imaging devices and communicate with the user interface through the control unit. The image is displayed on the display. The user can check in a safe second position and automatically detect abnormalities using artificial intelligence or machine learning. .
Significantly reduces inspection time, reduces the risk of damage to individuals and aircraft, provides digital permanent records, and improves inspection efficiency and safety.
Smart Images

Figure CN118992116A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is related to and claims the benefit of priority of U.S. Provisional Patent Application No. 63 / 502,929, filed on May 18, 2023, which is hereby incorporated by reference in its entirety. Technical Field
[0003] Examples of the present disclosure generally relate to systems and methods for remotely inspecting an aircraft. Background Art
[0004] Aircraft are used to transport passengers and cargo between various locations. Many aircraft depart from and arrive at a typical airport every day.
[0005] Aircraft are manually inspected before and after flight. For example, individuals look at various parts of the aircraft to look for evidence of damage, such as damage caused by other objects, hail, lightning, etc. Manual inspections often require the use of a lift, which has the potential to result in a fall and possible damage to the aircraft, such as through accidental lift contact. In addition, the process of such inspections is time-consuming and labor-intensive. For example, one or more individuals operate a lift and expertly manipulate support equipment to access various areas of the aircraft. In addition, manual recording of inspection results often produces non-digital information that may not be easily accessible. Summary of the invention
[0006] There is a need for an improved system and method for inspecting an aircraft. In view of this need, certain examples of the present disclosure provide a system configured for inspecting an aircraft at a first location. The system includes an imaging device configured to acquire one or more images of one or more surfaces of the aircraft at the first location. A control unit is in communication with the imaging device. The control unit is configured to receive the one or more images. A user interface is in communication with the control unit. The user interface is at a second location different from the first location. The user interface includes a display. The control unit is configured to show the one or more images on the display. An inspection is performed at the second location.
[0007] The inspection may include one or more of the following: a general visual inspection of the aircraft, a lightning strike inspection of the aircraft, or a hail damage inspection of the aircraft.
[0008] In at least one example, the control unit is configured to modify the one or more images based on at least one characteristic of the display.
[0009] In at least one example, the control unit is configured to calculate optical requirements for the display to maintain an optical resolution that matches human eye inspection performance of the aircraft.
[0010] In at least one example, the control unit is configured to model human visual performance by applying calculations of human eye resolution to establish a baseline for replicating the capabilities on the display.
[0011] In at least one example, the control unit is configured to divide the one or more images into portions shown on the display.
[0012] The control unit may be further configured to store the one or more images in the memory.
[0013] In at least one example, a mobile cart includes an imaging device. As another example, a drone includes an imaging device.
[0014] In at least one example, the control unit is configured to compare the one or more images to one or more reference images of the aircraft to automatically detect one or more anomalies.
[0015] In at least one example, the control unit is configured to automatically determine one or more anomalies in the one or more images through artificial intelligence or machine learning.
[0016] Some examples of the present disclosure provide a method for inspecting an aircraft at a first location. The method includes acquiring one or more images of one or more surfaces of the aircraft at the first location by an imaging device; receiving the one or more images by a control unit in communication with the imaging device; displaying the one or more images on a display of a user interface at a second location different from the first location by the control unit; and performing an inspection of the aircraft at the second location through the display.
[0017] Certain examples of the present disclosure provide a non-transitory computer-readable storage medium including executable instructions that, in response to execution, cause one or more control units including a processor to perform operations including receiving one or more images of one or more portions of an aircraft at a first location from an imaging device; and showing the one or more images on a display of a user interface at a second location different from the first location to allow an inspection to be performed at the second location. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 A schematic block diagram of a system for inspecting an aircraft according to an example of the present disclosure is shown.
[0019] Figure 2 A simplified diagram of a mobile platform with an imaging device is shown according to an example of the present disclosure.
[0020] Figure 3 A simplified diagram of a mobile platform with an imaging device is shown according to an example of the present disclosure.
[0021] Figure 4 A simplified depiction of the capabilities of the human eye is shown.
[0022] Figure 5 A simplified view of an individual is shown at a distance from the surface of the aircraft.
[0023] Figure 6 A simplified depiction of the size of synthetic objects by the human eye is shown.
[0024] Figure 7 The letter E on an eye chart is shown.
[0025] Figure 8 A simplified depiction of the human eye's resolution in megapixels is shown.
[0026] Fig. 9 A simplified depiction of viewing a 44 megapixel image on a fixed resolution monitor is shown.
[0027] Fig.10 A simplified depiction of viewing distance from a display is shown.
[0028] Fig.11 An image of a portion of an aircraft according to an example of the present disclosure is shown.
[0029] Fig.12 The partition in the example according to the present disclosure is shown Fig.11 of the image.
[0030] Fig.13 A perspective front view of an aircraft according to an example of the present disclosure is shown.
[0031] Fig.14 A flow chart of a method according to an example of the present disclosure is shown. DETAILED DESCRIPTION
[0032] The above overview and the following detailed description of certain examples will be better understood when read in conjunction with the accompanying drawings. As used herein, elements or steps listed in the singular and preceded by the word "one" or "one" should be understood to not necessarily exclude plural elements or steps. In addition, reference to "an example" is not intended to exclude the existence of additional examples that also incorporate the described features. In addition, unless explicitly stated to the contrary, examples that "include" or "have" an element or multiple elements with a particular condition may include additional elements that do not have that condition.
[0033] Examples of the present disclosure provide systems and methods for remotely inspecting an aircraft. The systems and methods can be used with various types of aircraft inspections, such as general visual inspections, lightning strike inspections, hail damage inspections, etc. The systems and methods provide remote inspections that reduce overall inspection time, reduce the potential for injury to individuals, and reduce the potential for damage to the aircraft.
[0034] The system and method provide image-based remote inspection. The images can be stored for future reference and can be used to track potential damage over time, as well as provide a permanent digital record of the condition of the aircraft.
[0035] In at least one example, the system and method are configured to determine human eye capabilities and convert them into digital information to be viewed at a remote workstation. Image capture parameters and monitor specifications can be used to replicate the process of the experience at the aircraft when the aircraft is located at the remote location. The transfer of image information can be handled by inspectors around the world through a cloud system.
[0036] Examples of the present disclosure provide an equivalent inspection experience that meets certification aircraft maintenance requirements.Systems and methods may be configured to determine damage type, such as through stored reference images, artificial intelligence, and / or machine learning.
[0037] In at least one example, the control unit executes an image processing algorithm that may also provide image overlap percentages, check image progression, depth and size assessments, etc. In at least one example, the control unit is configured to model human visual performance, such as by applying a calculation of human eye resolution that establishes a baseline for replicating capabilities at the remote worksite. The control unit uses the remote site hardware and system specifications for monitoring capabilities in the processing logic. The results of the modeling create an image partitioning scheme that utilizes the capabilities of the monitor and the input of the aircraft imagery associated with the human eye model at the worksite.
[0038] Examples of the present disclosure provide systems and methods for inspecting an aircraft. The systems and methods include an imaging device configured to acquire one or more images of one or more surfaces of an aircraft. A control unit communicates with the imaging device. The control unit is configured to receive the one or more images. A user interface communicates with the control unit. The user interface includes a display. The control unit is configured to show one or more images (such as (one or more) processed images) on the display. In at least one example, the imaging device is at a location of the aircraft, and the user interface is away from the location of the aircraft. In at least one example, the control unit is configured to modify the one or more images based on at least one characteristic of the display.
[0039] Figure 1A schematic block diagram of a system 100 for inspecting an aircraft 102 according to an example of the present disclosure is shown. The system 100 can be used for various types of inspections, such as general visual inspections, lightning strike inspections, hail damage inspections, etc. The system 100 can be used during maintenance operations as well as manufacturing processes. The system 100 includes an imaging device 104, such as a camera. The camera can be a digital camera. As another example, the imaging device 104 can be a video camera. As another example, the imaging device 104 can be an infrared camera.
[0040] Imaging device 104 is configured to acquire images 105 of various portions of aircraft 102. In at least one example, imaging device 104 is configured to acquire digital photographs of various exterior surfaces of aircraft 102. As another example, imaging device 104 may be configured to acquire digital videos of various surfaces of aircraft 102.
[0041] In at least one example, the imaging device 104 can be supported on a mobile platform that is configured to maneuver the imaging device 104 around the aircraft. As an example, the imaging device 104 can be coupled to a mobile cart, such as by one or more mobile arms, booms, etc. As another example, the imaging device 104 can be coupled to a drone that is configured to fly around the aircraft. The imaging device 104 can move according to a defined path (e.g., a flight plan defined by an original equipment manufacturer (OEM) or an airline associated with the aircraft) to ensure that the inspection is completed in a manner that meets certification or other requirements.
[0042] The imaging device 104 and the aircraft 102 are in a first position 112. That is, the imaging device 104 is at the location of the aircraft 102. The imaging device 104 is located near the aircraft 102 (such as within a field of view of the imaging device 104) to allow the imaging device 104 to acquire images 105 of various exterior and / or interior surfaces of the aircraft 102, as described herein. In at least one example, an image positioning plan for the imaging device 104 establishes an image field of view, a distance to an object to be imaged, a gimbal angle setting, and / or other position and orientation requirements.
[0043] The control unit 106 is in communication with the imaging device 104, such as through one or more wired or wireless connections. The control unit 106 may be located remotely from the imaging device 104. The control unit 106 is configured to receive acquired images from the imaging device 104.
[0044] The control unit 106 also communicates with a user interface 108, such as through one or more wired or wireless connections. The user interface 108 includes a display 110, such as an electronic monitor, a television, etc. In at least one example, the control unit 106 and the user interface 108 are part of a computer workstation. In at least one other example, the control unit 106 and the user interface 108 can be part of a handheld device. The user interface 108 also includes an input device 111, such as one or more of a keyboard, a mouse, a stylus, a touch screen interface, etc. The input device 111 allows a user to retrieve images and data, select and manipulate images and data, etc.
[0045] The user interface 108 is at a second location 114 that is separate and distinct from the first location 112. The first location 112 may not be visible from the second location 114. As an example, the first location 112 is outside an airport gate, and the second location 114 may be an enclosed room from which the first location 112 cannot be seen. As another example, the first location 112 and the second location 114 may be separated by a large distance, such as tens, hundreds, or thousands of miles. The user interface 108 is located at a location remote from the imaging device 104 and the aircraft 102. That is, the user interface 108 is not at the first location 112, such as the location of the aircraft. Instead, the user interface 108 may be located at a central monitoring location remote from the aircraft.
[0046] The control unit 106 may be in the first position 112. For example, the imaging device 104 may include the control unit 106. As another example, the control unit 106 may be in the second position 114. As another example, the control unit 106 may be in a third position different from the first position 112 and the second position 114.
[0047] In at least one example, the control unit 106 is also in communication with the memory 107, such as through one or more wired or wireless connections. The control unit 106 can include the memory 107. The memory 107 stores one or more reference images 109 of various parts of the aircraft 102.
[0048] In at least one example, control unit 106 can also store images 105 acquired by imaging device 104, such as in memory 107. In this manner, acquired images 105 can be used as additional reference images 109 for future inspections. Stored images 105 can be used to track potential damage over time, as well as provide a permanent digital record of the condition of aircraft 102.
[0049] In operation, imaging device 104 acquires images 105 of various surfaces of aircraft 102. Control unit 106 receives images 105, which are then shown on display 110. In this way, an inspection of aircraft 102 is performed at second location 114 remote from first location 112, such as by a person viewing images 105 on display 110.
[0050] The control unit 106 is configured to show the image 105 on the display 110 at the second location 114. The image 105 shown in the display 110 at the second location 114 is shown on the display to match the human eye capabilities at the first location 112.
[0051] In at least one example, the control unit 106 automatically performs the inspection without human intervention. For example, the control unit 106 compares the image 105 with the reference image 109 to automatically determine anomalies (e.g., differences) therebetween. The control unit 106 then marks the anomaly on the image 105 and outputs an alert indicating the anomaly to the user interface 108. The alert may include one or more of a graphic, text, audio, etc. For example, the control unit 106 may automatically highlight, surround, circle, indicate with an arrow, etc., the anomaly within the image 105.
[0052] As used herein, the terms "control unit," "central processing unit," "CPU," "computer," and the like may include any processor-based or microprocessor-based system, including systems using microcontrollers, reduced instruction set computers (RISCs), application specific integrated circuits (ASICs), logic circuits, and any other circuit or processor including hardware, software, or a combination thereof capable of performing the functions described herein. These are exemplary only and are not intended to limit the definition and / or meaning of such terms in any way. For example, the control unit 106 may be or include one or more processors configured to control operations, as described herein.
[0053] The control unit 106 is configured to execute instruction sets stored in one or more data storage units or elements (such as one or more memories) to process data. For example, the control unit 106 may include or be coupled to one or more memories. The data storage unit may also store data or other information as desired or required. The data storage unit may be in the form of an information source or physical memory element within the processing machine.
[0054] The instruction set may include various commands that instruct the control unit 106 as a processor to perform specific operations, such as the methods and processes of various examples of the subject matter described herein. The instruction set may be in the form of a software program. The software may be in various forms, such as system software or application software. In addition, the software may be in the form of a collection of separate programs, a subset of programs within a larger program, or a portion of a program. The software may also include modular programming in the form of object-oriented programming. The processing of the input data by the processor may be in response to user commands, or in response to the results of previous processing, or in response to a request made by another processor.
[0055] The illustrations of the examples herein may show one or more control or processing units, such as the control unit 106. It should be understood that the processing or control unit may represent circuits, circuit systems, or portions thereof, which may be implemented as hardware with associated instructions (e.g., software stored on a tangible and non-transitory computer-readable storage medium, such as a computer hard drive, ROM, RAM, etc.) to perform the operations described herein. The hardware may include a hardwired state machine circuit system to perform the functions described herein. Alternatively, the hardware may include an electronic circuit that includes and / or is connected to one or more logic-based devices, such as a microprocessor, a processor, a controller, etc. Optionally, the control unit 106 may represent a processing circuit system, such as one or more of a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a microprocessor, etc. The circuits in the various examples may be configured to execute one or more algorithms to perform the functions described herein. One or more algorithms may include aspects of the examples disclosed herein, whether or not explicitly identified in a flowchart or method.
[0056] As used herein, the terms "software" and "firmware" are interchangeable and include any computer program stored in a data storage unit (e.g., one or more memories) for execution by a computer, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and non-volatile RAM (NVRAM) memory. The above data storage unit types are exemplary only and are therefore not limited to the types of memories that can be used to store computer programs.
[0057] The system 100 is configured to provide a remote non-instrumented inspection of the exterior and / or interior of an aircraft 102. The remote inspection is configured to be equivalent to aircraft maintenance performed by a licensed mechanic / inspector at an aircraft inspection location. While the inspection by a human at the inspection location is accomplished using typical human vision rating standards such as 20 / 20 vision, examples of the present disclosure use an image 105 and a designated monitor capability at a location remote from the aircraft 102, such as a second location 114. A control unit 106 provides an image 105 of the aircraft 102 acquired by an imaging device 104 at the first location 112 to a display 110 at the second location 114. For example, the control unit 106 displays the image 105 on the display 110.
[0058] In at least one example, the control unit 106 calculates the optical requirements of the display 110 (e.g., monitor size, pixel density, distance from the monitor, etc.) to maintain an optical resolution required to match human eye inspection performance. Examples of the present disclosure ensure equivalent results between inspections performed remotely and inspections performed at the inspection location. In general, the systems and methods described herein allow for remote visual inspections of images of surfaces of an aircraft 102.
[0059] It has been found that the remote inspection systems and methods described herein significantly reduce inspection time (such as by at least 50%). The systems and methods also (a) allow for flexible maintenance planning activities that identify surface anomalies early in the process, (b) reduce airline costs, and (c) improve safety (e.g., individuals do not need to move on and around aircraft 102).
[0060] Known aircraft inspection processes are subject to regulations and approved practices. Aircraft manufacturers require the use of approved maintenance practices to ensure continued safe operation. In order to perform remote inspections that are equivalent to the current practice of locating a mechanic at the aircraft, the systems and methods described herein ensure equivalent results to inspections performed on-site. Remote aircraft inspections utilize unique processes and tools to inspect large areas and eliminate or otherwise reduce the need for access infrastructure (such as elevators and stanchions), thereby reducing exposure to potential safety events. As described herein, the systems and methods analyze the following: 1) human eye acuity, 2) distance from the aircraft, 3) human eye resolution, and 4) monitor characteristics.
[0061] Figure 2A simplified diagram of a mobile platform 120 with an imaging device 104 is shown according to an example of the present disclosure. The imaging device 104 is supported on the mobile platform 120, such as a movable cart configured to maneuver the imaging device 104 around an aircraft. For example, the mobile platform 120 includes a base 121 with wheels 122. One or more movable arms 124 movably couple the imaging device 104 to the base 121.
[0062] Figure 3 A simplified diagram of a mobile platform 120 with an imaging device 104 is shown according to an example of the present disclosure. The mobile platform 120 may be or otherwise include a drone having a body 126 and a propulsion system 128, such as one or more propellers. The drone is configured to fly around an aircraft.
[0063] Figure 4 A simplified description of the capabilities of the human eye is shown. Figures 1 to 4 In at least one example, the control unit 106 may first establish the capabilities of a human eye in order to replicate a human eye inspection of the aircraft 102 using a remote computer station, such as the user interface 108. The human eye is able to clearly see objects of a certain size from a specified distance. The measurement of this capability is defined as acuity. A visual acuity test is an eye examination that measures the ability of an individual's eyes to read or see small details, thereby determining the sharpness and clarity of vision. For the purpose of inspecting an object at a first location 112, such as one or more parts of the aircraft 102, the capabilities of the eye determine the ability to see inconsistencies on the surface of the object, such as scratches, gouges, cracks, etc. Although different technicians have different visual acuities, the control unit 106 may guarantee 20 / 20 vision, which is a typical measurement of normal vision, corrected or uncorrected. 20 / 20 vision is defined as an individual's ability to see an object at a resolution of 1 arc minute at 20 feet away, which is the same as the average vision of an individual on an eye chart.
[0064] Figure 5 A simplified view of a person 130 is shown at a distance 134 from a surface 132 of an aircraft 102. Aircraft inspections are typically conducted at a specified distance from the aircraft 102, depending on the type of inspection being performed. For example, a typical visual inspection is defined by industry guidelines as being conducted within a touching distance. Figures 1 to 5 In at least one non-limiting example, control unit 106 may use 30.5 inches as an average of the arms reach of a typical male and female, indicating the distance a person would be from the aircraft 102 being inspected if a general visual inspection were being conducted. Alternatively, distance 134 may be less than 30.5 inches, such as 20-30 inches, or greater than 30.5 inches, such as 31-45 inches.
[0065] Figure 6 A simplified depiction of the resultant object size for the human eye is shown. Figure 7 The letter E on the eye chart is shown. Figure 6 and Figure 7 As shown and described, the human ability to inspect an object at a distance of 30.5 inches can be calculated. Figures 1 to 7 In at least one example, when θ is 1 arc minute and D is 30.5 inches from the object, the control unit 106 calculates the resulting arc length (S). The resultant object size or space / gap between the two edges of the spatial pattern that can be seen with 20 / 20 vision is 0.0089 inches, which represents the size of an object that can be resolved by the human eye.
[0066] Figure 8 A simplified depiction of the human eye's resolution in megapixels is shown. Figure 8 As shown and described, the area that can be observed by an individual standing within arms reach of the aircraft is 48 inches above and below and 72 inches side to side, which is referred to as the Field of View (FOV). In this case, the FOV is defined as a 6 foot by 4 foot rectangle that defines the boundaries of the individual's ability to see in all directions from the inspection position. As mentioned above, the size of a synthetic object that the human eye can resolve at 30.5 inches from the object is 0.0089 inches. Reference Figures 1 to 8 , to find the human eye resolution covering a 6 ft x 4 ft area, the control unit 106 divides the synthetic object size (.0089") by the 6 ft x 4 ft FOV, giving the number of pixels that will fit into the 6 ft x 4 ft space. This calculation results in 8089 pixels x 5393 pixels, for a total of 43,623,977 pixels or approximately 44 million pixels / megapixels.
[0067] Fig. 9 A simplified description of viewing a 44 megapixel (MP) image on a fixed resolution monitor is shown. Fig. 9 As shown and described, the resolution of an exemplary display 110 (such as a monitor) is a measure of how many pixels the display 110 can show. Higher resolutions result in sharper images. With the human eye at a distance of 30.5 inches from an object covering a 48 inch x 72 inch field of view, the monitor resolution provides 44 MP. Therefore, the control unit 106 can use a 1:1 representation of 44 MP to maintain the human visual experience.
[0068] As an example, to view a full 44MP image on an 8.3MP monitor (3840 x 2160 pixels) (also known as 4K resolution), the control unit 106 removes 35.7MP from the image 105, thereby creating a lower resolution image. Viewing the image on an 8.3MP monitor represents approximately 1 / 5 of the pixel data. To view the full 44MP of the image on an 8.3MP display 110, the control unit 106 divides the image 105 into 5.3MP portions 105a, 105b, 105c, 105d, and 105e on the display 110.
[0069] Alternatively, at a particular resolution, a smaller monitor may provide a sharper image than a larger monitor at the same resolution. However, a sharper image on a smaller monitor may present difficulty in viewing detail due to the monitor size.
[0070] Fig.10 A simplified depiction of the viewing distance d from the display 110 is shown. Fig.10 As shown and described, remote inspection is performed at a computer station (e.g. Figure 1 The user interface 108 shown in the figure is performed at a computer station having a display 110 (such as an electronic monitor) positioned at a specified position from the observer's eyes. The distance from the monitor to the eyes ensures that the observer sees a screen resolution of one pixel at one arc minute. The distance d ensures that the distance from the monitor to the eyes allows the observer to see a screen resolution of 1 pixel at 1 arc minute. As an example, the display 110 is a 4K monitor that is 21 inches wide (3840 pixels), 12 inches high (2160 pixels), and 8,217,600 pixels (8.3MP). Monitor area = 21 inches x 12 inches = 252 square inches. The area of one pixel is 252 square inches / 8,217,600 pixels = 3.06681E-05 square inches. S = √Area of one pixel = √3.06681E-05 = 0.005538 inches. d = S / Θ = 0.005538 inches / 0.000290888 radians. Observe the distance from the display 110, d = 19.03785 inches.
[0071] Fig.11 An image 105 of a portion of an aircraft is shown according to an example of the present disclosure. Fig.12 The partitions or sections A, B, C, D, E and F according to examples of the present disclosure are shown. Fig.11 Image 105. Reference Figures 1 to 12In order to present the image 105 to the individual at the display 110 as it would be seen at the location of the aircraft 102, the control unit 106 divides the image 105 for inspection at the display 110. For example, the control unit 106 divides the image 105 into separate partial AFs. The control unit 106 determines the size, shape, and number of partial AFs using various factors, including but not limited to inspection monitor specifications, size / resolution of the acquired image, type of inspection to be performed, etc. As an example, based on human eye resolution, the control unit 106 divides the 44MP image 105 (acquired by the imaging device 104 at the location of the aircraft 102) into six 7.3MP partial AFs, such as Fig.12 shown.
[0072] In at least one example, the image 105 is shown on the display 110, and the individual inspects the image 105 for anomalies (such as damage, defects, etc.) on the exterior of the aircraft 102. Alternatively, or in addition, in at least one example, the control unit 106 compares the image 105 to a reference image 109 in the memory 107 (such as a stored image of the aircraft, such as when manufactured and / or from a previous inspection). Based on the comparison, the control unit 106 can automatically mark the differences between the current image 105 and the reference image 109. As another example, the control unit 106 can automatically determine the anomaly, such as through artificial intelligence, machine learning, etc. In at least one example, the control unit 106 can also tag the image with an associated image number to provide a unique image identifier that supports other trend analysis processes.
[0073] In at least one example, the order in which the portions AF are presented on the display 110 can be predefined or determined based on artificial intelligence or machine learning. For example, portions with identified or potential defects can be shown first.
[0074] The control unit 106 can check the color, contrast and resolution of the image. The control unit 106 can also determine and indicate the image overlap percentage. The images can be configured to overlap each other, which can provide different viewpoints and contrasts and can provide easier abnormality identification.
[0075] In at least one example, control unit 106 may also register aircraft surface coordinates associated with image 105. In this manner, control unit 106 may provide an identification of where image 105 is relative to aircraft 102.
[0076] In at least one example, the control unit 106 may also overlay the positions of frames and ribs, stringers, spars, etc., on the image.
[0077] In at least one example, the control unit 106 is configured to provide for checking image coverage progress.
[0078] In at least one example, the control unit 106 is configured to identify defect areas of interest, classify and categorize defects, assess defect size and depth, perform non-contact, non-destructive testing, and / or provide a report. The control unit 106 can analyze the images 105 from the plurality of inspections using data analytics and trend analysis to identify anomalies in the images. In at least one example, the defect or damage information can be converted by the control unit 106 into a three-dimensional model of the aircraft 102 that records dent and bend information (e.g., damage type, size, location, etc.).
[0079] In at least one example, all or part of the systems and methods described herein may be or otherwise include an artificial intelligence (AI) or machine learning system that can automatically perform the operations of the methods described herein. For example, the control unit 106 may be an artificial intelligence or machine learning system. These types of systems can be trained and / or self-trained based on external information to repeatedly improve the accuracy of data analysis, thereby automatically detecting anomalies within the image 105. Over time, these systems can be improved by determining such information with increased accuracy and speed, thereby significantly reducing the possibility of any potential errors. For example, an AI or machine learning system can learn and determine image segmentation parameters and automatically detect anomalies, defect areas, etc. within the image 105. The AI or machine learning system described herein may include a technology implemented by adaptive predictive capabilities that exhibits at least a certain degree of autonomous learning to automate and / or enhance pattern detection (e.g., identifying irregularities or regularities in data), customization (e.g., generating or modifying rules to optimize record matching), etc. The system can be trained and retrained using feedback from one or more previous analyses of data, collection data, and / or other such data. Based on the feedback, the system can be trained by adjusting one or more parameters, weights, rules, criteria, etc. used in the analysis of the system. This process can be performed using data and collection data instead of training data, and can be repeated multiple times to repeatedly improve the determination and location of various features within the image 105. Training minimizes conflicts and interference by performing an iterative training algorithm in which the system is retrained with an updated data set and based on feedback examined prior to the latest training of the system. This provides a robust analysis model that can better determine locations, features, structures, etc. in an economical and efficient manner.
[0080] Fig.13 A perspective front view of an aircraft 300 is shown according to an example of the present disclosure. Figure 1An example of an aircraft 102 is shown. Aircraft 300 includes a propulsion system 312, which includes, for example, engines 314. Optionally, propulsion system 312 may include more engines 314 than shown. Engines 314 are carried by wings 316 of aircraft 300. In other examples, engines 314 may be carried by fuselage 318 and / or empennage 320. Emitter 320 may also support horizontal stabilizers 322 and vertical stabilizers 324. Fuselage 318 of aircraft 300 defines an interior cabin 330. Fig.13 An example of an aircraft 300 is shown. It should be understood that the size, shape, and configuration of the aircraft 300 may vary. Fig.13 Alternatively, examples of the present disclosure may be used with various other types of vehicles, such as automobiles, buses, trains, boats, spacecraft, etc.
[0081] Fig.14 A flow chart of a method according to an example of the present disclosure is shown. Figures 1 to 14 , the method is for inspecting an aircraft 102 at a first location 112. The method includes acquiring, at 400, by an imaging device 104, one or more images 105 of one or more surfaces of the aircraft 102 at the first location 112. The method further includes receiving, at 402, by a control unit 106 in communication with the imaging device 104, the one or more images 105. The method also includes showing, at 404, by the control unit 106, the one or more images 105 on a display 110 of a user interface 108, the user interface being at a second location 114 different from the first location 112. The method also includes, at 406, performing an inspection of the aircraft 102 at the second location 114 by showing 404. The method may also include creating and submitting a report regarding the inspection.
[0082] In at least one example, the method also includes modifying, by the control unit 106 , the one or more images 105 based on at least one characteristic of the display 110 .
[0083] In at least one example, the method also includes calculating, by the control unit 106 , optical requirements for the display 110 to maintain an optical resolution that matches human eye inspection performance of the aircraft 102 .
[0084] In at least one example, the method further includes modeling, by the control unit 106 , human visual performance by applying calculations of human eye resolution to establish a baseline for replicating the capabilities on the display 110 .
[0085] In at least one example, illustrating 404 includes dividing, by control unit 106 , one or more images 105 into portions.
[0086] The method may further include storing, by the control unit 106 , the one or more images 105 in the memory 107 .
[0087] In at least one example, the method further includes comparing, by the control unit 106 , the one or more images 105 to one or more reference images 109 of the aircraft 102 , and automatically detecting, by the control unit 106 , one or more anomalies through the comparison.
[0088] In at least one example, the method includes automatically determining, by the control unit 106 , one or more anomalies in the one or more images 105 through artificial intelligence or machine learning.
[0089] In addition, this disclosure includes examples according to the following clauses:
[0090] Clause 1. A system configured to inspect an aircraft at a first location, the system comprising:
[0091] an imaging device configured to acquire one or more images of one or more surfaces of the aircraft in the first position;
[0092] a control unit in communication with the imaging device, wherein the control unit (06) is configured to receive the one or more images; and
[0093] A user interface in communication with the control unit, wherein the user interface is in a second location different from the first location, wherein the user interface includes a display, wherein the control unit is configured to show the one or more images on the display, and wherein the examination is performed at the second location.
[0094] Clause 2. The system of clause 1, wherein the inspection comprises one or more of: a general visual inspection of the aircraft, a lightning strike inspection of the aircraft, or a hail damage inspection of the aircraft.
[0095] Clause 3. The system of clause 1 or 2, wherein the control unit is configured to modify the one or more images based on at least one characteristic of the display.
[0096] Clause 4. The system of any of clauses 1-3, wherein the control unit is configured to calculate optical requirements of the display to maintain an optical resolution that matches human eye inspection performance of the aircraft.
[0097] Clause 5. The system of any one of clauses 1-4, wherein the control unit is configured to model human visual performance by applying calculations of human eye resolution to establish a baseline for replicating capabilities on the display.
[0098] Clause 6. The system of any of clauses 1-5, wherein the control unit is configured to divide the one or more images into portions shown on the display.
[0099] Clause 7. The system of any of clauses 1-6, wherein the control unit is further configured to store the one or more images in a memory.
[0100] Clause 8. The system of any of Clauses 1-7, further comprising a mobile cart comprising the imaging device.
[0101] Clause 9. The system of any one of clauses 1-7, further comprising a drone comprising the imaging device.
[0102] Clause 10. The system of any one of clauses 1-9, wherein the control unit is configured to compare the one or more images with one or more reference images of the aircraft to automatically detect one or more anomalies.
[0103] Clause 11. The system according to any one of clauses 1-10, wherein the control unit is configured to automatically determine one or more abnormalities in the one or more images through artificial intelligence or machine learning.
[0104] Clause 12. A method for inspecting an aircraft in a first position, the method comprising:
[0105] acquiring, by an imaging device, one or more images of one or more surfaces of the aircraft in the first position;
[0106] receiving the one or more images by a control unit in communication with the imaging device;
[0107] showing, by the control unit, the one or more images on a display of a user interface at a second location different from the first location; and
[0108] By the illustration, the inspection of the aircraft is performed at the second location.
[0109] Clause 13. The method of Clause 12, further comprising modifying, by the control unit, the one or more images based on at least one characteristic of the display.
[0110] Clause 14. The method of clause 12 or 13, further comprising calculating, by the control unit, optical requirements of the display to maintain an optical resolution that matches human eye inspection performance of the aircraft.
[0111] Clause 15. The method of any of clauses 12-14, further comprising modeling, by the control unit, human visual performance by applying calculations of human eye resolution to establish a baseline for replicating capabilities on the display.
[0112] Clause 16. The method according to any of clauses 12-15, wherein the presenting comprises dividing, by the control unit, the one or more images into parts.
[0113] Clause 17. The method of any of clauses 12-16, further comprising storing, by the control unit, the one or more images in a memory.
[0114] Clause 18. The method according to any one of clauses 12-17, further comprising:
[0115] comparing, by the control unit, the one or more images with one or more reference images of the aircraft; and
[0116] The control unit automatically detects one or more anomalies in the one or more images through the comparison.
[0117] Clause 19. The method according to any one of clauses 12-18 further comprises automatically determining, by the control unit, one or more abnormalities in the one or more images through artificial intelligence or machine learning.
[0118] Clause 20. A system configured to inspect an aircraft at a first location, wherein the inspection comprises one or more of: a general visual inspection of the aircraft, a lightning strike inspection of the aircraft, or a hail damage inspection of the aircraft, the system comprising:
[0119] an imaging device configured to acquire one or more images of one or more surfaces of the aircraft in the first position;
[0120] a control unit in communication with the imaging device, wherein the control unit is configured to receive the one or more images; and
[0121] a user interface in communication with the control unit, wherein the user interface is in a second location different from the first location, wherein the user interface includes a display, wherein the control unit is configured to modify the one or more images based on at least one characteristic of the display, wherein the control unit is configured to calculate optical requirements of the display to maintain an optical resolution that matches human eye inspection performance of the aircraft, wherein the control unit is configured to model human visual performance by applying calculations of human eye resolution to establish a baseline for replicating capabilities on the display, wherein the control unit is configured to show the one or more images on the display, wherein the control unit is configured to divide the one or more images into portions shown on the display, and wherein the control unit is configured to automatically determine one or more anomalies in the one or more images through artificial intelligence or machine learning, and wherein the inspection is performed at the second location.
[0122] Clause 21. A non-transitory computer-readable storage medium comprising executable instructions that, in response to being executed, cause one or more control units including a processor to perform operations comprising:
[0123] receiving, from an imaging device, one or more images of one or more portions of the aircraft at a first location; and
[0124] The one or more images are shown on a display of a user interface at a second location different from the first location to allow the inspection to be performed at the second location.
[0125] As described herein, examples of the present disclosure provide improved systems and methods for inspecting an aircraft.
[0126] Although various spatial and directional terms, such as top, bottom, lower, middle, lateral, horizontal, vertical, front, etc., may be used to describe examples of the present disclosure, it should be understood that such terms are only used for the orientations shown in the figures. The orientation can be reversed, rotated or otherwise changed so that the upper part becomes the lower part, vice versa, the horizontal becomes the vertical, etc.
[0127] As used herein, a structure, limitation, or element that is "configured to" perform a task or operation is specifically structurally formed, constructed, or adjusted in a manner corresponding to the task or operation. For clarity and avoidance of doubt, an object that can only be modified to perform a task or operation is not "configured to" perform a task or operation as used herein.
[0128] It should be understood that the above description is intended to illustrate and is not limiting. For example, the above examples (and / or aspects thereof) can be used in combination with each other. In addition, without departing from its scope, many modifications can be made to adapt specific situations or materials to the teachings of various examples of the present disclosure. Although the size and type of the material described herein are intended to define the aspects of the various examples of the present disclosure, these examples are by no means restrictive and are exemplary examples. After reviewing the above description, many other examples will be apparent to those skilled in the art. Therefore, the scope of the various examples of the present disclosure should be determined with reference to the attached claims and the full scope of equivalent forms enjoyed by such claims. In the attached claims and the detailed description herein, the terms "comprising" and "in which" are used as the plain English equivalents of the corresponding terms "including" and "wherein". In addition, the terms "first", "second" and "third" etc. are used only as labels and are not intended to impose numerical requirements on their objects. Furthermore, the appended claim limitations are not written in means-plus-function form and are not intended to be interpreted based on 35 U.S.C. §112(f) unless and until such claim limitations expressly use the phrase "means for..." followed by a statement of a function void of further structure.
[0129] This written description uses examples to disclose various examples of the disclosure, including the best mode, and also to enable any person skilled in the art to practice the various examples of the disclosure, including making and using any device or system and performing any combined methods. The patentable scope of the various examples of the disclosure is defined by the claims, and may include other examples that occur to those skilled in the art. If an example has structural elements that do not differ from the literal language of the claims, or if an example includes equivalent structural elements with insubstantial differences from the literal language of the claims, such other examples are intended to be within the scope of the claims.
Claims
1. A system (100) configured to inspect an aircraft (102) at a first location (112), the system (100) comprising: an imaging device (104) configured to acquire one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first position (112); a control unit (106) in communication with the imaging device (104), wherein the control unit (06) is configured to receive the one or more images (105); and A user interface (108) in communication with the control unit (106), wherein the user interface (108) is in a second position (114) different from the first position (112), wherein the user interface (108) includes a display (110), wherein the control unit (106) is configured to show the one or more images (105) on the display (110), and wherein the examination is performed at the second position (114).
2. The system (100) of claim 1, wherein the inspection comprises one or more of: a general visual inspection of the aircraft (102), a lightning strike inspection of the aircraft (102), or a hail damage inspection of the aircraft (102).
3. The system (100) of claim 1, wherein the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110).
4. The system (100) of claim 1, wherein the control unit (106) is configured to calculate optical requirements of the display (110) to maintain an optical resolution that matches human eye inspection performance of the aircraft (102).
5. The system (100) of claim 1, wherein the control unit (106) is configured to model human visual performance by applying calculations of human eye resolution to establish a baseline for replicating capabilities on the display (110).
6. The system (100) of claim 1, wherein the control unit (106) is configured to divide the one or more images (105) into portions shown on the display (110).
7. The system (100) of claim 1, wherein the control unit (106) is further configured to store the one or more images (105) in a memory (107).
8. The system (100) of claim 1, further comprising a mobile cart comprising the imaging device (104).
9. The system (100) of claim 1, further comprising a drone comprising the imaging device (104).
10. The system (100) of claim 1, wherein the control unit (106) is configured to compare the one or more images (105) with one or more reference images (109) of the aircraft (102) to automatically detect one or more anomalies.
11. The system (100) according to claim 1, wherein the control unit (106) is configured to automatically determine one or more abnormalities in the one or more images (105) through artificial intelligence or machine learning.
12. A method for inspecting an aircraft (102) in a first position (112), the method comprising: acquiring, by an imaging device (104), one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first position (112); receiving the one or more images (105) by a control unit (106) in communication with the imaging device (104); showing, by the control unit (106), the one or more images (105) on a display (110) of a user interface (108) at a second location (114) different from the first location (112); and As shown, the inspection of the aircraft (102) is performed at the second location (114).
13. The method of claim 12, further comprising modifying, by the control unit (106), the one or more images (105) based on at least one characteristic of the display (110).
14. The method of claim 12, further comprising calculating, by the control unit (106), optical requirements of the display (110) to maintain an optical resolution that matches human eye inspection performance of the aircraft (102).
15. The method of claim 12, further comprising modeling, by the control unit (106), human visual performance by applying calculations of human eye resolution to establish a baseline for replicating capabilities on the display (110).
16. The method according to claim 12, wherein the showing comprises dividing the one or more images (105) into parts by the control unit (106).
17. The method of claim 12, further comprising storing, by the control unit (106), the one or more images (105) in a memory (107).
18. The method according to claim 12, further comprising: comparing, by the control unit (106), the one or more images (105) with one or more reference images (109) of the aircraft (102); as well as The control unit (106) automatically detects one or more anomalies in the one or more images (105) through the comparison.
19. The method according to claim 12, further comprising automatically determining, by the control unit (106), one or more abnormalities in the one or more images (105) through artificial intelligence or machine learning.
20. A system (100) configured to inspect an aircraft (102) at a first location (112), wherein the inspection comprises one or more of the following: a general visual inspection of the aircraft (102), a lightning strike inspection of the aircraft (102), or a hail damage inspection of the aircraft (102), the system (100) comprising: an imaging device (104) configured to acquire one or more images (105) of one or more surfaces (132) of the aircraft (102) at the first position (112); a control unit (106) in communication with the imaging device (104), wherein the control unit (106) is configured to receive the one or more images (105); and A user interface (108) in communication with the control unit (106), wherein the user interface (108) is in a second position (114) different from the first position (112), wherein the user interface (108) includes a display (110), wherein the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110), wherein the control unit (106) is configured to calculate an optical requirement of the display (110) to maintain an optical resolution that matches human eye inspection performance of the aircraft (102), wherein the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110), wherein the control unit (106) is configured to calculate an optical requirement of the display (110) to maintain an optical resolution that matches human eye inspection performance of the aircraft (102), wherein the control unit (106) is configured to modify the one or more images (105) based on at least one characteristic of the display (110). A calculation of human eye resolution is applied to model human visual performance to establish a baseline for replicating the capability on the display (110), wherein the control unit (106) is configured to display the one or more images (105) on the display (110), wherein the control unit (106) is configured to divide the one or more images (105) into portions displayed on the display (110), and wherein the control unit (106) is configured to automatically determine one or more anomalies in the one or more images (105) through artificial intelligence or machine learning, and wherein the inspection is performed at the second location (114).
