Determining the serviceability and remaining life of existing structures using 3D scan data
The use of 3D scan data to generate real-world CAD models for aircraft components enhances the efficiency and accuracy of structural assessments, addressing the limitations of manual methods in determining serviceability and remaining life.
Patent Information
- Application Number
- JP2020074804
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-05-03
- Filing Date
- 2020-04-20
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2040-04-20
AI Technical Summary
Current structural inspection and maintenance processes for aircraft components are time-consuming and lack precision, requiring manual measurements and off-site analysis, which hinders efficient determination of serviceability and remaining life.
A system utilizing 3D scan data to generate real-world CAD data, compare it with nominal CAD data, and perform finite element analysis (FEA) to determine serviceability and remaining life, thereby automating and accelerating the assessment process.
The system significantly reduces measurement and generation cycles while improving the accuracy of FEA analysis, enabling quicker and more precise determination of structural condition.
Smart Images

Figure 0007578413000001 
Figure 0007578413000002 
Figure 0007578413000003
Abstract
Description
[Technical field]
[0001] SUMMARY OF THE DISCLOSURE The embodiments described herein relate to the analysis of existing structures, and more particularly, to determining the serviceability and remaining life of existing structures using 3D scan data. [Background technology]
[0002] During structural inspection and maintenance of an aircraft, aircraft parts are inspected, measured, and compared to predefined (e.g., original or designed) tolerance limits, such as design tolerances. For example, parts are manually measured by a maintenance technician using measuring tools (e.g., calipers, micrometers, scales, hull gauges, etc.). The measurements are compared to the design tolerances of the part (e.g., design tolerances as indicated by a 3D model or 2D blueprint). If the measurements are not within the design tolerances, they are sent to a structural engineer (which may be off-site) for analysis. This analysis indicates whether the part should be reused, repaired, or scrapped. Additionally, due to the complexity of the analysis, the structural engineer may require more measurements to complete the analysis, which increases the cycle time of the inspection and maintenance. This structural inspection and maintenance process is time consuming and allows little or no reuse of the complex analysis performed on the part or similar parts of the same type. Summary of the Invention
[0003] According to one embodiment, a system for determining a service capability and remaining life of a real structure is disclosed. The system includes a processor circuit and a memory coupled to the processor circuit. The memory includes machine-readable instructions that, when executed by the processor circuit, access three-dimensional (3D) scan data representing a real structure acquired by a scanning device. The machine-readable instructions further cause the processor circuit to generate real computer-aided design (CAD) data representing a real surface corresponding to the real structure based on the 3D scan data. The machine-readable instructions further cause the processor circuit to determine at least one of a service capability level or an estimated remaining life of the real structure based on the real CAD data representing the real surface.
[0004] According to one embodiment and the preceding embodiments, the machine-readable instructions further cause the processor circuit to access nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to a nominal structure, a portion of the nominal surface corresponding to the real surface. The machine-readable instructions further cause the processor circuit to generate modified nominal CAD data representing a modified nominal volume including the real surface by replacing the portion of the nominal surface with the real surface. Determining at least one of the serviceability level or an estimated remaining life of the real structure is further performed based on the modified nominal CAD data.
[0005] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume.
[0006] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes adding an additional volume defined by the portion of the nominal surface and the actual surface to the nominal volume.
[0007] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes elevating the nominal surface relative to the nominal volume to generate an extended nominal volume, and removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume.
[0008] According to one embodiment and any of the preceding embodiments, the machine readable instructions further cause the processor circuit to compare the real surfaces of the modified nominal volume to the 3D scan data. The machine readable instructions further cause the processor circuit to determine, based on the comparison, whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance. The machine readable instructions further cause the processor circuit to generate, in response to the determining, an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within the predetermined tolerance.
[0009] According to one embodiment and any of the preceding embodiments, the machine readable instructions further cause the processor circuit to access second 3D scan data representing the real structure acquired by the scanning device. The machine readable instructions further cause the processor circuit to compare the real surface of the modified nominal CAD data with the second 3D scan data. The machine readable instructions further cause the processor circuit to determine, based on the comparison, whether the real surface in the modified nominal CAD data matches the real surface of the real structure within a predetermined tolerance. The machine readable instructions further cause the processor circuit to generate, in response to the determining, an indication of whether the real surface in the modified nominal CAD data matches the real surface of the real structure within the predetermined tolerance.
[0010] According to one embodiment and any of the preceding embodiments, the 3D scan data includes a 3D mesh data structure. Generating the real CAD data further includes converting the 3D mesh data structure into a real CAD data structure including the real surface.
[0011] According to one embodiment and any of the preceding embodiments, determining at least one of the serviceability level or estimated remaining life of the actual structure based on the actual CAD data further includes performing a strength analysis on the actual CAD data.
[0012] According to one embodiment and any of the preceding embodiments, performing a strength analysis includes performing a finite element analysis (FEA) to determine the condition of the real structure.
[0013] According to one embodiment and any of the preceding embodiments, the real structure includes a real vehicle structure.
[0014] According to one embodiment and any of the preceding embodiments, the real vehicle structure includes a real aircraft structure.
[0015] According to one embodiment and any of the preceding embodiments, a method for determining a serviceability and remaining life of an existing structure is disclosed. The method includes accessing, by a processor circuit, three-dimensional (3D) scan data representing an existing structure acquired by a scanning device. The method further includes generating, by the processor circuit, real CAD data representing a real surface corresponding to the existing structure based on the 3D scan data. The method further includes determining at least one of a serviceability level or an estimated remaining life of the existing structure based on the real CAD data representing the real surface.
[0016] According to one embodiment and any of the preceding embodiments, the method further includes accessing nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to a nominal structure, a portion of the nominal surface corresponding to the real surface. The method further includes generating modified nominal CAD data representing a modified nominal volume including the real surface by replacing the portion of the nominal surface with the real surface. Determining at least one of the serviceability level or estimated remaining life of the real structure is further based on the modified nominal CAD data.
[0017] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume.
[0018] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes adding an additional volume defined by the portion of the nominal surface and the actual surface to the nominal volume.
[0019] According to one embodiment and any of the preceding embodiments, replacing the portion of the nominal surface further includes elevating the nominal surface relative to the nominal volume to generate an extended nominal volume, and removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume.
[0020] According to one embodiment and any of the preceding embodiments, the method further includes comparing, by the processor circuit, the real surfaces of the modified nominal volume to the 3D scan data. The method further includes determining, by the processor circuit, based on the comparison, whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance. The method further includes, in response to the determining, generating, by the processor circuit, an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within the predetermined tolerance.
[0021] According to one embodiment and any of the preceding embodiments, the method further includes determining a condition of the real structure by performing a strength analysis on the modified nominal CAD data.
[0022] According to one embodiment and any of the preceding embodiments, a system for determining the serviceability and remaining life of a real structure is disclosed. The system includes a processor circuit and a memory coupled to the processor circuit. The memory includes machine readable instructions that, when executed by the processor circuit, access nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to the nominal structure. The machine readable instructions further cause the processor circuit to access three-dimensional (3D) scan data representing a real structure corresponding to a portion of the nominal structure, the scan data being acquired by a scanning device. The machine readable instructions further cause the processor circuit to generate real CAD data representing a real surface of the real structure corresponding to the portion of the nominal surface based on the 3D scan data. The machine readable instructions further cause the processor circuit to generate modified nominal CAD data representing a modified nominal volume including the real surface by replacing the portion of the nominal surface with the real surface. [Brief description of the drawings]
[0023] [Figure 1A] 1 is a flowchart of a process for generating computer-aided design (CAD) data for strength analysis of an existing part, according to one embodiment. [Figure 1B] 1 is a flowchart of a process for replacing a portion of a nominal surface with an actual surface, the process including adding or removing a volume defined by the portion of the nominal surface and the actual surface from the nominal volume, according to one embodiment. [Figure 1C] 13 is a flowchart of a process for replacing a portion of a nominal surface with an actual surface, the process including removing a volume defined by an elevated portion of the nominal surface and the actual surface from the extended nominal volume, according to one embodiment. [Figure 1D] 1 is a flow chart of a process 150 for verifying the accuracy of a modified nominal volume, according to one embodiment. [Figure 2A] FIG. 2 illustrates an operation of acquiring 3D scan data of a real structure by an imaging device according to one embodiment. [Figure 2B] FIG. 2B illustrates an operation for generating real CAD data from the 3D scan data acquired in FIG. 2A according to one embodiment. [Figure 2C] FIG. 2C illustrates the modification of the nominal CAD data by replacing a portion of the nominal surface with the actual surface of FIG. 2B to generate a modified nominal volume, according to one embodiment. [Figure 2D] FIG. 2D shows modified nominal CAD data including modified nominal volume as modified in FIG. 2C. [Figure 3A] FIG. 2D illustrates raising a nominal surface relative to a nominal volume similar to that of FIG. 2C to generate an extended nominal volume, according to an alternative embodiment. [Figure 3B] FIG. 3B illustrates an operation of generating a modified nominal volume by removing a trim volume defined by the elevated nominal surface and the actual surface of FIG. 3A from the extended nominal volume, according to one embodiment. [Figure 4A]FIG. 2C illustrates a comparison of 3D scan data to the real surface of a modified nominal volume similar to the modified nominal volume of FIG. 2D, according to one embodiment. [Figure 4B] FIG. 13 illustrates a graphical representation of how well the real surfaces of the modified nominal CAD data match or deviate from the real surfaces of the real structure based on a comparison. [Diagram 5] FIG. 1 illustrates a computing system for performing the operations of any of the systems, devices, or methods disclosed herein, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0024] Examples or embodiments described herein relate to analyzing real structures, and more particularly, to determining the serviceability and remaining life of an in-service structure using three-dimensional scan data. According to some examples, three-dimensional (3D) scan data representing a real structure, such as a vehicle (e.g., an aircraft) or other structure, is acquired by a scanning device. Based on the 3D scan data, real computer-aided design (CAD) data is generated that represents real surfaces corresponding to the real structure. Based on the real CAD data, at least one of a serviceability level or an estimated remaining life of the real structure is determined. In some examples, nominal CAD data is accessed, the nominal CAD data representing a nominal volume having a nominal surface. The nominal volume corresponds to the nominal structure, and a portion of the nominal surface corresponds to the real surface. In this example, modified nominal CAD data is generated that represents a modified nominal volume having a real surface by replacing a portion of the nominal surface with the real surface. In this embodiment, at least one of the serviceability level or estimated remaining life of the actual structure is determined based on the modified nominal CAD data.
[0025] One advantage of this and other arrangements is that models, such as finite element analysis (FEA) models used to perform in-service strength analysis, can be created more quickly and efficiently than existing methods, such as manual measurement and gridding. Instead of manually measuring and creating and modifying a CAD model (e.g., a FEA mesh), a high-resolution scan can generate a more representative 3D surface that can be used to create a CAD model for FEA analysis. This can significantly reduce the time required for the measurement and creation cycle, and can improve the accuracy of the FEA analysis over conventional techniques.
[0026] In this regard, FIG. 1A is a flow chart of a process 100 for generating CAD data for strength analysis of a real part, according to one embodiment. The process 100 includes accessing nominal CAD data (block 102) representing a nominal volume including nominal surfaces, the nominal volume corresponding to a nominal structure. In one example, the nominal structure is an aircraft or other vehicle structure design. The process 100 further includes accessing 3D scan data acquired by a scanning device (block 104). The 3D scan data represents a real structure corresponding to the nominal structure. In the case of an aircraft, the real structure is an in-service aircraft corresponding to the nominal aircraft design. The process 100 further includes generating real CAD data (block 106) representing real surfaces corresponding to the real structure based on the 3D scan data. In some examples, the 3D scan data includes a 3D mesh data structure, and generating the real CAD data further includes converting the 3D mesh data structure to a real CAD data structure including real surfaces.
[0027] In some examples, the actual surface includes wear or damage that causes the actual surface to deviate from the corresponding nominal surface of the nominal structure. The process 100 further includes modifying the nominal CAD data based on the actual CAD data (block 108). In one embodiment, this includes generating modified nominal CAD data by replacing a portion of the nominal surface of the nominal CAD data with the actual surface of the actual CAD data (block 110). The portion of the nominal surface of the nominal CAD data corresponds to a portion of the nominal structure described above. The process 100 further includes determining at least one of a serviceability level or an estimated remaining life of the actual structure based on the actual CAD data representing the actual surface (block 112). In some examples, this determination includes saving the modified nominal CAD data to a memory (block 113) and performing a strength analysis (e.g., FEA strength analysis, etc.) using the modified nominal CAD data (block 114). For example, modified nominal CAD data may be analyzed using FEA strength analysis to produce FEA results that correspond to at least one of the actual structure's reality or service capability within a predetermined tolerance.
[0028] FIG. 1B is a flow chart of an example process 110′ for replacing a portion of a nominal surface with an actual surface as an alternative step to block 110 of FIG. 1. The process 110′ includes defining a trim volume based on the portion of the nominal surface and the actual surface (block 116). In one embodiment, defining the trim volume includes placing the nominal surface and the actual surface in a common coordinate system and defining the trim volume as a volume between the nominal surface and the actual surface in one or more dimensions of the coordinate system. The process 110′ further includes generating modified nominal CAD data by adding or removing the trim volume from the nominal volume (block 118). When the trim volume is added to the nominal volume, the trim volume may also be referred to as an added volume.
[0029] FIG. 1C is a flow chart of another example process 110″ for replacing a portion of a nominal surface with an actual surface as an alternative step to block 110 of FIG. 1. Process 110″ includes extending a nominal volume by elevating a portion of the nominal surface (block 120). Process 110″ further includes removing a trim volume from the nominal volume (block 122), the trim volume being defined by the elevated portion of the nominal surface and the actual surface.
[0030] 1D is a flow chart of a process 150 for verifying the accuracy of the modified nominal volume, according to one embodiment. The process 150 includes accessing the 3D scan data, or a second 3D scan data representative of the real structure acquired by a scanning device, and comparing the real surfaces of the modified nominal volume thereto (block 152). The process 150 further includes determining whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance based on the comparison (block 154). The process 150 further includes generating an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance in response to the determination (block 156).
[0031] 2A-2D, FIG. 2A illustrates the operation of acquiring 3D scan data of a real structure 200 by an imaging device 202 according to one embodiment. In this embodiment, the real structure 200 is an in-service aircraft structure, e.g., a part of an aircraft, having real-world dimensions, i.e., depth (x) 204, length (y) 206, and height (z) 208. However, the real structure 200 may be other types of real vehicle structures or other structures, as desired. In this embodiment, the real structure 200 has a number of physically damaged portions 210, e.g., due to wear or damage to the real structure 200. These damaged portions 210 cause the dimensions of the real structure 200 to deviate from the original design or original state of the real structure 200. As discussed above, traditional manual measurement techniques, such as using hand measuring tools and gridding, can be time consuming and may not provide measurement results of acceptable accuracy or sufficient precision to perform strength analysis or other types of analysis to determine at least one of the serviceability or remaining life of the real structure 200.
[0032] Referring now to Figure 2B, real CAD data is generated using 3D scan data of the real structure 200 of Figure 2A. The 3D scan data shown in Figure 2B includes a real surface 212 located and oriented within a scanner coordinate system 214. In this embodiment, the scanner coordinate system 214 is a Cartesian coordinate system having dimensions of depth (x) 216, length (y) 218, and height (z) 220, although other types of coordinate systems such as cylindrical coordinate systems, spherical coordinate systems, etc. may also be used. The real surface 212 includes a damaged portion 222 that corresponds to the physically damaged portion 210 of the real structure 200 of Figure 2A.
[0033] 2C, a nominal volume 224 is accessed that corresponds to nominal structures 225 and has a nominal surface 226 that corresponds to real surface 212. Nominal volume 224 is located and oriented in a CAD coordinate system 228 having dimensions of depth (x) 230, length (y) 232, and height (z) 234. The coordinates of real surface 212 are transformed from the scanner coordinate system 214 to the CAD coordinate system 228 such that real surface 212 is registered and aligned with the corresponding nominal surface 226 of nominal volume 224.
[0034] Next, referring to FIG. 2D, a modified nominal CAD volume 236 is generated by replacing the nominal surface 226 of FIG. 2C with the real surface 212. The replacement function in this embodiment is performed by a process similar to process 110' described above with reference to FIG. 1A and FIG. 1B. As can be seen in FIG. 2D, the modified nominal CAD volume 236 is substantially identical to the nominal CAD volume (i.e., represents the original design or original state of the real structure 200 of FIG. 2A), but also includes the real surface 212 and includes the damaged portion 222 corresponding to the scanned physically damaged portion 210 of the real structure 200 of FIG. 2A.
[0035] 3A and 3B, FIG. 3A illustrates an example of elevating a nominal surface 326 relative to a nominal volume 324 similar to nominal volume 224 of FIG. 2C to generate an extended nominal volume 340, according to an alternative embodiment. Nominal volume 324 is located and oriented within a CAD coordinate system 328 having dimensions of depth (x) 330, length (y) 332, and height (z) 334. In this embodiment, nominal surface 326 is moved in the dimension of height (z) 334 to form a raised surface 338 of extended nominal volume 340.
[0036] 3B, a trimmed volume 342 is defined by the elevated surface 338 of FIG. 3A and an actual surface 312, which is similar to the actual surface 212 of FIG. 2A-2D. The trimmed volume 342 is subtracted from the extended nominal volume 340 to generate a modified nominal volume 336. The subtraction function in this embodiment is performed by a process similar to process 110'' described above with reference to FIG. 1A and 1C.
[0037] It may also be desirable to compare the modified nominal volume with the original 3D scan data to verify the accuracy of the modified nominal volume, for example to ensure that the FEA strength analysis produces results within a predetermined tolerance that corresponds to at least one of the realities or service capabilities of the real structure. In this regard, Figures 4A and 4B illustrate the comparison of the 3D scan data with the real surfaces of the modified nominal volume to graphically display the extent to which the real surfaces of the modified nominal CAD data match or deviate from the real surfaces of the real structure.
[0038] In Fig. 4A, the 3D scan data is transformed into a verification surface 444 in a CAD coordinate system 428 having dimensions of depth (x) 430, length (y) 432, and height (z) 434. The verification surface 444 is compared to the real surface 412 of the modified nominal volume 436, which includes the damaged portion 422 corresponding to the measured real structure, thereby comparing the modified nominal volume 436 to the 3D scan data. In another example, new 3D scan data is acquired, for example by the imaging device 202 of Fig. 2A, and transformed into the verification surface 444, which allows for independent comparison and accuracy verification with the modified nominal volume 436 in addition to the original 3D scan data. Based on this comparison, it is determined whether the real surface 412 of the modified nominal volume 436 matches the real surface of the real structure, such as the real structure 200 of Fig. 2A in this example, within a predetermined tolerance.
[0039] 4B , in response to this determination, an indication 446 is generated that indicates whether the real surface 412 of the modified nominal volume 436 matches the real surface of the real structure within a predetermined tolerance. In this example, the indication 446 is a graphical indication that corresponds to a graphical scale 448. The graphical scale 448, in this example, is color-coded or patterned to indicate different tolerances or tolerance ranges 452, 453 with corresponding colors or patterns. The portions of the real surface 412 that match the 3D scan data within a particular tolerance or tolerance range are indicated with a corresponding pattern or color based on the graphical scale 448. For example, certain portions 450 of the real surface 412 that are within the unacceptable range 453, i.e., that deviate from a predetermined acceptable tolerance or tolerance range 452, may be shown with a high contrast pattern 454, color, or the like that is different from the base pattern or color of the modified nominal volume 426 or that is different from the pattern 455 or color associated with the acceptable tolerance range 452, thereby visually drawing the viewer's attention to the portions 450 that deviate from the 3D scan data beyond the acceptable range. In this manner, the accuracy of the modified nominal volume 436 may be verified, for example, before or after FEA analysis.
[0040] FIG. 5 is a block schematic diagram of a computing system 500 for performing operations of any of the systems, devices, or methods disclosed herein, according to one embodiment. According to one embodiment, the process 100 of FIGS. 1A-1C is implemented and performed by the system 500, and aspects of the embodiments described herein are performed, configured, and provided by the system 500. The system 500 includes a processor device 502. According to one embodiment, the processor device 502 is a server or similar processor circuit. The processor device 502 includes a processor circuit 504 for controlling the operation of the processor device 502 and for performing functions such as those described herein with respect to the process 100 of FIGS. 1A-1C. The processor device 502 also includes a memory 506, such as, for example, a file system. An operating system 508, applications, and other programs are stored in the memory 506 for execution or operation on the processor circuit 504. One or more CAD modules 510 or systems are also stored in the memory 506 and are compiled and executed by the processor circuitry 504 to perform the functions or operations described herein. The CAD module 510 is any type of software, hardware, or combination of hardware and software for performing 3D data processing, transformations, CAD operations, or other functions described herein.
[0041] An imaging module 512 is also stored in the memory 506. The process 100 of Figures 1A-1C, e.g., acquiring 3D scan data, is implemented in the imaging module 512 and performed by the processor circuitry 504 when the imaging module 512 is compiled and executed by the processor circuitry 504. The imaging module 512 operates in cooperation with the CAD module 510. According to one embodiment, the imaging module 512 is a separate component from the CAD module 510. In another embodiment, the imaging module 512 is a component of the CAD module 510.
[0042] The processor unit 502 also includes one or more input devices, output devices, or a combination of input / output devices, collectively referred to as I / O (input / output) devices 520. The I / O devices 520 include, but are not limited to, a keyboard or keypad, a pointing device such as a mouse, a disk drive, and any other device that allows a user to interact with the processor unit 502 to control the operation of the device and to access the CAD module 510 or the system and the imaging module 512. According to one embodiment, at least one of the I / O devices 520 is a device for reading a computer program product, such as a computer program product 522. The computer program product 522 is similar to those described in detail herein. The CAD module 510 and the imaging module 512 are loaded into the memory 506 from a computer program product, such as the computer program product 522.
[0043] A network member or user 523 of the system 500 uses a computer system 524 or communication device to access the processor device 502 or server, the CAD module 510, and the imaging module 512. The computer system 524 or communication device may be any type of communication device, including mobile or handheld computers and communication devices. The computer system 524 includes a processor 526 for controlling the operation of the computer system 524, and a memory 528, such as a file system, or similar data storage device. An operating system 530, applications 532, and other programs are stored in the memory 528 to execute or operate on the processor circuitry 526. A web or Internet browser 534 is also stored in the memory 528 for accessing the processor device 502 or server over a network 536. The network 536 may be the Internet, an intranet, or other private or proprietary network.
[0044] Also stored in memory 528 is a CAD application 538. According to one embodiment, process 100 of Figures 1A-1C is implemented or performed by CAD application 538. CAD application 538 is compiled and executed by processor 526 to perform functions similar to those described for process 100, for example.
[0045] One or more imaging applications 540 are also stored in memory 528, such as, for example, a file system. The one or more imaging applications 540 are any type of software application for performing 3D data processing, conversion, CAD manipulation, or other functions described herein. According to one embodiment, the CAD application 538 is a separate component from the imaging application 540, as shown in the example of FIG. 5. In another embodiment, the imaging application 540 is a component of the CAD application 538.
[0046] The CAD application 538 and the imaging application 540 running on the computer system 524 operate in conjunction with the CAD module 510 and the imaging module 512 on the processor device 502 or server to perform the functions or operations described herein. Thus, the CAD application 538 and the imaging application 540 running on the computer system 524 perform some of the functions and operations of the process 100 of Figures 1A-1C, and the CAD module 510 or the imaging module 512 running on the processor device 502 or server perform other functions of the process 100 of Figures 1A-1C. Some embodiments include only the CAD module 510 and the imaging module 512 on the processor device 502 or server, while other embodiments include only the CAD module 510 and the imaging module 512 running on the client computer system 524 or communication device.
[0047] According to one embodiment, the client computer system 524 or communication device also includes a display 548, a speaker system 550, and a microphone 552 for audio communication. Instructions for controlling the operation of the CAD module 510 and the imaging module 512, or the CAD application 538 and the imaging application 540, and for performing the operations or functions described herein are displayed on the display 548. According to one embodiment, a graphical user interface (GUI) is displayed on the display 548 for displaying aspects of the embodiments described above.
[0048] According to one embodiment, computer system 524 also includes one or more input devices, output devices, or combination input / output devices, collectively referred to as I / O (input / output) devices 554. Examples of I / O devices 554 include, but are not limited to, a keyboard or keypad, a pointing device such as a mouse, disk drives, and any other device that enables a user, such as user 523, to interact with computer system 524 to control the operation of the device or access components of system 500. I / O devices 554 also include imaging devices, such as imaging device 202 of FIG. 2A, or devices configured to read computer code from a computer program product, such as computer program product 522.
[0049] The present disclosure also includes examples according to the following appendices.
[0050] Clause 1. A system for determining a service capability and remaining life of a real structure, comprising: a processor circuit; and a memory coupled to the processor circuit, the memory comprising machine-readable instructions that, when executed by the processor circuit, access three-dimensional (3D) scan data representing a real structure acquired by a scanning device; generate real computer-aided design (CAD) data representing real surfaces corresponding to the real structure based on the 3D scan data; and determine at least one of a service capability level or an estimated remaining life of the real structure based on the real CAD data representing the real surfaces.
[0051] Appendix 2. The system of Appendix 1, wherein the machine-readable instructions further cause the processor circuit to access nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to a nominal structure, a portion of the nominal surface corresponding to the real surface, and generate modified nominal CAD data representing a modified nominal volume including the real surface by replacing the portion of the nominal surface with the real surface, and determining at least one of the serviceability level or estimated remaining life of the real structure is further performed based on the modified nominal CAD data.
[0052] Addendum 3. The system of Addendum 2, wherein replacing the portion of the nominal surface further includes removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume.
[0053] Addendum 4. The system of Addendum 2, wherein replacing the portion of the nominal surface further includes adding an additional volume to the nominal volume, the additional volume being defined by the portion of the nominal surface and the actual surface.
[0054] Addendum 5. The system of Addendum 2, wherein replacing the portion of the nominal surface further includes elevating the nominal surface relative to the nominal volume to generate an extended nominal volume, and removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume.
[0055] Clause 6. The system of Clause 2, wherein the machine-readable instructions further cause the processor circuit to compare the real surfaces of the modified nominal volume to the 3D scan data, determine based on the comparison whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance, and, in response to the determining, generate an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within the predetermined tolerance.
[0056] Appendix 7. The system of Appendix 2, wherein the machine-readable instructions further cause the processor circuit to access second 3D scan data representing the real structure acquired by the scanning device, compare the real surfaces of the modified nominal CAD data to the second 3D scan data, determine based on the comparison whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within a predetermined tolerance, and in response to the determining, generate an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within the predetermined tolerance.
[0057] Addendum 8. The system of Addendum 1, wherein the 3D scan data includes a 3D mesh data structure, and generating the real CAD data further includes converting the 3D mesh data structure into a real CAD data structure including the real surface.
[0058] Addendum 9. The system of Addendum 1, wherein determining at least one of the serviceability level or estimated remaining life of the actual structure based on the actual CAD data further includes determining the condition of the actual structure by performing a strength analysis on the actual CAD data.
[0059] Clause 10. The system of clause 9, wherein performing a strength analysis includes performing a finite element analysis to determine the condition of the real structure.
[0060] Addendum 11. The system of Addendum 1, wherein the real structure includes an in-service vehicle structure.
[0061] Clause 12. The system of clause 11, wherein the in-service vehicle structure includes an in-service aircraft structure.
[0062] Addendum 13. A method for determining the serviceability and remaining life of an existing structure, comprising: accessing, by a processor circuit, three-dimensional (3D) scan data representing an existing structure acquired by a scanning device; generating, by the processor circuit, based on the 3D scan data, actual computer-aided design (CAD) data representing actual surfaces corresponding to the existing structure; and determining at least one of a serviceability level or an estimated remaining life of the existing structure based on the actual CAD data representing the actual surfaces.
[0063] Addendum 14. The method of Addendum 13, further comprising: accessing nominal CAD data representing a nominal volume including a nominal surface, said nominal volume corresponding to a nominal structure, a portion of said nominal surface corresponding to said real surface; generating modified nominal CAD data representing a modified nominal volume including said real surface by replacing said portion of said nominal surface with said real surface; and determining at least one of said serviceability level or estimated remaining life of said real structure further based on said modified nominal CAD data.
[0064] Addendum 15. The method of Addendum 14, wherein replacing the portion of the nominal surface further comprises removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume.
[0065] Addendum 16. The method of Addendum 14, wherein replacing the portion of the nominal surface further comprises adding an additional volume to the nominal volume, the additional volume being defined by the portion of the nominal surface and the actual surface.
[0066] Addendum 17. The method of Addendum 14, wherein replacing the portion of the nominal surface further includes elevating the nominal surface relative to the nominal volume to generate an extended nominal volume, and removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume.
[0067] Addendum 18. The method of Addendum 14, further comprising: comparing, by the processor circuitry, the real surfaces of the modified nominal volume to the 3D scan data; determining, by the processor circuitry based on the comparison, whether the real surfaces in the modified nominal CAD data match, within a predetermined tolerance, the real surfaces of the real structure; and, in response to the determination, generating, by the processor circuitry, an indication of whether the real surfaces in the modified nominal CAD data match, within the predetermined tolerance, the real surfaces of the real structure.
[0068] Addendum 19. The method of Addendum 14, further comprising performing a strength analysis on the modified nominal CAD data.
[0069] Appendix 20. A system for determining the serviceability and remaining life of a real structure, comprising: a processor circuit; and a memory coupled to the processor circuit, the memory comprising machine-readable instructions that, when executed by the processor circuit, access nominal computer-aided design (CAD) data representing a nominal volume including a nominal surface, the nominal volume corresponding to the nominal structure; access three-dimensional (3D) scan data representing a real structure corresponding to a portion of the nominal structure, acquired by a scanning device; generate real CAD data representing a real surface of the real structure corresponding to the portion of the nominal surface based on the 3D scan data; and generate modified nominal CAD data representing a modified nominal volume including the real surface by replacing the portion of the nominal surface with the real surface.
[0070] As will be appreciated by those skilled in the art, aspects of the present disclosure are illustrated and described herein in any of several patentable classes or concepts, including any new and useful method, apparatus, product, composition of matter, or any new and useful improvement thereof. Thus, aspects of the present disclosure may be implemented entirely in hardware, entirely in software (including firmware, resident software, microcode, etc.), or a combination of software and hardware implementations, all of which may be referred to generally herein as "circuits," "modules," "components," or "systems." Aspects of the present disclosure may also take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-readable program code embodied therein.
[0071] Any combination of one or more computer readable media may be used. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples of computer readable storage media (non-exhaustive list) may include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or flash memory), a suitable optical fiber with a repeater, a portable compact disk read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the context of this document, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
[0072] A computer-readable signal medium may include a propagated data signal that embodies computer-readable program code, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium, other than a computer-readable storage medium, that can convey, propagate, or transfer program code used by or in connection with an instruction execution system, apparatus, or device. Program code embodied in a computer-readable signal medium may be transmitted using any suitable medium, including, but not limited to, wireless, wired, fiber optic cable, RF, or the like, or any suitable combination thereof.
[0073] Computer program code for carrying out operations of aspects of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, the "C" programming language, traditional procedural programming languages such as Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby, Groovy, or other programming languages. The program code may run entirely on the user's computer, partially on the user's computer as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be to an external computer (e.g., via the Internet using an Internet Service Provider), or in a cloud computing environment, or may be provided as a service, such as Software as a Service (SaaS).
[0074] Aspects of the present disclosure are described herein with reference to flowcharts or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. Each block of these flowcharts or block diagrams, and combinations of blocks in these flowcharts or block diagrams, can be implemented by machine-readable instructions, such as computer program instructions. These machine-readable instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing device to configure a machine and mechanism for implementing the functions or operations described in the flowchart or block diagram blocks, the instructions being executed by the processor of the computer or other programmable instruction execution device.
[0075] These machine-readable instructions may also be stored on a temporary or non-transitory computer-readable medium and, when executed, direct a computer, other programmable data processing device, or other device to function in a particular manner, and the instructions stored on the computer-readable medium may realize a product including instructions that, when executed, cause a computer to perform the functions or operations specified in the blocks of the flowcharts or block diagrams. The machine-readable instructions may also be loaded into a computer, other programmable instruction execution device, or other device to perform a series of operation steps to realize a computer-implemented process, and the instructions executed on the computer or other programmable device realize the process to perform the functions or operations specified in the blocks of the flowcharts or block diagrams. The flowcharts and block diagrams illustrated in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various aspects of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which includes one or more executable instructions for performing a particular logical function. It should be noted that in some alternative implementations, the functions shown in the blocks may be executed out of the order shown in the figures. For example, two blocks shown in succession may be executed substantially simultaneously or in the reverse order, depending on the functionality involved. It should be noted that each block in the block diagrams or flowcharts, and combinations of blocks in the block diagrams or flowcharts, may be realized by a special purpose hardware-based system that executes the specified functions or operations or combinations of special purpose hardware and computer instructions.
[0076] The terms used herein are for the purpose of describing particular aspects only and are not intended to limit the disclosure. As used herein, singular terms referring to indefinite or specific objects are intended to include plural terms unless the context clearly precludes otherwise. In addition, when the terms "comprises" and "comprises" are used herein, they refer to the presence of the stated features, steps, operations, elements, or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, or groups thereof. Note that like elements are designated by like numerals throughout the description of the figures.
[0077] Many different embodiments are disclosed herein in conjunction with the above description and drawings. To actually describe and illustrate every combination and subcombination of these embodiments would be overly repetitive and confusing. Thus, all embodiments can be combined in any manner or set, and the present specification, including the drawings, should be construed as constituting a complete written description of every combination and subcombination of the embodiments described herein, as well as the methods and processes of making and using them, and supports claims to every such combination or subcombination.
Claims
1. 1. A system for determining the serviceability and remaining life of an existing structure, comprising: A processor circuit; a memory coupled to the processor circuit, the memory including machine-readable instructions that, when executed by the processor circuit, accessing three-dimensional (3D) scan data representative of the real structure acquired by a scanning device; generating real computer-aided design (CAD) data representing real surfaces corresponding to the real structure based on the 3D scan data; determining at least one of a serviceability level or an estimated remaining life of the real structure based on the real CAD data representing the real surface; The machine readable instructions further include causing the processor circuit to: accessing nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to a nominal structure, a portion of the nominal surface corresponding to the real surface; generating modified nominal CAD data representing a modified nominal volume including the actual surface by replacing the portion of the nominal surface with the actual surface; Determining at least one of the serviceability level or estimated remaining life of the existing structure is further based on the modified nominal CAD data.
2. Replacing the portion of the nominal surface comprises: removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume; and The system of claim 1 , further comprising at least one of: adding to the nominal volume an additional volume defined by the portion of the nominal surface and the actual surface.
3. Replacing the portion of the nominal surface comprises: elevating the nominal surface relative to the nominal volume to generate an extended nominal volume; The system of claim 1 or 2, further comprising: removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume.
4. The machine readable instructions further include causing the processor circuit to: comparing the actual surface of the modified nominal volume to the 3D scan data; determining whether the actual surfaces in the modified nominal CAD data match the actual surfaces of the actual structure within a predetermined tolerance based on the comparison; 4. The system of claim 1, further comprising: in response to the determination based on the comparison, generating an indication of whether the actual surfaces in the modified nominal CAD data match the actual surfaces of the actual structure within the predetermined tolerance.
5. The machine readable instructions further include causing the processor circuit to: accessing second 3D scan data representative of the real structure acquired by the scanning device; comparing the actual surfaces of the modified nominal CAD data with the second 3D scan data; determining whether the real surface in the modified nominal CAD data matches the real surface of the real structure within a predetermined tolerance based on the comparison of the real surface of the modified nominal CAD data with the second 3D scan data; 5. The system of claim 1, further comprising: in response to the determination based on the comparison of the actual surfaces of the modified nominal CAD data with the second 3D scan data, generating an indication of whether the actual surfaces in the modified nominal CAD data match the actual surfaces of the real structure within the predetermined tolerance.
6. the 3D scan data includes a 3D mesh data structure; The system of any of claims 1 to 5, wherein generating the real CAD data further comprises converting the 3D mesh data structure into a real CAD data structure including the real surface.
7. Determining at least one of the serviceability level or the estimated remaining life of the actual structure based on the actual CAD data includes: The system of any one of claims 1 to 6, further comprising: determining a state of the real structure by performing a strength analysis on the real CAD data, wherein performing the strength analysis comprises performing a finite element analysis to determine the state of the real structure.
8. The system of any preceding claim, wherein the real structure includes an in-service vehicle structure, and the in-service vehicle structure includes an in-service aircraft structure.
9. 1. A method for determining the serviceability and remaining life of an existing structure, comprising: accessing, by a processor circuit, three-dimensional (3D) scan data representative of the real structure acquired by the scanning device; generating, by the processor circuitry, real computer-aided design (CAD) data representing real surfaces corresponding to the real structure based on the 3D scan data; determining at least one of a serviceability level or an estimated remaining life of the real structure based on the real CAD data representing the real surface; further comprising: accessing nominal CAD data representing a nominal volume including a nominal surface, the nominal volume corresponding to a nominal structure, a portion of the nominal surface corresponding to the real surface; generating modified nominal CAD data representing a modified nominal volume including the actual surface by replacing the portion of the nominal surface with the actual surface; The method, wherein determining at least one of the serviceability level or estimated remaining life of the existing structure is further based on the modified nominal CAD data.
10. The method of claim 9 , wherein replacing the portion of the nominal surface further comprises removing a trim volume defined by the portion of the nominal surface and the actual surface from the nominal volume.
11. The method of claim 9 or 10, wherein replacing the portion of the nominal surface further comprises adding to the nominal volume an additional volume defined by the portion of the nominal surface and the actual surface.
12. Replacing the portion of the nominal surface comprises: elevating the nominal surface relative to the nominal volume to generate an extended nominal volume; removing a trim volume defined by the elevated nominal surface and the actual surface from the extended nominal volume; The method of any of claims 9 to 11, further comprising performing an intensity analysis on the modified nominal CAD data.
13. further comprising: comparing, by the processor circuitry, the actual surface of the modified nominal volume to the 3D scan data; determining, by the processor circuitry, based on the comparison, whether the actual surfaces in the modified nominal CAD data match the actual surfaces of the actual structure within a predetermined tolerance; 13. The method of claim 9, further comprising generating, by the processor circuitry, an indication of whether the real surfaces in the modified nominal CAD data match the real surfaces of the real structure within the predetermined tolerance in response to the determination based on the comparison.
Citation Information
Patent Citations
Functional quality inspection method by three- dimensional solid model
JP2003344042A
Vehicle planning support system, vehicle planning support program, and vehicle planning assistance method
JP2008140139A
Three-dimensional shape measurement system and strength evaluation system
JP2010066169A
Three-dimensional data generation method
JP2017167808A
Systems and methods for detecting damage
US20180002039A1
