Check Project Manager

By designing an automatic inspection system, receiving inspection data and drawing files, and generating interactive survey image data and metadata, the problem of low efficiency in inspection data processing in the prior art is solved, and more efficient and accurate data management and processing is achieved.

CN115023713BActive Publication Date: 2025-06-27EVIDENT SCIENTIFIC INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202080079795.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-03-20
Filing Date
2020-11-18
Publication Date
2025-06-27
Estimated Expiration
2040-11-18

AI Technical Summary

Technical Problem

In the prior art, inspections of manufacturing or processing plant facilities usually require inspectors to handwritten data and input into the platform, resulting in inefficient data processing and susceptible to the on-site environment.

Method used

An automatic inspection system is designed to receive the inspection data and isometric drawing files of the assets through the server, and generate interactive survey image data and metadata, including indications of the status monitoring location (CML) of the assets and inspection measurement results.

Benefits of technology

Improves the management and processing efficiency of inspection data, reduces handwriting errors, enhances the readability and accuracy of data, and allows inspectors to update and submit data more quickly on the site.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115023713B_ABST
    Figure CN115023713B_ABST
Patent Text Reader

Abstract

A system includes a server that includes a port, a memory, and processing circuitry. The port is configured to receive: (i) a drawing file associated with an isometric drawing of an asset at an inspection location, the drawing file including an indication of a condition monitoring location (CML) of the asset; and (ii) inspection measurement result data of the asset, the inspection measurement result data including inspection measurement results associated with the CML. The memory is configured to store the drawing file and the inspection measurement result data. The processing circuitry is configured to use the inspection measurement result data and the drawing file to generate: (i) survey image data for display; and (ii) metadata of the survey image data, the metadata including survey image coordinates of the CML and inspection measurement results associated with the CML.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims the benefit of priority of U.S. Patent Application Serial No. 16 / 824,953, filed on March 20, 2020, which claims the priority of U.S. Provisional Patent Application Serial No. 62 / 936,775, filed on November 18, 2019. The entire contents of the above - mentioned U.S. Patent Application and U.S. Provisional Patent Application are incorporated herein by reference. Technical Field

[0003] This document relates to an automatic inspection system and, in particular, to a service application for generating an interactive inspection survey. Background Art

[0004] The inspection of a manufacturing or processing plant facility typically involves sending an inspector to the site to perform measurements on the plant systems. Usually, the inspector is given a drawing indicating where to take readings, and the inspection data from the inspection is handwritten on the drawing. Then, the handwritten inspection data from the drawing is later entered into a platform (e.g., a computer system). The on - site location and conditions may make it difficult to handwrite the data, and it may be difficult to read the handwritten data when attempting to enter it into the platform. Summary of the Invention

[0005] Systems and methods for an automatic inspection system are described that improve the efficiency of managing and processing inspection data. A system for automatically generating an interactive survey for a site inspection includes a server that includes: a port configured to receive: (i) a drawing file associated with an isometric drawing of assets at an inspection location, the drawing file including an indication of condition monitoring locations (CMLs) of the assets, and (ii) inspection measurement result data of the assets, the inspection measurement result data including inspection measurement results associated with the CMLs; a memory configured to store the drawing file and the inspection measurement result data; and a processing circuitry configured to use the inspection measurement result data and the drawing file to generate: (i) survey image data for display, and (ii) metadata of the survey image data, the metadata including survey image coordinates of the CMLs and inspection measurement results associated with the CMLs.

[0006] A method for automatically generating an interactive survey for asset inspection, the method comprising: receiving, at a server, inspection data of an asset, the inspection data being referenced by a condition monitoring location (CML) of the asset; receiving, at the server, a drawing file associated with an isometric drawing of the asset, the isometric drawing including an indication of the CML; and using, by a processor of the server, the inspection data and the drawing file to generate survey image data for display and metadata of the survey image data, the metadata including coordinates in the survey image of the CML and inspection data for the CML. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals with different letter suffixes may represent different instances of similar components. The drawings generally illustrate, by way of example and not limitation, various implementations discussed in this document.

[0008] Figure 1 is a functional block diagram of a cloud-based workflow system.

[0009] Figure 2 is a block diagram of an example of a portion of a system for automatically generating an interactive survey for factory inspection.

[0010] Figure 3 is an example of a drawing file of a portion of an asset to be inspected.

[0011] Figure 4 is an example of inspection data.

[0012] Figure 5 is a diagram of an example of an image for an interactive inspection survey.

[0013] Figure 6 is a diagram of a display showing an example of a screen of an interactive inspection survey.

[0014] Figure 7 is a diagram of a display showing an example of a screen of an interactive inspection survey.

[0015] Figures 8A to 8B shows a flowchart of a process for automatically generating an interactive inspection survey. DETAILED DESCRIPTION

[0016] Figure 1 is a functional block diagram of a cloud-based workflow system. A job manager can create an interactive inspection survey by uploading files to cloud 100. The job manager can also load inspection measurements from cloud 100. An inspector can access the interactive survey at an inspection location (e.g., using a portable computing device), perform the inspection and can synchronize the inspection data to the cloud.

[0017] The term "cloud" is used herein to refer to hardware abstraction. Instead of a dedicated server processing uploaded files to create an interactive inspection survey, uploading a file to the cloud can include sending the file to a data center or processing center. The actual servers used to process the files and create the inspection survey can be interchangeable at the data center or processing center.

[0018] Figure 2 is a block diagram of an example of a portion of a system for automatically generating an interactive survey for a factory inspection. System 200 includes server 205. Server 205 includes: a port 210 for receiving a file for creating an interactive inspection survey; and a memory 215 for storing the file. The file includes a drawing file of assets at an inspection location and a file including inspection measurement result data. The drawing file is associated with an isometric drawing of the asset being inspected.

[0019] Figure 3 is an example of a drawing file of a portion of an asset to be inspected. Figure 3 An example is a Portable Document Format (.pdf) drawing of a portion of a schematic diagram of a circuit of an asset and includes the piping and valves of the circuit. The drawing file includes an indication of a Condition Monitoring Location (CML) of the asset where inspection measurements will be taken. The CML in the drawing file can be determined by a job manager (marked as 004, 005, 006 in Figure 3 ).

[0020] Figure 4 is an example of inspection measurement result data that can be included in a file uploaded to the server. Figure 4 The inspection measurement result data in

[0021] returns to Figure 2, the user can upload a drawing file and a file with inspection measurement result data to the server 205. The server 205 also includes processing circuitry (e.g., one or more processors). The server processing circuitry 220 (e.g., via software) is configured to use the inspection data and the drawing file to generate: (i) inspection image data for display and (ii) metadata of the inspection image data. The metadata includes the inspection image coordinates of the CML and the inspection measurement result data previously obtained for the CML. For example, the metadata of the inspection image may include the X-Y coordinates of the CML in the inspection image and the previous inspection measurement results associated with the CML. In some examples, the coordinates are relative coordinates (e.g., relative to the vertices of the inspection image) rather than absolute X-Y coordinates or longitude / latitude positions.

[0022] Figure 5 is a diagram of an example of an image for an interactive inspection survey. The interactive inspection image 500 shows Figure 3 an expanded view of a factory line shown in an example drawing and includes CMLs labeled 001 to 006. The CMLs are shown highlighted by larger circles. An inspector on-site downloads the inspection image data to a portable computing device such as a tablet computer. The highlighted CMLs are interactive for the user. An interaction such as tapping on a highlighted CML using a touch-sensitive display causes the computing device to display the inspection measurement results for that CML. Additional user interactions for the interactive inspection survey are possible and are described elsewhere herein.

[0023] Returning to Figure 2 , the system includes a service application 225. The service application 225 includes an artificial intelligence (AI) algorithm. The server processing circuitry 220 uses the inspection measurement result data and the drawing file to execute the AI algorithm to generate the inspection image data for display and the metadata of the inspection image data. In some examples, the server processing circuitry 220 executes a computer vision algorithm to generate the inspection image data for display and the metadata of the inspection image data. The computer vision algorithm may include one or more of optical character recognition (OCR), image recognition, and image tagging. In certain examples, the server processing circuitry 220 applies the computer vision algorithm to a PDF drawing and an FTP data file to generate the inspection image data for display and the metadata of the inspection image data.

[0024] The system also includes a computing device remote from the server 205. In Figure 1Among them, the remote computing device can be the computing device 130 used by the job manager to create workflow assignments, or can be a portable computing device 135 (e.g., a tablet computer) used by an inspector on-site. The remote computing device includes: a communication port, a user interface including a display, and processing circuitry. The remote computing device receives data from the server 205 via the communication port. The received data includes inspection image data and metadata. The processing circuitry (e.g., via software) is configured to use the received inspection image data and metadata to generate an interactive inspection image of the asset for presentation on the display. The interactive inspection image can be an isometric drawing of the asset and includes user-interactive indications of the CML of the asset, such as Figure 5 the highlighted circles in. In response to a user prompt received at the indication of the CML, the processing circuitry displays inspection data associated with the CML.

[0025] If the remote computing device is the portable computing device 135 for on-site inspection, the remote computing device can receive measurement result information from the inspection of the asset. In some examples, the inspector uses the user interface to input the measurement result information. In some examples, the communication port of the remote computing device is capable of wireless communication with an automatic measurement device, for example, by using a protocol or other wireless protocols. In an illustrative example that is intended to be non-limiting, the measurement device can be an ultrasonic measurement device, which is configured to collect pipe thickness information of the lines of the asset and transmit the information to the communication port of the inspector's portable computing device.

[0026] In some examples, the measurement devices are located at each CML in the CML of the asset. To obtain measurement result information from the measurement devices, the inspector on-site can log in to the portable computing device 135 using the user interface. The inspector can click or otherwise interact with the "Start Inspection" icon on the display to initiate an interactive inspection survey. The user can also pause and resume the interactive survey through the user interface. Initiating the survey can cause the portable computing device to pair with the measurement devices of the CML for communication. When the devices are paired, the inspection measurement result data of the CML is available to the inspector.

[0027] Figure 6 is an illustration of the display of a portable computing device showing an example of a screen of an interactive inspection survey. The user can tap on the interactive indication of the CML to display the number of measurement points at a specific CML and view what the previous measurement results were at the CML during past inspections. In Figure 6 the example of, the indication of the user tapping on CML 003 (ID#003) and the previous measurement results of the pipe thickness of the pipe located at CML 003 are shown.

[0028] The inspector can use the user interface of a portable computing device or an automated measuring device to obtain new measurement results. For example, the inspector can tap an arrow in the display of the portable computing device to request new measurement results, or the inspector can use the user interface of the automated measuring device at the CML to send new measurement results. The inspector continues to obtain new data for other CMLs of the interactive inspection survey. The processing circuitry of the portable computing device can update the metadata of the survey image with the measurement result information and send the updated metadata to the server or cloud.

[0029] The interface between the portable computing device and the measuring device can include an automatic sending feature for hands-free data collection. For safety reasons, it may be desirable to keep the inspector's hands free at the inspection site. When the portable computing device is paired with the automated measuring device, the measurement results are automatically sent to the portable computing device when the measurement results are stable. The measurement results can be considered stable if they are the same or within a specified range for a specified number of readings (e.g., the measurement results are automatically sent when five consecutive measurement results are within the specified range). The automatic sending feature enables the inspector to obtain the measurement results without the inspector having to use the user interface of the portable computing device. The automatic sending feature also prevents possible errors in the data caused by handwriting mistakes.

[0030] The portable computing device can be equipped with a camera device that generates digital image data. For example, the portable computing device can be a tablet computer or a smart phone. The inspector can use the camera device to add visual events to the inspection survey. To generate a visual event, the inspector can hold an indication mark (e.g., a fingertip, a pen, or a cursor) at the following position on the survey image: the position corresponding to the position of a visually concerned object (e.g., a leak, corrosion, suspected corrosion under insulation, etc.) in the line. This position may or may not correspond to the CML. Holding the indication mark generates an indication (e.g., a circle of a specific type indicating the concerned object) on the survey image.

[0031] Figure 7 is a diagram of the display of a portable computing device showing another example of a screen of an interactive inspection survey. The inspector holds an indication mark at a certain position to create an indication of a visual event on the survey image. In Figure 7 the example, the indication mark is two concentric circles 740. Color can be used to draw attention to the concerned object. For example, the indication of the CML can be blue and the indication of the visual event can be orange to indicate a problem. When an indication of a visual event is created, the inspector can tap the indication, and the interactive survey image can present as Figure 7The pop-up screen 745 shown. The inspector can use the pop-up screen to add digital images and add text for the questions.

[0032] Thus, the interactive inspection image enables the inspector to update the drawing on-site. If a connection to the Internet is available, the inspection image updated with the images captured by the imaging device and the new inspection data can be immediately uploaded to the server.

[0033] Once the measurement result information is uploaded from the inspection site, the operation manager can view the measurement result information. At the office location, the operation manager can refresh the web application to open the updated interactive inspection survey, and see the new measurement results just obtained from the field, and see any reported visual events. The operation manager can set the alarm conditions for the inspection, for example, by setting the threshold of the inspection data for when an alarm should be reported. The alarm conditions can be added to the metadata. It can be seen that this provides an improvement in efficiency and enables faster decision-making.

[0034] Figures 8A to 8B A flowchart showing the process for automatically generating an interactive inspection survey is shown. Figure 8A The system server 805 and the user interface 830 (UI) are shown. The server 805 can be a cloud server and the processes in can be executed by the cloud Figure 8A At 802, the operation manager starts creating an interactive survey, and at 804, the file of the interactive survey is uploaded. The file is received at the server 805. The file includes asset inspection data and a drawing file. The asset inspection data can be a text file in FTP format. The drawing file can be a PDF file. At 806, the server parses the inspection data of the inspection points, and at 808, the server uses an image processing service to process the drawing file.

[0035] At 812, the server generates and stores metadata. The processing circuit of the server can execute an AI algorithm to parse the file and generate metadata. The metadata includes the X-Y coordinates of the vertices of each CML relative to the survey image, the inspection points of each CML, and the previous measurement results of each inspection point in the inspection points. The metadata and image data for the isometric survey image are stored in the database 814 (DB) of the server.

[0036] Figure 8BShows a portable computing device 835 (e.g., a tablet computer) used by an inspector to perform an interactive inspection survey. At 816, the inspector logs into the portable computing device 835. At 818, the inspector starts an interactive inspection survey by, for example, clicking a cursor on a start survey icon displayed on the computing device or tapping the displayed icon. When starting the survey, the portable computing device 835 can be wirelessly paired with a measurement device such as an ultrasonic thickness gauge 822.

[0037] At 824, the server 805 sends survey image data and metadata to the portable computing device 835. The portable computing device 835 generates an interactive survey image of an asset or a portion of an asset on a display. The interactive survey image can be a hypertext markup language (HTML) web page with an isometric image of the flow line of the asset. The HTML page and image include interactive indicators (e.g., clickable circles) at each CML point of the asset. When the inspector performs a certain type of interaction with a CML indicator (e.g., clicks or taps the displayed CML indicator), the interactive survey image can display previous measurement results of the CML.

[0038] At 826, the portable computing device 835 captures measurement results from the measurement device. The inspector can tap or click an icon on the portable computing device to request measurement results, or the inspector can use the user interface of the measurement device to send measurement result data to the portable computing device. In some examples, an automatic send feature is used to capture measurement results.

[0039] At 828, the measurement result data is synchronized to the cloud by uploading the updated measurement result data. As previously described herein, at 832, the inspector can perform another type of interaction with the display (e.g., press and hold the display position) to add a visual event. The visual event is also synchronized to the cloud by uploading the visual event data and image data. The uploaded measurement result data, visual event data, and image data can be added to the metadata of the interactive inspection survey.

[0040] Returning to Figure 8A , at 834, the server 805 stores the measurement result data and any visual events in the database 814. If the job manager requests to view the measurement results at 836, the server 805 overlays the measurement results on the CML and includes the visual events in the interactive survey image presented to the job manager. If a connection to the Internet is available for the portable computing device at the inspection site, the job manager can view the updated survey image as soon as new data is uploaded to the cloud (e.g., by refreshing the web application) while the inspector is still on site.

[0041] The devices, systems, and methods described herein improve the efficiency of obtaining and processing inspection data. This enables faster decision-making regarding the operation of assets.

[0042] Additional description and examples

[0043] Example 1 includes a subject (e.g., a system) that includes a server. The server includes: a port configured to receive: (i) a drawing file associated with an isometric drawing of an inspection location, the drawing file including an indication of a condition monitoring location (CML) of an asset, and (ii) inspection measurement result data of the asset, the inspection measurement result data including inspection measurement results associated with the CML; a memory configured to store the drawing file and the inspection measurement result data; and a processing circuit configured to use the inspection measurement result data and the drawing file to generate: (i) survey image data for display, and (ii) metadata of the survey image data, the metadata including survey image coordinates of the CML and inspection measurement results associated with the CML.

[0044] In Example 2, the subject of Example 1 optionally includes a server processing circuit configured to use an artificial intelligence algorithm to generate (i) survey image data for display and (ii) metadata of the survey image data.

[0045] In Example 3, the subject of Example 2 optionally includes a computer vision algorithm that includes one or more of optical character recognition (OCR), image recognition, and image tagging.

[0046] In Example 4, the subject of Example 1 to any combination of Examples 1 to 3 optionally includes: the inspection measurement result data of the asset includes thickness measurement result data of the asset.

[0047] In Example 5, the subject of Example 1 to any combination of Examples 1 to 4 optionally includes a computing device remote from the server. The remote computing device includes: a communication port configured to receive the survey image data; a display; and a processing circuit configured to use the survey image data to generate an isometric drawing of the asset for display.

[0048] In Example 6, the subject matter of Examples 1 to 4, optionally, includes a computing device remote from the server. The remote computing device includes: a communication port configured to receive the survey image data and the metadata; a user interface including a display; and a processing circuit. The processing circuit is configured to: use the survey image data and the metadata to generate an interactive survey image of the asset for presentation on the display, the interactive survey image including a user-interactive indication of the CML of the asset; receive a notification of a user prompt at a first interactive indication associated with a first CML in the CML; and in response to the user prompt, display inspection data associated with the first CML.

[0049] In Example 7, the subject matter of Example 6, optionally, includes a communication port of the remote computing device, the communication port of the remote computing device being configured to receive measurement result information from a measuring device located at the CML of the asset; and the processing circuit being configured to update the metadata of the survey image with the measurement result information; and send the updated metadata to the server.

[0050] In Example 8, the subject matter of Example 7, optionally, includes a communication port configured to receive pipe thickness information of a pipe located at the CML from an ultrasonic measuring device.

[0051] In Example 9, the subject matter of Examples 5 to 8, optionally, includes a computing device including a camera device configured to generate digital image data; and the processing circuit of the remote computing device being configured to add the digital image data to the survey image data in response to a second type of user prompt received by the user interface.

[0052] Example 10 includes the subject matter (e.g., a method for automatically generating an interactive survey of a site inspection) or can optionally be combined with one or any combination of Examples 1 to 9 to include such subject matter, the subject matter including: receiving, at a server, inspection measurement result data of an asset at an inspection location, the inspection measurement result data including inspection measurement results associated with a condition monitoring location (CML) of the asset; receiving, at the server, a drawing file associated with an isometric drawing of the asset, the isometric drawing including an indication of the CML; and generating, by a processor of the server, using the inspection measurement result data and the drawing file: (i) survey image data for display, and (ii) metadata of the survey image data, the metadata including survey image coordinates of the CML and the inspection measurement results associated with the CML.

[0053] In Example 11, the subject matter of Example 10 optionally includes: sending the survey image data and the metadata from the server to a remote computing device including a user interface; generating, using the survey image data and the metadata, an interactive survey image of the asset on a display of the remote computing device, the interactive survey image including a user-interactive indication of the CML of the asset; and displaying inspection measurement results associated with the CML in response to a first type of user prompt received at the indication of the CML.

[0054] In Example 12, the subject matter of Example 11 optionally includes: receiving measurement result information from a measurement device located at the CML of the asset using the remote computing device; updating the metadata of the survey image using the measurement result information; and sending the updated metadata to the server.

[0055] In Example 13, the subject matter of Example 12 optionally includes: receiving thickness measurement result information of the asset from an ultrasonic measurement device located at the CML.

[0056] In Example 14, the subject matter of Example 12 and / or Example 13 optionally includes: the remote computing device adding image data of the location of the asset to the survey image in response to a second type of user prompt received by the user interface.

[0057] In Example 15, the subject matter of Example 10 to Example 14, in one or any combination, optionally includes: a processor of the server applying an artificial intelligence algorithm to the inspection measurement result data and the drawing file to generate (i) the survey image data for display and (ii) the metadata of the survey image data.

[0058] In Example 16, the subject matter of Example 15 optionally includes: the server applying a computer vision algorithm to the inspection measurement result data of the asset and the isometric drawing of the asset to generate the survey image data for display and the metadata of the survey image data, wherein the computer vision algorithm includes one or more of optical character recognition (OCR), image recognition, and image tagging.

[0059] In Example 17, the subject matter of Example 10 to Example 16, in one or any combination, optionally includes: sending the survey image data and the metadata from the server to a remote computing device, the remote computing device including a user interface having a display; and generating a survey image of the asset on the display, wherein the interactive survey image is an isometric drawing of the asset.

[0060] In Example 18, the subject matter of one or any combination of Examples 10 to 17 optionally includes thickness measurement results of a pipeline receiving the asset, and receiving a drawing file includes receiving a drawing file representing an isometric line drawing of the pipeline of the asset.

[0061] Example 19 includes the subject matter or can optionally be combined with one or any combination of Examples 1 to 18 to include such subject matter (e.g., a computer-readable storage medium including instructions that, when executed by a processing circuit of a server, cause the server to perform actions), the actions including: receiving, at the server, inspection measurement result data of an asset at an inspection location, the inspection measurement result data including inspection measurement results associated with a condition monitoring location (CML) of the asset; receiving, at the server, a drawing file associated with an isometric drawing of the asset, the isometric drawing including an indication of the CML; and using the inspection measurement result data and the drawing file to generate: (i) survey image data for display, and (ii) metadata of the survey image data, the metadata including survey image coordinates of the CML and inspection measurement results associated with the CML.

[0062] In Example 20, the subject matter of Example 19 optionally includes: using a computer vision algorithm to generate (i) survey image data for display and (ii) metadata of the survey image data, the computer vision algorithm including one or more of optical character recognition (OCR), image recognition, and image tagging.

[0063] These non-limiting examples can be combined in any arrangement or combination. The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings illustrate, by way of example, specific implementations in which the invention may be practiced. These implementations are also referred to herein as "examples". All publications, patents, and patent documents referenced in this document are incorporated herein by reference in their entirety as if individually incorporated by reference. In the case of inconsistent usage between this document and any document incorporated by reference, the usage in this document shall govern. In the case of inconsistent usage between this document and those documents incorporated by reference, the usage in the incorporated reference document(s) shall be regarded as supplementary to the usage in this document; for conflicting inconsistencies, the usage in this document shall govern.

[0064] In this document, as is common in patent documents, the term "a" or "an" is used to include one or more than one, regardless of any other instances or uses of "at least one" or "one or more". In this document, unless otherwise indicated, the term "or" is used to refer to a non-exclusive or, such that "A or B" includes "A but not B", includes "B but not A", and includes "A and B". In the appended claims, the terms "including" and "in which" are used as the ordinary English equivalents of the respective terms "comprising" and "wherein". Further, in the following claims, the terms "including" and "comprising" are open-ended, that is, a system, apparatus, article, or process that includes elements in addition to those listed after such a term in the claim is still considered to fall within the scope of that claim. Further, in the following claims, the terms "first", "second", "third", etc. are used merely as labels and are not intended to impose numerical requirements on their objects. The method examples described herein may be at least partially machine or computer-implemented.

[0065] The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more aspects of the examples) may be used in combination with each other. For example, other implementations may be used by those of ordinary skill in the art after reading the above description. The abstract is provided to enable the reader to quickly ascertain the nature of the technical disclosure. The abstract is submitted with the understanding that it will not be used to limit or interpret the scope or meaning of the claims. Additionally, in the above detailed description, various features may be combined to simplify the disclosure. This should not be construed as meaning that for any claim, the disclosed features that are not claimed are necessary. Rather, the inventive subject matter may lie in less than all of the features of a particular disclosed embodiment. Accordingly, the appended claims are hereby incorporated into the detailed description, where each claim stands on its own as a separate embodiment. The scope of the present invention should be determined with reference to the appended claims and the full scope of equivalents to such claims.

Claims

1. A system for automatically generating an interactive survey for on-site inspection of an asset, the system comprising: A server, which includes: A port configured to receive: (i) a drawing file associated with an isometric drawing of an inspection location, the drawing file including an indication of the asset condition monitoring location CML of the asset, and (ii) inspection measurement result data of the asset, the inspection measurement result data including inspection measurement results associated with the asset CML; A memory configured to store the drawing file and the inspection measurement result data; and A processing circuit configured to: Use the inspection measurement result data and the drawing file to generate the interactive survey, the interactive survey including: (i) survey image data for display, (ii) a user interactive CML for display corresponding to the asset CML, and (iii) metadata of the survey image data, the metadata including survey image coordinates of the asset CML and inspection measurement results associated with the asset CML; and Initiate sending the generated interactive survey to a separate device; and Wherein, a prompt received by the user interactive CML of the interactive survey initiates an automatic update of the inspection measurement result information of the asset CML corresponding to the user interactive CML, and the metadata of the survey image is updated using the updated measurement result information.

2. The system according to claim 1, wherein, The server processing circuit is configured to use an artificial intelligence algorithm to generate (i) survey image data for display and (ii) metadata of the survey image data.

3. The system according to claim 2, wherein The artificial intelligence algorithm is a computer vision algorithm including one or more of optical character recognition OCR, image recognition, and image tagging.

4. The system according to any one of claims 1 to 3, wherein The inspection measurement result data includes thickness measurement result data of the asset.

5. The system according to any one of claims 1 to 3, including a computing device remote from the server, the remote computing device including: A communication port configured to receive the survey image data; A display; And A processing circuit configured to use the survey image data to generate an isometric drawing of the asset for display.

6. The system according to any one of claims 1 to 3, including a computing device remote from the server, the remote computing device including: A communication port configured to receive the survey image data and the metadata; A user interface including a display; And A processing circuit configured to: Use the survey image data and the metadata to generate an interactive survey image of the asset for presentation on the display, the interactive survey image including a user interactive CML; Receive a notification of a user prompt at a first user interactive CML of the interactive survey image associated with a first asset CML in the asset CML; And In response to the user prompt, display inspection data associated with the first asset CML.

7. The system according to claim 6, Among them, The communication port of the remote computing device is further configured to receive new inspection information from a measuring device located at the asset CML in response to a prompt received by the corresponding user interactive CML of the interactive survey image; and wherein, the processing circuit of the remote computing device is configured to: update the metadata of the survey image with the measurement result information; and send the updated metadata to the server.

8. The system according to claim 7, wherein, The communication port is configured to receive pipeline thickness information located at the asset CML from an ultrasonic measuring device.

9. The system according to claim 6, Among them, the remote computing device includes a camera device configured to generate digital image data; and wherein, the processing circuit of the remote computing device is configured to add the digital image data to the survey image data in response to a second type of user prompt received by the user interface.

10. A method for automatically generating an interactive survey of a site inspection, the method comprising: receiving, at a server, inspection measurement result data of an asset at an inspection location, the inspection measurement result data including inspection measurement results associated with an asset condition monitoring location CML of the asset; receiving, at the server, a drawing file associated with an isometric drawing of the asset, the isometric drawing including an indication of the asset CML; and generating, by a processor of the server, the interactive survey using the inspection measurement result data and the drawing file, the interactive survey including: (i) survey image data for display, (ii) a user interactive CML for display corresponding to the asset CML, and (iii) metadata of the survey image data, the metadata including survey image coordinates of the asset CML and inspection measurement results associated with the asset CML, wherein, a prompt received by the user interactive CML of the interactive survey initiates an automatic update of the inspection measurement result information of the asset CML corresponding to the user interactive CML, and the updated measurement result information is used to update the metadata of the survey image.

11. The method according to claim 10, comprising: sending the survey image data and the metadata from the server to a remote computing device including a user interface; generating, on a display of the remote computing device, an interactive survey image of the asset using the survey image data and the metadata, the interactive survey image including the user interactive CML; and displaying inspection measurement results associated with the asset CML in response to a first type of user prompt received via the user interactive CML corresponding to the asset CML.

12. The method according to claim 11, comprising: receiving, in response to a prompt received by the user interactive CML corresponding to the asset CML, measurement result information from a measuring device located at the asset CML of the asset using the remote computing device; updating the metadata of the survey image with the measurement result information; and sending the updated metadata to the server.

13. The method according to claim 12, wherein, Receiving the measurement result information includes: receiving thickness measurement result information of the asset from an ultrasonic measurement device located at the asset CML.

14. The method according to claim 12, comprising: In response to a second type of user prompt received by the user interface, the remote computing device adds image data of the location of the asset to the survey image.

15. The method according to any one of claims 10 to 14, wherein Generating the survey image data includes: the processor of the server applying an artificial intelligence algorithm to the inspection measurement result data and the drawing file to generate (i) the survey image data for display and (ii) metadata of the survey image data.

16. The method according to claim 15, wherein, Generating the survey image data includes: the server applying a computer vision algorithm to the inspection measurement result data of the asset and the isometric drawing of the asset to generate the survey image data for display and metadata of the survey image data, wherein the computer vision algorithm includes one or more of optical character recognition OCR, image recognition, and image tagging.

17. The method according to any one of claims 10 to 14, comprising: Sending the survey image data and the metadata from the server to a remote computing device, the remote computing device including a user interface having a display; And Generating an interactive survey image of the asset on the display, wherein the interactive survey image is an isometric drawing of the asset.

18. The method according to any one of claims 10 to 14, wherein, Receiving inspection data includes receiving the thickness measurement result of the asset, and receiving the drawing file includes receiving a drawing file representing an isometric line drawing of the asset.

19. A non-transitory computer-readable storage medium, comprising instructions that, when executed by a processing circuit of a server, cause the server to perform actions including the following: Receiving, at the server, inspection measurement result data of an asset at an inspection location, the inspection measurement result data including inspection measurement results associated with the asset condition monitoring location CML of the asset; Receiving, at the server, a drawing file associated with an isometric drawing of the asset, the isometric drawing including an indication of the asset CML; And Using the inspection measurement result data and the drawing file to generate an interactive survey, the interactive survey including: (i) survey image data for display, (ii) a user interactive CML for display corresponding to the asset CML, and (iii) metadata of the survey image data, the metadata including survey image coordinates of the asset CML and inspection measurement results associated with the asset CML, wherein a prompt received by the user interactive CML of the interactive survey initiates an automatic update of the inspection measurement result information of the asset CML corresponding to the user interactive CML, and the updated measurement result information is used to update the metadata of the survey image.

20. The non-transitory computer-readable storage medium according to claim 19, comprising instructions that cause the processing circuit to perform actions including the following: Use computer vision algorithms to generate (i) survey image data for display and (ii) metadata of the survey image data, the computer vision algorithms including one or more of optical character recognition OCR, image recognition, and image tagging.

Citation Information

Patent Citations

  • Inspection data graphical filter

    US20140207419A1

  • System and method for facilitating an inspection process

    US20180039715A1

  • Quality control isometric for inspection of field welds and flange bolt-up connections

    US20190146448A1