Data labeling method and system for non-destructive ultrasonic test

Abstract

Disclosed is a data labeling system. More particularly, the present invention relates to a data labeling method and system for a non-destructive ultrasonic test reflecting an improved procedure for rapid processing of a labeling task of image data acquired through an ultrasonic diagnostic device or the like. According to an embodiment of the present invention, labeling data for the ultrasonic diagnostic device may be efficiently registered, generated, and inspected by registering, for each project in units of teams, new data constructed on a cloud server and acquired through the ultrasonic diagnostic device, and allowing an expert and a general worker to share and sequentially process all labeling tasks of labeling and storage, such as sample classification, labeling, and inspection, according to their respective permissions.

Description

Data labeling method and system for non-destructive ultrasonic inspection

[0001] The present invention relates to a data labeling system, and more specifically, to a data labeling method and system for non-destructive ultrasonic inspection that incorporates an improved procedure for rapid processing of the labeling of image data acquired through an ultrasonic diagnostic device, etc.

[0002] An ultrasonic diagnostic device refers to a device that converts ultrasonic signals transmitted to and received by an object to be inspected into electrical image signals to output the internal state of the object. Currently, it is used in industrial settings for Non-destructive Ultrasonic Testing (NDT) to evaluate the quality of manufactured parts or to inspect defects in welded parts of steel plates.

[0003] As the non-destructive ultrasonic inspection process using such ultrasonic diagnostic devices is managed through subjective and qualitative competency testing or certification of inspectors, problems of deterioration in inspection quality due to human error are repeatedly occurring.

[0004] Accordingly, non-destructive testing solution technologies utilizing artificial intelligence are being proposed to minimize the occurrence of human error and to innovatively improve inspection quality and reliability.

[0005] However, while such AI-based solutions require the securing of a large amount of high-quality non-destructive testing data, the technology for producing and collecting this data is currently lacking.

[0006] Accordingly, there is a need to secure training data for non-destructive testing using ultrasonic testing devices and to build a database for the data set by developing data labeling tools and programs that can minimize human error in currently operating non-destructive ultrasonic testing procedures and secure high-quality non-destructive testing data, as well as developing non-destructive testing solutions using artificial intelligence.

[0007] In this regard, Korean Published Patent Application No. 10-2024-0022151 discloses a technology relating to a method and apparatus for labeling phased array ultrasound images, comprising: a first input step of receiving three-dimensional shape data of an object; a second input step of receiving coordinates for a specific position in the object as reference coordinates; a plane providing step of generating an X-plane, Y-plane, and Z-plane of the object at the reference coordinates and outputting the X-plane, Y-plane, and Z-plane; and a labeling step of labeling ultrasound images according to which, when a target area is indicated in any one of the X-plane, Y-plane, and Z-plane, an area identical to the target area is labeled in the remaining planes.

[0008] However, according to these prior art documents as well as other known technologies, while specific processing techniques for the data itself are presented, the overall procedure for constructing a database—from the data acquisition process to processing, verification, and storage—is not presented.

[0009] In particular, as the entire business process for data labeling is carried out by multiple personnel in a team unit, procedures for managing and supervising the work must be performed in addition to the labeling procedures mentioned above, and it can be said that means to systematically manage and operate this are required.

[0010] (Patent Document 1) Korean Published Patent Application No. 10-2024-0022151 (Feb. 20, 2024)

[0011] The present invention relates to a data labeling system for non-destructive ultrasonic inspection, and in particular, has a challenge in implementing a system that provides an environment for systematically creating, managing, and operating projects for non-destructive ultrasonic inspection data labeling work performed by a large number of people online.

[0012] To solve the aforementioned problem, a data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention may include: a step of creating a project for data labeling at the request of a project manager; a step of setting up one or more teams consisting of a plurality of first to third participants having different authority to perform the project; a step of registering one or more new data according to non-destructive ultrasonic inspection in the project by a first participant; a step of generating sample data according to C-scan labeling and B-scan labeling according to a first labeling process for the new data by the first participant; a step of generating labeling data by performing the remaining B-scan labeling for the new data according to a second labeling process using the sample data by a second participant; and a step of storing the approved labeling data in a database according to an inspection process for the labeling data by a third participant.

[0013] In addition, prior to the step of creating a project for data labeling at the request of the project manager, a step of receiving multiple image data acquired through an ultrasound diagnostic device and listing them may be further included.

[0014] The step of registering one or more new data in the project by the first participant may include: providing a list of multiple image data at the request of the first participant; receiving a selection of one or more image data within the list from the first participant; loading the selected image data onto a work tool; and generating the sample data by receiving coordinates and parameters on the image according to the input of the first participant through a web interface including a visualization function provided by the work tool.

[0015] The step of generating sample data according to C-scan labeling and B-scan labeling according to the first labeling process for the new data of the first participant may include, for a defect existing on the new data, determining a bounding box corresponding to a defect area using a guide line, receiving a selection of the type of defect indicated by the bounding box, storing C-scan data including the bounding box, and receiving a representative B-scan data based on a search for an index axis corresponding to the bounding box and storing it as the sample data.

[0016] The step of generating labeling data by performing the remaining B-scan labeling for the new data according to the second labeling process using the sample data of the second participant may include the step of selecting a bounding box present in the C-scan data, the step of selecting other B-scan data in which the index axis has been changed for the remaining area corresponding to the bounding box, and the step of storing the other B-scan data.

[0017] In addition, a system for performing a data labeling project for non-destructive ultrasonic inspection according to an embodiment of another aspect of the present invention for solving the aforementioned problem may include a web UI providing unit that provides a web interface including a work tool for project execution to a plurality of first to third participants having different authority belonging to one or more teams for performing said project; a front-end unit that provides one or more functions for proceeding with procedures regarding the creation of said project, team setting, registration of new data, generation of sample data, generation of labeling data, and storage of labeling data; and a back-end unit that provides one or more functions for proceeding with procedures regarding the storage and management of stored labeling data.

[0018] The above front-end unit may include a work management unit that processes authority and information regarding the project and first to third participants participating in the project, and a labeling unit that processes the display, generation, and procedure execution regarding leveling data and identified defects according to the work of the first to third participants.

[0019] According to an embodiment of the present invention, by establishing a cloud server and registering new data acquired through an ultrasonic diagnostic device for each team-based project, and by allowing experts and general workers to sequentially process the entire labeling work, such as labeling and storage including sample classification, labeling, and inspection, according to their respective authority, there is an effect of efficiently registering, generating, and inspecting labeling data for an ultrasonic diagnostic device.

[0020] FIG. 1 is a schematic diagram showing the online connection form of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0021] FIG. 2 is a diagram showing the structure of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0022] FIGS. 3a to 3d are schematic diagrams illustrating a method for generating scan data for new data in a labeling process of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0023] FIG. 4 is a diagram illustrating labeling data completed by a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0024] FIG. 5 is a diagram illustrating a data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0025] FIGS. 6a to 6f are drawings illustrating a web UI provided by the system at each step according to the data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0026] The present invention as described above will be explained in detail through the attached drawings and embodiments.

[0027] It should be noted that the technical terms used in this invention are used merely to describe specific embodiments and are not intended to limit the invention. Furthermore, unless specifically defined otherwise in this invention, the technical terms used in this invention should be interpreted in the sense generally understood by those skilled in the art to which this invention pertains, and should not be interpreted in an overly broad or overly narrow sense. Additionally, if a technical term used in this invention is an incorrect technical term that fails to accurately express the concept of the invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. Moreover, general terms used in this invention should be interpreted according to their prior definitions or the context, and should not be interpreted in an overly narrow sense.

[0028] Furthermore, singular expressions used in the present invention include plural expressions unless the context clearly indicates otherwise. In the present invention, terms such as "composed of" or "comprising" should not be interpreted as necessarily including all of the various components or steps described in the invention, and should be interpreted as meaning that some of the components or steps may not be included, or that additional components or steps may be included.

[0029] Additionally, terms including ordinal numbers, such as first, second, etc., used in the present invention may be used to describe components, but the components shall not be limited by such terms. The terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component.

[0030] In the following description, the term referring to the "data labeling system for non-destructive ultrasonic inspection" of the present invention may be used interchangeably as "data labeling system" or "system".

[0031] Hereinafter, a data labeling method and system for non-destructive ultrasonic inspection according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0032] FIG. 1 is a schematic diagram showing the online connection form of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0033] Referring to FIG. 1, a data labeling system (100) for non-destructive ultrasonic inspection according to an embodiment of the present invention can provide a team-based cloud work environment in which participants with various rights participating in the project can access through an information and communication network using their terminals (10) and perform work through a labeling process as the project progresses.

[0034] In detail, the system (100) of the present invention is configured to carry out a process of examining whether there are defects in an object such as a steel plate by dividing labor among participants with various authority. These participants include a project manager who has the authority to set the creation, registration, and termination of a project; a first participant who has the authority of a certified expert in non-destructive testing who possesses a certain level of expertise related to non-destructive ultrasonic testing; a second participant who has the authority of a worker who does not possess the level of expertise of the first participant but has the capability to perform non-destructive testing data labeling work through the education and instruction of an expert; and a third participant who has the authority of an inspector who possesses knowledge of inspecting labeling data.

[0035] Accordingly, the project manager can access the data labeling system (100) through the terminal (10) to create one or more projects for generating labeling data for non-destructive ultrasonic inspection using an ultrasonic diagnostic device and register them in the system (100), and additionally, create a team to carry out the registered projects, and grant authority to various participants already registered in the system (100) and assign them to the team.

[0036] Afterwards, the project team members can sequentially perform the reading or inspection tasks assigned to them according to authority on new data generated by the ultrasonic diagnostic device registered in the system (100) according to the labeling process to generate labeling data and store it in the database.

[0037] In particular, the data labeling system (100) for non-destructive ultrasonic inspection according to an embodiment of the present invention is characterized in that the labeling process performed according to the authority of a plurality of participants is designated differently, thereby enabling more accurate and rapid work to be performed through collaboration among participants and securing high-quality labeling data.

[0038] Here, the above-mentioned labeling data can be used as training data to train an artificial intelligence model when developing an artificial intelligence model for non-destructive ultrasonic inspection.

[0039] To this end, the system (100) of the present invention grants different work procedures according to the authority of each participant according to the labeling process, and provides a corresponding web UI, and specific details regarding the procedures for each labeling process and the web UI provided by the system (100) will be described later.

[0040] According to the structure described above, the data labeling system for non-destructive ultrasonic inspection of the present invention enables efficient allocation of human resources based on the capabilities of the participants, thereby rapidly processing the labeling work for image data resulting from non-destructive ultrasonic inspection for inspecting defects occurring in welded parts of steel plates, and increasing the accuracy of the data.

[0041] Hereinafter, the structure of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0042] FIG. 2 is a diagram showing the structure of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0043] Referring to FIG. 2, a data labeling system (100) for non-destructive ultrasonic inspection according to an embodiment of the present invention is a system for performing a data labeling project for non-destructive ultrasonic inspection, and may include a web UI providing unit (110) that provides a web interface including a work tool for performing the project to a plurality of first to third participants having different authority belonging to one or more teams for performing the project, a front end unit (120) that provides one or more functions for performing procedures regarding the creation of the project, team setting, registration of new data, creation of sample data, creation of labeling data, and storage of labeling data, and a back end unit (130) that provides one or more functions for performing procedures regarding the storage and management of stored labeling data.

[0044] The web UI providing unit (110) can provide a GUI-type work environment in which each participant participating in the registered project, including the project manager, performs the labeling process.

[0045] The front end (120) can provide various functions necessary for the overall procedure to each participant, including the manager who is the subject performing the data labeling process through the system (100) of the present invention.

[0046] To this end, the front end unit (120) may include a work management unit (122) that processes authority and information regarding a project and first to third participants participating in said project, and a labeling unit (124) that processes the display, generation, and procedure progress regarding leveling data and identified defects according to the work of the first to third participants.

[0047] In detail, the work management unit (122) can provide functions related to the work of the data labeling project, such as a user management function that registers one or more participants participating in the project and grants job-specific authority according to the input of the manager, a team management function that assigns one or more teams to the project created according to the input of the manager, a team member management function that adds or removes one or more participants as team members for each team, a project management function that allows the manager to create, update, or delete one or more projects for data labeling, a work management function that receives the progress of the labeling process currently in progress from each participant and reflects it in the project status, and a file management function that stores, loads, updates, or deletes new data, labeling data, etc. required for data labeling in the backend unit (130).

[0048] The various functions provided by the aforementioned task management unit (122) can be provided to the terminals of each participant, including the manager, through the web interface provided by the web UI providing unit (110).

[0049] The labeling unit (124) can provide a work tool for the data labeling process. This work tool provides a visualized work environment based on a web interface and can provide visualization functions, labeling functions, and defect management functions.

[0050] The labeling unit (124) can provide a visualization function that loads new data generated according to the ultrasonic inspection onto a screen with an editing function, a labeling function that receives input from a participant and reflects the labeling work on the data, and a defect management function that creates, edits, saves, and deletes data set as defects during the labeling work.

[0051] The backend unit (130) can provide storage and management functions for various data required for a labeling project. Specifically, the backend unit (130) provides non-destructive ultrasonic inspection labeling management functions that store, update, and delete labeling data generated during project execution, including a number of new data obtained through non-destructive ultrasonic inspection, and can store non-destructive inspection information including new data in 3D form and labeling data associated therewith.

[0052] Additionally, the backend unit (130) may provide a function to convert file metadata between new data and labeling data associated therewith. This file metadata conversion function may be a function that converts the generated labeling data into a form of metadata for the corresponding new data and stores it when the labeling data is generated.

[0053] Hereinafter, a labeling method using the data labeling system for non-destructive ultrasonic inspection according to the present invention by the participants will be described in detail with reference to the drawings.

[0054] FIGS. 3a to 3d are schematic diagrams illustrating a method for generating scan data for new data in a labeling process of a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention.

[0055] Referring to FIG. 3a, the novel data targeted by the data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention is inspection data for various targets according to ultrasonic inspection, and the drawing illustrates an ultrasonic inspection method for a welded part of a metal plate.

[0056] Image data from an ultrasonic diagnostic device can be broadly classified into A scan, B scan, and C scan. An A scan is data that displays the amplitude of the received ultrasonic echo signal over time, a B scan is data that represents the response of the ultrasonic signal to the one-dimensional movement of the probe and displays the cross-section of the object being inspected to determine the depth and length of the defect, and a C scan is data that represents the response of the ultrasonic signal to the two-dimensional movement of the probe and displays the interior of the object being inspected as a plane to determine the approximate outline of the defect.

[0057] Accordingly, in the present invention, an ultrasonic diagnostic device is used to transmit ultrasonic waves while moving over the welded area of ​​an object, and the ultrasonic signal reflected from the object is received to generate new data such as that shown in Fig. 3b, which is then input, and multiple participants, including experts, perform labeling according to their authority.

[0058] Here, FIG. 3c illustrates 3D C-scan data acquired as the ultrasonic scanner moves in the horizontal and vertical directions, and FIG. 3d illustrates B-scan data corresponding to a point on the index axis of the C-scan data. That is, FIG. 3d can be viewed as a cross-sectional image cut along a selected horizontal axis in the planar image of FIG. 3c, and an expert defines a defect area in the planar image and designates one of the multiple cross-sectional images belonging to that defect area as representative B-scan data, i.e., sample data. Additionally, a general operator performs additional labeling work on the remaining terminal images included in the defect area by referring to that sample image.

[0059] The participant can identify the defective areas in Figures 3c and 3d on the web UI and perform a labeling task to generate labeling data.

[0060] In addition, FIG. 4 is a diagram illustrating labeling data completed by a data labeling system for non-destructive ultrasonic inspection according to an embodiment of the present invention, showing the form of new three-dimensional data (a) and labeling data (b) that matches the new data, respectively, by an ultrasonic diagnostic device.

[0061] Hereinafter, a data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention using a system of the structure described above will be described in detail with reference to the drawings.

[0062] FIG. 5 is a diagram illustrating a data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention, and FIGS. 6a to 6f are diagrams illustrating a web UI provided by the system at each step according to the data labeling method for non-destructive ultrasonic inspection according to an embodiment of the present invention. In the following description, unless otherwise specified, the entity executing each step is the data labeling system for non-destructive ultrasonic inspection and its components according to the present invention.

[0063] Referring to FIGS. 5, 6a, and 6b, in the step (S100) of creating a project for data labeling at the request of a project manager, the project manager can access the web UI provided by the system using a web browser on their terminal, and after performing a login procedure using a pre-set account and password, can create a labeling project for non-destructive ultrasonic inspection. FIG. 6b illustrates a screen showing a list of multiple previously registered projects, and the project manager can select and manage previously registered projects or create a new project and register it in the list.

[0064] Next, in the step (S200) of setting up one or more teams consisting of multiple first to third participants having different authority to perform a project, the project manager sets up one or more teams to perform a project for any registered project. At this time, one team may consist of multiple participants, such as experts and workers with general authority, and the project manager sets authority for experts, general participants, and inspectors, registers them in the system, and can add or exclude each participant from a specific team.

[0065] Next, in the step (S300) of registering one or more new data according to non-destructive ultrasonic inspection in the project by the first participant, the first participant, who is registered as a team member of a project, particularly has expert authority, loads the new data through a web UI in the form of FIG. 6c in order to perform work on the new data set in the project to which he belongs.

[0066] In particular, the first participant can set and store parameters so that defective areas are easily identified on the newly loaded data.

[0067] Next, in the step (S400) of generating sample data according to C scan labeling and B scan labeling according to the first labeling process for the new data of the first participant, as shown in FIG. 6d, the first participant inspects defects on the web UI and sets coordinates and parameters on the image to generate the sample data.

[0068] Specifically, in step S400, the first participant defines an area for a defect present on the sample image using a guide line. Accordingly, the work tool determines a bounding box based on the defined area, and then receives a selection of the type of defect indicated by the bounding box, and stores C scan labeling data based on the bounding box. Additionally, the system receives a selection from the first participant of a representative B scan image in which the defect is displayed, based on a search for the index axis corresponding to the bounding box.

[0069] That is, the first participant can mark defect areas in the C scan data, select and save defect types, and select an index axis to select representative B scan data to generate sample data.

[0070] In accordance with this process, the first participant handles the labeling process according to their authority, and subsequently, the second participant, who has general worker authority, performs the labeling work for the remaining defects present in the new data by referring to the representative B scan data, i.e., the sample data.

[0071] Accordingly, the step (S500) of generating labeling data by proceeding with the remaining B-scan labeling according to the second labeling process for the sample data of the second participant is a defect inspection procedure by a general worker as shown in FIG. 6e, and the second worker having such authority checks the representative B-scan data to recognize the defect type and completes the second labeling by performing a labeling task to additionally mark defects on the remaining B-scan data present in the new data.

[0072] In detail, the second participant can select one or more remaining B-scan data excluding the representative B-scan data by selecting a bound box through a leader line in the new data based on the sample data.

[0073] Then, after identifying defects present in the remaining B-scan data and the second participant determines the corresponding defect area, the system saves the B-scan labeling according to the defect area. At this time, the second participant can terminate the task by selecting the completion button provided by the web UI after completing the work for each defect.

[0074] Subsequently, as a step (S600) of storing approved labeling data in a database according to the inspection process of the labeling data of the third participant, the inspection process for B-scan data for which a secondary operation has been completed by a third participant having inspection authority as shown in FIG. 6f may be carried out, and when the inspection of the B-scan data assigned by the third participant is completed, the system may integrate the new data and the labeling data and store them in the backend.

[0075] Although many details are described in detail in the above description, this should be interpreted as an example of a preferred embodiment rather than as a limitation to the scope of the invention. Accordingly, the invention should not be determined by the described embodiment, but by the claims and equivalents thereof.

Claims

1. Step of creating a project for data labeling at the request of the project manager; A step of establishing one or more teams consisting of multiple first to third participants having different authority to carry out the above project; A step of registering one or more new data based on non-destructive ultrasonic inspection in the above project by the first participant; A step of generating sample data according to C-scan labeling and B-scan labeling in accordance with the primary labeling process for the new data of the first participant; A step of generating labeled data by performing the remaining B-scan labeling on the new data according to a secondary labeling process using the sample data of the second participant; and A step of storing approved labeling data in a database according to the inspection process of the third participant regarding the above-mentioned labeling data. A data labeling method for non-destructive ultrasonic inspection including 2. In Paragraph 1, Before the step of creating a project for data labeling at the request of the project manager, A step of receiving multiple image data acquired through an ultrasound diagnostic device and converting them into a list. A data labeling method for non-destructive ultrasonic inspection including further 3. In Paragraph 2, The step of registering one or more new data to the project by the first participant is, A step of providing a list of multiple video data in accordance with the request of the first participant; A step of receiving one or more image data from the list from the first participant; A step of loading selected image data onto a work tool; and A step of generating the sample data by receiving coordinates and parameters on an image according to the input of the first participant through a web interface including a visualization function provided by the above-mentioned work tool. A data labeling method for non-destructive ultrasonic inspection including 4. In Paragraph 3, The step of generating sample data according to C-scan labeling and B-scan labeling in accordance with the primary labeling process for the new data of the first participant is, A step of determining a bounding box corresponding to a defect area using a guide line for a defect existing on the above new data; A step of selecting the type of defect indicated by the bounding box above; A step of storing C scan data including the bounding box above; and A step of selecting representative B-scan data based on the search for the index axis corresponding to the bounding box and saving it as the sample data. A data labeling method for non-destructive ultrasonic inspection including 5. In Paragraph 4, The step of generating labeled data by proceeding with the remaining B-scan labeling for the new data according to the secondary labeling process using the sample data of the second participant is: A step of selecting a bounding box present in the above C scan data; A step of selecting other B-scan data with the index axis changed for the remaining area corresponding to the bounding box above; and Step of storing the above other B scan data A data labeling method for non-destructive ultrasonic inspection including 6. As a system for performing a data labeling project for non-destructive ultrasonic inspection, A web UI providing unit that provides a web interface including work tools for project execution to a plurality of first to third participants having different authority belonging to one or more teams for executing the above project; A front-end section providing one or more functions for proceeding with procedures regarding the creation of the above-mentioned project, team setup, registration of new data, generation of sample data, generation of labeling data, and storage of labeling data; and A backend providing one or more functions for carrying out procedures regarding the storage and management of stored labeling data. A data labeling system for non-destructive ultrasonic inspection including 7. In Paragraph 6, The above front end part is, A work management unit that processes authority and information regarding the above project and the first to third participants participating in the above project; and A labeling unit that processes the display, generation, and procedure execution regarding leveling data and identified defects according to the work of the first to third participants. A data labeling system for non-destructive ultrasonic inspection including

Images