Automated method for generating prothesis from three-dimensional scan data, generator automatically generating prosthesis from three-dimensional scan data and computer readable medium having program for performing the method on computer

Abstract

To provide an automated method for generating a prosthesis from three-dimensional scan data, the method reducing time for generating the prosthesis by using a geometric deep learning.SOLUTION: The automated method for generating a prosthesis from three-dimensional scan data includes: extracting prep-information of a prepared tooth from the three-dimensional scan data; generating two-dimensional projection images by projecting the three-dimensional scan data on the basis of the prep-information; and generating a three-dimensional prosthesis on the basis of the two-dimensional projection images using a generative adversarial network including a two-dimensional encoder and a three-dimensional decoder.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a method for automatically generating a prosthesis from three-dimensional scan data, a generator for automatically generating a prosthesis from three-dimensional scan data, and a computer-readable recording medium on which a program for causing a computer to execute the same is recorded. More specifically, the present invention relates to a method for automatically generating a prosthesis from three-dimensional scan data, a generator for automatically generating a prosthesis from three-dimensional scan data, and a computer-readable recording medium on which a program for causing a computer to execute the same is recorded, which uses geometric deep learning to shorten the production time of the prosthesis. The present invention relates to a method for automatically generating a prosthesis from three-dimensional scan data, a generator for automatically generating a prosthesis from three-dimensional scan data, and a computer-readable recording medium on which a program for causing a computer to execute the same is recorded.

Background Art

[0002] Three-dimensional oral scan data refers to data obtained by scanning teeth, the oral cavity, or an object imitating or reconstructing the same with a three-dimensional scanner. Dental treatments such as inlays, onlays, crowns, implants, and orthodontics acquire the oral data of patients and are used for prosthesis or implant design, orthodontic appliance production, etc.

[0003] Conventionally, a method of directly imitating the oral cavity using alginate or the like and then manually producing a prosthesis has been mainly used. In order to create an anatomically correct prosthesis, a dentist or dental technician grasps the degree of wear of the surrounding teeth, comprehensively understands the tooth number and the meshing information of the opposing teeth, and then generates the result. The conventional prosthesis generation method can be manually modified by a person according to the oral condition of each patient based on a general tooth shape considering such information.

[0004] In addition, conventionally, since the prosthesis generation process is performed manually, there are problems such as an increase in the work fatigue of dentists or dental technicians, a decrease in the accuracy and productivity of the result, and a large deviation in the quality and required time of the prosthesis depending on the skill level of the operator.

Summary of the Invention

Problems to be Solved by the Invention

[0005] An object of the present invention is to provide a method for automatically generating a prosthesis from three-dimensional scan data that shortens the production time of the prosthesis using geometric deep learning.

[0006] Another object of the present invention is to provide a generator that automatically generates a prosthesis from three-dimensional scan data.

[0007] Still another object of the present invention is to provide a computer-readable recording medium on which a program for causing a computer to execute a method for automatically generating a prosthesis from the three-dimensional scan data is recorded.

Means for Solving the Problems

[0008] A method for automatically generating a prosthesis from three-dimensional scan data according to an embodiment for realizing the object of the present invention includes a step of extracting prepared information of a prepared tooth from the three-dimensional scan data, a step of generating a two-dimensional projection image obtained by projecting the three-dimensional scan data based on the prepared information, and a step of generating a three-dimensional prosthesis based on the two-dimensional projection image using an adversarial generation network including a two-dimensional encoder and a three-dimensional decoder.

[0009] Furthermore, the method includes a step of extracting a margin line of the prepared tooth, and the step of extracting the prepared information extracts the prepared information using prepared mesh data extracted using the margin line.

[0010] The prepared information includes a position of the prepared tooth, and the position of the prepared tooth is a center of gravity of the prepared mesh data.

[0011] The prepared information includes the position of the prepared tooth, and the position of the prepared tooth is the center of the margin line.

[0012] The prepared information includes the direction of the prepared tooth, and the direction of the prepared tooth is determined using the normal vector of the surface of the prepared mesh data.

[0013] When the direction of the prepared tooth is d, the number of surfaces of the prepared mesh data is N, and the normal vector is JPEG2025096467000002.jpg6170 where xopt is the direction in which the normal vector of the point of the prepared mesh data is not hidden, and T is the swapping function that exchanges the rows and columns of the matrix, JPEG2025096467000003.jpg8170 is satisfied.

[0014] The prepared information includes the position and the direction of the prepared tooth, the two-dimensional projection image is generated using a projection plane, the projection plane is arranged at a predetermined distance from the position of the prepared tooth, and is defined so that the mating tooth or the adjacent tooth of the prepared tooth can be seen.

[0015] The pixel value of the two-dimensional projection image is defined as the distance to the closest point that hits the three-dimensional scan data when a ray is emitted from the projection plane in the direction of the normal vector of the projection plane.

[0016] The two-dimensional encoder receives the two-dimensional projection image and outputs a latent vector.

[0017] The three-dimensional decoder receives the latent vector and generates the coordinates of the points forming the three-dimensional prosthesis.

[0018] Furthermore, it includes the step of generating the prosthesis correct data used for the learning of the adversarial generation network, and the step of generating the prosthesis correct data converts the first correct data corresponding to the prepared tooth into the second correct data with a fixed connection relationship by using deformable registration.

[0019] The step of generating the prosthesis correct data divides the hexahedron-shaped initial model into eight equal parts and deforms the initial model so as to be close to the shape of the first correct data to generate the second correct data.

[0020] Furthermore, it includes the step of learning the adversarial generation network, and the step of learning the adversarial generation network includes a first learning step of inputting the prosthesis correct data into a 3D encoder to generate a latent vector and inputting the latent vector into the 3D decoder to restore it to the prosthesis correct data.

[0021] The step of learning the adversarial generation network further includes a second learning step of using a generator to generate a learned 3D prosthesis and using a discriminator to determine whether the learned 3D prosthesis is true.

[0022] The generator includes the 2D encoder and the 3D decoder learned in the first learning step, and the discriminator includes the 3D encoder learned in the first learning step.

[0023] In the step of learning the adversarial generation network, the learning objective function uses a loss that compares the distance difference between the points of the correct mesh data and the points of the predicted mesh data. The number of points of the correct mesh data is the same as the number of points of the predicted mesh data. The loss is L, the number of points of the correct mesh data is X, and the points of the correct mesh data are JPEG2025096467000004.jpg8170 、 When the points of the predicted mesh data are JPEG2025096467000005.jpg8170 set to JPEG2025096467000006.jpg9170 it satisfies

[0024] The first correct data corresponding to the prepared tooth is converted into second correct data with a fixed connection relationship using deformable registration, and the prosthesis correct data is the second correct data.

[0025] A generator for automatically generating a prosthesis from three-dimensional scan data according to an embodiment for realizing the object of the present invention includes a two-dimensional encoder and a three-dimensional decoder. The two-dimensional encoder receives a two-dimensional projection image of a prepared tooth of the three-dimensional scan data and outputs a latent vector. The three-dimensional decoder receives the latent vector and generates coordinates of points forming a three-dimensional prosthesis for the prepared tooth.

[0026] A program for causing a computer to execute a method for automatically generating a prosthesis from the three-dimensional scan data is recorded on a computer-readable recording medium.

Advantages of the Invention

[0027] According to the method for automatically generating a prosthesis from three-dimensional scan data according to the present invention, prepared information of the prepared tooth is automatically extracted from the three-dimensional scan data, and based on the prepared information, a two-dimensional projection image obtained by projecting the three-dimensional scan data is generated, and a three-dimensional prosthesis can be automatically generated using an adversarial generation network including a two-dimensional encoder and a three-dimensional decoder.

[0028] In the method for automatically generating a prosthesis of the present invention, the two-dimensional coordinates of the prosthesis are generated and not restored to three-dimensional coordinates. Instead, a three-dimensional coordinate of the prosthesis is directly generated using an adversarial generation network including a two-dimensional encoder and a three-dimensional decoder. Therefore, a complicated post-processing for restoring two-dimensional coordinates to three-dimensional coordinates is unnecessary.

[0029] Further, in the method for automatically generating a prosthesis of the present invention, since the three-dimensional coordinates of the prosthesis are directly generated, it can also be applied to the anterior tooth region where information on the meshing surface is insufficient and it is difficult to restore two-dimensional coordinates to three-dimensional coordinates.

[0030] In this way, the prosthesis is automatically generated from the three-dimensional scan data, the manufacturing time and process of the prosthesis can be shortened, and the quality of the prosthesis can be improved.

Brief Description of the Drawings

[0031]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Best Mode for Carrying Out the Invention

[0032] Regarding the embodiments of the present invention shown in the text, the specific structural or functional descriptions are merely exemplified for the purpose of explaining the embodiments of the present invention. The embodiments of the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described in the text.

[0033] The present invention can be modified in various ways and can have various forms. Specific embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to the specific disclosed forms, and it should be understood that all modifications, equivalents, and alternatives included within the spirit and technical scope of the present invention are encompassed.

[0034] Terms such as first, second, etc. are used to describe various components, but the components should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another. For example, without departing from the scope of the rights of the present invention, the first component can be referred to as the second component, and similarly, the second component can also be referred to as the first component.

[0035] When it is stated that a certain component is "connected to" or "attached to" another component, it should be understood that it can be directly connected or attached to the other component, but there can also be other components in between. On the other hand, when it is stated that a certain component is "directly connected to" or "directly attached to" another component, it should be understood that there are no other components in between. Other expressions for explaining the relationship between components, namely, "between" and "immediately between", or "adjacent to" and "directly adjacent to", etc. should be interpreted in the same way.

[0036] The terms used in this application are merely used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as "including" or "having" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and it should be understood that the presence or addition possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

[0037] Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the technical field to which the present invention belongs. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or overly formal sense unless clearly defined in this application.

[0038] On the other hand, when a certain embodiment can be implemented differently, the functions or operations specified in a specific block can also occur differently from the procedures specified in the flowchart. For example, two consecutive blocks can actually be performed substantially simultaneously, and depending on the related functions or operations, the blocks can also be performed in reverse.

[0039] Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. The same reference numerals are assigned to the same components in the drawings, and redundant descriptions of the same components are omitted.

[0040] FIG. 1 is a flowchart showing a method for automatically generating a prosthesis from three-dimensional scan data according to an embodiment of the present invention.

[0041] As shown in FIG. 1, the method for automatically generating a prosthesis from three-dimensional scan data according to this embodiment includes a step of extracting prepared information of a prepared tooth from the three-dimensional scan data (step S100), a step of generating a two-dimensional projection image obtained by projecting the three-dimensional scan data based on the prepared information (step S200), and a step of generating a three-dimensional prosthesis based on the two-dimensional projection image using a generative adversarial network including a two-dimensional encoder and a three-dimensional decoder (step S300).

[0042] The method for automatically generating a prosthesis from the three-dimensional scan data of this embodiment is performed by a computing device.

[0043] FIG. 2 is a detailed flowchart showing the method for automatically generating a prosthesis from the three-dimensional scan data of FIG. 1. FIG. 3 is a diagram showing the margin line of the prepared tooth of FIG. 2.

[0044] Referring to FIGS. 1 to 3, the method for automatically generating a prosthesis from the three-dimensional scan data further includes a step of extracting the margin line (Margin Line, ML) of the prepared tooth. including.

[0045] In order to utilize the present invention, three-dimensional scan data (three-dimensional mesh data) obtained by scanning a dental arch together with a prepared tooth from a three-dimensional scanner, and the margin line (ML) of the prepared tooth are required.

[0046] Here, the three-dimensional scan data refers to data obtained by scanning a tooth and an oral cavity or an object imitating or reconstructing the same with a three-dimensional scanner. For example, the three-dimensional scan data is mesh data including three-dimensional vertices and triangular faces (Triangles) or rectangular faces (Rectangles) generated by connecting the points. The file extension of the three-dimensional scan data is not limited, and for example, it is any one of ply, obj, and stl.

[0047] Here, the prepared tooth means a tooth prepared for a crown, and the prepared tooth means a tooth with a part of the tooth removed. Specifically, in order to generate a single crown, it is necessary to grind down the entire natural tooth so that it is easier to cover with a prosthesis, and the natural tooth that has gone through this process is referred to as the prepared tooth. Also, the margin line (ML) means the edge of the prepared tooth. The margin line (ML) indicates the boundary between the prepared tooth and the tooth root.

[0048] Figure 3 shows the margin line (ML) of the prepared tooth. For example, the margin line (ML) is automatically extracted from the three-dimensional scan data. For example, the margin line (ML) is automatically extracted from the three-dimensional scan data using an artificial intelligence neural network.

[0049] For example, the step of extracting the margin line (ML) includes the step of extracting partial scan data corresponding to the prepared tooth from the three-dimensional scan data, the step of mapping the partial scan data into a predetermined two-dimensional space using a transformation matrix, the step of obtaining a two-dimensional margin line by determining a curvature value from the data mapped in the two-dimensional space, and the step of converting the two-dimensional margin line into a three-dimensional margin line using the inverse matrix of the transformation matrix.

[0050] For example, the curvature value is any one of a maximum curvature value, a minimum curvature value, a Gaussian curvature value, and an average curvature value.

[0051] In the case of the upper surface of the tooth, the curvature value has a relatively constant value. On the other hand, at the boundary between teeth or at the part where the tooth and the tooth root are in contact, the curvature value changes greatly. Therefore, the margin line (ML) of the tooth can be determined using the curvature value.

[0052] FIG. 4 is a diagram showing the step (step S100) of extracting the prepared information of the prepared tooth of FIG. 1.

[0053] Referring to FIGS. 1 to 4, in order to input the three-dimensional scan data into the input of the deep learning model, a process (Prep Info Extractor) of extracting the prepared information for the prepared tooth of the three-dimensional scan data is required.

[0054] For example, in the step (step S100) of extracting the prepared information, the prepared information is extracted using the prepared mesh data extracted using the margin line (ML).

[0055] For example, the prepared information includes the position (p) and direction (d) of the prepared tooth. For example, the position (p) of the prepared tooth is the center of gravity (Prep center) of the prepared mesh data.

[0056] For example, the position of the prepared tooth is p, the number of vertices of the prepared mesh data is K, and the vertices are JPEG2025096467000007.jpg6170 when JPEG2025096467000008.jpg9170 is satisfied.

[0057] Differently, the position (p) of the prepared tooth is also the center of the margin line (ML). heart.

[0058] The direction (d) of the prepared tooth is determined using the normal vector of the surface of the prepared mesh data. The direction (d) of the prepared tooth indicates the protruding direction of the prepared tooth. The direction (d) of the prepared tooth indicates the direction (Insertion Direction) in which the prosthesis model is inserted into the prepared tooth.

[0059] For example, if the direction of the prepared tooth is d, the number of faces of the prepared mesh data is N, and the normal vector is JPEG2025096467000009.jpg6170 and x opt is the direction in which the normal vector of the points of the prepared mesh data is not hidden, and T is a swapping function that exchanges the rows and columns of a matrix, then JPEG2025096467000010.jpg9170 is satisfied.

[0060] Expressing in an equation the fact that the normal vector n is not hidden in the direction x, x T n > 0, which means that the angle between x and n is an acute angle. If the angle between x and n is an acute angle, x T n > 0, and if the angle between x and n is a right angle, x T n = 0, and if the angle between x and n is an obtuse angle, x T n < 0. Therefore, xopt is the direction in which the average value of the angles with the normal vectors on the faces of each prepared mesh data is the lowest.

[0061] FIG. 5 is a diagram showing the step (step S200) of generating the two-dimensional projection image of FIG. 1.

[0062] Referring to FIGS. 1 to 5, based on the position (p) and direction (d) of the prepared tooth, a two-dimensional projection image (Projected Images) obtained by projecting the three-dimensional scan data can be generated.

[0063] The method for automatically generating a prosthesis from the three-dimensional scan data further includes, prior to the step of generating a two-dimensional projection image (step S200), the step of aligning the three-dimensional scan data with the origin of a predetermined coordinate system in the direction of the predetermined coordinate system. The three-dimensional scan data thus aligned is referred to as processed 3D Models.

[0064] The two-dimensional projection image is a projection plane (Ad1 , A d2 , A d3 ) is used to generate the projection. The projection plane (A d1 , A d2 , A d3 ) is arranged at a predetermined distance from the position (p) of the prepared tooth, and is defined so that the mating tooth of the prepared tooth or the adjacent tooth of the prepared tooth can be seen.

[0065] For example, when the three-dimensional scan data includes only one of the upper jaw data or the lower jaw data, the two-dimensional projection image is defined so that the adjacent teeth of the prepared tooth can be clearly seen.

[0066] For example, when the three-dimensional scan data includes the upper jaw data and the lower jaw data in a pair, the two-dimensional projection image is defined so that the mating tooth and the adjacent teeth of the prepared tooth can be clearly seen.

[0067] The pixel value of the two-dimensional projection image is from the projection plane (A d1 , A d2 , A d3 ) to the three-dimensional scan data when a light ray is emitted in the direction of the normal vectors (d1, d2, d3) of the projection plane (A d1 , A d2 , A d3 ). It is defined as the distance to the closest point that hits the three-dimensional scan data. Different from this, the pixel value of the two-dimensional projection image can also be defined as the perspective view of the three-dimensional scan data when a light ray is emitted in the direction of the normal vectors (d1, d2, d3) of the projection plane (A ). d1 , A d2 , A d3 ) to the projection plane (A d1 , A d2 , A d3 ).

[0068] In FIG. 5, the case where the number of the two-dimensional projection images is three is shown, but the present invention is not limited thereto.

[0069] FIG. 6 is a diagram showing an adversarial generation network used in the step of generating the three-dimensional prosthesis model of FIG. 1 (step S300).

[0070] Referring to FIGS. 1 to 6, the adversarial generation network is also called Geometric AI.

[0071] The input of the Geometric AI is the two-dimensional projection image, and the output of the Geometric AI is a three-dimensional prosthesis model. Here, the three-dimensional prosthesis model is a 3D Crown Model.

[0072] The adversarial generation network includes a two-dimensional encoder (Image Encoder) and a three-dimensional decoder (Mesh Decoder). The two-dimensional encoder receives the two-dimensional projection image and outputs a latent vector. The three-dimensional decoder can receive the latent vector and generate the coordinates of the points forming the three-dimensional prosthesis.

[0073] Specifically, the two-dimensional encoder is a function that receives projected image data of size M JPEG2025096467000011.jpg7170 on the input side and provides an encoded latent vector on the output side.

[0074] In the three-dimensional decoder, the latent vector created by the two-dimensional encoder is received on the input side, and finally, a three-dimensional output corresponding to the crown model is produced.

[0075] In the present invention, in order to learn from data with a fixed connection relationship, the three-dimensional output can only predict the positions of each point of the mesh. Thus, instead of two-dimensional convolution for stereotyped data, operations applicable to non-stereotyped data are used. For example, the three-dimensional decoder can utilize graph convolution operations such as GCN, ChebConv, GraphConv, PointNetConv, DynamicEdgeConv, SpiralConv and the like.

[0076] As shown in FIG. 5, a three-dimensional crown mesh is generated from a two-dimensional projection image. The geometric AI combines the two-dimensional projection images obtained in multiple directions to generate the three-dimensional crown mesh. The adversarial generation network consists of an image decoder that understands two-dimensional image information and a mesh decoder that re-analyzes the information understood in two dimensions into three dimensions.

[0077] FIG. 7 is a diagram showing a method for generating correct data used for learning the adversarial generation network of FIG. 6.

[0078] Referring to FIGS. 1 to 7, the method for automatically generating a prosthesis from the three-dimensional scan data further includes a step of generating prosthesis correct data used for learning the adversarial generation network. The step of generating the prosthesis correct data converts the first correct data (CR1) corresponding to the prepared tooth into the second correct data (CR2) with a fixed connection relationship using deformable registration. For example, the step of generating the prosthesis correct data can divide the first model (M1) in the shape of a regular hexahedron into eight equal parts and deform it so that the first model (M1) is close to the shape of the first correct data (CR1) to generate the second correct data (M2).

[0079]

[0080] Specifically, in order to generate the three-dimensional crown model proposed in the present invention, learning of the geometric AI is required. For the learning of the geometric AI, three-dimensional scan data including the prepared teeth and actual crown mesh data (CR1) created by a dental technician corresponding to the prepared teeth are required. However, the tooth morphology and the positions of the feature points of each patient are different from each other, and since the shape of the scan data is not constant, it is unnatural to directly use the crown mesh data (CR1) created by the dental technician for model learning.

[0081] As a solution to this, a method of performing deformable registration on the crown mesh data (CR1) created by the dental technician to a polygon mesh (tooth library) representing a general tooth shape, an initial model of a regular hexahedron, or an initial spherical model is used. Deformable registration refers to a method of aligning a source mesh having an indefinite property ( connection relationship) with the connection relationship of a previously defined target mesh. Although the crown mesh data (CR1) created by each dental technician has different properties (connection relationships), when the deformable registration is used, the properties of the crown mesh data (CR1) can be made the same.

[0082] As shown in FIG. 6, as a method of performing deformable registration, a Mesh shrink wrapping technique is used. This is a method of dividing a quadmesh of a regular hexahedron through a number of steps and creating a mesh shape having a target shape (CR1). The crown mesh data (CR2 ) with the same properties in this way is used as the correct data for training the model.

[0083] ) is used as the correct data for training the model.

[0084] ​That is, by the mesh shrinkage clap method of FIG. 6, an algorithm by step is applied to the initial mesh (M1) in the shape of a hexahedron to generate intermediate data such as M2, M3, M4, M5, etc., and finally the connection relationship having a shape like the first correct data (CR1) is fixed. The second correct data (CR2) can be generated.

[0085] FIG. 8 is a diagram showing a method of learning the adversarial generation network of FIG. 6.

[0086] Referring to FIGS. 1 to 8, the method of automatically generating a prosthesis from the three-dimensional scan data further includes a step of learning the adversarial generation network.

[0087] The step of learning the adversarial generation network is to input prosthesis correct data (for example, CR2 in FIG. 7) into a three-dimensional encoder (Mesh Encoder) to generate a latent vector (Z), and input the latent vector into the three-dimensional decoder (Mesh Decoder) to restore the prosthesis correct data (for example, CR2 in FIG. 7). The first learning step (Training Stage 1) is included. Here, the prosthesis correct data is the second correct data (CR2).

[0088] For example, the step of learning the adversarial generation network further includes a second learning step (Training Stage 2) of using a generator to generate a learned three-dimensional prosthesis and using a discriminator to determine whether the learned three-dimensional prosthesis is True or Fake.

[0089] For example, the generator includes the two-dimensional encoder (Image Encoder) and the first It includes the three-dimensional decoder (Pretained Mesh Decoder) learned in the learning step (Training Stage 1). The discriminator includes the three-dimensional encoder (Pretained Mesh Encoder) learned in the first learning step (Training Stage 1).

[0090] In the step of training the adversarial generation network, the training objective function uses a loss that compares the distance difference between the points of the correct mesh data and the points of the predicted mesh data. The number of points of the correct mesh data is the same as the number of points of the predicted mesh data. Let the loss be L, the number of points of the correct mesh data be X, the points of the correct mesh data be JPEG2025096467000012.jpg8170 and the points of the predicted mesh data be JPEG2025096467000013.jpg8170 Then, JPEG2025096467000014.jpg9170 is satisfied.

[0091] Specifically, the adversarial generation network includes two model generators and a discriminator. The adversarial generation network uses the following optimization method to have better results.

[0092] Since the connection relationship is fixed, the points of the correct data JPEG2025096467000015.jpg8170 and the points predicted by the deep learning model JPEG2025096467000016.jpg8170 are in one-to-one correspondence. Therefore, it is not necessary to use a loss with high complexity such as chamfer loss. To train the deep learning model proposed in the present invention, it can be trained with a simple L1L2 loss.

[0093] The learning consists of two steps. In the first learning step (Training Stage 1), first, in order to represent 3D prosthesis data from the latent vector (Z), a mesh decoder is learned. This uses the training method of an autoencoder. Input the correct data (CR2) into the mesh encoder, and repeat the process of compressing and expanding the size of the correct data (CR2) with the vector (Z) in the latent space and restoring it to the original state. Thus, the fixed connection relationship between the mesh encoder and the mesh decoder can be understood. As the second learning step (Training Stage 2), an adversarial generative network (GAN) structure model is learned. The generator is composed of an image encoder that extracts feature vectors from a 2D image and the mesh decoder learned in the first learning step (Training 1), and the discriminator is composed of the mesh encoder learned in the first learning step (Training 1). When the generator uses the 2D projection image to create 3D prosthesis data, the discriminator determines how real it is and provides the determined information to the generator, thereby training the generator. The generator trained in this way can produce a usable 3D prosthesis with only simple post-processing without another complex algorithm.

[0094] According to this embodiment, prepared tooth prepared information is automatically extracted from the 3D scan data, and based on the prepared information, a 2D projection image obtained by projecting the 3D scan data is generated, and a 3D prosthesis can be automatically generated using an adversarial generative network including a 2D encoder and a 3D decoder.

[0095]

[0096] ​​In the method for automatically generating a prosthesis of the present invention, two-dimensional coordinates of the prosthesis are generated, and the three-dimensional coordinates of the prosthesis are directly generated using an adversarial generation network including a two-dimensional encoder and a three-dimensional decoder without restoring them to three-dimensional coordinates. Therefore, complicated post-processing for restoring two-dimensional coordinates to three-dimensional coordinates is unnecessary.

[0097] Further, in the method for automatically generating a prosthesis of the present invention, since the three-dimensional coordinates of the prosthesis are directly generated, it can also be applied to the anterior tooth region where information on the meshing surface is insufficient and it is difficult to restore two-dimensional coordinates to three-dimensional coordinates.

[0098] In this way, by automatically generating the prosthesis from the three-dimensional scan data, the manufacturing time and process of the prosthesis can be shortened, and the quality of the prosthesis can be improved.

[0099] According to one embodiment of the present invention, there is provided a computer-readable recording medium having a program recorded thereon for causing a computer to execute a method for automatically generating a prosthesis from the three-dimensional scan data according to the above-described embodiment. The method can be created by a program executed by a computer and can be implemented on a general-purpose digital computer that operates the program using a computer-readable medium. Also, the data structure used in the method is recorded on a computer-readable medium by a plurality of means. The computer-readable medium can include program instructions, data files, data structures, etc., alone or in combination. The program instructions recorded on the medium are those specially designed and configured for the present invention and those known and usable by ordinary technicians in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as optical disks, and hardware devices specially configured to store and execute program instructions such as ROMs, RAMs, and flash memories. Program instructions include not only machine language code created by a compiler but also high-level language code executed by a computer using an interpreter or the like. The above-described hardware device is configured to operate as one or more software modules for performing the operations of the present invention.

[0100] Also, the method for automatically generating a prosthesis from the three-dimensional scan data described above can also be implemented in the form of a computer program executed by a computer stored on a recording medium or an application.

[0101] [Industrial Applicability] The present invention relates to a method for automatically generating a prosthesis from three-dimensional scan data and a computer-readable recording medium having a program recorded thereon for causing a computer to execute the same, and can shorten the labor for manufacturing the prosthesis and improve the accuracy and productivity of the prosthesis.

[0102] In the foregoing, the preferred embodiments of the present invention have been described with reference thereto. However, those skilled in the art in the relevant technical field will understand that the present invention can be variously modified and changed without departing from the spirit and scope of the present invention described in the following claims.

Claims

[Claim 1] extracting prepared information of the prepared teeth from the 3D scan data; generating a two-dimensional projection image by projecting the three-dimensional scan data based on the prepared information; generating a 3D prosthesis from the 2D projection images using a generative adversarial network including a 2D encoder and a 3D decoder; 13. A method for automatically generating a prosthesis from 3D scan data, comprising:

Images