Dental integrated data generation method

Abstract

The purpose of the present invention is to provide a method with which it is possible to intuitively compare the current tooth state or before and after dental treatment without being limited by dental treatment or consultation purposes. To this end, a method for generating integrated dental data according to one embodiment of the present invention comprises the steps of: acquiring an oral cavity scan (IOS) image relating to a tooth part of a patient; acquiring a three-dimensional (3D) face image relating to the face including the tooth part of the patient; acquiring a computed tomography image comprising the tooth part of the patient; generating first integration data for integrating the three-dimensional face image with one of the oral cavity scan (IOS) image and the computed tomography image; and generating a dental three-dimensional head portrait (Dental 3D Avatar) as final integrated data by integrating the other of the oral scan (IOS) image and the computed tomography image into the first integrated data.

Description

Technical Field

[0001] The present invention relates to a method for generating integrated dental data, and more particularly to a method for more intuitively presenting the dental condition of a dental patient by generating integrated dental data that integrates an oral scan image, a three-dimensional facial image, and a computed tomography image. Background Art

[0002] During dental consultation or treatment, relying solely on the dentist's verbal explanation has limitations. Therefore, there is a need to more intuitively present the patient's dental status and the status of the teeth after treatment.

[0003] With the development of digital imaging technology, a wide range of image data types are being utilized during dental treatment or consultation. This diverse array of image data can improve dental diagnosis, develop treatment plans, and manage patients. Representative image data used during dental consultation or treatment can include computed tomography (CT) scans acquired using dental computed tomography (CT) equipment, facial images acquired by photographing the patient's face using a facial camera, and oral scans acquired by scanning the inside of the patient's oral cavity using a three-dimensional oral scanner.

[0004] However, while computed tomography images are useful for understanding the location of tooth roots and nerves, they struggle to visualize the aesthetics of teeth or their harmony with the face. Facial images and oral scans also have limitations in their inability to visualize the internal structure of the patient's face and teeth. Consequently, users such as dentists struggle to appropriately load and utilize image data for different purposes, depending on the purpose of treatment or consultation.

[0005] Therefore, a method is needed that can visually compare the current state of teeth or before and after dental treatment without being limited by the purpose of dental treatment or consultation. Summary of the Invention

[0006] Therefore, an object of the present invention is to provide a method for intuitively comparing the current state of teeth or before and after dental treatment without being limited by the purpose of dental treatment or consultation.

[0007] However, the problems to be solved by the present invention are not limited to the problems described above, and may include objects that are not mentioned but can be clearly understood by those skilled in the art through the following description.

[0008] Hereinafter, specific embodiments for achieving the object of the present invention will be described.

[0009] A method for generating dental integrated data according to an embodiment of the present invention includes the following steps: obtaining an intraoral scan (IOS) image related to a patient's dental parts; obtaining a three-dimensional (3D) facial image related to a face including the patient's dental parts; obtaining a computed tomography (CT) image including the patient's dental parts; generating first integrated data by integrating the three-dimensional facial image with one of the intraoral scan (IOS) image and the CT image; and generating a dental 3D avatar (Dental 3D Avatar) as final integrated data by integrating the other of the intraoral scan (IOS) image and the CT image into the first integrated data.

[0010] A method for generating integrated dental data according to another embodiment of the present invention includes the following steps: acquiring an intraoral scan (IOS) image related to a patient's dental parts; acquiring a three-dimensional facial image related to a face including the patient's dental parts; acquiring a computed tomography image including the patient's dental parts; generating first integrated data by integrating the intraoral scan (IOS) image with one of the three-dimensional facial image and the computed tomography image; and generating a three-dimensional dental head portrait as final integrated data by integrating the other of the three-dimensional facial image and the computed tomography image into the first integrated data.

[0011] Another embodiment of the present invention is a method for generating integrated dental data, which includes the following steps: obtaining an intraocular scan (IOS) image related to a patient's dental parts, the intraocular scan image including an upper jaw image and a lower jaw image; obtaining a three-dimensional facial image related to a face including the patient's dental parts and a computed tomography image including the patient's dental parts, the three-dimensional facial image and the computed tomography image being images obtained when the patient is in a occlusal state; generating second integrated data by integrating the three-dimensional facial image with the upper jaw image in the intraocular scan (IOS) image; generating a first three-dimensional dental head portrait by integrating the computed tomography image into the second integrated data; generating third integrated data by integrating the lower jaw image in the intraocular scan image with the computed tomography image; and generating a second three-dimensional dental head portrait by integrating the three-dimensional facial image into the third integrated data.

[0012] A dental integrated data generating device according to an embodiment of the present invention includes: a memory storing an application for generating dental integrated data; and a processor implementing a plurality of modules by executing the application stored in the memory, wherein the plurality of modules include: an acquisition module for acquiring an intraoral scan (IOS) image related to a patient's dental parts, a three-dimensional facial image related to a face including the patient's dental parts, and a computed tomography image including the patient's dental parts; an integration module for integrating the intraoral scan (IOS) image, the three-dimensional facial image, and the computed tomography image to generate a three-dimensional dental head portrait; and a display module for displaying the three-dimensional dental head portrait on a display of the device.

[0013] According to an embodiment of the present invention, a method for generating integrated dental data can be used to generate and provide a dental 3D head portrait by integrating an intraoral scan (IOS) image and a computed tomography (CT) scan image based on a 3D facial image rather than a 2D facial image. This 3D dental head portrait realistically represents the patient's actual face, enabling effective explanations and consultations with the patient. Furthermore, this integration can be performed precisely using the characteristic points of the patient's face, particularly the teeth, resulting in a more accurate representation of the patient's condition.

[0014] Furthermore, according to an embodiment of the present invention, a three-dimensional dental portrait can present not only the tooth surface but also the tooth roots obtained from a computed tomography image, etc., while intuitively explaining the patient's tooth condition before and after dental treatments such as orthodontics, implants, and restorations. It also has the following effect, namely, providing a variety of expression methods such as presenting changes before and after treatment through different colors or transparencies.

[0015] Moreover, in addition to the dental field, the dental three-dimensional head portrait according to the embodiment of the present invention can also be applied to various fields such as plastic surgery, computer games, and multimedia.

[0016] However, the effects obtained by the present invention are not limited to the effects described above, and those skilled in the art can clearly understand other effects not mentioned through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The following drawings attached to this specification illustrate preferred embodiments of the present invention and, together with the detailed description of the invention, are used to further understand the technical concept of the present invention. Therefore, the present invention should not be construed as being limited to the matters described in the drawings.

[0018] Figure 1 The following is a brief description of the basic structure of an apparatus for generating dental integrated data according to an embodiment of the present invention.

[0019] Figure 2 FIG. 1 is a diagram for briefly explaining the principle of generating dental integrated data based on an integrated module according to an embodiment of the present invention.

[0020] Figure 3 FIG. 1 is a flowchart for explaining a method for generating dental integrated data according to an embodiment of the present invention.

[0021] Figure 4a and Figure 4b The figure is an exemplary diagram illustrating the extraction of feature points for generating first integrated data according to an embodiment of the present invention.

[0022] Figure 5 FIG. 1 is a flowchart for explaining a method for generating dental integrated data according to another embodiment of the present invention.

[0023] Description of reference numerals:

[0024] 10: 3D oral scanner; 15: Oral scan image; 20: 3D facial camera; 25: 3D facial image; 30: Dental computed tomography scanner; 35: Computed tomography image; 100: Dental integrated data generation device; 110: Memory; 120: Processor; 130: Acquisition module; 140: Integration module; 150: Display module. DETAILED DESCRIPTION

[0025] The various embodiments described in this specification are illustrative for the purpose of clearly illustrating the technical ideas of the present disclosure and are not intended to limit the present disclosure to specific implementations. The technical ideas of the present disclosure include various modifications, equivalents, alternatives, and embodiments selectively combined from all or part of the various embodiments described in this specification. Furthermore, the scope of rights of the technical ideas of the present disclosure is not limited to the various embodiments set forth below or their specific descriptions.

[0026] Unless otherwise defined, the meanings of various terms used in this specification, including technical or scientific terms, are the same as those commonly understood by those skilled in the art in the art to which this disclosure belongs.

[0027] Throughout this specification, expressions such as "including," "may include," "have," "may have," "have," and "may have" imply the presence of the specified feature (e.g., function, action, or structural element) and do not preclude the presence of additional features. In other words, such expressions should be understood as open-ended terms encompassing the possibility of a second embodiment.

[0028] In this specification, unless the context clearly specifies that it is singular, expressions in the singular include expressions in the plural. Furthermore, unless the context clearly specifies that it is plural, expressions in the plural include expressions in the singular. Throughout this specification, when a portion is indicated as including a certain structural element, unless there is a specific description to the contrary, this does not exclude other structural elements and means that other structural elements may also be included.

[0029] Furthermore, in this specification, terms such as "module" or "unit" are used to refer to software or hardware structural elements, and the "module" or "unit" performs a certain function. However, "module" or "unit" is not limited to software or hardware. A "module" or "unit" may exist on an addressable storage medium, or may be configured in a manner that enables one or more processors to be regenerated. Therefore, as an example, a "module" or "unit" may include at least one of a software structural element, an object-pointing software structural element, a class structural element, and a task structural element, a program, a function, an attribute, a procedure, a subroutine, a segment of program code, a driver, firmware, microcode, a loop, data, a database, a data structure, a table, an array, or a variable. The functions provided by the structural elements and "modules" or "units" may be combined with fewer structural elements and "modules" or "units", or may be further divided into additional structural elements and "modules" or "units".

[0030] According to one embodiment of the present disclosure, a "module" or "unit" may be embodied by a processor and a memory. "Processor" should be interpreted broadly to include a general-purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, etc. In some environments, a "processor" may also refer to an application-specific integrated circuit (ASIC), a programmable logic circuit (PLD), a field programmable gate array (FPGA), etc. For example, a "processor" may also refer to a combination of a digital signal processor and a microprocessor, a combination of multiple microprocessors, a combination of more than one microprocessor combined with a digital signal processor core, a combination of any other such structures, and other processing devices. Furthermore, " The term "memory" should be interpreted broadly to include any electronic component that can store electronic information. "Memory" can refer to various types of processor-readable media, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic or optical data storage devices, and cache. If a processor reads information from and / or records information to the memory, the memory and the processor are said to be in electronic communication. Memory integrated into a processor is in electronic communication with the processor.

[0031] Unless they indicate different meanings in the context, expressions such as "first", "second", "firstly", and "nextly" used in this specification are used to distinguish one object from other objects of the same kind, and do not limit the order or importance of the corresponding objects.

[0032] As used in this specification, expressions such as “A, B and C”, “A, B or C”, “A, B and / or C” or “at least one of A, B and C”, “at least one of A, B or C”, “at least one of A, B and / or C”, “at least one selected from A, B and C”, “at least one selected from A, B or C”, “at least one selected from A, B and / or C”, etc. may mean all possible combinations of the listed items or multiple listed items. For example, “at least one selected from A and B” may mean all of the following: (1) A; (2) at least one of A; (3) B; (4) at least one of B; (5) at least one of A and at least one of B; (6) at least one of A and B; (7) at least one of B and A; (8) A and B.

[0033] The expression "based on..." used in this specification is used to describe one or more factors that affect the determination, judgment behavior or action described in the sentence or article containing the expression. The expression does not exclude additional factors that affect the corresponding determination, judgment behavior or action.

[0034] As used in this specification, expressions such as "connected" or "coupled" between a certain structural element (e.g., the first structural element) and other structural elements (e.g., the second structural element) not only mean the situation where the above-mentioned certain structural element is directly connected or coupled to the above-mentioned other structural elements, but also mean the situation where a new other structural element (e.g., the third structural element) is used as a medium to connect or couple.

[0035] As used in this specification, expressions such as "configured to" may mean, depending on the context, "set to," "having a function to," "changed to," "manufactured to," "capable of executing," and the like. This expression is not limited to the meaning of "specifically designed in hardware." For example, a processor configured to perform a specific action may mean a general-purpose processor that can execute the specific action by running software.

[0036] Various embodiments of the present invention will be described below with reference to the accompanying drawings. In the accompanying drawings and their descriptions, identical or substantially equivalent structural elements may be assigned the same reference numerals. Furthermore, in the following description of various embodiments, repeated descriptions of identical or corresponding structural elements may be omitted, but this does not mean that the corresponding structural elements are not included in the embodiments.

[0037] Basic structure of an apparatus for generating integrated dental data

[0038] Figure 1 This figure briefly illustrates the basic structure of a generating device for generating dental integrated data according to an embodiment of the present invention.

[0039] Reference Figure 1 The dental integrated data generating device 100 may include a memory 110 and a processor 120 .

[0040] The memory 110 can store various applications, including applications for generating individual patient information and treatment data, and integrated dental data. According to one embodiment, the patient's treatment data may include at least one of an intra-oral scan (IOS) image 15, a three-dimensional (3D) facial image 25, and a CT (Computed Tomography) scan image 35.

[0041] The processor 120 can execute an application stored in the memory 110 for generating integrated dental data. According to one embodiment, the acquisition module 130, integration module 140, and display module 150 can be implemented via software based on the execution of the application for generating integrated dental data. However, depending on the design of the device, some modules can also be implemented via hardware, but this is not limited to this.

[0042] According to one embodiment, the oral scan image 15 can be obtained by scanning the patient's dental area using a three-dimensional oral scanner 10, that is, by scanning the oral cavity. The three-dimensional oral scanner 10, which is a non-contact scanner, collects surface data of the patient's oral cavity structure, and based on this, uses a confocal method or an optical triangulation method to generate a three-dimensional oral scan (IOS) image. As described above, when a three-dimensional oral scan image (IOS) is obtained as a digital impression by a three-dimensional oral scanner 10, there is an advantage of not having to go through the following tedious steps, that is, performing an impression operation (dental impression operation) on the patient's oral cavity using an impression material placed on a tray, thereby physically obtaining the patient's oral cavity structure. The oral scan image 15 can be obtained by various types of commercially available three-dimensional oral scanners, but is not limited to this.

[0043] The 3D facial image 25 can be acquired by photographing the patient's face using the 3D facial capture device 20. According to one embodiment, the 3D facial capture device 20 may include multiple cameras and may be driven by the multiple cameras to capture the patient's face at a single time and acquire the 3D facial image 25. However, the 3D facial capture device 20 may also be driven by fixing or moving the patient's face and capturing the patient's face at certain time intervals, but this is not a limitation.

[0044] Furthermore, according to one embodiment, the multiple cameras of the 3D facial capture device 20 may include multiple facial capture cameras and at least one dental capture camera for capturing the patient's teeth. The multiple facial capture cameras may be located on the front, left side, right side, and bottom of the 3D facial capture device 20 to capture the front, left side, right side, and bottom of the patient's face. According to one embodiment, the dental capture cameras are distinct from the facial capture cameras; for example, the magnification of the lenses may be different. For example, the dental capture cameras may be located on both the left and right sides of the 3D facial capture device 20 to capture both sides of the patient's teeth, but the number or placement of the dental capture cameras is not limited. Having separate dental capture cameras in this manner not only allows for more accurate representation and presentation of the patient's teeth, but also allows for more precise and smooth integration with other data (e.g., computed tomography images or intraoral scans (IOS)) during the generation of integrated data. This will be described in detail later.

[0045] According to one embodiment, the 3D facial image 25 is captured with the patient's teeth exposed. Specifically, when the 3D facial capture device 20 captures the patient's face, the patient can be guided to position their face correctly and expose their teeth before the capture is completed. To this end, the 3D facial capture device 20 can be designed with a guidance function. This allows for more accurate capture of the patient's face and teeth, resulting in the generation of the 3D facial image 25. However, depending on the situation, the 3D facial image 25 may not necessarily be captured with the patient's teeth exposed. In this case, the teeth may or may not be exposed in the 3D facial image 25.

[0046] According to one embodiment, the 3D facial capture device 20 can capture a 3D facial image 25 based on multiple images captured by multiple cameras while illuminating the patient's face with a structured light pattern. However, in addition to using structured light, methods for capturing the 3D facial image 25 may include, but are not limited to, laser scanning, depth sensors, and artificial intelligence (AI) to reconstruct a 3D facial image.

[0047] The CT image 35 can be obtained by photographing a facial area including the patient's dental area using the CT device 30. For example, the CT device 30 used as a dental CT device can be a cone beam CT device. The advantage of a cone beam CT device is that it can minimize the radiation exposure of the patient and obtain a CT image of the patient's dental area by irradiating a cone beam of X-rays. However, the CT device 30 used as a fan beam CT device can also be a device that irradiates a fan beam of X-rays. That is, the CT image 35 of the embodiment of the present invention can be obtained by a variety of CT devices, but is not limited to this.

[0048] According to one embodiment, the acquisition module 130 of the dental integrated data generation device 100 can acquire the oral cavity scan image 15, the 3D facial image 25, and the computed tomography image 35 described above from the 3D oral scanner 10, the 3D facial imaging device 20, and the computed tomography device 30, respectively. However, at least one of the oral cavity scan image 15, the 3D facial image 25, and the computed tomography image 35 can also be acquired by the acquisition module 130 by downloading an image stored on another storage medium or the cloud.

[0049] The oral cavity scan images 15, three-dimensional facial images 25, and computed tomography images 35 acquired by the acquisition module 130 can be stored in the memory 110 of the device 100 for generating integrated dental data. The oral cavity scan images 15, three-dimensional facial images 25, and computed tomography images 35 can be stored in the memory 110 by patient. If multiple images of the same type exist, captured at different times, the images are stored by time. Furthermore, the memory 110 can store various applications, including those for generating individual patient information, treatment data such as dentists' opinions, and integrated dental data.

[0050] Figure 2 FIG. 1 is a diagram for briefly explaining the principle of generating dental integrated data based on an integrated module according to an embodiment of the present invention.

[0051] Reference Figure 1 and Figure 2 The integration module 140 can generate a dental 3D head portrait by integrating the oral scan image 15, the 3D facial image 25, and the computed tomography image 35. According to one embodiment, this integration can be performed by extracting and utilizing feature points of the patient's face and / or teeth. However, in addition to utilizing feature points, other methods can also be used, but this is not a limitation.

[0052] According to one embodiment, the integration module 140 may extract three or more feature points of the patient's face and teeth. Three or more feature points are required because the oral scan image 15, the three-dimensional facial image 25, and the computed tomography image 35 of the present invention are all three-dimensional, or at least three or more three-dimensional data. Therefore, using only two (or one) feature points would not allow for complete integration of the x, y, and z axes.

[0053] According to an embodiment of the present invention, the method for generating integrated dental data can be used to manually specify feature points by a user, such as a dentist or a laboratory manager. For example, the user can specify feature points using a mouse or other pointer via an application user interface. The application is presented to the user via the display module 150 and used to generate integrated dental data.

[0054] On the other hand, according to another embodiment, an artificial neural network module pre-learned from a large amount of data may be built into the application for generating dental integrated data or connected to such an artificial neural network module via a network, thereby extracting feature points based on artificial intelligence.

[0055] According to one embodiment, the oral scan image 15 corresponds to a three-dimensional image generated by scanning the inside of a patient's oral cavity and does not include facial data. Therefore, when integrating the three-dimensional facial image 25 with the other images 25 and 35, feature points of the dental area can be utilized. Furthermore, when integrating the three-dimensional facial image 25 with the computed tomography image 35, feature points of the facial area other than the patient's teeth can be utilized as feature points, or feature points of the patient's teeth and facial area can be utilized together.

[0056] According to one embodiment, the integration module 140 may first generate first integrated data by integrating the 3D facial image 25 with one of the oral scan image 15 and the computed tomography image 35 based on three or more feature points. Subsequently, the integration module 140 may generate final integrated data by integrating the other of the oral scan image and the computed tomography image into the first integrated data based on the three or more feature points. According to an embodiment of the present invention, this final integrated data is referred to as a dental 3D avatar. The feature points used to generate the first integrated data may be the same as or different from the feature points used to generate the dental 3D avatar.

[0057] According to one embodiment, when integrating the 3D facial image 25 with the oral scan image 15, the 3D facial image 25 must be a facial image that shows the patient's teeth. In particular, when the 3D facial capture device 20 of one embodiment includes a separate camera for capturing teeth and generates a 3D facial image 25 that accurately depicts the patient's teeth, three or more feature points of the teeth can be more accurately extracted. Therefore, the integration module 140 can more accurately perform the integration process of the 3D facial image 25 with the oral scan image 15.

[0058] According to one embodiment, the integration module 140 may determine whether the 3D facial image 25 shows the patient's teeth. If so, the 3D facial image 25 is ready for integration using dental feature points and can be integrated with any of the 3D facial image 25, the oral scan image 15, and the computed tomography image 35. However, if the 3D facial image 25 is determined to be an image without exposed teeth, integration using dental feature points is unavailable. Therefore, the 3D facial image 25 can only be integrated with the computed tomography image 35 and cannot or will have difficulty integrating with the oral scan image 15. Specifically, integration of the 3D facial image 25 and the oral scan image 15 is possible when the dentist or laboratory manager manually specifies feature points. However, integration using an application or artificial intelligence (AI) may result in decreased accuracy. Therefore, in this case, the integration module 140 first generates first integrated data by integrating the 3D facial image 25 with the computed tomography image 35. Subsequently, the oral scan image 15 is integrated into the first integrated data to generate a dental 3D head portrait. On the other hand, the computed tomography image and the three-dimensional facial image are images taken of the patient at different times, so if possible, a process may be required to guide the patient to maintain the same expression and posture when both images are taken.

[0059] According to another embodiment, the integration module 140 may integrate the oral scan image 15 with one of the three-dimensional facial image 25 and the computed tomography image 35 based on three or more dental feature points to generate first integrated data. Subsequently, the integration module 140 generates a dental 3D head portrait by integrating the other of the three-dimensional facial image 25 and the computed tomography image 35 into the first integrated data based on the three or more feature points. In this case, the three-dimensional facial image 25 may be an image of a face showing the dental area. In other words, the integration module 140 may perform integration based on either the three-dimensional facial image 25 or the oral scan image 15. This may vary depending on the patient's treatment method or system design and is not limited thereto.

[0060] As described above, the three-dimensional dental avatar according to an embodiment of the present invention can integrate oral scan images and computed tomography (CT) scan images based on a three-dimensional facial image rather than a two-dimensional facial image, thereby realistically representing the patient's actual face, thereby effectively explaining or consulting with the patient. Furthermore, the three-dimensional dental avatar not only displays the tooth surface but also the tooth roots obtained from CT scan images, intuitively explaining the patient's dental condition before and after dental treatments such as orthodontics, implants, and restorations. It also offers the ability to present changes before and after treatment in a variety of ways, such as through different colors or transparencies. Furthermore, in addition to the dental field, the three-dimensional dental avatar can also be applied in a variety of fields, including plastic surgery, computer games, and multimedia.

[0061] The display module 150 can display the three-dimensional dental head portrait generated by the integration module 140 on the display of the device 100. According to one embodiment, the display module 150 can display the three-dimensional dental head portrait on a user interface provided by the application used to generate the integrated dental data. Furthermore, the display module 150 can adjust the transparency of portions of the three images 15, 25, and 35 that comprise the three-dimensional dental head portrait, or select whether to display them, so that users such as dentists or laboratory managers can view the appropriate representation as needed. Furthermore, the display module 150 can display reference lines or planes such as the midline, alar line, occlusal plane, and Campers plane along with the three-dimensional dental head portrait, allowing users to use them during patient treatment and consultation. Furthermore, within the three-dimensional dental head portrait displayed by the display module 150, users can adjust certain data, such as the position or shape of the oral scan image 15.

[0062] Method for generating integrated dental data

[0063] Figure 3 FIG. 1 is a flowchart for explaining a method for generating dental integrated data according to an embodiment of the present invention.

[0064] First, refer to Figure 3 In a method for generating integrated dental data according to an embodiment of the present invention, in step S10, an oral scan image related to the patient's dental area, a three-dimensional facial image related to the face including the patient's dental area, and a computed tomography image including the patient's dental area may be acquired. Such image acquisition may be performed by acquisition module 130. The oral scan image, three-dimensional facial image, and computed tomography image are acquired from a three-dimensional oral scanner, a three-dimensional facial camera, and a computed tomography device, respectively. Alternatively, the images may be downloaded from other storage media or from the cloud.

[0065] Next, in step S20, first integrated data may be generated by integrating the three-dimensional facial image with one of the oral scan image and the computed tomography image based on the feature points. According to one embodiment, each image corresponds to three-dimensional data, so the feature points used to generate the first integrated data may be three or more and may be extracted from the patient's face and / or teeth. Based on the three or more feature points extracted in this manner, the first integrated data may be generated by integrating the three-dimensional facial image with one of the oral scan image and the computed tomography image.

[0066] Figure 4a and Figure 4b The figure is an exemplary diagram illustrating the extraction of feature points for generating first integrated data according to an embodiment of the present invention.

[0067] Reference Figure 4a , by integrating the three-dimensional facial image 25 with one of the oral scan image 15 and the computed tomography image 35 based on three or more feature points to generate first integrated data. As a non-limiting example, Figure 4a To illustrate, for example, three feature points L1, L2, and L3 can be extracted from the three-dimensional facial image 25, and three corresponding feature points L1', L2', and L3' can be extracted from the computed tomography image 35. In this case, the first feature point L1 of the three-dimensional facial image 25 and the first feature point L1' of the computed tomography image 35 can correspond to the tip of the nose, the second feature point L2 of the three-dimensional facial image 25 and the second feature point L2' of the computed tomography image 35 can correspond to the left corner of the eye, and the third feature point L3 of the three-dimensional facial image 25 and the third feature point L3' of the computed tomography image 35 can correspond to the right corner of the eye.

[0068] but, Figure 4a In the example of integrating the three-dimensional facial image 25 with the computed tomography image 35, feature points of the patient's face such as the tip of the nose or the corners of the eyes are extracted. However, when the three-dimensional facial image 25 is integrated with the oral scan image 15, feature points of the patient's dental parts (for example, the middle part of the front teeth, the boundaries between the teeth, etc.) can be extracted. Figure 4b The following is an example of a process for extracting feature points of teeth from a three-dimensional facial image. Figure 4b In the application for generating integrated dental data, an artificial neural network module that has been pre-learned using a large amount of data can be built in or connected to such an artificial neural network module through a network, thereby extracting feature points based on artificial intelligence.

[0069] In order to utilize a dental 3D head portrait for dental treatment or consultation, accurate integration of the teeth is particularly important compared to other parts of the face. Therefore, accurately extracting the feature points of the patient's teeth is a crucial operation. Furthermore, extracting the feature points of the teeth is necessary to integrate the oral scan image 15 with other images. Therefore, if accurate integration can be performed using only the feature points of the teeth, there is no need to extract additional feature points in the facial area other than the patient's teeth, thereby increasing efficiency. Therefore, according to one embodiment of the present invention, the 3D facial image 25 is a facial image that exposes the patient's teeth. The 3D facial image 25 accurately depicting the patient's teeth is captured using a 3D facial capture device 20 having a separate camera for capturing teeth. This allows for more accurate extraction of three or more feature points of the teeth, allowing the integration module 140 to more accurately perform the integration of the 3D facial image 25 with the oral scan image 15.

[0070] Refer again Figure 3 In step S30, a dental three-dimensional head portrait may be generated as final integrated data by integrating the other of the oral scan image and the computed tomography scan image into the first integrated data generated in step S20 based on the feature points.

[0071] According to one embodiment, the feature points used in step S30 may be three or more and may be extracted from the patient's face and / or teeth. When integrating an intraoral scan (IOS) image into the first integrated data, three or more feature points of the patient's teeth (e.g., the middle of the front teeth, the boundary between the teeth, etc.) may be utilized. When integrating a computed tomography (CT) image into the first integrated data, three or more feature points of the patient's teeth and facial regions may be utilized. In other words, integration may also utilize feature points from one dental region and feature points from two facial regions.

[0072] Figure 5 FIG. 1 is a flow chart for explaining a method for generating dental integrated data according to another embodiment of the present invention. Figure 5 When describing the embodiment of FIG. 4 , descriptions of portions that overlap with the embodiment of FIG. 4 will be omitted.

[0073] Reference Figure 5 In step S10a, an oral scan image related to the patient's dental area, a three-dimensional facial image related to the patient's face, and a computed tomography image including the patient's dental area may be acquired. The oral scan image may include an image of the maxilla (i.e., the patient's upper teeth) and an image of the mandible (i.e., the patient's lower teeth). Furthermore, the three-dimensional facial image may be acquired with the patient's gums exposed and teeth clenched (i.e., the patient's teeth clenched), and the computed tomography image may also be acquired with the patient's teeth clenched.

[0074] In step S20a, second integrated data based on the three-dimensional facial image can be generated by integrating the three-dimensional facial image with the maxillary image in the oral scan image. In this case, to generate the second integrated data, three or more feature points can be extracted from the maxillary region of the patient's teeth, and the second integrated data can be generated based on the extracted feature points.

[0075] In step S30a, a first three-dimensional dental head portrait is generated by integrating the computed tomography image with the second integrated data generated in step S20a. In this case, to generate the first three-dimensional dental head portrait, at least three feature points extracted in step S20a may be extracted from the computed tomography image and integrated, or at least three additional feature points may be extracted and integrated.

[0076] In step S40a, third integrated data based on the computed tomography image may be generated by integrating the mandibular image in the oral scan image with the computed tomography image. In this case, to generate the third integrated data, three or more feature points may be extracted from the mandibular region of the patient's teeth, and the third integrated data may be generated based on the extracted feature points.

[0077] In step S50a, the second dental 3D head portrait may be integrated with the third integrated data generated in step S40a to generate a 3D facial image. During the integration process in step S50a, the second integrated data or the first dental 3D head portrait may be used to improve the integration accuracy.

[0078] As described above, according to the method for generating integrated dental data according to another embodiment of the present invention, a first dental three-dimensional head portrait and a second dental three-dimensional head portrait are all generated, the first dental three-dimensional head portrait is generated based on the image of the maxillary image in the oral scanning image integrated into the three-dimensional facial image obtained in the patient's oral cavity in an occlusal state, and the second dental three-dimensional head portrait is generated based on the image of the mandibular image in the oral scanning image integrated into the computed tomography image obtained in the patient's oral cavity in an occlusal state. Therefore, the user can not only selectively use the data required according to the patient's dental treatment purpose, but also produce an effect of more effectively expressing the state of the teeth when the patient maintains the occlusal state in the mouth.

[0079] More specifically, depending on the purpose of treatment, sometimes it is more appropriate to use the first dental three-dimensional head image, sometimes it is more appropriate to use the second dental three-dimensional head image, or sometimes both are needed. For example, when designing restorations such as crowns / inlays / onlays, the appearance of the teeth themselves is more important, so the first dental three-dimensional head image generated based on the patient's three-dimensional facial image can be used. On the other hand, when designing a surgical guide, it is necessary to confirm the patient's tooth roots or nerve positions, etc., so the second integrated data, which is data of the patient's tooth occlusion state (i.e., CT occlusion state) based on a CT image, would be more suitable. Furthermore, when designing a prosthesis and a surgical guide at the same time, two types of data (i.e., the first dental three-dimensional head image and the second dental three-dimensional head image) may be required.

[0080] Computer readable recording medium

[0081] It is obvious that each step or task of the method according to the embodiment of the present invention is performed by a computer including one or more processors as the computer program stored in the computer-readable recording medium is executed.

[0082] The computer executable instructions stored in the above-mentioned recording medium can be implemented by a computer program programmed to perform each corresponding step. Such a computer program can be stored in a computer-readable recording medium and can be executed by a processor. The computer-readable recording medium can be a non-transitory readable medium. In this case, the non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device (reading), rather than a medium that stores data for a short period of time such as a register, a cache memory, or a memory. Specifically, the program for executing the above-mentioned various methods can be stored in a semiconductor memory device such as an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), and a flash memory device, a magnetic disk such as a built-in hard disk and a mobile magnetic disk, and a non-volatile memory including an optical magnetic disk, a CD-ROM, and a DVD-ROM disk.

[0083] A computer program product may include and provide the methods of various embodiments disclosed herein. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read only memory (CD-ROM)) or through an application store (e.g., Play Store). TMWhen distributed online, at least a portion of the computer program product may be at least temporarily stored or temporarily generated on a storage medium such as a manufacturer's server, an app store's server, or a memory of a relay server.

[0084] As described above, it will be understood by those skilled in the art that the present invention can be implemented in other specific forms without changing its technical concept or essential features. Therefore, it should be understood that the above embodiments are illustrative in all aspects and not restrictive. The scope of the present invention should be indicated by the attached claims, rather than detailed descriptions. The meaning and scope of the claims and all variations or modifications derived from equivalent concepts should be interpreted as being included within the scope of the present invention.

[0085] The features and advantages described in this specification are not all-inclusive, and many additional features and advantages will become apparent to one of ordinary skill in the art, particularly in light of the drawings, the specification, and the claims. Furthermore, it should be noted that the language used in this specification is selected primarily for readability and instructional purposes and is not intended to describe or limit the subject matter of the present invention.

[0086] The above description of the embodiments of the present invention is provided for the purpose of illustration. It is not intended to limit the invention to the precise form disclosed or to be exhaustive. It will be appreciated by those skilled in the art that many modifications and variations are possible based on the above disclosure.

[0087] Therefore, the scope of the present invention is not limited to the detailed description, but is limited by the scope of the invention claims of this application based on the detailed description. Therefore, the disclosure of the embodiments of the present invention is exemplary and does not limit the scope of the present invention described in the scope of the invention claims.

Claims

1. A method for generating dental integrated data, characterized in that: The steps include: obtaining an oral scan image related to a patient's dental region; acquiring a three-dimensional facial image associated with a face including a dental portion of the patient; obtaining a computed tomography image of a region including the teeth of the patient; generating first integrated data by integrating the three-dimensional facial image with one of the oral scan image and the computed tomography scan image; as well as A dental three-dimensional head image is generated as final integrated data by integrating the other of the oral cavity scan image and the computed tomography scan image into the first integrated data.

2. The method for generating dental integrated data according to claim 1, wherein: The first integrated data and the dental three-dimensional head image are generated based on three or more feature points of the patient's face.

3. The method for generating dental integrated data according to claim 2, wherein: In the step of generating first integrated data by integrating the three-dimensional facial image with one of the oral scan image and the CT scan image, When the three-dimensional facial image is integrated with the oral scan image, the three or more feature points include feature points of the patient's teeth.

4. The method for generating dental integrated data according to claim 3, wherein: The three-dimensional facial image is acquired by a dental facial imaging device having a separate camera for accurately capturing dental data related to the patient's dental parts.

5. The method for generating dental integrated data according to claim 2, wherein: The three or more feature points are manually specified by the user.

6. The method for generating dental integrated data according to claim 2, wherein: The three or more feature points are extracted by an application for generating dental integrated data. The three or more feature points are built into the application or extracted using an artificial neural network module connected via a network, and the artificial neural network module is pre-learned using pre-learning data.

7. The method for generating dental integrated data according to claim 1, wherein: The three-dimensional facial image is a three-dimensional facial image captured with the patient's teeth exposed.

8. The method for generating dental integrated data according to claim 1, wherein: The method further includes determining whether the three-dimensional facial image is a facial image showing the patient's teeth. If it is determined that the three-dimensional facial image is a facial image in which the teeth are not exposed, In the step of generating the first integrated data, the first integrated data is generated by integrating the three-dimensional facial image with the computed tomography image.

9. A method for generating dental integrated data, characterized in that: The steps include: obtaining an oral scan image related to a patient's dental region; acquiring a three-dimensional facial image associated with a face including a dental portion of the patient; obtaining a computed tomography image of a region including the teeth of the patient; generating first integrated data by integrating the oral scan image with one of the three-dimensional facial image and the computed tomography image; as well as A dental three-dimensional head image is generated as final integrated data by integrating the other of the three-dimensional facial image and the computed tomography image into the first integrated data.

10. A computer-readable recording medium storing computer-executable instructions, characterized in that: When the above instructions are executed by the processor, the processor performs the following tasks: obtaining an oral scan image related to a patient's dental region; acquiring a three-dimensional facial image associated with a face including a dental portion of the patient; obtaining a computed tomography image of a region including the teeth of the patient; generating first integrated data by integrating the three-dimensional facial image with one of the oral scan image and the computed tomography scan image; as well as A dental three-dimensional head image is generated as final integrated data by integrating the other of the oral cavity scan image and the computed tomography scan image into the first integrated data.

11. A device for generating integrated dental data, characterized in that: include: a memory storing an application for generating integrated dental data; and The processor implements multiple modules by executing the above application stored in the above memory. The above modules include: an acquisition module for acquiring an oral scan image related to a patient's dental portion, a three-dimensional facial image related to a face including the patient's dental portion, and a computed tomography image including the patient's dental portion; an integration module for integrating the oral scan image, the three-dimensional facial image, and the computed tomography image to generate a three-dimensional dental head portrait; and The display module is used to display the three-dimensional dental portrait via the display of the device.

12. The device for generating dental integrated data according to claim 11, characterized in that: The above integration module performs the following work, generating first integrated data by integrating the three-dimensional facial image with one of the oral scan image and the computed tomography image, The dental three-dimensional head image is generated as final integrated data by integrating the other of the oral cavity scan image and the computed tomography scan image into the first integrated data.

13. The device for generating dental integrated data according to claim 11, characterized in that: The above integration module performs the following work, generating first integrated data by integrating the oral scan image with one of the three-dimensional facial image and the computed tomography image, The dental three-dimensional head image is generated as final integrated data by integrating the other of the three-dimensional facial image and the computed tomography image into the first integrated data.

14. The device for generating dental integrated data according to claim 11, characterized in that: The integration module integrates the oral scan image, the three-dimensional facial image, and the CT scan image based on three or more feature points of the patient's face.

15. The device for generating dental integrated data according to claim 12, characterized in that: When generating the first integration data, the integration module integrates the three-dimensional facial image with the oral scan image based on three or more feature points of the patient's teeth.

Images