Display method of orthodontic orthognathic fusion scheme

Abstract

The embodiment of the invention provides a method for displaying an orthodontic orthognathic fusion scheme, which comprises the following steps: acquiring initial three-dimensional dental composite model data which comprises maxillary tooth virtual model data, maxillary bone virtual model data, mandibular tooth virtual model data and mandibular bone virtual model data, wherein the initial three-dimensional tooth-jaw composite model data is from the shapes of actual teeth and jaw bones of a patient; a form adjustment interface is provided, the form adjustment interface is used for adjusting tooth model data and bone block model data in the initial three-dimensional tooth and jaw composite model data, the form adjustment interface dynamically displays the adjustment condition of the actual tooth and jaw form of the patient, a target form is obtained, and the target form is adjusted according to the adjustment condition of the actual tooth and jaw form of the patient. The image data corresponding to the target form is target image data; and displaying an orthodontic orthognathic fusion scheme postoperative three-dimensional tooth-jaw composite model for adjusting the shapes of the actual teeth and jaw bones of the patient to the target shape.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of oral orthodontics, and in particular to a method for displaying an orthodontic and orthognathic fusion solution. Background Art

[0002] Orthodontic and orthognathic combined treatment is an important medical means to correct skeletal dentofacial deformities, which requires the joint treatment of orthodontists and orthognathic surgeons. The process of traditional orthodontic and orthognathic combined treatment is as follows: after formulating a combined treatment plan, the orthodontist first performs preoperative orthodontic treatment to fully display the bone deformity, and then the orthognathic surgeon designs and performs the operation. The operation immediately achieves a roughly normal occlusion relationship, but the occlusion of individual teeth is poor and needs to be further improved through postoperative orthodontic treatment. The relative position relationship between the upper and lower jaws is the basis for orthognathic surgeons to shape the face shape, and it is also the basis for orthodontists to reshape the occlusion relationship. It is an important technical link for doctors in the two departments to conduct treatment handover, and it is also a key node that affects the treatment effect. The traditional treatment mode of this link is: the orthodontist "walks and watches" during preoperative orthodontic treatment, and continuously collects the patient's occlusion model for manual matching until it is considered that the upper and lower teeth can achieve a stable occlusion relationship, and then refers to the orthognathic surgeon for surgery. This method has the following problems: 1. The orthodontist's preoperative orthodontics lacks clear goals and has low treatment efficiency, usually taking 2-3 years or even longer; 2. The speed and quality of preoperative orthodontics are highly dependent on the orthodontist's experience and cannot be standardized. In addition, patients cannot clearly understand the changes after surgery, so they give up orthognathic treatment, which seriously limits the promotion and application of medical technology.

[0003] Therefore, it is of great significance to solve the problem that orthodontists cannot interactively formulate treatment plans. Summary of the invention

[0004] The purpose of the implementation mode of the present application is to provide a method for displaying an orthodontic orthognathic fusion plan that effectively solves the above-mentioned problem, allowing orthodontists to interactively design plans in a model, thereby making the orthodontic orthognathic fusion plan more accurate and reliable and shortening the overall treatment cycle.

[0005] To achieve the above objectives, the embodiments of the present application provide a method for displaying an orthodontic orthognathic fusion solution, comprising:

[0006] Acquire initial three-dimensional tooth-jaw composite model data, wherein the initial three-dimensional tooth-jaw composite model data includes maxillary teeth virtual model data, maxillary bone virtual model data, mandibular teeth virtual model data, and mandibular bone virtual model data, wherein the initial three-dimensional tooth-jaw composite model data is derived from the actual morphology of the patient's teeth and jaws;

[0007] Providing a morphology adjustment interface, the morphology adjustment interface is used to adjust the tooth model data and the bone block model data in the initial three-dimensional tooth-jaw composite model data, wherein the morphology adjustment interface dynamically displays the adjustment of the morphology of the patient's actual teeth and jaws to obtain a target morphology, and the image data corresponding to the target morphology is the target image data;

[0008] A three-dimensional dental-jaw composite model is displayed after the orthodontic orthognathic fusion scheme is performed to adjust the actual shape of the patient's teeth and jaws to the target shape.

[0009] Preferably, a morphology adjustment interface is provided, comprising: adjusting the posture of the tooth model in the initial three-dimensional tooth-jaw composite model in the morphology adjustment interface to obtain a preoperative three-dimensional tooth-jaw composite model, and adjusting the posture of the bone block model in the preoperative three-dimensional tooth-jaw composite model to obtain a postoperative three-dimensional tooth-jaw composite model, wherein the postoperative three-dimensional tooth-jaw composite model corresponds to the target morphology.

[0010] Preferably, the posture of the bone block model is adjusted in the preoperative three-dimensional tooth-jaw composite model to obtain the postoperative three-dimensional tooth-jaw composite model, including: performing virtual osteotomy in the preoperative three-dimensional tooth-jaw composite model to obtain each bone block model after segmentation.

[0011] Preferably, a morphology adjustment interface is provided, comprising: adjusting the posture of the bone block model in the initial three-dimensional dental-jaw composite model data in the morphology adjustment interface to obtain a three-dimensional dental-jaw composite model, and adjusting the posture of the tooth model in the three-dimensional dental-jaw composite model to obtain an orthodontic three-dimensional dental-jaw composite model, wherein the orthodontic three-dimensional dental-jaw composite model corresponds to the target morphology.

[0012] Preferably, the three-dimensional tooth-jaw composite model is obtained by adjusting the posture of the bone block model in the initial three-dimensional tooth-jaw composite model data in the morphology adjustment interface, including: performing virtual osteotomy in the initial three-dimensional tooth-jaw composite model to obtain each bone block model after segmentation.

[0013] Preferably, the method further comprises: using a color differentiation method to display each of the bone block models.

[0014] Preferably, the method further comprises: displaying the posture change information of each bone block model.

[0015] Preferably, an orthodontic orthognathic fusion scheme for adjusting the shape of the patient's actual teeth and jaws to the target shape is displayed, including: displaying the changes of teeth and jaws from the initial three-dimensional tooth-jaw composite model to the postoperative three-dimensional tooth-jaw composite model.

[0016] Preferably, the initial three-dimensional tooth-jaw composite model data also includes facial soft tissue data, and the image data corresponding to the target morphology also includes morphological image data after the soft tissue data is changed.

[0017] An embodiment of the present application also provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute a method for displaying an orthodontic orthognathic fusion plan as described in any of the above.

[0018] One embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements a method for displaying an orthodontic orthognathic fusion plan as described in any one of the above.

[0019] Compared with the prior art, the method for displaying an orthodontic orthognathic fusion solution provided by the present invention has the following advantages:

[0020] The method for displaying the orthodontic orthognathic fusion plan in the present application obtains the initial three-dimensional dental composite model data and allows the user to adjust the tooth model and bone block model at any time through the adjustment interface, so that the orthodontic orthognathic surgery plan can be displayed through a model, which increases the convenience for users to obtain the correction plan. In addition, the method for displaying the orthodontic orthognathic fusion plan in the present application also includes the display of the patient's soft tissue changes. Therefore, the method of the present application not only allows orthodontists and orthognathic surgeons to interactively formulate the patient's overall treatment plan, it not only greatly shortens the designation process of the preoperative plan, saves the time cost of orthognathic surgeons and orthodontists, but also improves the accuracy of the plan. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0022] Figure 1 is a schematic diagram of interactions between different terminals in a scenario example in some embodiments of the present application;

[0023] Figure 2 is a flow chart of a method for displaying an orthodontic orthognathic fusion solution in some embodiments of the present application;

[0024] Figure 3 is a flow chart of a method for obtaining an initial three-dimensional dental-jaw composite model in some embodiments of the present application;

[0025] Figure 4 is a schematic diagram of an adjustment interface in some embodiments of the present application;

[0026] Figure 5 is a schematic diagram of an initial three-dimensional tooth-jaw composite model in some embodiments of the present application;

[0027] Figure 6 is a schematic diagram of an initial three-dimensional dental-jaw composite model at another angle in some embodiments of the present application;

[0028] Figure 7 is a schematic diagram of a preoperative three-dimensional dental-jaw composite model in some embodiments of the present application;

[0029] Figure 8 is a schematic diagram of a preoperative three-dimensional dental-jaw composite model at another angle in some embodiments of the present application;

[0030] Fig. 9 is a schematic diagram of a three-dimensional dental-jaw composite model after surgery in some embodiments of the present application;

[0031] Fig.10 is a schematic diagram of a three-dimensional dental-jaw composite model after surgery at another angle in some embodiments of the present application;

[0032] Fig.11 is a schematic diagram of an initial three-dimensional tooth-jaw composite model in some embodiments of the present application;

[0033] Fig.12 is a schematic diagram of an initial three-dimensional dental-jaw composite model at another angle in some embodiments of the present application;

[0034] Fig.13 is a schematic diagram of a three-dimensional tooth-jaw composite model in some embodiments of the present application;

[0035] Fig.14 is a schematic diagram of a three-dimensional dental-jaw composite model at another angle in some embodiments of the present application;

[0036] Fig.15 is a schematic diagram of an orthodontic three-dimensional tooth-jaw composite model in some embodiments of the present application;

[0037] Fig.16 is a schematic diagram of an orthodontic three-dimensional tooth-jaw composite model at another angle in some embodiments of the present application;

[0038] Fig.17 is a flowchart of a method for predicting facial changes of a patient after treatment in some embodiments of the present application;

[0039] Fig.18 is a schematic diagram of a generating device of a solution in some embodiments of the present application;

[0040] Fig.19It is a schematic diagram of a display device of some embodiments of the present application;

[0041] Fig. 20 It is a schematic diagram of an electronic device in some embodiments of the present application. DETAILED DESCRIPTION

[0042] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, each embodiment of the present application will be described in detail below in conjunction with the accompanying drawings. However, it will be appreciated by those skilled in the art that in each embodiment of the present application, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can also be implemented. The division of the following embodiments is for the convenience of description, and the specific implementation of the present application should not constitute any limitation, and the various embodiments can be combined with each other and referenced to each other without contradiction.

[0043] The "posterior tooth area" mentioned in each embodiment of the present application is defined according to the classification of teeth in the second edition of "Introduction to Stomatology" published by Peking University Medical Press, pages 36-38, including premolars and molars, which are displayed as teeth 4-8 by the FDI marking method, and the teeth 1-3 in the anterior tooth area by the FDI marking method. The teeth in the anterior tooth area include central incisors, lateral incisors, and canines. In addition, for the teeth in the deciduous tooth stage, the "posterior tooth area" is defined according to the classification of deciduous teeth in the second edition of "Introduction to Stomatology" published by Peking University Medical Press, pages 40-41, including three categories: deciduous incisors, deciduous canines, and deciduous molars, among which deciduous incisors include deciduous central teeth and deciduous lateral incisors, and deciduous molars include first deciduous molars and second deciduous molars.

[0044] See also Figure 1 This specification provides a scenario example of an orthodontic orthognathic fusion plan generation system. The orthodontic orthognathic fusion plan generation system may include a client and a server. The user may be a plan designer, an orthodontist, or an orthognathic doctor.

[0045] The server can provide a basic image data input interface to the client and provide corresponding prompt information. The user can input facial photos including frontal photos and side photos, three-dimensional data of the dentition (which can be oral scan data or scan data of the patient's dental plaster model in the mouth) and CBCT or spiral CT skull data through the basic image data input interface. The user can also input photos of the inside of the oral cavity (including photos of the front teeth, left teeth, right teeth, lower occlusal area and upper occlusal area). After the server receives the skull data and three-dimensional data of the dentition from CBCT or spiral CT, it processes them. Specifically, it can be to extract the tooth model (including crown and root) and jaw model from the CBCT or spiral CT data, and obtain the crown model of each tooth according to the intraoral scan data. The tooth model and jaw model in the CBCT or spiral CT data are converted to the coordinate system of the intraoral scan data, so that the tooth model in the CBCT or spiral CT data coincides with the crown model in the intraoral scan data. The tooth model in the aligned CBCT or spiral CT data is spliced ​​and fused with the crown model in the intraoral scan data, and the tooth fusion model and the converted jaw model are combined to form new model data, namely the initial three-dimensional tooth-jaw composite model data in this application. The server sends the initial three-dimensional tooth-jaw composite model to the client. The user can complete the adjustment of the central tooth model data and the bone block model data on the client, and send the adjusted dentition and jaw target morphology to the server. The server processes the target morphology to generate dynamic change data of the patient's actual tooth and jaw morphology adjusted to the target morphology and sends it to the client. The user can view the orthodontic orthognathic fusion plan on the client, namely the changes of the dentition from the initial position to the target position, as well as the segmentation of the jaw and the movement of each bone block.

[0046] Of course, in some other implementations, the server can also provide the client with an input interface for the orthognathic procedure, and the user can input the osteotomy requirements for the upper and lower jaws. After receiving the orthognathic procedure, the server performs virtual osteotomy on the maxillary virtual model data and the mandibular virtual model data in the initial three-dimensional dental composite model data. The user can move the segmented bone blocks with 6 degrees of freedom on the client.

[0047] The above is only an example scenario provided in this specification and is not intended to limit the present invention. Any modifications, equivalent substitutions, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

[0048] The embodiment of this specification provides an orthodontic orthognathic fusion scheme generation system. The orthodontic orthognathic fusion scheme generation system may include a client and a server. The client may be an electronic device with network access capability. Specifically, for example, the client may be a desktop computer, a tablet computer, a laptop computer, a smart phone, a digital assistant, a smart wearable device, a shopping guide terminal, a television, a smart speaker, a microphone, etc. Among them, smart wearable devices include but are not limited to smart bracelets, smart watches, smart glasses, smart helmets, smart necklaces, etc. Alternatively, the client may also be software that can be run in the electronic device. The server may be an electronic device with certain computing and processing capabilities. It may have a network communication module, a processor, and a memory, etc. Of course, the server may also refer to software running in the electronic device. The server may also be a distributed server, which may be a system with multiple processors, memories, network communication modules, etc. operating in collaboration. Alternatively, the server may also be a server cluster formed by several servers. Alternatively, with the development of science and technology, the server may also be a new technical means that can realize the corresponding functions of the embodiment of the specification. For example, it may be a new form of "server" based on quantum computing.

[0049] Please refer to Figure 2 The embodiment of this specification provides a method for displaying an orthodontic orthognathic fusion solution. The method for displaying an orthodontic orthognathic fusion solution can be applied to a server. The method may include the following steps:

[0050] Step S101: Acquire initial three-dimensional tooth-jaw composite model data, wherein the initial three-dimensional tooth-jaw composite model data includes maxillary teeth virtual model data, maxillary bone virtual model data, mandibular teeth virtual model data and mandibular bone virtual model data, wherein the initial three-dimensional tooth-jaw composite model data comes from the actual morphology of the patient's teeth and jaw.

[0051] In some embodiments, the server receives the skull data and the three-dimensional data of the dentition from the CBCT or spiral CT and processes them to obtain the initial three-dimensional dental composite model data. The specific method can be referred to Figure 3 As shown in, including:

[0052] Step S201: extracting the maxillary teeth model, the maxillary bone model, the mandibular teeth model, and the mandibular bone model.

[0053] In some embodiments, the corresponding structure can be extracted based on setting a threshold. First, each layer of the CBCT data needs to be preprocessed, including noise reduction and contrast enhancement. Then, appropriate thresholds are selected to segment the tooth and jaw regions. Then, image morphological operations (such as dilation, erosion, opening, and closing) are used to remove noise in the segmentation results and close small holes to achieve the purpose of optimizing the segmentation. The tooth region pixels and jaw region pixels of all layers are superimposed, and the pixel region is converted into a grid model using the Marching cube method.

[0054] In other embodiments, the corresponding structure can be obtained based on machine learning, and image preprocessing is performed on each layer of the CBCT data. The tooth and jaw regions of each layer of the image are identified using network structures such as 3D U-net and Swin Transformer. Then, the segmented region is optimized and the pixel region is converted into a grid model.

[0055] Step S202: segment the intraoral scan data into teeth to obtain the crown region of each tooth after segmentation.

[0056] In some embodiments, the segmentation result can be calculated by using a spectral clustering method. The dental model obtained by intraoral scanning is first divided into a tooth region and a gum region, and then the tooth region is divided into independent tooth regions according to the number of teeth. When performing spectral clustering, the similarity matrix W of the mesh of the dental model must first be calculated, where each element W(i,j) in the matrix represents the correlation between the facet with index i and the adjacent facet with index j. The smaller the angle between the two facets or the larger the distance between the two facets, the smaller the correlation value. The specific calculation method is as follows:

[0057]

[0058] Among them, the distance Dist is composed of two parts: the geodetic distance Geod_Dist and the angular distance Ang_Dist. σ is the average value of the distance Dist. The distance Dist(i, j) is calculated as follows:

[0059]

[0060] Among them, δ represents the weight of the geodesic distance Geod_Dist, and (1-δ) represents the weight of the angular distance Ang_Dist.

[0061] Then calculate the normalized matrix N: N = D -1 / 2 WD -1 / 2, where D is the degree matrix. Calculate the first k largest eigenvectors e1, e2, …, ek (k represents the number of categories) of the matrix N, and use these k eigenvectors as columns to form a matrix U = [e1, e2, …, ek],

[0062] Finally, K-means clustering is performed with each row of the matrix U as the feature quantity to obtain k cluster regions, which is the segmentation result. When separating the whole tooth region and the gum region, k is 2, and when separating the independent tooth region, k is the number of teeth.

[0063] In other implementations, the corresponding segmentation results can be obtained based on machine learning, and the segmentation result attributes of each vertex or each facet can be obtained using a grid structure such as PointNet, PointNet++, or MeshSegNet.

[0064] Step S203: Align the model data extracted from CBCT or spiral CT with the model of the intraoral scan.

[0065] The basis for alignment is to overlap the teeth in the CBCT or spiral CT data with the crown segmentation of the intraoral scan data. The alignment method can use the icp alignment algorithm (icp alignment is based on one model and then selects each vertex on the other model and the closest point on the reference model as the corresponding point, and then aligns), and applies the transformation matrix obtained by alignment to the jaw in the CBCT or spiral CT data, so that the teeth and jaw models of the CBCT or spiral CT are simultaneously converted to the coordinate system of the intraoral scan model.

[0066] Step S204: splicing and fusing the tooth model in the aligned CBCT or spiral CT data with the crown model in the intraoral scan data, and combining the tooth fusion model with the converted jaw model to form an initial three-dimensional tooth-jaw composite model data.

[0067] In some specific implementations, the edge line of each crown model of the intraoral scan model is fitted into a segmentation surface, and the corresponding tooth model in the CBCT or spiral CT is segmented into a crown part and a root part using the segmentation surface. The root model of the CBCT or spiral CT is spliced ​​with the crown model of the intraoral scan model. During the splicing process, the edge line vertices of the root model and the edge line vertices of the crown model are stitched in order to form a triangular network patch to achieve the stitching of the two models, and then smoothing is performed within a certain distance range on both sides of the stitching area, and finally the initial three-dimensional dental-jaw composite model data is obtained.

[0068] Step S102: providing a morphology adjustment interface, the morphology adjustment interface is used for the user to adjust the position of the teeth and jaws, the server obtains the adjustment result and adjusts the tooth model data and the bone block model data in the initial three-dimensional tooth-jaw composite model data, the bone block model is obtained by virtual osteotomy of the maxillary virtual model and the mandibular virtual model. The morphology adjustment interface dynamically displays the adjustment of the morphology of the patient's actual teeth and jaws to obtain the target morphology, and the image data corresponding to the target morphology is the target image data. Figure 4 The schematic diagram shows the adjustment interface that users can use on the client.

[0069] In some embodiments, the tooth arrangement may be adjusted first, and the jaw movement may be adjusted later. Figures 5 to 10 As shown, in the morphology adjustment interface, the posture of the tooth model in the initial three-dimensional tooth-jaw composite model 100 is adjusted to obtain the preoperative three-dimensional tooth-jaw composite model 200. During the process, the maxillary virtual model and the mandibular virtual model maintain the relative position unchanged. After the adjustment of the tooth model is completed, the posture of the bone block model is adjusted in the preoperative three-dimensional tooth-jaw composite model 200 to obtain the postoperative three-dimensional tooth-jaw composite model 300, and the postoperative three-dimensional tooth-jaw composite model 300 corresponds to the target morphology. In the process of the movement of the bone block model, the tooth model corresponding to each bone block model also moves together. Specifically, step S101 also includes obtaining the FDI tooth position number corresponding to each bone block model and mapping it to the corresponding tooth model. Each tooth model in the initial three-dimensional tooth-jaw composite model 100 has an FDI number, and each bone block model after segmentation contains an FDI tooth position number, that is, each bone block model corresponds to zero, one or more tooth models. In this embodiment, step S102 further includes: obtaining a movement matrix of each bone block model, adjusting the position of each bone block model according to the movement matrix, and moving the tooth models mapped by each bone block model using the same movement matrix. Specifically, the movement matrix of each bone block model is determined according to the change in the positional relationship of each bone block model before and after adjustment.

[0070] In some embodiments, the preoperative three-dimensional dental-jaw composite model 200 may have completed the segmentation of virtual bone blocks according to the orthognathic surgery procedure, or the user may specify a segmentation scheme for the preoperative three-dimensional dental-jaw composite model 200 on the client. After receiving the segmentation scheme, the server processes the data of the preoperative three-dimensional dental-jaw composite model 200 and displays the preoperative three-dimensional dental-jaw composite model 200 with the segmented bone blocks on the client, and uses color differentiation to display each of the bone block models.

[0071] In other embodiments, the jaw may be adjusted first, and the dentition may be adjusted later. Figures 11 to 16As shown, in the morphology adjustment interface, the posture of the bone block model in the data of the initial three-dimensional dental-jaw composite model 100 is adjusted to obtain a three-dimensional dental-jaw composite model 400, wherein the tooth model corresponding to the bone block model moves with the bone block model. Specifically, step S101 also includes obtaining the FDI tooth position number corresponding to each of the bone block models and mapping it to the corresponding tooth model. Each tooth model in the initial three-dimensional dental-jaw composite model 100 has an FDI number, and each bone block model after segmentation contains an FDI tooth position number, that is, each bone block model corresponds to zero, one or more tooth models. And in this embodiment, step S102 also includes: obtaining the movement matrix of each bone block model, adjusting the posture of each bone block model according to the movement matrix, and moving the tooth model mapped by each bone block model using the same movement matrix.

[0072] Then, the posture of the tooth model is adjusted in the three-dimensional tooth-jaw composite model 400 to obtain an orthodontic three-dimensional tooth-jaw composite model 500, and the orthodontic three-dimensional tooth-jaw composite model 500 corresponds to the target form. In some corresponding embodiments of the three-dimensional tooth-jaw composite model 400, the initial three-dimensional tooth-jaw composite model 100 may have completed the segmentation of virtual bone blocks according to the orthognathic procedure, or the user may specify a segmentation scheme for the initial three-dimensional tooth-jaw composite model 100 on the client, and after receiving the segmentation scheme, the server processes the data of the initial three-dimensional tooth-jaw composite model 100, and displays the initial three-dimensional tooth-jaw composite model 100 with segmented bone blocks on the client, and uses color differentiation to display each of the bone block models.

[0073] Step S103: displaying an orthodontic orthognathic fusion plan for adjusting the actual shape of the patient's teeth and jaws to the target shape.

[0074] Specifically, it includes displaying the change process of teeth and jaws from the initial three-dimensional tooth-jaw composite model to the post-operative three-dimensional tooth-jaw composite model on the client.

[0075] In some embodiments, displaying an orthodontic orthognathic fusion plan for adjusting the actual shape of the patient's teeth and jaws to the target shape may also include: Figure 4 The interface shown displays the movement information of each tooth and jaw.

[0076] In some embodiments, the changes in the patient's facial soft tissues are displayed, and specifically, a prediction method for the patient's facial changes after treatment can be used to obtain a photo of the patient's facial changes after surgery. The initial three-dimensional dental-jaw composite model data also includes facial soft tissue data, and the image data corresponding to the target morphology also includes morphological image data after the soft tissue data changes.

[0077] Further, a method for predicting facial changes after treatment of patients, referring to Fig.17 As shown, the specific steps include:

[0078] Step S1, obtaining relevant parameters: the original profile photo of the patient, the lateral radiograph, the set ruler length, the set occlusal plane, the control point coordinates of the upper and lower teeth in the lateral radiograph, and the movement of the teeth.

[0079] Among them, the original profile photo is the side photo input by the user from the client, that is, the photo of the patient's face from the side perspective (left perspective or right perspective); the lateral film is a projection of the side of the skull taken at 90 degrees to the side of the head. It is the most commonly used X-ray film for orthodontic measurement. Through specific orthodontic measurement methods, it can measure abnormalities in the angles, lengths, and positions of the upper and lower jaws, alveoli, and teeth; based on the profile photo and the lateral film, the lateral film and the profile photo can be aligned through image fusion and feature recognition methods, and the marked feature points on the teeth can be obtained.

[0080] The set scale length refers to the actual length measured by a certain pixel straight line segment in the image after registration and fusion, which is used to calibrate the actual distance between pixel points. The set occlusal plane is a straight line in a two-dimensional perspective, which is formed by connecting two points, namely, the midpoint of the line connecting the feature point of the upper molar and the feature point of the lower molar, and the midpoint of the line connecting the cusp point of the upper central incisor and the cusp point of the lower central incisor.

[0081] Among them, the control point coordinates of the mandibular and maxillary teeth in the lateral view refer to the pixel coordinates of the characteristic landmark points on the image used to define and control the actual movement of the teeth. The characteristic landmark points here refer to some points selected on the lateral view that can represent the movement of teeth, such as the cusp points of the teeth; the movement of the control points includes left and right and up and down translation in the two-dimensional image, the movement of the teeth includes translation and rotation in the two-dimensional image, and the movement of the teeth includes buccal translation, lingual translation, elongation translation, depression translation and torque in the two-dimensional lateral perspective. The buccal / lingual movement direction is the direction tangent to the occlusal plane, and the elongation / depression movement direction is the direction perpendicular to the occlusal plane. The torque movement of the teeth can be divided into cusp-lingual torque and cusp-labial torque. The setting of the tooth movement amount can be determined according to the movement amount of the teeth after alignment by the doctor or manually input and specified in the interactive interface.

[0082] Step S2, determining the location of the prediction point based on the coordinates of the control point and the tooth movement amount, establishing a mathematical function relationship between the control point and the prediction point based on the interpolation function, and constructing a distance function between all the prediction points and all the control points based on the smooth kernel function;

[0083] The predicted point refers to the new position point of the original control point after the tooth moves. This step is described by the following specific embodiment:

[0084] Assuming that the cusp of the maxillary central incisor is selected as the control point, the coordinates of the maxillary central incisor control point are (x0, y0), assuming that the movement of the maxillary central incisor is buccal translation, and the translation amount is dx, then the tooth movement amount can be expressed as (dx, 0), assuming that the coordinates of the prediction point are (x1, y1), then x1 = x0 + dx, y1 = y0. Based on the interpolation function, the functional relationship between the control point and the prediction point can be established. The interpolation function can be selected from polynomial interpolation, spline function interpolation, etc. In this example, the thin plate spline interpolation function is selected, and its mathematical form is expressed as:

[0085]

[0086] In the formula, the left side of the equation is the position coordinates x1 and y1 of the prediction point, the right side of the equation a1, ax, ay and wi (i = the sequence number of the control point) are the coefficients of the interpolation function, U (|| (xi, yi) - (x, y)) is the smooth kernel function of the distance between the constructed control point and the prediction point, and the smooth kernel function can usually be a spline kernel function or a Gaussian kernel function. Here, the Gaussian kernel function is selected, and its mathematical form is: Where r is the distance between the control point and the prediction point, and σ is the radius of the Gaussian kernel function.

[0087] Step S3, solving the linear equations based on the functional relationship between the control points and the prediction points established in step S2 to obtain the coefficients of the interpolation function;

[0088] Substitute the coordinates of the control point and the prediction point into the interpolation mathematical relationship established in step S2, and substitute the Gaussian kernel function calculated based on the control point and the prediction point, and use the Gauss-Seidel method to solve the linear equations. In addition to the equations determined by the interpolation mathematical relationship in step S2, the linear equations also introduce three constraint equations of interpolation coefficients, and their expressions are as follows:

[0089]

[0090] Thus, a linear equation system determined by four equations is obtained, and the coefficients of the interpolation function {a1, ax, ay and w1} are finally calculated by a computer design program.

[0091] Step S4, substituting the coefficients obtained in step S3 into the interpolation function, performing interpolation transformation on all pixels of the profile image, and obtaining a new profile image. At this point, the prediction of the face profile image after correction is completed.

[0092] Substitute the coefficients of the interpolation function calculated in step S3 into the interpolation function formula (1), and perform interpolation transformation on all the pixels on the profile photo, that is, take all the pixels on the image as control points, and finally calculate the predicted point positions of all the pixels after interpolation. The predicted points of all the pixels form a new profile photo image.

[0093] See also Fig.18 In some embodiments, a device for generating an orthodontic orthognathic fusion plan may be provided, which may include: a data receiving module, an adjustment determination module, and a plan generation module.

[0094] The data receiving module is used to receive basic image data representing the actual shape of teeth and jaws and target image data of the target shape obtained after adjustment of the basic image data.

[0095] An adjustment determination module is used to determine an orthodontic orthognathic fusion plan based on the basic image data and the target image data; wherein the correction measures are used to adjust the teeth and jaws from the actual shape to the target shape.

[0096] The plan generation module is used to generate orthodontic and orthognathic fusion plans.

[0097] See also Fig.19 In some embodiments, a display device for orthodontic orthognathic fusion solutions may be provided, which may include: a basic image data acquisition module, a morphological adjustment display module, and a solution display module.

[0098] The basic image data acquisition module is used to acquire basic image data representing the actual morphology of teeth and jaws.

[0099] A morphology adjustment display module is used to provide a morphology adjustment interface; wherein the morphology adjustment interface dynamically displays the adjustment of the actual morphology according to the user input to obtain the target morphology; wherein the image data corresponding to the target morphology is the target image data.

[0100] A plan display module is used to display a plan for adjusting the teeth and jaws from the actual shape to the target shape.

[0101] Regarding the specific functions and effects achieved by the device for generating an orthodontic orthognathic fusion solution and the device for displaying an orthodontic orthognathic fusion solution, please refer to other embodiments of this specification for comparative explanation and will not be repeated here. The various modules in the device for generating an orthodontic orthognathic fusion solution and the device for displaying an orthodontic orthognathic fusion solution can be fully or partially implemented by software, hardware and a combination thereof. The modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0102] One embodiment of the present invention relates to an electronic device, such as Fig. 20 As shown, it includes at least one processor 401; and

[0103] A memory 402 is communicatively connected to the at least one processor 401; wherein,

[0104] The memory 402 stores instructions that can be executed by the at least one processor 401 . The instructions are executed by the at least one processor 401 so that the at least one processor 401 can perform a method for generating a shell-shaped dental appliance.

[0105] Among them, the memory and the processor are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors and memories together. The bus can also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor.

[0106] The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory can be used to store data used by the processor when performing operations.

[0107] One embodiment of the present invention relates to a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the above method embodiment is implemented.

[0108] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions for making a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0109] It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0110] It should be noted that the above embodiments can be freely combined as needed to form different new implementation plans without causing any contradiction. The implementation plans formed by such combination are all within the protection scope of the present invention. In order to save the length of the application text, they will not be described in detail here.

[0111] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

[0112] Similarly, the above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for displaying an orthodontic orthognathic fusion plan, characterized in that: include: Acquire initial three-dimensional tooth-jaw composite model data, wherein the initial three-dimensional tooth-jaw composite model data includes maxillary teeth virtual model data, maxillary bone virtual model data, mandibular teeth virtual model data, and mandibular bone virtual model data, wherein the initial three-dimensional tooth-jaw composite model data is derived from the actual morphology of the patient's teeth and jaws; Providing a morphology adjustment interface, the morphology adjustment interface is used to adjust the tooth model data and the bone block model data in the initial three-dimensional tooth-jaw composite model data, wherein the morphology adjustment interface dynamically displays the adjustment of the morphology of the patient's actual teeth and jaws to obtain a target morphology, and the image data corresponding to the target morphology is the target image data; An orthodontic orthognathic fusion plan for adjusting the actual tooth and jaw shape of the patient to the target shape is presented.

2. The method for displaying an orthodontic orthognathic fusion plan according to claim 1, characterized in that: Provides a morphology adjustment interface, including: The posture of the tooth model in the initial three-dimensional tooth-jaw composite model is adjusted in the morphology adjustment interface to obtain a preoperative three-dimensional tooth-jaw composite model, and the posture of the bone block model in the preoperative three-dimensional tooth-jaw composite model is adjusted to obtain a postoperative three-dimensional tooth-jaw composite model, and the postoperative three-dimensional tooth-jaw composite model corresponds to the target morphology.

3. The method for displaying an orthodontic orthognathic fusion plan according to claim 2, characterized in that: The postoperative three-dimensional tooth-jaw composite model is obtained by adjusting the posture of the bone block model in the preoperative three-dimensional tooth-jaw composite model, including: performing virtual osteotomy in the preoperative three-dimensional tooth-jaw composite model to obtain each segmented bone block model.

4. The method for displaying an orthodontic orthognathic fusion plan according to claim 1, characterized in that: A morphology adjustment interface is provided, including: adjusting the posture of the bone block model in the initial three-dimensional tooth-jaw composite model data in the morphology adjustment interface to obtain a three-dimensional tooth-jaw composite model, and adjusting the posture of the tooth model in the three-dimensional tooth-jaw composite model to obtain an orthodontic three-dimensional tooth-jaw composite model, wherein the orthodontic three-dimensional tooth-jaw composite model corresponds to the target morphology.

5. The method for displaying an orthodontic orthognathic fusion plan according to claim 4, characterized in that: The three-dimensional tooth-jaw composite model is obtained by adjusting the posture of the bone block model in the initial three-dimensional tooth-jaw composite model data in the morphology adjustment interface, including: performing virtual osteotomy in the initial three-dimensional tooth-jaw composite model to obtain each bone block model after segmentation.

6. The method for displaying an orthodontic orthognathic fusion plan according to claim 3 or 5, characterized in that: Also includes: The bone block models are displayed using color differentiation.

7. The method for displaying an orthodontic orthognathic fusion plan according to claim 6, characterized in that: Also includes: Display the posture change information of each bone block model.

8. The method for displaying an orthodontic orthognathic fusion plan according to claim 2, characterized in that: An orthodontic orthognathic fusion plan for adjusting the shape of the patient's actual teeth and jaws to the target shape is displayed, including: displaying the changes in the teeth and jaws from the initial three-dimensional tooth-jaw composite model to the postoperative three-dimensional tooth-jaw composite model.

9. The method for displaying an orthodontic orthognathic fusion plan according to claim 1, characterized in that: The initial three-dimensional tooth-jaw composite model data also includes facial soft tissue data, and the image data corresponding to the target morphology also includes morphological image data after the soft tissue data is changed.

10. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for displaying an orthodontic orthognathic fusion plan as described in any one of claims 1 to 9.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for displaying an orthodontic orthognathic fusion plan as described in any one of claims 1 to 9 is implemented.

Images