Orthodontic simulation method and apparatus, device, and storage medium

Abstract

The present application relates to an orthodontic simulation method and apparatus, a device, and a storage medium. The orthodontic simulation method comprises: obtaining a facial model of a target object, and identifying a lip line in the facial model; merging a dental model of the target object with a dental area of the facial model to obtain an orthodontic-ready model, wherein the dental area is an area surrounded by the lip line; calculating a facial midline position of the facial model, and performing orthodontic simulation on the orthodontic-ready model on the basis of the facial midline position to obtain an orthodontic simulation model; and performing facial deformation on the basis of the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents facial changes of the target object during an orthodontic stage. In the method provided by the present application, while performing orthodontic simulation on the basis of tooth movement changes, facial changes caused by dental orthodontics are also simulated, thereby effectively improving user experience.

Description

Orthodontic simulation methods, devices, equipment and storage media

[0001] This application claims priority to Chinese Patent Application No. 2024107952432, filed on June 19, 2024, entitled "Orthodontic Simulation Method, Apparatus, Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of medical technology, and in particular to an orthodontic simulation method, apparatus, device, and storage medium. Background Technology

[0003] With the widespread use of intraoral scanners, simulating treatment effects using scanned model data before actual treatment to adjust treatment methods is becoming a growing trend in clinical practice. Currently, existing orthodontic simulation software primarily simulates tooth movement. However, orthodontic treatment not only causes changes in teeth but also in the face, and current software does not predict these changes. Furthermore, some patients seeking orthodontic treatment aim to improve facial aesthetics; simulating only tooth movement cannot meet their aesthetic needs, as it lacks a preview of overall facial changes and hinders effective communication between doctors and patients, negatively impacting the orthodontic experience. Therefore, there is an urgent need for an orthodontic simulation method that specifically targets the face. Summary of the Invention

[0004] One of the objectives of this application is to provide an orthodontic simulation method, apparatus, device, and storage medium that simulates orthodontic changes based on tooth changes, and also simulates facial changes caused by orthodontics, thereby effectively improving the user experience.

[0005] The technical solution adopted in the embodiments of this application is:

[0006] In a first aspect, embodiments of this disclosure provide an orthodontic simulation method, including:

[0007] Obtain the facial model of the target object and identify the lip line in the facial model;

[0008] The tooth model of the target object is spliced ​​with the tooth area of ​​the facial model to obtain the orthodontic model, wherein the tooth area is the area surrounded by the lip line;

[0009] Calculate the midline position of the face model, and perform orthodontic simulation on the model to be orthodontized based on the midline position to obtain an orthodontic simulation model;

[0010] Facial deformation processing is performed based on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage.

[0011] In some embodiments, the step of splicing the tooth model of the target object with the tooth region of the facial model to obtain the orthodontic model includes:

[0012] A dental model of the target object is obtained, and the dental model and the facial model are obtained by scanning during the same orthodontic stage;

[0013] Align the tooth regions of the dental model and the facial model;

[0014] With the tooth regions of the tooth model and the facial model aligned, the tooth regions are hidden, so that the tooth model is displayed in the tooth regions;

[0015] The facial model, which incorporates the dental model, is used as the model to be orthodontized.

[0016] In some embodiments, aligning the tooth regions of the tooth model and the facial model includes:

[0017] The scanning effect of the facial model is evaluated, and the evaluation results are obtained;

[0018] If the evaluation result does not meet the preset result, semantic segmentation is performed on a single tooth in the tooth model to obtain the first segmentation result for each tooth;

[0019] Semantic segmentation is performed on individual teeth in the dental region of the facial model to obtain a second segmentation result for each tooth;

[0020] Align the same teeth in the first segmentation result and the second segmentation result to obtain the aligned tooth model and the facial model.

[0021] In some embodiments, calculating the facial midline position of the facial model includes:

[0022] Identify facial feature points in the facial model, the facial feature points including first feature points located in a first part and second feature points located in a second part;

[0023] The first feature point and the second feature point are fitted together to obtain the midline position of the face model.

[0024] In some embodiments, the first feature point includes the tip of the nose, the glabella, and the prechin; the second feature point is at least two feature points located on the same baseline and symmetrical about each other along the midline of the face, the baseline being determined based on the position of the ears.

[0025] In some embodiments, the orthodontic simulation of the model to be orthodontized based on the facial midline position to obtain an orthodontic simulation model includes:

[0026] Calculate the position of the tooth midline in the dental model of the model to be orthodontized;

[0027] Based on the midline position of the teeth and the midline position of the face, the midline of the teeth of the dental model is aligned with the midline of the face model in the model to be orthodontized, to obtain the model after midline alignment;

[0028] Orthodontic simulation is performed on the model after midline alignment to obtain an orthodontic simulation model.

[0029] In some embodiments, the step of performing facial deformation processing based on the orthodontic simulation model to generate a facial simulation model includes:

[0030] Identify the facial feature points of the facial model, divide the region to be deformed based on the facial feature points, and determine the interpolation coefficients of the region to be deformed.

[0031] Extract the tooth change features from the orthodontic simulation model;

[0032] Based on the tooth change characteristics and the interpolation coefficients, the deformable region in the target model is deformed to generate a facial simulation model, wherein the target model is the orthodontic simulation model or the facial model;

[0033] In the case where the target model is the orthodontic simulation model, the facial simulation model also presents the changes in the teeth of the target object during the orthodontic stage.

[0034] In some embodiments, the tooth change features include changes in arch width, changes in the anteroposterior position of the pre-set incisal edge of the upper central incisor, anteroposterior movement of the lower arch, and vertical movement of the lower arch.

[0035] In some embodiments, the step of deforming the region to be deformed in the target model according to the tooth change characteristics and the interpolation coefficients to generate a facial simulation model includes:

[0036] Simulate the width of the cheeks after facial changes based on the changes in the dental arch width;

[0037] The anterior-posterior position of the upper lip is simulated based on the anterior-posterior position change value of the preset incisal edge of the upper central incisor;

[0038] The anterior and posterior positions of the lower lip are simulated based on the anterior and posterior movement values ​​of the lower dental arch;

[0039] The height change of the chin is simulated based on the vertical movement value of the lower dental arch;

[0040] The area to be deformed is deformed based on the interpolation coefficients, the width of the cheeks, the front-back position of the upper lip, the front-back position of the lower lip, and the height change of the chin to generate a facial simulation model. The facial changes include changes in the cheeks, the upper lip, the lower lip, and the chin.

[0041] Secondly, embodiments of this disclosure provide an orthodontic simulation device, comprising:

[0042] The acquisition unit is configured to acquire a facial model of a target object and identify the lip line in the facial model;

[0043] The processing unit is configured to stitch the tooth model of the target object with the tooth region of the facial model to obtain the orthodontic model, wherein the tooth region is the region surrounded by the lip line;

[0044] An orthodontic unit is configured to calculate the midline position of the face model and perform orthodontic simulation on the model to be orthodontized based on the midline position to obtain an orthodontic simulation model.

[0045] The generation unit is configured to perform facial deformation processing based on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage.

[0046] Thirdly, embodiments of this disclosure provide an electronic device, including:

[0047] Memory;

[0048] Processor; and

[0049] Computer programs;

[0050] The computer program is stored in the memory and configured to be executed by the processor to implement the orthodontic simulation method as described above.

[0051] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method for determining the layout information of the scanning bar as described above.

[0052] The orthodontic simulation method disclosed herein includes: acquiring a facial model of a target object and identifying the lip line in the facial model; stitching the target object's dental model with the dental region of the facial model to obtain a model to be orthodontized, wherein the dental region is the area enclosed by the lip line; calculating the facial midline position of the facial model and performing orthodontic simulation on the model to be orthodontized based on the facial midline position to obtain an orthodontic simulation model; and performing facial deformation processing on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage. The method disclosed herein integrates the facial model into the orthodontic simulation, simulating both dental orthodontic changes based on tooth movement and facial changes caused by orthodontics, thus simulating the changes in the target object's facial model after orthodontic treatment. This allows for a comprehensive display of orthodontic effects and effectively improves the user experience. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or exemplary technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0054] Figure 1 is a flowchart illustrating an orthodontic simulation method provided in an embodiment of this disclosure;

[0055] Figure 2 is a schematic diagram of a facial model provided in an embodiment of this disclosure;

[0056] Figure 3 is a schematic diagram of a model to be orthodontized according to an embodiment of this disclosure;

[0057] Figure 4 is a schematic diagram of a facial model provided in an embodiment of this disclosure;

[0058] Figure 5 is a schematic diagram of an orthodontic simulation model provided in an embodiment of this disclosure;

[0059] Figure 6 is a schematic diagram of the refinement process of S104 in an orthodontic simulation method shown in Figure 1;

[0060] Figure 7 is a schematic diagram of a region to be deformed according to an embodiment of this disclosure;

[0061] Figure 8 is a schematic diagram of a tooth arrangement provided in an embodiment of this disclosure;

[0062] Figure 9 is a schematic diagram of the structure of an orthodontic simulation device provided in an embodiment of this disclosure;

[0063] Figure 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0064] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0065] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0066] Currently, most intraoral scanning devices include orthodontic simulation software in their scanning software to simulate the alignment of a patient's teeth after orthodontic treatment. However, patients often want to see the changes in their facial appearance resulting from the simulated orthodontic treatment in conjunction with their own faces. Facial changes are caused by the movement of teeth and jawbones. While tooth movement can be predicted relatively well, the relationships between teeth and jawbones, teeth and face, and jawbones and face are not clearly defined, making it difficult to predict facial changes. Furthermore, the face is composed of soft tissue, and changes in soft tissue are influenced not only by hard tissue but also by its thickness and tension.

[0067] To address the aforementioned technical problems, this disclosure provides an orthodontic simulation method that combines dental data obtained from intraoral scanning with facial data for orthodontic simulation. By simulating facial changes during orthodontic treatment based on changes in the teeth, it better facilitates doctor-patient communication and allows for flexible adjustments to the treatment plan in response to facial changes, effectively improving the user experience. Detailed descriptions are provided below through one or more embodiments.

[0068] Figure 1 is a schematic flowchart of an orthodontic simulation method provided in an embodiment of this disclosure. Applied to a scanning device or server, one possible scenario is that the scanning device simulates facial and dental changes during orthodontic treatment based on a facial model and a dental model. Alternatively, the scanning device sends the facial and dental models to the server, which then simulates the facial and dental changes during orthodontic treatment based on the facial and dental models. The following embodiment uses the server executing the orthodontic simulation method as an example for detailed explanation, specifically including the following steps S101 to S104 as shown in Figure 1:

[0069] S101. Obtain the facial model of the target object and identify the lip line in the facial model.

[0070] The teeth area is the region enclosed by the lip line.

[0071] Understandably, the scanning device generates a facial model of the target object's face during the current orthodontic stage. The scanning device can be a facial scanning model, and the facial model can be a three-dimensional model of a complete face, including the lips, which include the upper lip and lower lip. The lips in the facial model are identified, and a lip line that completely surrounds all the teeth displayed on the facial model is extracted from the lips. The lips of the target object should display as many teeth as possible to improve the subsequent orthodontic effect. The area surrounded by the lip line is defined as the tooth area of ​​the facial model.

[0072] For example, see Figure 2, which is a schematic diagram of a facial model provided in an embodiment of the present disclosure. The lip line is identified, and the area surrounded by the lip line is the tooth area, which includes at least one tooth.

[0073] S102. The tooth model of the target object is spliced ​​with the tooth area of ​​the facial model to obtain the model to be orthodontized.

[0074] Understandably, based on the above S101, a dental model of the target object is acquired through a scanning device. The dental model can be in the same orthodontic stage as the facial model. The orthodontic stage can be before or during orthodontic treatment. Subsequently, the dental regions of the dental model and the facial model are stitched together. The stitching process can use the Iterative Closest Point (ICP) method or other stitching algorithms to align the facial model and the dental model, resulting in the model to be orthodontized. The model to be orthodontized can be understood as a combination of the facial model and the dental model.

[0075] Optionally, in step S102 above, the tooth model of the target object is stitched together with the tooth region of the facial model to obtain the orthodontic model. This can be achieved through the following steps:

[0076] Obtain the dental model of the target object; the dental model and facial model are scanned in the same orthodontic stage. Align the dental regions of the dental model and facial model. With the dental regions of the dental model and facial model aligned, hide the dental regions so that the dental model is displayed in the dental regions. Use the facial model that combines the dental model as the model to be orthodontized.

[0077] Understandably, the dental model can be a 3D model of the teeth obtained from an intraoral scanner. The dental areas of the dental model and the facial model are stitched together using ICP (Intraoral Photogrammetry) to align them. After alignment, the dental area of ​​the facial model is hidden, meaning the area of ​​the teeth enclosed by the lip line in the facial model is removed, allowing the dental model to be displayed within that area. This results in a combined orthodontic model, showing the combined facial and intraoral scan results. Understandably, before hiding the dental area, adjustments can be made to ensure the aesthetics of the facial model, excluding the lips and only including the teeth.

[0078] Optionally, the above alignment process between the tooth model and the facial model's tooth areas can be achieved through the following steps:

[0079] The scanning effect of the facial model is first evaluated to obtain the evaluation result. If the evaluation result does not meet the preset result, semantic segmentation is performed on individual teeth in the dental model to obtain the first segmentation result of each tooth. Semantic segmentation is performed on individual teeth in the dental region of the facial model to obtain the second segmentation result of each tooth. The same teeth in the first segmentation result and the second segmentation result are aligned to obtain the aligned dental model and facial model.

[0080] Understandably, to ensure the alignment accuracy of the facial and dental models, the scanning effect of the facial model is first evaluated to obtain an evaluation result. The specific evaluation method is not limited, and the evaluation result includes conclusions such as poor scanning effect and good scanning effect. Subsequently, if the evaluation result is poor, that is, if the evaluation result does not meet the preset result for direct alignment, semantic segmentation is performed on the dental region of the facial model and the dental model separately to segment individual teeth. The first segmentation result obtained from the semantic segmentation of individual teeth in the dental model must include a greater number and type of teeth than the second segmentation result obtained from the semantic segmentation of individual teeth in the dental region of the facial model. In other words, the first segmentation result includes the second segmentation result. Then, the same teeth in the first and second segmentation results are aligned to obtain the aligned dental and facial models. That is, when the facial model scanning effect is poor, semantic segmentation of individual teeth is performed on the dental model and dental region before ICP alignment to improve alignment accuracy.

[0081] If the facial model scan is of good quality, the teeth in the dental model can be aligned as a whole with the dental region of the facial model. If the facial model scan is poor quality, the teeth in the dental regions of the dental model and the facial model need to be semantically segmented separately, and then the segmented results are aligned separately to ensure more accurate alignment and greater practicality.

[0082] For example, see Figure 3, which is a schematic diagram of a model to be orthodontized provided in an embodiment of the present disclosure. In the model to be orthodontized, the tooth area of ​​the facial model shows the aligned tooth model.

[0083] S103. Calculate the midline position of the face model and perform orthodontic simulation on the orthodontic model to be orthodontic based on the midline position to obtain the orthodontic simulation model.

[0084] Understandably, based on the above S102, when simulating orthodontics with facial features, patients with misaligned midlines often need to align their midlines. Therefore, it is necessary to identify the facial feature points of the facial model and calculate the position of the facial midline based on the facial feature points, or calculate the position of the facial midline based on the facial contour of the facial model. The position of the facial midline refers to the position of the facial midline. When displaying the facial model, the facial midline is usually rotated to be parallel to the vertical to ensure that the face is aligned in the appropriate position.

[0085] Subsequently, orthodontic simulation is performed on the tooth model in the orthodontic model based on the midline position of the face to obtain the orthodontic simulation model. It can be understood that orthodontic simulation is the change of teeth, and the content displayed by the tooth model in the tooth area of ​​the facial model will change as the orthodontic simulation process proceeds.

[0086] Optionally, the calculation of the facial midline position of the facial model in S103 above can be achieved through the following steps:

[0087] Identify facial feature points in the facial model, including a first feature point located in the first part and a second feature point located in the second part; fit the first and second feature points to obtain the position of the facial midline of the facial model.

[0088] The first feature point includes the tip of the nose, the glabella, and the prechin; the second feature point consists of at least two feature points located on the same baseline and symmetrical about the midline of the face, the baseline being determined based on the position of the ears.

[0089] Understandably, facial feature points are identified in a facial model. The facial model is pre-divided into a first part and a second part. The first part can be understood as the upper and lower vertical sections of the face, and the second part as the left and right horizontal sections. Facial feature points include first feature points located in the first part and second feature points located in the second part. For example, the first feature points include the tip of the nose, the glabella, and the chin, with the glabella located in the upper part and the tip of the nose and the chin in the lower part. Second feature points refer to at least two feature points located on the same baseline and symmetrical along the facial midline. The baseline is determined based on the positions of the ears; for example, second feature points refer to points symmetrically positioned along the midline on the face. Alternatively, preset feature points can be set, and the preset feature points in the facial model can be directly identified. The position of the facial midline is calculated based on the feature information of the identified preset feature points. Subsequently, the first and second feature points are fitted to obtain the position of the facial midline of the facial model. After recognizing facial feature points, the position of the orbital-auricular plane can be calculated based on the facial feature points. It is understandable that in a natural head position, the orbital-auricular plane is parallel to the horizontal plane. By utilizing the position of the facial midline and the orientation of the orbital-auricular plane, the facial model can be positioned in a suitable orientation when displaying the facial model, making it easier to better display the facial model.

[0090] In this field, the facial midline can also be determined based on other feature points such as: hairline midpoint, forehead point, nasal root point, nasal tip point, nasal base point, upper lip point, lower lip point, prechin point, subchinal point, mentolabial sulcus point, philtrum point, glabella point, outer canthus point, corner of mouth point, etc., which will not be listed here one by one;

[0091] In this scheme, for the first feature point of the first part of the face in the vertical direction, the three points of the nose tip, the glabella, and the anterior chin are preferred. These three points are far apart and have obvious features. Selecting these three points can improve the speed of determining the midline of the face while ensuring accuracy and reducing the amount of data processing.

[0092] For example, see Figure 4, which is a schematic diagram of a facial model provided in an embodiment of the present disclosure. The facial model includes a facial midline and an orbitoauricular plane. The facial midline includes the tip of the nose, the tip of the eyebrow, and the prechin point.

[0093] Optionally, in step S103 above, orthodontic simulation is performed on the model to be orthodontized based on the midline position of the face to obtain an orthodontic simulation model. This can be achieved through the following steps:

[0094] Calculate the midline position of the teeth in the model to be orthodontized; based on the midline position of the teeth and the midline position of the face, align the midline of the teeth in the model to be orthodontized to the midline of the face in the model to be orthodontized, and obtain the midline-aligned model; perform orthodontic simulation on the midline-aligned model to obtain the orthodontic simulation model.

[0095] Understandably, in simulated orthodontics involving the face, the position of the midline must be considered during the orthodontic simulation to ensure that the midline of the aligned teeth in the simulation matches the facial midline. Specifically, the midline position of the teeth in the model to be orthodontized is calculated. Based on the midline positions of the teeth and the facial midline, the midline of the teeth is aligned with the facial midline to obtain the midline-aligned model. Subsequently, orthodontic simulation is performed on the midline-aligned model to obtain the orthodontic simulation model. The specific orthodontic method is not limited here.

[0096] For example, referring to Figure 5, Figure 5 is a schematic diagram of an orthodontic simulation model provided in an embodiment of the present disclosure. The orthodontic model 510 and the orthodontic simulation model 520 are shown in Figure 5. The orthodontic model 510 is a combined model in which the tooth model and the facial model are aligned and the tooth model is displayed in the tooth area of ​​the facial model. The orthodontic simulation model 520 is an orthodontic model obtained by aligning the tooth midline and the facial midline and performing orthodontic simulation.

[0097] S104. Perform facial deformation processing based on the orthodontic simulation model to generate a facial simulation model.

[0098] Among them, the facial simulation model presents the facial changes of the target subject during the orthodontic stage.

[0099] Understandably, based on the above S103, the tooth position change features after orthodontic simulation are extracted from the orthodontic simulation model, and the face is deformed according to the tooth position change after orthodontic treatment. That is, the relationship between facial deformation and tooth change is constructed, and then the impact of orthodontics on the face is simulated to generate a facial simulation model. The facial simulation model presents the facial changes from the start of the current orthodontic stage to the target orthodontic stage. The current orthodontic stage refers to a certain stage before orthodontic treatment begins or during orthodontic treatment, and the target orthodontic stage refers to a certain orthodontic stage after the current orthodontic stage. That is, facial changes can be simulated before orthodontic treatment begins, and facial changes can also be simulated in real time during orthodontic treatment.

[0100] The method provided in this disclosure aligns the tooth region of a facial model with the tooth model to obtain an orthodontic model in which the tooth model is displayed in the tooth region of the facial model. By recognizing facial feature points, the position of the facial midline is determined, and the tooth midline of the tooth model is aligned with the facial midline. This facilitates a more accurate construction of the correlation between tooth changes and facial changes. Based on the correlation, facial deformation processing is performed to generate a facial simulation model. This method of introducing a facial model into orthodontic simulation results in a more realistic and vivid orthodontic effect, effectively improving the user experience.

[0101] Based on the above embodiments, Figure 6 is a detailed flowchart of S104 in an orthodontic simulation method shown in Figure 1. Facial deformation processing is performed according to the orthodontic simulation model to generate a facial simulation model, specifically including the following steps S601 to S603 as shown in Figure 6:

[0102] S601. Identify facial feature points of the facial model, divide the area to be deformed based on the facial feature points, and determine the interpolation coefficients of the area to be deformed.

[0103] Understandably, facial feature points are identified in the initial facial model or the facial model to be orthodontized, or the facial feature points identified when calculating the facial midline position are directly obtained. Facial feature points can distinguish parts such as lips, nose, and cheeks. Subsequently, the facial deformation area is divided according to the facial feature points and denoted as the area to be deformed. The area to be deformed refers to the area of ​​the face that will change with the changes in teeth.

[0104] For example, see Figure 7, which is a schematic diagram of a region to be deformed provided in an embodiment of the present disclosure. Figure 7 shows the orthodontic model and the orthodontic simulation model, and shows the region to be deformed divided on the orthodontic simulation model. The region to be deformed will undergo corresponding deformation based on the changes in teeth after orthodontics.

[0105] S602. Extract tooth change features from orthodontic simulation model.

[0106] Among them, the tooth change characteristics include changes in the width of the dental arch, changes in the anteroposterior position of the pre-set incisal edge of the upper central incisor, anteroposterior movement of the lower dental arch, and vertical movement of the lower dental arch.

[0107] Understandably, based on the above S601, the tooth change features of the orthodontic simulation model relative to the model to be orthodontized are extracted, that is, the tooth position change features after orthodontic simulation are extracted. These tooth change features include changes in arch width, changes in the anteroposterior position of the pre-set incisal edge of the upper central incisor, anteroposterior movement of the lower dental arch, and vertical movement of the lower dental arch. The arch width change refers to the change in arch width before and after tooth arrangement. Specifically, the dental arches before and after orthodontic treatment can be simulated first, and then the changes in the width of the two arches can be compared. The anteroposterior position change of the pre-set incisal edge of the upper central incisor refers to the anteroposterior position change of the incisal edge of the upper central incisor after tooth arrangement. The anteroposterior movement of the lower dental arch refers to the anteroposterior movement of the lower dental arch after tooth arrangement, and the vertical movement of the lower dental arch specifically refers to the vertical position of the lower dental arch after tooth arrangement.

[0108] For example, referring to Figure 8, Figure 8 is a schematic diagram of a tooth arrangement provided in an embodiment of the present disclosure. Figure 810 shows the change in the width of the dental arch in the dental model before and after orthodontics. Figure 820 shows the change in the position of the tooth arrangement in the dental model before and after orthodontics, denoted as tooth arrangement position change. Figure 830 shows the change in the position of the dental arch in the dental model before and after orthodontics, denoted as dental arch position change.

[0109] S603. Based on the tooth variation characteristics and interpolation coefficients, deform the area to be deformed in the target model to generate a facial simulation model.

[0110] The target model is either an orthodontic simulation model or a facial model. When the target model is an orthodontic simulation model, the facial simulation model also shows the changes in the target object's teeth during the orthodontic stage.

[0111] Understandably, based on the above S602, a target model is determined. The target model refers to an orthodontic simulation model or an initial facial model. The area to be deformed in the target model is deformed according to the tooth change characteristics and interpolation coefficients to generate a facial simulation model. When the target model is an initial facial model, the facial simulation model shows facial changes. When the target model is an orthodontic simulation model, the facial simulation model shows both facial changes and tooth changes. In other words, the facial simulation model obtained in this case performs orthodontic simulation of both teeth and face.

[0112] Optionally, the above-mentioned deformation processing of the area to be deformed in the target model based on tooth variation characteristics and interpolation coefficients can be performed to generate a facial simulation model. This can be achieved through the following steps:

[0113] The facial simulation model is generated by simulating the changes in cheek width based on the changes in the width of the dental arch; simulating the changes in the anterior-posterior position of the upper lip based on the changes in the pre-set anterior-posterior position of the upper central incisors; simulating the anterior-posterior position of the lower lip based on the anterior-posterior movement of the lower dental arch; simulating the changes in chin height based on the vertical movement of the lower dental arch; and deforming the area to be deformed based on the interpolation coefficients, cheek width, anterior-posterior position of the upper lip, anterior-posterior position of the lower lip, and chin height to generate a facial simulation model. The facial changes include changes in the cheeks, upper lip, lower lip, and chin.

[0114] Understandably, the change in the width of the dental arch before and after tooth alignment is used to simulate the width of the cheeks after facial changes. The dental arch shape is a holistic shape that determines the changes in the cheeks, thus establishing the relationship between the width of the dental arch and the width of the cheeks. Similarly, the change in the anteroposterior position of the upper lip is simulated based on the change in the incisal third of the upper central incisors after tooth alignment, establishing the relationship between the upper central incisors and the upper lip. The anteroposterior position of the lower lip is simulated based on the anteroposterior movement of the lower dental arch after tooth alignment, establishing the relationship between the lower dental arch and the lower lip. Finally, the change in chin height is simulated based on the vertical position of the lower dental arch after tooth alignment, establishing the relationship between the lower dental arch and the chin.

[0115] Understandably, when performing facial deformities, one can choose the target area for the deformity. The target area refers to at least one part of the face, including the upper lip, lower lip, cheeks, and chin. Deformation is performed on the selected target area in order to flexibly simulate the treatment effect of orthodontic treatment on different parts of the face.

[0116] The orthodontic simulation method provided in this embodiment divides the area to be deformed by facial feature points, extracts corresponding tooth change features for each part of the area to be deformed, simulates the deformation of each part, and establishes a pre-established correspondence between facial deformation and tooth change, thereby achieving accurate simulation of facial orthodontics.

[0117] Figure 9 is a schematic diagram of the structure of an orthodontic simulation device provided in an embodiment of this disclosure. The orthodontic simulation device provided in this embodiment can execute the processing flow provided in the orthodontic simulation method embodiment. As shown in Figure 9, the device 900 includes an acquisition unit 901, a processing unit 902, an orthodontic unit 903, and a generation unit 904, wherein:

[0118] The acquisition unit 901 is configured to acquire the facial model of the target object and identify the lip line in the facial model;

[0119] Processing unit 902 is configured to stitch together the tooth model of the target object with the tooth region of the facial model to obtain the orthodontic model, wherein the tooth region is the area surrounded by the lip line;

[0120] Orthodontic unit 903 is configured to calculate the midline position of the face model and perform orthodontic simulation on the orthodontic model to be orthodontized based on the midline position to obtain an orthodontic simulation model;

[0121] The generation unit 904 is configured to perform facial deformation processing based on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage.

[0122] Optionally, the processing unit 902 is configured as follows:

[0123] The dental model of the target object was obtained, and the dental model and facial model were obtained by scanning during the same orthodontic phase.

[0124] Align the tooth areas of the dental model and the facial model;

[0125] When the tooth regions of the dental model and the facial model are aligned, the tooth regions are hidden, so that the dental model is displayed in the tooth regions.

[0126] A facial model combining dental models is used as the model to be orthodontized.

[0127] Optionally, the processing unit 902 is configured as follows:

[0128] The scanning effect of the facial model was evaluated, and the evaluation results were obtained;

[0129] If the evaluation results do not meet the preset results, semantic segmentation is performed on individual teeth in the tooth model to obtain the first segmentation result for each tooth;

[0130] Semantic segmentation is performed on individual teeth in the dental region of the facial model to obtain a second segmentation result for each tooth;

[0131] Align the identical teeth in the first and second segmentation results to obtain the aligned tooth and facial models.

[0132] Optionally, the orthodontic unit 903 is configured as follows:

[0133] Identify facial feature points in a facial model, including first feature points located in a first part and second feature points located in a second part;

[0134] The first and second feature points are fitted together to obtain the midline position of the face model.

[0135] Optionally, the first feature point in the device 900 includes the tip of the nose, the glabella, and the prechin; the second feature point is at least two feature points located on the same baseline and symmetrical about each other along the midline of the face, the baseline being determined based on the position of the ears.

[0136] Optionally, the orthodontic unit 903 is configured as follows:

[0137] Calculate the position of the tooth midline in the model to be orthodontized;

[0138] Based on the positions of the dental midline and the facial midline, the dental midline of the dental model is aligned with the facial midline of the facial model in the model to be orthodontized, resulting in a midline-aligned model.

[0139] Orthodontic simulation was performed on the model after midline alignment to obtain the orthodontic simulation model.

[0140] Optionally, generation unit 904 is configured as follows:

[0141] Identify facial feature points of the facial model, divide the region to be deformed based on the facial feature points, and determine the interpolation coefficients of the region to be deformed.

[0142] Extract tooth change features from orthodontic simulation models;

[0143] Based on the tooth change characteristics and interpolation coefficients, the deformable area in the target model is deformed to generate a facial simulation model, wherein the target model is an orthodontic simulation model or a facial model.

[0144] In the case where the target model is an orthodontic simulation model, the facial simulation model also presents the changes in the target object's teeth during the orthodontic stage.

[0145] Optionally, the tooth variation features in the device 900 include changes in the width of the dental arch, changes in the anteroposterior position of the preset incisal edge of the upper central incisor, anteroposterior movement of the lower dental arch, and vertical movement of the lower dental arch.

[0146] Optionally, generation unit 904 is configured as follows:

[0147] Simulate the width of the cheeks after facial changes based on the changes in dental arch width;

[0148] The anterior-posterior position of the upper lip is simulated based on the pre-set anterior-posterior position change value of the upper central incisor;

[0149] The anterior and posterior position of the lower lip is simulated based on the anterior and posterior movement value of the lower dental arch;

[0150] Simulate chin height changes based on the vertical movement of the lower dental arch;

[0151] The facial simulation model is generated by deforming the area to be deformed based on the interpolation coefficients, the width of the cheeks, the front-back position of the upper lip, the front-back position of the lower lip, and the height of the chin. The facial changes include the changes of the cheeks, upper lip, lower lip, and chin.

[0152] The orthodontic simulation device shown in Figure 9 can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and will not be described again here.

[0153] Figure 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Referring specifically to Figure 10 below, it shows a schematic diagram of the structure suitable for implementing the electronic device 1000 in the embodiments of this disclosure. The electronic device 1000 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable electronic devices, etc., as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc. The electronic device shown in Figure 10 is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this disclosure.

[0154] As shown in FIG10, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes to implement the orthodontic simulation method as described in the embodiments of the present disclosure, based on a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the electronic device 1000. The processing device 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0155] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows electronic device 1000 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 shows an electronic device 1000 with various devices, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0156] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts, thereby implementing the orthodontic simulation method described above. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0157] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0158] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0159] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0160] Optionally, when one or more of the above-described procedures are executed by the electronic device, the electronic device may also execute other steps of the above embodiments.

[0161] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0162] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0163] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0164] The functions described above in this document can be performed at least in part by one or more hardware logic units. For example, without limitation, exemplary types of hardware logic units that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0165] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0166] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or gateway that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or gateway. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or gateway that includes the element.

[0167] The above are merely specific embodiments of this disclosure, enabling those skilled in the art to understand or implement this disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to these embodiments, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. Industrial applicability

[0168] This application relates to an orthodontic simulation method, apparatus, device, and storage medium. The orthodontic simulation method includes: acquiring a facial model of a target object and identifying the lip line in the facial model; stitching the target object's tooth model with the tooth region of the facial model to obtain a model to be orthodontized, wherein the tooth region is the area surrounded by the lip line; calculating the facial midline position of the facial model and performing orthodontic simulation on the model to be orthodontized based on the facial midline position to obtain an orthodontic simulation model; and performing facial deformation processing on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage. Using this technical solution, while simulating orthodontic changes based on tooth movement, it also simulates facial changes caused by orthodontic treatment, effectively improving the user experience and possessing strong industrial applicability.

Claims

1. An orthodontic simulation method, wherein, include: Obtain the facial model of the target object and identify the lip line in the facial model; The tooth model of the target object is spliced ​​with the tooth area of ​​the facial model to obtain the orthodontic model, wherein the tooth area is the area surrounded by the lip line; Calculate the midline position of the face model, and perform orthodontic simulation on the model to be orthodontized based on the midline position to obtain an orthodontic simulation model; Facial deformation processing is performed based on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage.

2. The method according to claim 1, wherein, The step of stitching the tooth model of the target object with the tooth region of the facial model to obtain the orthodontic model includes: A dental model of the target object is obtained, and the dental model and the facial model are obtained by scanning during the same orthodontic stage; Align the tooth regions of the dental model and the facial model; With the tooth regions of the tooth model and the facial model aligned, the tooth regions are hidden, so that the tooth model is displayed in the tooth regions; The facial model, which incorporates the dental model, is used as the model to be orthodontized.

3. The method according to claim 2, wherein, The process of aligning the tooth regions of the tooth model and the facial model includes: The scanning effect of the facial model is evaluated, and the evaluation results are obtained; If the evaluation result does not meet the preset result, semantic segmentation is performed on a single tooth in the tooth model to obtain the first segmentation result for each tooth; Semantic segmentation is performed on individual teeth in the dental region of the facial model to obtain a second segmentation result for each tooth; Align the same teeth in the first segmentation result and the second segmentation result to obtain the aligned tooth model and the facial model.

4. The method according to claim 1, wherein, The calculation of the facial midline position of the facial model includes: Identify facial feature points in the facial model, the facial feature points including first feature points located in a first part and second feature points located in a second part; The first feature point and the second feature point are fitted together to obtain the midline position of the face model.

5. The method according to claim 4, wherein, The first feature point includes the tip of the nose, the glabella, and the prechin; the second feature point consists of at least two feature points located on the same baseline and symmetrical about each other along the midline of the face, the baseline being determined based on the position of the ears.

6. The method according to claim 1, wherein, The orthodontic simulation of the model to be orthodontized based on the midline position of the face, to obtain an orthodontic simulation model, includes: Calculate the position of the tooth midline in the dental model of the model to be orthodontized; Based on the midline position of the teeth and the midline position of the face, the midline of the teeth of the dental model is aligned with the midline of the face model in the model to be orthodontized, to obtain the model after midline alignment; Orthodontic simulation is performed on the model after midline alignment to obtain an orthodontic simulation model.

7. The method according to any one of claims 1-6, wherein, The step of performing facial deformation processing based on the orthodontic simulation model to generate a facial simulation model includes: Identify the facial feature points of the facial model, divide the region to be deformed based on the facial feature points, and determine the interpolation coefficients of the region to be deformed. Extract the tooth change features from the orthodontic simulation model; Based on the tooth change characteristics and the interpolation coefficients, the deformable region in the target model is deformed to generate a facial simulation model, wherein the target model is the orthodontic simulation model or the facial model; In the case where the target model is the orthodontic simulation model, the facial simulation model also presents the changes in the teeth of the target object during the orthodontic stage.

8. The method according to claim 7, wherein, The tooth change characteristics include changes in arch width, changes in the anteroposterior position of the pre-set incisal edge of the upper central incisor, anteroposterior movement of the lower dental arch, and vertical movement of the lower dental arch. The step of deforming the region to be deformed in the target model based on the tooth change characteristics and the interpolation coefficients to generate a facial simulation model includes: Simulate the width of the cheeks after facial changes based on the changes in the dental arch width; The anterior-posterior position of the upper lip is simulated based on the anterior-posterior position change value of the preset incisal edge of the upper central incisor; The anterior and posterior positions of the lower lip are simulated based on the anterior and posterior movement values ​​of the lower dental arch; The height change of the chin is simulated based on the vertical movement value of the lower dental arch; The area to be deformed is deformed based on the interpolation coefficients, the width of the cheeks, the front-back position of the upper lip, the front-back position of the lower lip, and the height change of the chin to generate a facial simulation model. The facial changes include changes in the cheeks, the upper lip, the lower lip, and the chin.

9. An orthodontic simulation device, wherein, include: The acquisition unit is configured to acquire a facial model of a target object and identify the lip line in the facial model; The processing unit is configured to stitch the tooth model of the target object with the tooth region of the facial model to obtain the orthodontic model, wherein the tooth region is the region surrounded by the lip line; An orthodontic unit is configured to calculate the midline position of the face model and perform orthodontic simulation on the model to be orthodontized based on the midline position to obtain an orthodontic simulation model. The generation unit is configured to perform facial deformation processing based on the orthodontic simulation model to generate a facial simulation model, wherein the facial simulation model presents the facial changes of the target object during the orthodontic stage.

10. An electronic device, wherein, include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and configured to be executed by the processor to implement the orthodontic simulation method as described in any one of claims 1 to 8.

11. A computer-readable storage medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the steps of the orthodontic simulation method as described in any one of claims 1 to 8.

Images