A method, apparatus and storage medium for displaying a virtual jaw

Abstract

The present disclosure relates to a display method, device and storage medium of a virtual jaw frame. The display method of the virtual jaw frame comprises: acquiring first facial three-dimensional data, second facial three-dimensional data, tooth three-dimensional data and radiographic three-dimensional data of a patient; aligning the first facial three-dimensional data and the radiographic three-dimensional data based on the tooth three-dimensional data; extracting facial feature points from the second facial three-dimensional data and tooth arrangement feature points from the tooth three-dimensional data or the radiographic three-dimensional data; constructing a reference axis and a plurality of reference planes of the patient according to the facial feature points and the tooth arrangement feature points; and displaying a facial three-dimensional model and a virtual jaw frame of the patient on a display interface, wherein the positional relationship between the virtual jaw frame and the facial three-dimensional model is determined based on the reference axis and the plurality of reference planes. The method provided by the present disclosure can accurately transfer the occlusion relationship of the patient to the virtual jaw frame, thereby providing a reliable basis for digital restoration.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more particularly to a method, apparatus, and storage medium for displaying a virtual jaw. Background Technology

[0002] Articulators are essential instruments in dentistry used to simulate mandibular movement and fabricate prostheses. With the digital transformation of the dental industry, digital technologies are increasingly being applied to reduce costs and improve treatment capabilities. Accurately transferring a patient's bite to a virtual articulator is beneficial to the development of digital dentistry. Summary of the Invention

[0003] In a first aspect, embodiments of this disclosure provide a method for displaying a virtual jawbone, comprising: Acquire the patient's first facial 3D data, second facial 3D data, dental 3D data, and X-ray 3D data; Based on the three-dimensional dental data, the first three-dimensional facial data and the three-dimensional ray data are aligned; Facial feature points are extracted from the second facial 3D data, and dental arch feature points are extracted from the tooth 3D data or the ray 3D data; The patient's reference axis and multiple reference planes are constructed based on the facial feature points and the dental arch feature points; The display interface shows a three-dimensional facial model and a virtual jawbone, wherein the positional relationship between the virtual jawbone and the three-dimensional facial model is determined based on the reference axis and the plurality of reference planes.

[0004] Secondly, embodiments of this disclosure provide a display device for a virtual jawbone, comprising: The three-dimensional data acquisition unit is used to acquire the patient's first facial three-dimensional data, second facial three-dimensional data, dental three-dimensional data, and radiographic three-dimensional data. A data alignment unit is used to align the first facial three-dimensional data and the ray three-dimensional data based on the tooth three-dimensional data; The feature extraction unit is used to extract facial feature points from the second facial three-dimensional data and extract dental arch feature points from the tooth three-dimensional data or the ray three-dimensional data. A construction unit is used to construct the patient's reference axis and multiple reference planes based on the facial feature points and the dental arch feature points; The display unit is used to display the patient's facial 3D model and virtual jaw frame on the display interface, wherein the positional relationship between the virtual jaw frame and the facial 3D model is determined based on the reference axis and the plurality of reference planes.

[0005] Thirdly, embodiments of this disclosure provide an electronic device, including: Memory; One or more processors; and, One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing the virtual jaw display method according to the first aspect described above.

[0006] Fourthly, embodiments of this disclosure provide a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors, implement the virtual jaw display method according to the first aspect described above.

[0007] The virtual occlusal articulation display method disclosed herein includes: acquiring a patient's first facial 3D data, second facial 3D data, dental 3D data, and radiographic 3D data; aligning the first facial 3D data and radiographic 3D data based on the dental 3D data; extracting facial feature points from the second facial 3D data and extracting dental arch feature points from the dental 3D data or radiographic 3D data; constructing a patient's reference axis and multiple reference planes based on the facial feature points and dental arch feature points; and displaying the patient's facial 3D model and virtual occlusal articulation on a display interface, wherein the positional relationship between the virtual occlusal articulation and the facial 3D model is determined based on the reference axis and multiple reference planes. The method provided in this application can accurately transfer the patient's occlusal relationship to the virtual occlusal articulation, providing a reliable foundation for digital restoration. Attached Figure Description

[0008] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0009] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0010] Figure 1 A flowchart illustrating a method for displaying a virtual jawbone, provided as an exemplary embodiment of this disclosure; Figure 2 for Figure 1 A detailed flowchart of step S102 in a method for displaying a virtual jawbone is shown. Figure 3 for Figure 1 A detailed flowchart of step S104 in a method for displaying a virtual jawbone is shown. Figure 4 A schematic diagram of three-dimensional model data provided for an exemplary embodiment of this disclosure; Figure 5 Another schematic diagram of three-dimensional model data provided for an exemplary embodiment of this disclosure; Figure 6 A technical flowchart illustrating a method for displaying a virtual jawbone, provided as an exemplary embodiment of this disclosure; Figure 7 A schematic diagram of the structure of a display device for a virtual jawbone provided for an exemplary embodiment of this disclosure; Figure 8 A schematic diagram of the structure of an electronic device provided for an exemplary embodiment of this disclosure. Detailed Implementation

[0011] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0012] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0013] Specifically, an articulator is an important instrument commonly used in dentistry. It is used to simulate the patient's mandibular movements to facilitate the precise fabrication of dentures, crowns, bridges, or other restorations outside the body. With the development of computer technology, the dental industry is undergoing a digital transformation. Digital technology can effectively reduce costs and improve diagnostic and treatment capabilities. Among the key aspects, accurately transferring the patient's occlusal relationship to a virtual articulator significantly impacts the progress of digital dental development.

[0014] However, the current process of transferring a patient's occlusal relationship to a virtual articulator has the following problems: First, the transfer process lacks intuitiveness, and it is difficult to directly verify the accuracy of the transfer from the results after completion. Furthermore, the accuracy is highly dependent on the precision of measuring equipment such as facebows, and multiple transfer processes are required. Second, the operation is inefficient and lacks flexibility in adjustment. For example, the patient's occlusal relationship must first be transferred to a physical facebow, then from the physical facebow to a digital facebow, and finally matched with the patient's maxillary and mandibular occlusal relationship to determine the spatial position of the virtual articulator. If any data during the transfer process is questionable and needs adjustment, this step and several subsequent steps must be completely repeated, increasing the complexity of the operation.

[0015] This disclosure provides a method for displaying a virtual jawbone, which directly constructs the relationship between the patient's occlusion and the virtual jawbone using features of facial 3D data, dental 3D data, and ray 3D data, and displays the facial 3D data and virtual jawbone with the constructed matching relationship. The results are intuitive and the feedback is clear, allowing for quick confirmation of the matching effect from the matched 3D model.

[0016] The virtual jawbone display method provided in this disclosure is applicable to virtual jawbone display scenarios. This method can be executed by a virtual jawbone display device, which can be implemented in software and / or hardware and can be integrated into an electronic device. The electronic device can include, but is not limited to, mobile terminals such as smartphones, laptops, digital radio receivers, personal digital assistants (PDAs), tablet computers (Tablet PCs), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable devices, handheld scanning devices, etc., as well as fixed terminals such as digital televisions, desktop computers, smart home devices, fixed scanning devices, etc.

[0017] Figure 1 A flowchart illustrating a virtual jawbone display method provided for an exemplary embodiment of this disclosure, specifically including, as follows: Figure 1 The following steps are shown: S101. Obtain the patient's first facial 3D data, second facial 3D data, dental 3D data, and X-ray 3D data.

[0018] Understandably, facial 3D data is obtained by scanning the patient's face using a facial 3D scanning device. The first and second facial 3D data are acquired from the patient's face in different states. The first facial 3D data can be understood as static facial 3D data acquired by the facial 3D scanning device with markers attached to the patient's mouth or a motion target worn. Static facial 3D data refers to facial 3D data collected when the patient is in the intercuspal position (i.e., the occlusal position with the maximum contact area between the upper and lower teeth), used to characterize the patient's facial spatial morphology and occlusal relationship in the maximum intercuspal position. The second facial 3D data can be understood as resting facial 3D data acquired by the facial 3D scanning device. Resting facial 3D data refers to facial 3D data collected when the patient is in the mandibular posture position (i.e., the mandible position when the head is upright, muscles are relaxed, upper and lower teeth are naturally separated, and there is no occlusal contact), used to characterize the patient's facial spatial morphology and mandibular spatial position in the non-occlusal state. Dental 3D data is obtained by scanning the patient's teeth using an intraoral 3D scanning device. Dental 3D data refers to 3D morphological data containing the patient's maxillary and / or mandibular dentition, used to characterize the patient's tooth arrangement and occlusal relationship. In some examples, the 3D dental data also includes the gingiva. For better virtual jaw transfer, the patient's 3D radiographic data (e.g., DICOM data) can also be acquired. DICOM data refers to medical imaging data that conforms to the Digital Imaging and Communications in Medicine standard. In dentistry, it can be acquired using computed tomography (CT) or cone-beam computed tomography (CBCT) equipment. It is used to characterize the spatial morphological information of the patient's hard tissue structures such as the jawbone, alveolar bone, tooth roots, and dentition. For example, 3D radiographic data can be obtained by irradiating the patient's head with CT or CBCT.

[0019] S102. Based on the three-dimensional data of the teeth, align the first three-dimensional facial data and the three-dimensional ray data.

[0020] It is understandable that, using the spatial position of the three-dimensional tooth data as a reference, the three-dimensional facial data and the ray three-dimensional data are matched to the same spatial position, thus aligning the three-dimensional tooth data, the three-dimensional facial data, and the ray three-dimensional data. For example, point cloud registration algorithms (such as the iterative nearest point algorithm) can be used to align the above three types of three-dimensional data, so as to incorporate the facial soft tissue morphology and dental hard tissue morphology in the patient's occlusal state into the same spatial coordinate system, providing a precise registration basis for subsequent construction of reference benchmarks and determination of the relative positional relationship between the virtual articulator and the facial three-dimensional data.

[0021] S103. Extract facial feature points from the second facial 3D data, and extract dental arch feature points from the tooth 3D data or ray 3D data.

[0022] In some examples, facial feature points are anatomically significant landmarks in the 3D facial model, including but not limited to the corners of the mouth, nasal alae, tragus, eyebrows, infraorbital points, and condylar points. Dental arch feature points are extracted from dental 3D data or ray 3D data. In some examples, dental arch feature points are anatomically significant landmarks in the dental arch 3D data, including but not limited to incisal endpoints. For example, facial feature points can be extracted from the second facial 3D data, and dental arch feature points can be extracted from the dental 3D data or ray 3D data, respectively, through curvature analysis, feature recognition algorithms, or manual interactive selection.

[0023] S104. Construct the patient's reference axis and multiple reference planes based on facial feature points and dental arch feature points.

[0024] In some examples, a reference benchmark for the patient's face is constructed using facial feature points and dental arch feature points. This benchmark can be understood as a spatial geometric reference system generated based on the fitted facial and dental arch feature points, used to determine the relative positional relationship between the 3D facial model and the virtual jawbone. The reference benchmark includes multiple reference planes and reference axes for establishing spatial positioning. By constructing this reference benchmark, a geometric reference system can be established in a 3D coordinate system. This system uses the patient's own anatomical features as a reference, incorporating facial soft tissues and hard tissues such as bones (e.g., mandibles and jaws), and dental arches into a unified reference framework.

[0025] S105. Display the patient's three-dimensional facial model and virtual jaw frame on the display interface.

[0026] The positional relationship between the virtual jaw frame and the 3D facial model is determined based on a reference axis and multiple reference planes.

[0027] In some examples, the 3D facial model is constructed based on first 3D facial data (acquired when the patient is in an intercuspal position) and / or second 3D facial data (acquired when the patient is in a mandibular posture position), used to present the patient's realistic facial shape and spatial posture in the display interface. In other examples, the 3D facial model is constructed based on third 3D facial data obtained at a different time and / or in a different state. The virtual articulator is a digitally constructed 3D model of a simulated mechanical articulator used to simulate the patient's mandibular movement trajectory and occlusal relationship. It contains adjustable condylar guides, incisal guides, and other parametric structures to reproduce the patient's jaw position in a virtual environment. The positional relationship between the virtual articulator and the 3D facial model is determined based on a reference axis and multiple reference planes. That is, the spatial position and posture of the virtual articulator are associated with the 3D facial model based on the reference axis and multiple reference planes, accurately transferring the patient's occlusal relationship to the virtual articulator. For example, by aligning the hinge axis of the virtual jawbone with the reference axis, matching the jawbone plane (e.g., the maxillary body floor plane) of the virtual jawbone with the reference plane (e.g., the orbitoauricular plane or the occlusal plane), and matching the midpoint of the incisor pin and condylar rod of the virtual jawbone with the midsagittal plane, the precise spatial position of the virtual jawbone relative to the three-dimensional facial model can be determined.

[0028] In other examples, a 3D model of teeth and a 3D model of rays are displayed on the 3D model of the face on the display interface. The 3D model of teeth can be obtained from the 3D data of teeth mentioned above, and the 3D model of rays can be obtained from the 3D data of rays mentioned above. This allows for the analysis of the effect of transferring the patient's occlusal relationship to the virtual articulator by viewing the relative positional relationship of the 3D model of the virtual articulator, the 3D model of the patient's face, the 3D model of teeth, and the 3D model of rays.

[0029] This disclosure provides a method for displaying a virtual jawbone, aiming to address the problems in related technologies where the transfer process of occlusal relationships to a virtual jawbone is not intuitive, its accuracy is overly dependent on physical equipment and difficult to verify, and its operation efficiency is low with poor adjustment flexibility. First, multi-source data is acquired, including first-source three-dimensional facial data of the patient in an intercuspal position, second-source three-dimensional facial data of the patient in a mandibular posture, three-dimensional dental data obtained through intraoral scanning, and three-dimensional radiographic data obtained through CT or CBCT. Based on the alignment of the multi-source data, facial feature points are extracted from the second-source three-dimensional facial data, and dental arch feature points are extracted from the radiographic or dental three-dimensional data. Subsequently, reference axes and multiple reference planes are constructed based on these feature points. Finally, the patient's three-dimensional facial model and the virtual jawbone are displayed on a display interface, and the spatial positional relationship between the virtual jawbone and the three-dimensional facial model is determined based on the constructed reference axes and reference planes, thus achieving a visual display of the occlusal relationship transfer results.

[0030] Figure 2 for Figure 1The diagram illustrates a detailed process flow of S102 in a virtual jawbone display method. Optionally, based on the three-dimensional dental data, the first facial three-dimensional data and the ray three-dimensional data are aligned, specifically including, as shown below. Figure 2 The following steps are shown: In some examples, the first facial 3D data is acquired when the patient's teeth are attached with marking attachments, and the tooth 3D data includes the first tooth 3D data acquired when the patient's teeth are attached with marking attachments and the second tooth 3D data acquired when the patient's teeth are not attached with marking attachments.

[0031] It can be understood that the first facial 3D data is static facial 3D data collected when the patient is wearing a marker attachment, where the marker attachment can be a moving target. The second facial 3D data is static facial 3D data collected without wearing a moving target. Correspondingly, the dental 3D data includes the first dental 3D data collected when the patient is wearing a moving target and the second dental 3D data collected when the patient is not wearing a moving target.

[0032] S201. Align the first facial 3D data and the first tooth 3D data based on the marker attachment.

[0033] It is understandable that the first facial 3D data records the morphology of facial soft tissues and the spatial position of the motion target in the patient's occlusal state, while the first dental 3D data records the spatial position of the patient's dentition and the motion target. Since both the first facial 3D data and the first dental 3D data contain motion targets, precise alignment between the first facial 3D data and the first dental 3D data can be achieved by identifying the spatial position of the motion targets.

[0034] In some examples, the first three-dimensional data of the teeth wearing the motion target is used as a reference for matching, and other three-dimensional facial data are also matched to the same position based on the static three-dimensional facial data that is matched with the first three-dimensional data. For example, the other three-dimensional facial data is the second three-dimensional facial data.

[0035] S202. Align the 3D ray data and the 3D tooth data based on tooth features.

[0036] Understandably, the second tooth's three-dimensional data records the true morphology of the patient's dentition, without the influence of motion targets, and is used to subsequently construct precise dentition feature points and occlusal planes.

[0037] In some examples, shared tooth features between the 3D ray data (DICOM data) and the second tooth 3D data are used as the registration basis, and spatial alignment is achieved through feature matching algorithms. These tooth features include, but are not limited to, the geometric morphology of the crown surface (e.g., cusps, incisal edges, pits, marginal ridges, etc.) and the spatial arrangement of teeth. Furthermore, since both the first and second facial 3D data were acquired using an intraoral 3D scanning device under different patient conditions (whether or not the patient is wearing a motion target), they use the same scanning device, the same scanning principle, and the same scanning coordinate system. Therefore, the first tooth 3D data (acquired when the patient's teeth are attached with marker attachments) and the second tooth 3D data (acquired when the patient's teeth are not attached with marker attachments) are naturally in the same spatial coordinate system, requiring no additional registration or alignment. Based on this, the first facial 3D data, the first tooth 3D data, the second tooth 3D data, and the ray 3D data can be incorporated into the same spatial coordinate system, achieving precise alignment of the facial 3D data, tooth 3D data, and ray 3D data.

[0038] Understandably, this embodiment achieves high-precision alignment between facial 3D data and dental 3D data by using marker attachments as a common reference. The marker attachments provide clear, automatically identifiable registration features, avoiding registration errors caused by indirect matching based on soft and hard tissue morphology. Furthermore, by separately acquiring 3D dental data with and without marker attachments, the accuracy of the registration process is ensured, and the final dentition data used for occlusal analysis reflects the patient's true morphology, unaffected by the marker attachments. This provides a high-quality data foundation for subsequent construction of reference benchmarks and transfer of occlusal relationships.

[0039] In another embodiment, the first facial three-dimensional data is acquired when multiple optical markers are bonded to the patient's teeth, and the three-dimensional tooth data includes the third three-dimensional tooth data acquired when multiple optical markers are bonded to the patient's oral cavity.

[0040] It can be understood that the first facial 3D data is the static facial 3D model data collected when the patient attaches the markers (optical markers). Correspondingly, the third tooth 3D data includes the tooth 3D data collected when the patient attaches the markers. Among them, the optical markers are positioning markers that can be directly adhered to the surface of the patient's teeth. They have specific geometric shapes or reflective properties and can be accurately identified and have their spatial positions captured by 3D scanning equipment (such as facial scanning equipment and intraoral scanning equipment).

[0041] Optionally, based on the dental 3D data, the first facial 3D data and the ray 3D data are aligned, including: Align the first facial 3D data and the third tooth 3D data based on multiple optical markers; align the ray 3D data and the third tooth 3D data based on tooth features.

[0042] Understandably, the first facial 3D data simultaneously records the patient's facial soft tissue morphology and the spatial position of optical markers in the facial coordinate system. The third dental 3D data also simultaneously records the patient's dental arch morphology and the spatial position of optical markers in the dental coordinate system. Subsequently, the first facial 3D data and the third dental 3D data are aligned by identifying identical optical markers. For example, this can be achieved by calculating the spatial transformation matrix between the facial coordinate system and the dental coordinate system, or by calculating the spatial transformation matrix between the facial scanning coordinate system and the intraoral scanning coordinate system.

[0043] In some examples, the shared tooth morphological features between the ray 3D data and the third tooth 3D data are used as the registration basis, and spatial alignment between the two is achieved through a feature matching algorithm. Simultaneously, since the third tooth 3D data has already been aligned with the first facial 3D data based on optical markers, the ray 3D data is further incorporated into the same coordinate system, ultimately achieving multi-source data unification of facial 3D data, tooth 3D data, and DICOM data (ray 3D data).

[0044] Understandably, this embodiment simplifies the data acquisition process by directly bonding optical markers to the tooth surface, while maintaining registration accuracy. On one hand, it eliminates the need for additional marker attachments, reducing operational complexity and material costs. On the other hand, it only requires acquiring three-dimensional tooth data once (i.e., the third three-dimensional data of the tooth at the time of optical marker bonding), reducing the number of times the patient needs to open their mouth for scanning, thus improving the convenience of clinical operation and patient comfort. Simultaneously, because the optical markers are directly bonded to the tooth surface, their spatial relationship with the dentition is more stable, further improving the accuracy and reliability of registration.

[0045] In some examples, various alignment methods can be used to achieve precise alignment of facial 3D data, dental 3D data, and ray 3D data. For instance, after achieving precise alignment of the three types of data by wearing a motion target, the aligned data can be adjusted by pasting marker points. Other possible alignment methods will not be elaborated here.

[0046] The present invention discloses a method for displaying a virtual jawbone, which enables the precise fusion of multiple sources of data, such as facial 3D data, dental 3D data, and radiographic 3D data (DICOM data), in the same spatial coordinate system. This provides a unified and complete data foundation for the subsequent construction of reference benchmarks and the accurate transfer of occlusal relationships to the virtual jawbone.

[0047] Figure 3 for Figure 1The diagram illustrates a detailed process flow of S104 in a virtual articulation display method. Optionally, a reference axis and multiple reference planes for the patient are constructed based on facial feature points and dental arch feature points, specifically including, for example... Figure 3 The following steps are shown: S301. Extract the first part of facial feature points from the second facial 3D data.

[0048] The first part of the facial feature points includes the left and right tragus points, the left and right infraorbital points, and / or the left and right nasal alar points.

[0049] In one embodiment, all facial feature points are obtained from the second facial 3D data (resting facial 3D data) using an intelligent recognition algorithm. The facial feature points include the left and right tragus points, the left and right infraorbital points, the left and right nasal alar points, the left and right corners of the mouth points, the left and right eyebrow points, and the left and right condylar points.

[0050] In another embodiment, all facial feature points are obtained from the second facial 3D data and the ray 3D data using an intelligent recognition algorithm. Specifically, a portion of facial feature points are obtained from the second facial 3D data, denoted as the first part of facial features. The first part of facial features includes the left and right tragus points and the left and right infraorbital points, the left and right tragus points and the left and right alar points, or the left and right tragus points, the left and right infraorbital points, and the left and right alar points.

[0051] S302. Extract the second part of facial feature points from the 3D ray data.

[0052] The second part of the facial feature points includes the left and right condylar points.

[0053] Understandably, another set of facial feature points can be obtained from the 3D ray data, denoted as the second set of facial feature points. This second set includes the left and right condylar points. Additionally, the left and right corners of the mouth and the left and right eyebrows can be obtained from the first set of facial feature points.

[0054] S303. Construct multiple reference planes based on the facial feature points and dental arch feature points in the first part.

[0055] Among them, the dental arch feature points include the incisal endpoints.

[0056] Understandably, the first set of facial feature points is used to characterize key anatomical landmarks of the facial soft tissues. Dental feature points include incisal endpoints, used to characterize the incisal edge position of the maxillary or mandibular central incisors.

[0057] In some examples, multiple reference planes are constructed based on the first facial feature point and the dental arch feature point. That is, the reference plane is constructed by combining the facial soft tissue feature points with the dental arch feature points. This takes advantage of the fact that the facial feature points are consistent with the clinical facebow transfer habits, making it easy for doctors to understand and operate. At the same time, the precise hard tissue landmark of the dental arch feature points is introduced to ensure that the construction of the occlusal plane can truly reflect the patient's occlusal function status.

[0058] The multiple reference planes include a vertical cross-section and a horizontal cross-section. The vertical cross-section is the patient's midsagittal plane, and the horizontal cross-section is determined from the patient's orbitoauricular plane and nasolabial plane based on the patient's oral restoration type.

[0059] Understandably, multiple reference planes include vertical and horizontal cross-sections. The vertical cross-section is the patient's midsagittal plane, used as a reference benchmark to characterize the left-right symmetry of the patient's face. The horizontal cross-section is determined from the patient's orbitoauricular plane and nasolabial plane based on the type of oral restoration. For example, for anterior cases requiring aesthetic restoration, the nasolabial plane is preferred as the horizontal cross-section because it is closer to the aesthetic reference line in a natural head position; for posterior cases requiring functional restoration or full-mouth restoration, the orbitoauricular plane is preferred as the horizontal cross-section because it is consistent with the anatomical horizontal plane, facilitating matching with the standard parameters of the articulator system.

[0060] S304. Construct a reference axis based on the facial feature points in the second part.

[0061] Understandably, the line connecting the left and right condylar points can be used as a reference axis, which can be understood as a hinge axis.

[0062] Optionally, a reference axis and multiple reference planes for the patient can be constructed based on facial feature points and dental arch feature points, including: The orbitoauricular plane is obtained by fitting the left and right tragus points and the left and right infraorbital points, and the normal of the orbitoauricular plane is corrected to be parallel to the reference axis; the nasolabial plane is obtained by fitting the left and right tragus points and the left and right alar points, and the normal of the nasolabial plane is corrected to be parallel to the reference axis; the reference axis is used as the normal of the midsagittal plane, and the midsagittal plane is corrected to pass through the dental arch feature points.

[0063] Understandably, by fitting the left and right tragus points and the left and right infraorbital points, the first plane position and normal of the orbitoauricular plane are obtained, and the orbitoauricular plane is corrected to be parallel to the hinge axis. Similarly, by fitting the left and right alar points and the left and right tragus points, the second plane position and normal of the alar-alar plane are obtained, and the alar-alar plane is corrected to be parallel to the hinge axis. The hinge axis is then used as the normal of the third plane in the midsagittal plane, and its position is determined by passing through the tangent endpoint.

[0064] Figure 4 Figure 410 shows three-dimensional model data for an exemplary embodiment of this disclosure. Figure 420 shows facial feature points extracted from two facial three-dimensional data. Figure 430 shows the incision points extracted from three-dimensional tooth data. Figure 440 shows the reference axis determined based on the left and right condylar points obtained from DICOM data. Figure 450 shows the incision points obtained from DICOM data.

[0065] Optionally, before displaying the patient's 3D facial model and virtual jawbone on the display interface, the following steps are also included: Based on the horizontal cross-section, determine the jaw plane of the virtual jaw frame; align the hinge axis of the virtual jaw frame to the straight line of the reference axis to determine the spatial orientation of the hinge axis; align the midpoint of the incisor and condylar rod of the virtual jaw frame to the midsagittal plane to determine the centric relationship of the virtual jaw frame.

[0066] Understandably, the virtual articulator's plane is determined by aligning it parallel to either the orbital-auricular plane or the nasal-auricular plane in the horizontal cross-section. Users can choose to align the articulator plane with either the orbital-auricular plane or the nasal-auricular plane, or select the plane based on the type and purpose of the articulator. For example, patients with complete dentures or complex jaw reconstruction typically need to use the orbital-auricular plane as a reference plane, while patients with conventional restorations and natural dentition can use the nasal-auricular plane. The final choice requires the user to consider the patient's specific situation and restorative experience, which will not be elaborated upon here. Subsequently, the virtual articulator's hinge axis is aligned with the reference axis formed by connecting the patient's left and right condylar points, thus determining the spatial orientation of the virtual articulator's hinge axis. Next, align the midpoints of the incisal guide pin and condylar rod of the virtual articulator with the patient's midsagittal plane to determine the centric relationship of the virtual articulator. The incisal guide pin is the contact component in the virtual articulator corresponding to the incisal guide disc (incisal guide ramp), used to simulate the control of mandibular movement trajectory by incisor guidance during mandibular protrusion and lateral movements. The condylar rod is the component in the virtual articulator corresponding to the condyle, used to simulate the movement trajectory of the mandibular condyle within the temporomandibular joint fossa. Based on this, determine a set of spatial positions and postures of the virtual articulator, accurately transferring the patient's occlusal relationship onto the virtual articulator.

[0067] For example, see Figure 5 , Figure 5 Another three-dimensional model schematic diagram provided for an exemplary embodiment of this disclosure. Figure 5The diagram illustrates the positional relationship between the virtual articulator and the 3D facial model. The condylar rod corresponds to the hinge axis and is the rotation center for the mandibular opening and closing movements. The incisor guide pin is the vertical rod at the front of the articulator, used to control the vertical distance between the upper and lower jaws and the incisor guide angle. Users can intuitively analyze the effect of transferring the patient's occlusal relationship to the virtual articulator by viewing the relative positional relationships of the virtual articulator image, the patient's facial image, the dental image, and the DICOM image.

[0068] Optionally, the virtual jawbone is configured as follows: In response to adjusting one or more of the dental arch feature points, facial feature points, and reference planes, the positional relationship between the virtual articulator and the 3D facial model is changed.

[0069] Understandably, after displaying images of the 3D facial model and the virtual jawbone in a unified spatial coordinate system, users can evaluate the matching effect based on the current image. If the position of a certain feature point needs adjustment, the relevant target feature point or target reference plane can be directly selected for adjustment. After the target feature point is adjusted, its associated other feature points and other reference planes will be linked, and the spatial position of the virtual jawbone will be recalculated and the image updated to the latest calculated position, changing the positional relationship between the virtual jawbone and the 3D facial model so that users can intuitively see the positional change of the virtual jawbone before and after adjustment. In other words, the positional relationship between the patient's bite and the virtual jawbone can be adjusted by adjusting features, and the user's adjustments to features can be fed back to the spatial position of the virtual jawbone image in real time. This method is efficient and easy to use; users can quickly obtain the adjusted results without complicated procedures after fine-tuning features.

[0070] In one embodiment, the user can manually adjust the identified feature points and reference planes within the interactive interface. Specifically, the user can choose to adjust the condylar points on facial 3D data or DICOM data. The condylar points can be moved on the surface of the facial or DICOM 3D model. When adjusting the condylar points, each reference plane needs to be recalculated. The user can also choose to adjust the reference planes on dental 3D data or DICOM data. During adjustment, the incisal endpoints can be moved on the surface of the jaw or DICOM 3D model. When adjusting the incisal endpoints, the midsagittal plane also needs to be recalculated. When a feature point is adjusted, the reference planes are recalculated based on the new feature point position. After the feature point is confirmed, the user can continue to adjust the reference planes using the plane interactive tool. For example, to adjust the orbitoauricular plane, the user can use the plane interactive tool to translate the orbitoauricular plane along its normal direction or rotate it around the hinge axis. The user can also adjust the nasal auricular plane, using the plane interactive tool to translate the nasal auricular plane along its normal direction or rotate it around the hinge axis. To adjust the median sagittal plane, the user can use the plane interactor to translate the median sagittal plane along its normal.

[0071] Understandably, the adjusted feature points are displayed in real-time on the patient's facial 3D model or DICOM model. For example, the adjusted reference plane is displayed semi-transparently at the corresponding position. When making adjustments, the user can intuitively see the precise positional relationship between each feature point, each reference plane, and each 3D model of the patient in real time, and quickly obtain the matching results from the matched images. This allows for an accurate evaluation of the matching results, making the feedback clearer. Subsequent fine-tuning of features by the user can quickly obtain the adjusted results without complicated procedures, resulting in high operational efficiency and ease of use.

[0072] Understandably, it also provides undo, rollback, and reset functions. If a user accidentally manipulates a feature point or reference plane, they can use the restore function to prevent the adjusted position from being accidentally modified.

[0073] Understandably, after the user adjusts the spatial position of the virtual jaw frame, the current position of the virtual jaw frame relative to the original virtual jaw frame will be recorded in a file in the form of a transformation matrix. This can be imported into relevant analysis software for analysis or used to guide the transfer of the physical jaw frame.

[0074] The virtual jawbone display method provided in this disclosure constructs multiple reference planes, including both a vertical cross-section (midsagittal plane) for determining left-right symmetry and a horizontal cross-section that can be flexibly selected according to the type of restoration. This selectable horizontal reference plane setting allows the subsequent positioning of the virtual jawbone to adapt to different restoration needs, improving clinical adaptability and flexibility.

[0075] Based on the above embodiments, Figure 6 A technical flowchart illustrating a virtual jawbone display method provided for an exemplary embodiment of this disclosure specifically includes, as follows: Figure 6 The following steps are shown: 1) Data Processing: Acquisition, import, and stitching of facial 3D data, dental and jaw 3D data, and jawbone DICOM data; 2) Feature Extraction and Creation: Extracting facial feature points from the facial 3D data and jawbone DICOM data, extracting incisor points from the dental and jaw 3D data and jawbone DICOM data, and creating reference planes and reference axes based on the feature points extracted from the facial 3D data, jawbone DICOM data, and dental and jaw 3D data; 3) Virtual Articulation and Feature Matching: Determining the hinge axis of the virtual articulation based on the reference axis, determining the articulation plane of the virtual articulation based on the virtual plane, determining the centric relationship of the virtual articulation based on the reference plane and incisor points, and matching and displaying the virtual articulation with the patient image; 4) Feature Fine-tuning: Adjusting the left and right condylar points and / or adjusting the incisor points, recalculating the reference plane, adjusting the reference plane, and re-matching the virtual articulation with the features.

[0076] Figure 7This is a schematic diagram of a virtual jawbone display device provided for an exemplary embodiment of the present disclosure. The virtual jawbone display device provided in this embodiment can execute the processing flow provided in the virtual jawbone display method embodiment, such as... Figure 7 As shown, the virtual jawbone display device 700 includes: The three-dimensional data acquisition unit 701 is used to acquire the patient's first facial three-dimensional data, second facial three-dimensional data, dental three-dimensional data, and radiographic three-dimensional data. Data alignment unit 702 is used to align first facial three-dimensional data and ray three-dimensional data based on dental three-dimensional data; The feature extraction unit 703 is used to extract facial feature points from the second facial three-dimensional data and extract dental row feature points from the tooth three-dimensional data or ray three-dimensional data. Construction unit 704 is used to construct the patient's reference axis and multiple reference planes based on facial feature points and dental arch feature points; Display unit 705 is used to display a three-dimensional facial model and a virtual jawbone on a display interface, wherein the positional relationship between the virtual jawbone and the three-dimensional facial model is determined based on a reference axis and multiple reference planes.

[0077] The virtual jawbone is configured as follows: In response to adjusting one or more of the dental arch feature points, facial feature points, and reference planes, the positional relationship between the virtual articulator and the 3D facial model is changed.

[0078] The first facial 3D data was acquired when the patient's teeth were attached with marking attachments, which included multiple optical markers. The tooth 3D data included the first tooth 3D data acquired when the patient's teeth were attached with marking attachments and the second tooth 3D data acquired when the marking attachments were not attached.

[0079] Optionally, the data alignment unit 702 is used for: Align the first facial 3D data and the first tooth 3D data based on the marker attachments; Align the 3D data of the ray and the 3D data of the second tooth based on tooth features.

[0080] The first facial 3D data was acquired when multiple optical markers were bonded to the patient's teeth, and the third tooth 3D data was acquired when multiple optical markers were bonded to the patient's oral cavity.

[0081] Optionally, the data alignment unit 702 is used for: Align the first facial 3D data and the third tooth 3D data based on multiple optical markers; Align the 3D data of the ray and the 3D data of the third tooth based on tooth features.

[0082] Specifically, a first part of facial feature points is extracted from the second part of the three-dimensional facial data, and a second part of facial feature points is extracted from the ray three-dimensional data. Multiple reference planes are constructed based on the first part of the facial feature points and the dental arch feature points, and a reference axis is constructed based on the second part of the facial feature points. The first part of the facial feature points includes the left and right tragus points, the left and right infraorbital points and / or the left and right nasal alar points, and the second part of the facial feature points includes the left and right condylar points.

[0083] The multiple reference planes include a vertical cross-section and a horizontal cross-section. The vertical cross-section is the patient's midsagittal plane, and the horizontal cross-section is determined from the patient's orbital-auricular plane and nasal-auricular plane based on the patient's oral restoration type.

[0084] Optionally, building block 704 is used for: The reference axis is determined based on the left and right condylar prominences; The orbitoauricular plane is obtained by fitting the left and right tragus points and the left and right infraorbital points, and the normal of the orbitoauricular plane is corrected to be parallel to the reference axis. The alar plane is obtained by fitting the left and right tragus points and the left and right alar points, and the normal of the alar plane is corrected to be parallel to the reference axis. The reference axis is taken as the normal to the midsagittal plane, and the midsagittal plane is corrected to pass through the dental arch feature points.

[0085] The virtual jawbone display device 700 is also used for: Determine the jaw plane of the virtual jaw arch based on the horizontal cross-section; Align the hinge axis of the virtual jaw with the straight line of the reference axis to determine the spatial orientation of the hinge axis; Align the midpoints of the incisor pins and condylar rods of the virtual jawbone frame to the midsagittal plane to determine the midline relationship of the virtual jawbone frame.

[0086] The virtual jawbone display device 700 is also used for: Based on the alignment relationship between the three-dimensional data of teeth and the three-dimensional data of the first face, the three-dimensional data of the second face is aligned with the three-dimensional data of teeth.

[0087] Among them, the dental arch feature points include the incisal endpoints.

[0088] The three-dimensional X-ray data includes scan data obtained from computed tomography (CT) or cone-beam computed tomography (CBCT).

[0089] The virtual jawbone display device 700 is also used for: The three-dimensional models of teeth and rays are displayed on the three-dimensional facial model on the display interface. The three-dimensional model of teeth is constructed based on three-dimensional tooth data, and the three-dimensional model of rays is constructed based on three-dimensional ray data.

[0090] Figure 7 The virtual jaw frame display device of the illustrated embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0091] Figure 8 This is a schematic diagram of the structure of an electronic device provided as an exemplary embodiment of the present disclosure. See below for details. Figure 7 The diagram illustrates a structural schematic suitable for implementing the electronic device 800 in the embodiments of this disclosure. The electronic device 800 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable electronic devices, etc., as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc. Figure 7 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0092] like Figure 7 As shown, the electronic device 800 may include a processing device 801 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803 to implement a virtual chin display method as described in the embodiments of this disclosure. The RAM 803 also stores various programs and data required for the operation of the electronic device 800. The processing device 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0093] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 809. Communication device 809 allows electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 7 An electronic device 800 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0094] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts, thereby implementing the virtual jaw display method described above. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by the processing device 801, it performs the functions defined above in the methods of embodiments of this disclosure.

[0095] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0096] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0097] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0098] Optionally, when one or more of the above-described procedures are executed by the electronic device, the electronic device may also execute other steps of the above embodiments.

[0099] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0100] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0101] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0102] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0103] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0104] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or gateway that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or gateway. Without further limitations, an element defined by the phrase "comprising a display of a virtual jaw" does not exclude the presence of other identical elements in the process, method, article, or gateway that includes the element.

[0105] The above are merely specific embodiments of this disclosure, enabling those skilled in the art to understand or implement this disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to these embodiments, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for displaying a virtual jawbone, comprising: Acquire the patient's first facial 3D data, second facial 3D data, dental 3D data, and X-ray 3D data; Based on the three-dimensional dental data, the first three-dimensional facial data and the three-dimensional ray data are aligned; Facial feature points are extracted from the second facial 3D data, and dental arch feature points are extracted from the tooth 3D data or the ray 3D data; The patient's reference axis and multiple reference planes are constructed based on the facial feature points and the dental arch feature points; The display interface shows a three-dimensional facial model and a virtual jawbone, wherein the positional relationship between the virtual jawbone and the three-dimensional facial model is determined based on the reference axis and the plurality of reference planes.

2. The method according to claim 1, wherein, The virtual jawbone is configured as follows: In response to adjusting one or more of the dental arch feature points, the facial feature points, and the reference plane, the positional relationship between the virtual articulator and the three-dimensional facial model is changed.

3. The method according to claim 1, wherein, The first facial 3D data is acquired when the patient's teeth are attached with a marking attachment, the marking attachment including multiple optical markers. The tooth 3D data includes first tooth 3D data acquired when the patient's teeth are attached with the marking attachment and second tooth 3D data acquired when the marking attachment is not attached. Based on the tooth 3D data, the first facial 3D data and the ray 3D data are aligned, including: The first facial 3D data and the first tooth 3D data are aligned based on the marked attachments; The 3D data of the ray and the 3D data of the second tooth are aligned based on the tooth features.

4. The method according to claim 1, wherein, The first facial 3D data was acquired when multiple optical markers were bonded to the patient's teeth. The tooth 3D data includes a third set of tooth 3D data acquired when the multiple optical markers were bonded to the patient's oral cavity. Based on the tooth 3D data, the first facial 3D data and the ray 3D data are aligned, including: The first facial 3D data and the third tooth 3D data are aligned based on the plurality of optical markers; The 3D data of the ray and the 3D data of the third tooth are aligned based on tooth features.

5. The method according to claim 1, wherein, A first part of facial feature points is extracted from the second facial 3D data, a second part of facial feature points is extracted from the ray 3D data, the plurality of reference planes are constructed based on the first part of facial feature points and the dental arch feature points, and the reference axis is constructed based on the second part of facial feature points. The first part of facial feature points includes left and right tragus points, left and right infraorbital points and / or left and right nasal alar points, and the second part of facial feature points includes left and right condylar points.

6. The method according to claim 5, wherein, The plurality of reference planes includes a vertical cross-section and a horizontal cross-section, wherein the vertical cross-section is the patient's midsagittal plane, and the horizontal cross-section is determined from the patient's orbitoauricular plane and nasolabial plane based on the patient's oral restoration type. The construction of the patient's reference axis and plurality of reference planes based on the facial feature points and the dental arch feature points includes: The reference axis is determined based on the left and right condylar protrusions; The orbitoauricular plane is obtained by fitting the left and right tragus points and the left and right infraorbital points, and the normal of the orbitoauricular plane is corrected to be parallel to the reference axis. The nasal alar plane is obtained by fitting the left and right tragus points and the left and right nasal alar points, and the normal of the nasal alar plane is corrected to be parallel to the reference axis. The reference axis is used as the normal to the median sagittal plane, and the median sagittal plane is corrected to pass through the dental arch feature points.

7. The method according to claim 6, wherein, Before displaying the patient's three-dimensional facial model and virtual jawbone on the display interface, the method further includes: The jaw plane of the virtual jaw is determined based on the horizontal cross-section; Align the hinge axis of the virtual jaw frame with the straight line where the reference axis is located to determine the spatial orientation of the hinge axis; Align the midpoints of the incision guide pin and condylar rod of the virtual jaw frame with the midsagittal plane to determine the midline relationship of the virtual jaw frame.

8. The method according to claim 1, further comprising: Based on the alignment relationship between the three-dimensional tooth data and the first three-dimensional facial data, the second three-dimensional facial data and the three-dimensional tooth data are aligned.

9. The method according to claim 1, wherein, The dental arch feature points include the incisal endpoints.

10. The method according to claim 1, wherein, The three-dimensional X-ray data includes scan data obtained from computed tomography (CT) or cone-beam computed tomography (CBCT).

11. The method according to claim 1, further comprising: A three-dimensional model of teeth and a three-dimensional model of rays are displayed on the three-dimensional model of the face on the display interface, wherein the three-dimensional model of teeth is constructed based on the three-dimensional data of teeth, and the three-dimensional model of rays is constructed based on the three-dimensional data of rays.

12. An electronic device, comprising: Memory; One or more processors; as well as, One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing a display method of a virtual jawbone according to any one of claims 1 to 11.

13. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors, implement the method for displaying a virtual jaw frame according to any one of claims 1 to 11.

Images