Model generation method, electronic equipment and storage medium
By acquiring and splicing the three-dimensional plaster model and the three-dimensional impression model, the target three-dimensional model is generated, which solves the problem that the three-dimensional plaster model cannot truly reflect the object area, and achieves the generation of a three-dimensional model with high accuracy and good presentation effect.
Patent Information
- Application Number
- CN202411638939.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-01-21
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The three-dimensional gypsum model cannot truly reflect various areas of the object, or if scanning the three-dimensional gypsum model, there will be problems that some areas are unclearly scanned, resulting in the inability to generate a complete three-dimensional model of the true shape of the reacting object.
By obtaining the three-dimensional plaster model and the three-dimensional impression model, the area of interest is determined, the area is expanded to determine the area to be spliced, and the model is spliced and fused to generate the target three-dimensional model.
It realizes the rapid generation of a complete three-dimensional model that reflects the true shape of the target object. It has high accuracy and good presentation effect on the area of interest, and avoids the problem in the existing technology that the object area cannot be truly reflected.
Smart Images
Figure CN119338998A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of scanning processing technology, and in particular to a model generation method, an electronic device and a storage medium. Background Art
[0002] 3D scanning is widely used in product design and manufacturing. Among them, 3D scanning of a 3D plaster model of an object can be used for dental restoration design or industrial product design. However, the 3D plaster model cannot truly reflect each area of the object or scanning of the 3D plaster model may result in unclear scanning of some areas, resulting in the inability to generate a complete 3D model that reflects the true shape of the object.
[0003] For example: tooth restoration design includes post-core crown, inlay, full crown, denture, bite plate, dental implant, etc. Among them, in the root canal treatment plan of teeth, the post-core plaster and post-core impression can be scanned, and the post-core crown can be made based on the scanned data. Root canal treatment is a common way to treat pulp disease and periapical periodontitis. In the root canal, the "load-bearing column" of the entire restoration is called a "post". It is fixed on the post and together with the remaining hard tissue of the tooth to form a preparation body that is convenient for the retention of the full crown, which is called a core. While retaining, the "post" can also transmit the external force from the crown, core and the remaining hard tissue of the crown. Usually, by adding a post and core, support and retention can be provided for the full crown, and a full crown restoration can be performed on this basis. However, due to the narrow post channel, it is difficult to clearly scan the shape of the post channel.
[0004] Similarly, for some industrial products, there is also the problem of difficulty in scanning some holes. Summary of the invention
[0005] The embodiments of the present application provide a model generation method, an electronic device, and a storage medium, which can quickly generate a complete target three-dimensional model reflecting the true shape of the target object based on a three-dimensional plaster model and a three-dimensional impression model. The target three-dimensional model has high accuracy and good presentation effect of the true shape of the target object's area of interest.
[0006] In a first aspect, an embodiment of the present application provides a model generation method, the method comprising: obtaining a three-dimensional plaster model and a three-dimensional impression model of a target object; determining an area of interest in the three-dimensional impression model; expanding the area of interest to determine an area to be spliced in the three-dimensional impression model; splicing the three-dimensional plaster model with the area to be spliced in the three-dimensional impression model to obtain splicing data, and determining whether the three-dimensional plaster model matches the three-dimensional impression model based on the splicing data; when it is determined that the three-dimensional plaster model matches the three-dimensional impression model, fusing the three-dimensional plaster model with the three-dimensional impression model based on the splicing data to obtain a target three-dimensional model.
[0007] In some embodiments of the present application, the three-dimensional plaster model and the three-dimensional impression model are fused according to the stitching data to obtain a target three-dimensional model, including: deleting the portion of the area to be stitched except the area of interest from the stitching data; performing a de-overlapping point operation on the stitching data to obtain an initial fused model; and performing a data removal operation on the initial fused model to obtain the target three-dimensional model.
[0008] In some embodiments of the present application, the de-overlapping point operation on the spliced data to obtain the initial fusion model includes: assigning an association value to the three-dimensional points in the spliced data, wherein the association value represents the association between the three-dimensional point and the initial fusion model; performing a de-overlapping point operation on the three-dimensional points in the spliced data according to the association value of the three-dimensional points to obtain the initial fusion model; wherein the three-dimensional points in the area of interest in the three-dimensional impression model have the highest association value, and the three-dimensional points of the three-dimensional plaster model have a greater association value than the three-dimensional points of the three-dimensional impression model.
[0009] In some embodiments of the present application, the removing of data from the initial fusion model includes: deleting a target data block in the initial fusion model, wherein the number of three-dimensional points included in the target data block is less than a preset number.
[0010] In some embodiments of the present application, determining the area of interest in the three-dimensional impression model includes: determining a marking mode selected by a user; if the marking mode is a first mode, marking the three-dimensional points on which the user operates in the three-dimensional impression model using a preset graphic; if the marking mode is a second mode, determining the scope of an operation area in which the user operates in the three-dimensional impression model, and marking the three-dimensional points within the scope of the operation area; and using the marked area formed by the marked three-dimensional points as the area of interest.
[0011] In some embodiments of the present application, determining the region of interest in the three-dimensional impression model includes: determining the region of interest in the three-dimensional impression model by using a preset AI model.
[0012] In some embodiments of the present application, expanding the region of interest to determine the region to be spliced in the three-dimensional impression model includes: extracting a bounding box of the region of interest, expanding the bounding box outward according to a preset range to obtain an outward-expanded bounding box; and determining the region to be spliced based on the outward-expanded bounding box.
[0013] In some embodiments of the present application, before splicing the three-dimensional gypsum model with the area to be spliced in the three-dimensional impression model, the method also includes: flipping the three-dimensional impression model along a preset direction so that the area to be spliced in the three-dimensional impression model is flipped, wherein the preset direction is the normal direction of the area to be spliced.
[0014] In some embodiments of the present application, when it is determined that the three-dimensional gypsum model does not match the three-dimensional impression model, the method also includes: displaying the area to be spliced and issuing a first prompt message so that the user can perform a point selection operation in the area to be spliced; if it is detected that the user performs a point selection operation in the area to be spliced, in response to the point selection operation, determine a plurality of splicing points; splicing the three-dimensional gypsum model with the area to be spliced based on the plurality of splicing points; if it is detected that the user does not perform a point selection operation in the area to be spliced, issuing feedback information so that the user can perform a point selection operation in the area to be spliced.
[0015] In some embodiments of the present application, determining whether the three-dimensional gypsum model matches the three-dimensional impression model according to the splicing data includes: determining a comparison area in the three-dimensional gypsum model corresponding to the area to be spliced; calculating a matching value between the comparison area and the area to be spliced, wherein the matching value represents a degree of matching between the comparison area and the area to be spliced; if the matching value is less than a preset threshold, determining that the three-dimensional gypsum model does not match the three-dimensional impression model; if the matching value is greater than or equal to the preset threshold, determining that the three-dimensional gypsum model matches the three-dimensional impression model, or determining whether the three-dimensional gypsum model matches the three-dimensional impression model according to the splicing data includes: issuing a second prompt message to prompt the user to confirm whether the three-dimensional gypsum model matches the three-dimensional impression model; if a confirmation operation of the user is received, determining that the three-dimensional gypsum model matches the three-dimensional impression model; if no confirmation operation of the user is received, determining that the three-dimensional gypsum model does not match the three-dimensional impression model.
[0016] In a second aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device executes the above-mentioned model generation method.
[0017] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned model generation method is implemented.
[0018] The present application determines the area to be spliced in the three-dimensional impression model by expanding the area of interest of the three-dimensional impression model, splicing the three-dimensional gypsum model with the area to be spliced in the three-dimensional impression model to obtain splicing data, and when the two models are determined to match according to the splicing data of the three-dimensional gypsum model and the three-dimensional impression model, the three-dimensional gypsum model and the three-dimensional impression model are merged to obtain a complete target three-dimensional model, so that a complete target three-dimensional model reflecting the true shape of the target object can be quickly generated based on the three-dimensional gypsum model and the three-dimensional impression model, and the target three-dimensional model has high accuracy and good presentation effect for the area of interest of the target object, avoiding the existing target three-dimensional model from being unable to truly reflect the area of interest or scanning the three-dimensional gypsum model will have some areas of interest that are not clearly scanned, resulting in the inability to generate a complete three-dimensional model reflecting the true shape of the object. In addition, the present application obtains the area to be spliced by expanding the area of interest, and splicing the three-dimensional gypsum model with the three-dimensional impression model based on the area to be spliced, which can ensure that there is enough common area between the three-dimensional gypsum model and the three-dimensional impression model for splicing, thereby improving the splicing accuracy. The present application also deletes the part of the area to be spliced except the area of interest from the splicing data between the three-dimensional plaster model and the three-dimensional impression model, and performs a de-overlapping point operation on the splicing data to obtain an initial fusion model, which can effectively reduce the overlapping data of the initial fusion model of the two models. In this way, there is no need to edit and delete the overlapping data in the three-dimensional plaster model and the three-dimensional impression model, which simplifies the generation process of the target three-dimensional model, while improving the design efficiency of the target three-dimensional model and reducing the error rate of users performing deletion operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0020] Figure 1 A flowchart of a model generation method provided for some embodiments of the present application.
[0021] Figure 2 Schematic diagram of a three-dimensional plaster model provided for some embodiments of the present application.
[0022] Figure 3 A schematic diagram of a three-dimensional impression model provided for some embodiments of the present application.
[0023] Figure 4 A schematic diagram of a first interface provided for some embodiments of the present application.
[0024] Figure 5A flow chart of a method for matching a three-dimensional plaster model with a three-dimensional impression model provided in some embodiments of the present application.
[0025] Figure 6 A flow chart of a method for matching a three-dimensional plaster model with a three-dimensional impression model provided in some other embodiments of the present application.
[0026] Figure 7 A schematic diagram of a second interface provided for some embodiments of the present application.
[0027] Figure 8 This is a flow chart of a method for fusing a three-dimensional plaster model with a three-dimensional impression model in some embodiments of the present application.
[0028] Fig. 9 This is a schematic diagram of a target three-dimensional model in some embodiments of the present application.
[0029] Fig.10 A structural diagram of a model generation device provided in some embodiments of the present application.
[0030] Fig.11 A schematic diagram of an electronic device provided for some embodiments of the present application. DETAILED DESCRIPTION
[0031] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0032] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way.
[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art in the technical field in this application. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. It should be understood that, unless otherwise specified in this application, "at least one" refers to one or more. "Multiple" refers to two or more than two. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, a, b and c seven situations.
[0034] The functional units and modules in the above embodiments may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the above integrated units may be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present application.
[0035] 3D scanning is widely used in product design and manufacturing. Among them, 3D scanning of a 3D plaster model of an object can be used for dental restoration design or industrial product design. However, the 3D plaster model cannot truly reflect each area of the object or scanning of the 3D plaster model may result in unclear scanning of some areas, resulting in the inability to generate a complete 3D model that reflects the true shape of the object.
[0036] One solution is to splice and merge the three-dimensional plaster model and the three-dimensional impression model to obtain data of the area of interest. However, the steps of splicing and merging the three-dimensional plaster model and the three-dimensional impression model are complicated, and there is a lot of miscellaneous data after the merger, resulting in a high failure rate of splicing and merging, and thus the complete target three-dimensional model cannot be generated. For example, in the related art, in order to obtain a complete target three-dimensional model, after the three-dimensional plaster model and the three-dimensional impression model are obtained by three-dimensional scanning, it is necessary to edit the scanned model to delete useless miscellaneous data in the model (such as miscellaneous data of holes in the model), and then splice and merge the data of the three-dimensional plaster model and the three-dimensional impression model to obtain a complete target three-dimensional model. However, when deleting the scanned data, it is necessary to control the deletion range. If the deletion range is too large, it is easy to delete too much data, resulting in a reduction in the common area between the three-dimensional plaster model and the three-dimensional impression model. Less common area will make it difficult to splice the three-dimensional plaster model and the three-dimensional impression model, and the splicing failure rate is high. If the deletion range is too small, it is easy to cause too much miscellaneous data to appear after the merging of the 3D plaster model and the 3D impression model, resulting in merging failure, and thus being unable to generate a complete target 3D model for dental restoration design or industrial product design.
[0037] The embodiments of the present application provide a model generation method, an electronic device, and a storage medium, which can quickly generate a complete target three-dimensional model reflecting the true shape of the target object based on a three-dimensional plaster model and a three-dimensional impression model, and the target three-dimensional model has high accuracy and good presentation effect for the target object's area of interest. The method proposed in the present application can be applied to desktop scanners or handheld scanners, and can also be applied to scanners such as oral scanners, facial scanners, industrial scanners, and professional scanners, and can realize three-dimensional reconstruction of objects or scenes such as teeth, faces, bodies, industrial products, industrial equipment, cultural relics, artworks, prostheses, medical devices, and buildings.
[0038] refer to Figure 1 , which is a flow chart of a model generation method provided in some embodiments of the present application, wherein the model generation method is applied in an electronic device. Figure 1 The method of the example includes one or more steps, but does not constitute a limitation of the present application. In addition, the order of the steps of the method is only an example, and the order of the steps can be changed. Additional steps can be added or steps can be reduced without departing from the content disclosed in the present application. The method includes the following steps.
[0039] S101, obtaining a three-dimensional plaster model and a three-dimensional impression model of a target object.
[0040] In some embodiments of the present application, a plaster model and an impression model of a target object are prepared, and the plaster model and the impression model of the target object are scanned to obtain a digitized three-dimensional plaster model and a three-dimensional impression model. The target object can be a patient's oral cavity or an industrial component, and the present application does not limit the type of the target object.
[0041] The 3D plaster model includes 3D point cloud data (or 3D points) of the plaster. Figure 2 , which is a schematic diagram of a three-dimensional plaster model provided in some embodiments of the present application. Figure 2 The image (a) shows the front view of the 3D plaster model. Figure 2 The image shown in (b) is a back image of the three-dimensional plaster model. In some embodiments of the present application, the three-dimensional impression model includes three-dimensional points of the impression. Figure 3 , which is a schematic diagram of a three-dimensional impression model provided in some embodiments of the present application.
[0042] S102: Determine a region of interest in the three-dimensional impression model.
[0043] In some embodiments of the present application, determining the area of interest in the three-dimensional impression model includes: determining the marking mode selected by the user; if the marking mode is the first mode, using a preset graphic to mark the three-dimensional points on which the user operates in the three-dimensional impression model; if the marking mode is the second mode, determining the scope of the operation area in which the user operates in the three-dimensional impression model, and marking the three-dimensional points within the operation area; and using the marked area formed by the marked three-dimensional points as the area of interest.
[0044] refer to Figure 4 , which is a schematic diagram of a first interface provided by some embodiments of the present application. The first interface 30 includes a first control 31, a second control 32 and a three-dimensional impression model 33. The first control 31 is used to set the marking mode to the first mode, and the second control 32 is used to set the marking mode to the second mode.
[0045] In some embodiments of the present application, when the user sets the marking mode to the first mode through the first control 31, the three-dimensional point operated by the user in the three-dimensional impression model is marked using a preset graphic. The preset graphic may be a sphere. For example, Figure 4 If the user operates the 3D point at position A in the 3D impression model 33, the 3D point at position A of the user can be marked based on the sphere, and the marked area formed by the marked 3D points can be used as the area of interest. It should be noted that the present application does not limit the preset graphics. For example, the preset graphics can also be a circle, an ellipse or a polygon, etc., so that the 3D points in the 3D impression model 33 can be marked according to a variety of different preset graphics.
[0046] In some embodiments of the present application, when the user sets the marking mode to the second mode through the second control 32, the operation area range of the user's operation in the three-dimensional impression model is determined, and the three-dimensional points within the operation area range are marked. For example, if the user draws a circle at position A in the three-dimensional impression model 33, the operation area range corresponding to the circle drawing operation is determined to be a circular area, and the three-dimensional points within the circular area are marked, and the marked area formed by the marked three-dimensional points is used as the region of interest.
[0047] Continue to refer Figure 4 The first interface 30 further includes a third control 34. The third control 34 is used to switch the marking mode to the erasing mode. When the user switches the marking mode to the erasing mode through the third control 34, the 3D point marked by the user is deleted, so that the user can modify the marked 3D point.
[0048] In some other embodiments of the present application, determining the region of interest in the three-dimensional impression model includes: determining the region of interest in the three-dimensional impression model by using a preset AI model. Specifically, the region where the target component in the three-dimensional impression model is located is determined by using a preset AI model, and the region of the target component is used as the region of interest, wherein in the oral field, the target component includes at least one of a tooth, a gum, a post and core, and a dental implant; in other fields, the target component includes a hole, etc.
[0049] In other embodiments of the present application, semantic recognition can also be performed on the three-dimensional impression model through a preset AI model, and the area where the identified target component is located can be used as the area of interest.
[0050] S103, expanding the region of interest to determine the region to be spliced in the three-dimensional impression model.
[0051] In some embodiments of the present application, expanding the region of interest and determining the region to be spliced in the three-dimensional impression model includes: extracting the bounding box of the region of interest, expanding the bounding box outward according to a preset range to obtain an outward-expanded bounding box; and determining the region to be spliced based on the outward-expanded bounding box. In some embodiments of the present application, the bounding box represents the region composed of the three-dimensional points of the region of interest in the three-dimensional impression model. After the bounding box is expanded outward according to a preset range to obtain an outward-expanded bounding box, the region composed of all three-dimensional points in the outward-expanded bounding box is used as the region to be spliced. It should be noted that the expanded bounding box can be a rectangular area or a circular area, and the present application does not limit the graphic shape of the outward-expanded bounding box. The present application can assist in splicing the three-dimensional gypsum model with the three-dimensional impression model through the region to be spliced, thereby improving the success rate of splicing the three-dimensional gypsum model with the three-dimensional impression model.
[0052] S104, splicing the 3D plaster model with the area to be spliced in the 3D impression model to obtain splicing data, and determining whether the 3D plaster model matches the 3D impression model according to the splicing data. If it is determined according to the splicing data that the 3D plaster model does not match the 3D impression model, executing step S105, if it is determined according to the splicing data that the 3D plaster model matches the 3D impression model, executing step S106.
[0053] In some embodiments of the present application, the three-dimensional impression model displays an area to be spliced. Based on the area to be spliced, a comparison area in the three-dimensional gypsum model corresponding to the area to be spliced can be determined; a matching value between the comparison area and the area to be spliced is calculated, wherein the matching value represents the degree of matching between the comparison area and the area to be spliced; if the matching value is less than a preset threshold, it is determined that the three-dimensional gypsum model does not match the three-dimensional impression model; if the matching value is greater than or equal to the preset threshold, it is determined that the three-dimensional gypsum model matches the three-dimensional impression model.
[0054] In some embodiments of the present application, the matching value may be a similarity value, and the preset threshold corresponding to the similarity value is the similarity threshold. Figure 5 As shown, it is a flow chart of a method for matching a three-dimensional plaster model with a three-dimensional impression model provided in some embodiments of the present application, comprising the following steps.
[0055] S501, calculating the similarity between the comparison area and the area to be spliced to obtain a similarity value.
[0056] S502, determine whether the similarity value is less than the similarity threshold. If the similarity value is less than the similarity threshold, execute step S503, if the similarity value is greater than or equal to the similarity threshold, execute step S504.
[0057] S503, determining that the three-dimensional plaster model does not match the three-dimensional impression model.
[0058] S504, determining whether the three-dimensional plaster model matches the three-dimensional impression model.
[0059] In some embodiments of the present application, one of the cosine similarity algorithm, mean square error similarity algorithm, structural similarity algorithm, and histogram algorithm may be used to calculate the similarity between the comparison area and the area to be spliced. The similarity threshold may be set according to user needs.
[0060] For example, the cosine similarity algorithm is used to calculate the cosine value of the vector angle between the comparison area and the area to be spliced, and the cosine value of the angle is used as the similarity value to determine whether the similarity value is less than a similarity threshold (for example, set to 0.8). If the cosine value of the vector angle is less than 0.8, it is determined that the 3D plaster model does not match the 3D impression model; if the cosine value of the vector angle is greater than or equal to 0.8, it is determined that the 3D plaster model matches the 3D impression model.
[0061] In some embodiments of the present application, the matching value may also be a coincidence value, and the preset threshold corresponding to the coincidence value is the coincidence threshold. Figure 6 As shown, it is a flow chart of a method for matching a three-dimensional plaster model with a three-dimensional impression model provided in some other embodiments of the present application, which includes the following steps.
[0062] S601, calculating the overlap value between the comparison area and the area to be spliced.
[0063] S602, determine whether the overlap value is less than the overlap threshold. If the overlap value is less than the overlap threshold, execute step S603, if the overlap value is greater than or equal to the overlap threshold, execute step S604.
[0064] S603, determining that the three-dimensional plaster model does not match the three-dimensional impression model.
[0065] S604, determining whether the three-dimensional plaster model matches the three-dimensional impression model.
[0066] In some embodiments of the present application, an algorithm for calculating the overlap percentage of rectangular frames may be used to calculate the overlap value between the comparison area and the area to be spliced. The overlap threshold may be set according to user needs.
[0067] For example, the intersection area and union area of the comparison area and the area to be spliced are calculated, and the intersection over union (IoU) value is calculated based on the intersection area and the union area to determine whether the IoU value is less than the overlap threshold (for example, set to 0.7). If the IoU value is less than 0.7, it is determined that the 3D plaster model does not match the 3D impression model; if the IoU value is greater than or equal to 0.8, it is determined that the 3D plaster model matches the 3D impression model.
[0068] In other embodiments of the present application, it is also possible to manually determine whether the three-dimensional gypsum model matches the three-dimensional impression model, including: issuing a first prompt message to prompt the user to confirm whether the three-dimensional gypsum model matches the three-dimensional impression model; if the user's confirmation operation is received, it is determined that the three-dimensional gypsum model matches the three-dimensional impression model; if the user's confirmation operation is not received, it is determined that the three-dimensional gypsum model does not match the three-dimensional impression model. In an embodiment of the present application, the first prompt message and the control corresponding to the confirmation operation can be displayed through a pop-up window. The user inputs a confirmation operation by operating the control on the pop-up window. If the confirmation operation input by the user through the pop-up window is received, it is determined that the three-dimensional gypsum model matches the three-dimensional impression model; if the confirmation operation input by the user through the pop-up window is not received, it is determined that the three-dimensional gypsum model does not match the three-dimensional impression model.
[0069] S105, setting a preset number of splicing points on the area to be spliced, and splicing the three-dimensional plaster model with the area to be spliced based on the plurality of splicing points.
[0070] If it is determined according to the splicing data that the three-dimensional gypsum model and the three-dimensional impression model do not match, step S105 is executed. In some embodiments of the present application, a preset number of splicing points are set on the area to be spliced, and splicing the three-dimensional gypsum model with the area to be spliced based on multiple splicing points includes: displaying the area to be spliced and issuing a second prompt message so that the user can select a point in the area to be spliced; if it is detected that the user performs a point selection operation in the area to be spliced, responding to the point selection operation, and determining the multiple points selected by the user as multiple splicing points; splicing the three-dimensional gypsum model with the area to be spliced based on multiple splicing points; if it is detected that the user does not perform a point selection operation in the area to be spliced, the multiple points selected by the user are not used as splicing points, and feedback information is issued so that the user can perform a point selection operation in the area to be spliced. In this way, the present application can ensure that the user can set a preset number of splicing points on the area to be spliced, and complete the splicing of the three-dimensional gypsum model with the area to be spliced, ensuring that there is enough common area between the three-dimensional gypsum model and the three-dimensional impression model for splicing, thereby improving the accuracy of splicing.
[0071] In some embodiments of the present application, when displaying the area to be spliced, the area to be spliced can be marked in a preset manner. For example, the area to be spliced can be marked by color or frame. This makes it convenient for users, especially inexperienced doctors or technicians, to select points in the marked area to be spliced, thereby ensuring the accuracy of the point selection operation.
[0072] refer to Figure 7 As shown, it is a schematic diagram of the second interface provided by some embodiments of the present application. The second interface 70 displays a three-dimensional plaster model 71, an area to be spliced 72, a splicing control 73 and prompt information (not shown in the figure), and the prompt information is used to remind the user to select a point in the area to be spliced. If it is detected that the user performs a point selection operation in the area to be spliced 72 displayed on the second interface 70, in response to the point selection operation, multiple splicing points 74 are determined. After the setting of the splicing point 74 is completed, the user's operation on the splicing control 73 is received, and the three-dimensional plaster model 71 and the area to be spliced 72 are spliced based on the splicing point 74. If it is detected that the user does not perform a point selection operation in the area to be spliced 72 displayed on the second interface 70, feedback information is issued to enable the user to perform a point selection operation in the area to be spliced 72.
[0073] S106, fusing the three-dimensional plaster model with the three-dimensional impression model according to the splicing data to obtain a target three-dimensional model.
[0074] If it is determined based on the splicing data that the three-dimensional plaster model matches the three-dimensional impression model, step S106 is executed. Figure 8 FIG. 1 is a flow chart of a method for fusing a three-dimensional plaster model with a three-dimensional impression model in some embodiments of the present application. The method comprises the following steps.
[0075] S801, deleting the portion of the area to be spliced except the area of interest from the spliced data.
[0076] In some embodiments of the present application, the splicing data includes 3D points of the 3D plaster model and 3D points of the 3D impression model. Parts other than the region of interest in the region to be spliced may be deleted from all 3D points of the splicing data.
[0077] S802, performing a removal of overlapping points operation on the spliced data to obtain an initial fusion model.
[0078] In some embodiments of the present application, performing a de-overlapping operation on the spliced data to obtain an initial fusion model includes: assigning a correlation value to the three-dimensional points in the spliced data, wherein the correlation value represents the correlation between the three-dimensional points and the initial fusion model; performing a de-overlapping operation on the three-dimensional points in the spliced data according to the correlation value of the three-dimensional points to obtain the initial fusion model; wherein the correlation value of the three-dimensional points in the area of interest in the three-dimensional impression model is the highest, and the correlation value of the three-dimensional points of the three-dimensional plaster model is greater than the correlation value of the three-dimensional points of the three-dimensional impression model.
[0079] In some embodiments of the present application, the association value can be expressed as a priority, wherein the higher the priority, the greater the association value, and the lower the priority, the smaller the association value. In other embodiments of the present application, the association value can be expressed as a weight value, wherein the greater the weight value, the higher the association value, and the smaller the weight value, the smaller the association value. The present application can effectively remove overlapping 3D points by performing a de-overlapping operation on 3D points in the spliced data according to the association values of the 3D points, and can retain the 3D points of the target components (such as the post and core, etc.) in the initial fusion model.
[0080] S803, performing a data removal operation on the initial fusion model to obtain a target three-dimensional model.
[0081] In some embodiments of the present application, performing a data removal operation on the initial fusion model includes: deleting a target data block in the initial fusion model, wherein the target data block includes less than a preset number of three-dimensional points. After removing the target data block in the initial fusion model, a target three-dimensional model is obtained (reference Fig. 9 As shown). In the present application, the target data block with less than a preset number of three-dimensional points is deleted, which can effectively remove useless and cluttered data in the target three-dimensional model.
[0082] This application uses the region of interest as a reference. When the region of interest has the highest priority, it can effectively remove the miscellaneous data on the single-jaw three-dimensional plaster model to ensure that the final merged model has a better effect. In addition, this application no longer requires manual editing and deletion of miscellaneous data on the scanned single-jaw three-dimensional plaster model and the three-dimensional impression model. It only needs to mark the region of interest that needs to be retained (such as the "pile" data in the region of interest) and then delete it to avoid accidental deletion of data, reducing the possibility of operational errors, especially inexperienced doctors or technicians accidentally deleting data, resulting in an incomplete target three-dimensional model.
[0083] In some embodiments of the present application, before step S104, the model generation method further includes: flipping the three-dimensional impression model along a preset direction so that the area to be spliced in the three-dimensional impression model is flipped, or flipping only the area to be spliced along a preset direction, wherein the preset direction is the normal direction of the area to be spliced. In the embodiment of the present application, since the three-dimensional impression model and the three-dimensional gypsum model are concave-convex matched to each other, after flipping the three-dimensional impression model so that the area to be spliced in the three-dimensional impression model is flipped in the normal direction, the normal direction of the three-dimensional gypsum model and the changed three-dimensional impression model can be the same, thereby facilitating the splicing of the three-dimensional gypsum model with the area to be spliced.
[0084] The present application determines the area to be spliced in the three-dimensional impression model by expanding the area of interest of the three-dimensional impression model, splicing the three-dimensional gypsum model with the area to be spliced in the three-dimensional impression model to obtain splicing data, and when the two models are determined to match according to the splicing data of the three-dimensional gypsum model and the three-dimensional impression model, the three-dimensional gypsum model and the three-dimensional impression model are merged to obtain a complete target three-dimensional model, so that a complete target three-dimensional model reflecting the true shape of the target object can be quickly generated based on the three-dimensional gypsum model and the three-dimensional impression model, and the target three-dimensional model has high accuracy and good presentation effect for the area of interest of the target object, avoiding the problem that the existing target three-dimensional model cannot truly reflect the area of interest or the scanning of the three-dimensional gypsum model will have unclear scanning of some areas of interest, resulting in difficulty in clearly scanning the complete target three-dimensional model. In addition, the present application obtains the area to be spliced by expanding the area of interest, and splicing the three-dimensional gypsum model with the three-dimensional impression model based on the area to be spliced, which can ensure that there is enough common area between the three-dimensional gypsum model and the three-dimensional impression model for splicing, thereby improving the splicing accuracy. The present application also deletes the part of the area to be spliced except the area of interest from the splicing data between the three-dimensional plaster model and the three-dimensional impression model, and performs a de-overlapping point operation on the splicing data to obtain an initial fusion model, which can effectively reduce the overlapping data of the initial fusion model of the two models. In this way, there is no need to edit and delete the overlapping data in the three-dimensional plaster model and the three-dimensional impression model, which simplifies the generation process of the target three-dimensional model, while improving the design efficiency of the target three-dimensional model and reducing the error rate of users performing deletion operations.
[0085] refer to Fig.10 , which is a structural diagram of a model generation device provided in some embodiments of the present application. The model generation device can implement the details of the model generation method in the above embodiments and achieve the same effect. The model generation device 90 includes the following modules.
[0086] The acquisition module 901 acquires a three-dimensional plaster model and a three-dimensional impression model of the target object.
[0087] The first determining module 902 is used to determine a region of interest in the three-dimensional impression model.
[0088] The second determining module 903 is used to expand the region of interest and determine the region to be spliced in the three-dimensional impression model.
[0089] The first splicing module 904 splices the 3D plaster model with the to-be-spliced area in the 3D impression model to obtain splicing data, and determines whether the 3D plaster model matches the 3D impression model according to the splicing data.
[0090] The second splicing module 905 is used to set a preset number of splicing points on the area to be spliced when the three-dimensional plaster model does not match the three-dimensional impression model, and splice the three-dimensional plaster model with the area to be spliced based on the multiple splicing points.
[0091] The fusion module 906, when determining that the 3D plaster model matches the 3D impression model, fuses the 3D plaster model with the 3D impression model according to the splicing data to obtain a target 3D model.
[0092] The present application determines the area to be spliced in the three-dimensional impression model by expanding the area of interest of the three-dimensional impression model, splicing the three-dimensional gypsum model with the area to be spliced in the three-dimensional impression model to obtain splicing data, and when the two models are determined to match according to the splicing data of the three-dimensional gypsum model and the three-dimensional impression model, the three-dimensional gypsum model and the three-dimensional impression model are merged to obtain a complete target three-dimensional model, so that a complete target three-dimensional model reflecting the true shape of the target object can be quickly generated based on the three-dimensional gypsum model and the three-dimensional impression model, and the target three-dimensional model has high accuracy and good presentation effect for the area of interest of the target object, avoiding the problem that the existing target three-dimensional model cannot truly reflect the area of interest or that the scanning of the three-dimensional gypsum model will have unclear scanning of some areas of interest, resulting in difficulty in clearly scanning the complete target three-dimensional model. In addition, the present application expands the area of interest to obtain the area to be spliced, and splices the three-dimensional gypsum model with the three-dimensional impression model based on the area to be spliced, which can ensure that there is enough common area between the three-dimensional gypsum model and the three-dimensional impression model for splicing, thereby improving the splicing accuracy.
[0093] It should be noted that the model generation device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0094] The functional units and modules in the above embodiments may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the above integrated units may be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present application.
[0095] The present application also provides an electronic device, referring to Fig.11FIG. 1 is a schematic diagram of an electronic device provided in some embodiments of the present application. The electronic device 10 includes: a memory 11, a processor 12, and a computer program 13 stored in the memory 11 and executable on the processor 12. When the processor 12 executes the computer program, the steps in the above-mentioned various method embodiments are implemented.
[0096] The electronic device 10 may be a general electronic device or a dedicated electronic device. In a specific embodiment, the electronic device 10 may be a desktop computer, a portable computer, a network server, a palm computer, a mobile phone, a tablet computer, a wireless terminal device, a communication device or an embedded device. The embodiment of the present application does not limit the type of the electronic device 10. Those skilled in the art will understand that Fig.10 This is only an example of the electronic device 10 and does not constitute a limitation on the electronic device 10 . The electronic device 10 may include more or fewer components than shown in the figure, or a combination of certain components, or different components, such as input and output devices, network access devices, etc. The processor 12 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor. In some embodiments, the memory 11 may be an internal storage unit of the electronic device 10, such as a hard disk or memory of the electronic device 10. In other embodiments, the memory 11 may also be an external storage device of the electronic device 10, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 10. Further, the memory 11 may also include both an internal storage unit of the electronic device 10 and an external storage device. The memory 11 is used to store an operating system, an application program, a boot loader (Boot Loader), data, and other programs. The memory 11 may also be used to temporarily store data that has been output or is to be output. Based on the same application concept, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented. The computer-readable storage medium may be a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or any other medium that can store program codes. The storage medium is used to store the program, and the processor executes the program after receiving the execution instruction. The method executed by the electronic device defined by the process disclosed in any embodiment of the present invention may be applied to the processor or implemented by the processor.
[0097] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms. It should be understood that the information interaction, execution process and other contents between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. The specific functions and technical effects brought about can be specifically referred to the method embodiment part, which will not be repeated here. For the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit, and the above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the scope of protection of the present application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0098] Alternatively, the present invention may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, the present invention may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part.
[0099] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A model generation method, characterized in that: The method comprises: Obtaining a three-dimensional plaster model and a three-dimensional impression model of the target object; determining a region of interest in the three-dimensional impression model; Expanding the region of interest to determine the region to be spliced in the three-dimensional impression model; Splicing the three-dimensional gypsum model with the area to be spliced in the three-dimensional impression model to obtain splicing data, and determining whether the three-dimensional gypsum model matches the three-dimensional impression model according to the splicing data; When it is determined that the three-dimensional gypsum model matches the three-dimensional impression model, the three-dimensional gypsum model is fused with the three-dimensional impression model according to the stitching data to obtain a target three-dimensional model.
2. The model generation method according to claim 1, characterized in that: The step of fusing the three-dimensional plaster model with the three-dimensional impression model according to the splicing data to obtain a target three-dimensional model comprises: Deleting the portion of the to-be-joined area except the region of interest from the stitching data; Performing a removal of overlapping points on the spliced data to obtain an initial fusion model; The initial fusion model is subjected to a data removal operation to obtain the target three-dimensional model.
3. The model generation method according to claim 2, characterized in that: The performing a removal of overlapping points operation on the spliced data to obtain an initial fusion model comprises: Assigning a correlation value to the three-dimensional point in the spliced data, wherein the correlation value represents the correlation between the three-dimensional point and the initial fusion model; Performing a de-overlapping operation on the three-dimensional points in the spliced data according to the correlation values of the three-dimensional points to obtain the initial fusion model; The three-dimensional points of the region of interest in the three-dimensional impression model have the highest correlation value, and the three-dimensional points of the three-dimensional plaster model have a correlation value greater than that of the three-dimensional points of the three-dimensional impression model.
4. The model generation method according to claim 2, characterized in that: The operation of removing impurities from the initial fusion model includes: The target data block in the initial fusion model is deleted, wherein the number of three-dimensional points included in the target data block is less than a preset number.
5. The model generation method according to claim 1, characterized in that: Determining the region of interest in the three-dimensional impression model comprises: Determine the marking mode selected by the user; If the marking mode is the first mode, the three-dimensional point operated by the user in the three-dimensional impression model is marked by using a preset graphic; If the marking mode is the second mode, determining the operating area range of the user's operation in the three-dimensional impression model, and marking the three-dimensional points within the operating area range; The marked area formed by the marked three-dimensional points is used as the region of interest.
6. The model generation method according to claim 1, characterized in that: Determining the region of interest in the three-dimensional impression model comprises: The region of interest in the three-dimensional impression model is determined by a preset AI model.
7. The model generation method according to claim 1, characterized in that: The step of expanding the region of interest and determining the region to be spliced in the three-dimensional impression model comprises: Extracting a bounding box of the region of interest, and expanding the bounding box outward according to a preset range to obtain an outward-expanded bounding box; Based on the outward-expanded bounding box, the area to be spliced is determined.
8. The model generation method according to claim 1, characterized in that: Before splicing the three-dimensional plaster model with the area to be spliced in the three-dimensional impression model, the method further includes: The three-dimensional impression model is flipped along a preset direction so that the area to be spliced in the three-dimensional impression model is flipped, wherein the preset direction is the normal direction of the area to be spliced.
9. The model generation method according to claim 1, characterized in that: When it is determined that the three-dimensional plaster model does not match the three-dimensional impression model, the method further includes: Displaying the area to be spliced and issuing a first prompt message, so that the user can perform a point selection operation in the area to be spliced; If it is detected that the user performs a point selection operation in the area to be spliced, respond to the point selection operation and determine a plurality of splicing points; splicing the three-dimensional plaster model with the area to be spliced based on the multiple splicing points; If it is detected that the user does not perform a point selection operation in the area to be spliced, feedback information is sent to enable the user to perform a point selection operation in the area to be spliced.
10. The model generation method according to claim 1, characterized in that: Determining whether the three-dimensional plaster model matches the three-dimensional impression model according to the splicing data includes: Determining a comparison area in the three-dimensional plaster model corresponding to the area to be spliced; Calculating a matching value between the comparison area and the area to be spliced, wherein the matching value represents a matching degree between the comparison area and the area to be spliced; If the matching value is less than a preset threshold, it is determined that the three-dimensional plaster model does not match the three-dimensional impression model; If the matching value is greater than or equal to the preset threshold, it is determined that the three-dimensional plaster model matches the three-dimensional impression model; or, Determining whether the three-dimensional plaster model matches the three-dimensional impression model according to the splicing data includes: Sending a second prompt message to prompt the user to confirm whether the three-dimensional plaster model matches the three-dimensional impression model; If a confirmation operation is received from the user, determining that the three-dimensional plaster model matches the three-dimensional impression model; If no confirmation operation is received from the user, it is determined that the three-dimensional plaster model does not match the three-dimensional impression model.
11. An electronic device, characterized in that: include: A processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device executes the model generation method described in any one of claims 1 to 10.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the model generation method according to any one of claims 1 to 10 is implemented.