A method, device and system for displaying and updating interactive three-dimensional tooth images

Abstract

The present invention discloses a method, device and system for displaying and updating an interactive three-dimensional tooth image disclosed in an embodiment of the present invention. The method includes: S101: acquiring original three-dimensional tooth image data corresponding to intraoral CBCT image data; S201: reading original three-dimensional tooth image data and generating original tooth slice images, displaying, and acquiring and displaying multiple first three-dimensional models corresponding to each tooth according to the original three-dimensional tooth image data; S301: performing a first operation on at least one first three-dimensional model; S401: slice updating; S501: repeating steps S301 and S401 multiple times according to multiple second three-dimensional models. The present invention updates and displays the three-dimensional model before and after the change through a two-dimensional slice image, uses the change of the two-dimensional image to guide the interactive operation of the three-dimensional model, improves the accuracy and intuitiveness of the interaction, and can realize the independent interaction of each tooth.

Description

Technical Field

[0001] The present invention relates to the technical field of medical image processing, and in particular to a method, device and system for displaying and updating interactive three-dimensional teeth images. Background Art

[0002] Cone beam computed tomography (CBCT) is a diagnostic imaging technology that is widely used in the diagnosis of dental diseases and the study of dental problems. Usually, the tooth image in the CBCT image is segmented manually or automatically to generate a three-dimensional image so that the dentist can observe the slices, volume or shape of the tooth, etc., so as to make more accurate diagnostic decisions and formulate treatment plans. Displaying the diseased tissue and normal tissue structure from a three-dimensional perspective avoids the defects of the two-dimensional plane, such as image overlap, distortion, and deformation of normal tissues and organs. It has been widely used in alveolar bone surgery, endodontic treatment, dental implant restoration, oral tumor diagnosis, periodontal disease diagnosis and treatment, orthodontic treatment, oral beauty, and jaw orthodontics.

[0003] In dental implant restoration, the patient's gums are examined using three-dimensional CT images, which can accurately determine important information such as the width, thickness and height of the alveolar bone. Doctors can not only visually see the three-dimensional image of the teeth on the computer, but also switch different perspectives to observe the positional relationship between soft and hard tissues, avoid dangerous areas in the surgical plan, and ensure the safety of the operation. CT data can also be used to reconstruct digital models, and the surgical templates can be prepared in advance with the software to make implant surgery safer and faster, avoiding complications such as facial nerve paralysis and sinusitis caused by accidentally damaging anatomical structures such as nerves and sinuses during surgery.

[0004] However, using CBCT to generate a three-dimensional tooth model is a one-way process, that is, the generated model is often only used for observation and diagnosis, and the generated three-dimensional model is presented on a two-dimensional display screen. When the doctor needs to adjust the position or angle of the tooth model to simulate the surgical plan, the three-dimensional model before and after the change is presented on the two-dimensional display screen. It is difficult to give people an intuitive feeling and it is difficult to observe the changes, which makes it difficult to control the changes of the model in the three-dimensional space, resulting in certain defects in medical guidance and bringing many hidden dangers and risks to diagnosis and treatment. Summary of the invention

[0005] In order to solve the above problems, the present invention provides a method, device and system for displaying and updating interactive three-dimensional dental images, which converts the three-dimensional model image into a two-dimensional slice image, and updates and displays the three-dimensional model before and after the change through the two-dimensional slice image through a slice update process, thereby utilizing the changes in the two-dimensional image to guide the interactive operation of the three-dimensional model, thereby improving the accuracy and intuitiveness of the interaction.

[0006] The present invention is achieved through the following technical solutions:

[0007] The first object of the present invention is to provide a method for displaying and updating an interactive three-dimensional tooth image, comprising:

[0008] S101: Acquire original tooth three-dimensional image data corresponding to intraoral CBCT image data;

[0009] S201: reading original tooth three-dimensional image data and generating and displaying original tooth slice images, and acquiring and displaying a plurality of first three-dimensional models corresponding to respective teeth according to the original tooth three-dimensional image data;

[0010] S301: performing a first operation on at least one first three-dimensional model;

[0011] S401: Slice update:

[0012] Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data;

[0013] Generate and display updated tooth slice images according to the post-processed tooth three-dimensional image data, and obtain a plurality of changed second three-dimensional models;

[0014] S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models.

[0015] Optionally, a method for displaying and updating an interactive three-dimensional tooth image comprises:

[0016] S101: Acquire intraoral CBCT image data and corresponding original tooth three-dimensional image data;

[0017] S102: reading intraoral CBCT image data and generating and displaying an intraoral CBCT slice image, with the intraoral CBCT image serving as a background image;

[0018] S201: reading original tooth 3D image data and generating original tooth slice images, superimposing and displaying the original tooth slice images on the background image, and acquiring and displaying a plurality of first 3D models corresponding to each tooth according to the original tooth 3D image data;

[0019] S301: performing a first operation on at least one first three-dimensional model;

[0020] S401: Slice update:

[0021] Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data;

[0022] Generate updated tooth slice images according to the post-processed tooth three-dimensional image data, obtain the changed multiple second three-dimensional models, and superimpose the updated tooth slice images on the background image and display them;

[0023] S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models.

[0024] Optionally, the process of acquiring a plurality of first three-dimensional models corresponding to each tooth according to the original three-dimensional tooth image data in S201 is:

[0025] The data tags for distinguishing each tooth in the original three-dimensional tooth image data are retrieved, and the original three-dimensional tooth image data is rendered according to the data tags to obtain a plurality of first three-dimensional models.

[0026] Optionally, the first process is:

[0027] Obtaining a mask array based on the three-dimensional data of the three-dimensional tooth model processed by the first operation;

[0028] Generate unlabeled three-dimensional image data, wherein the unlabeled three-dimensional image data is data having the same dimension as the three-dimensional image data of teeth including the plurality of first three-dimensional models before the first operation and having no data label;

[0029] The unlabeled three-dimensional image data is masked through a mask array, and the data labels of the tooth three-dimensional image data including multiple first three-dimensional models before the first operation are assigned to the unlabeled three-dimensional image data subjected to masking to obtain post-processed tooth three-dimensional image data.

[0030] Optionally, the assignment process is:

[0031] The process of obtaining the mask array is as follows: establishing a spatial coordinate system for the tooth three-dimensional model including the plurality of first three-dimensional models, retrieving data tags of the three-dimensional data of the tooth three-dimensional model processed by the first operation, extracting the coordinates of the data points on the plurality of three-dimensional models corresponding to each data tag, and generating a plurality of mask arrays corresponding to each data tag;

[0032] The process of assigning the mark is as follows: each point in the unmarked three-dimensional image data to be subjected to mask processing is retrieved; if the coordinates of a point in the unmarked three-dimensional image data are the same as the coordinate values ​​of a mask array, the mark of this point is configured to be the data mark value corresponding to the mask array, and the post-processed tooth three-dimensional image data is obtained.

[0033] Optionally, the first operation includes any one or more of moving, rotating, and deleting;

[0034] A second object of the present invention is to provide an interactive tooth three-dimensional image display and update device, comprising:

[0035] A first data acquisition module, used for acquiring original three-dimensional tooth image data;

[0036] A first data reading module, used for reading original three-dimensional tooth image data;

[0037] A first retrieval module, used to retrieve data tags in the three-dimensional image data;

[0038] A rendering module, used for rendering the three-dimensional image data of teeth according to the data tags to obtain multiple three-dimensional models;

[0039] The first operation module is used to perform any one or more operations including moving, rotating and deleting on the three-dimensional model;

[0040] A first processing module, configured to assign data tags of the three-dimensional tooth image data including a plurality of three-dimensional models before the first operation to non-tagged three-dimensional image data having the same dimension and without data tags;

[0041] A first slice image generation module, used for generating a two-dimensional slice image according to the three-dimensional tooth image data;

[0042] The image display module is used to display slice images and three-dimensional model images.

[0043] Optionally, the first processing module includes:

[0044] A second retrieval module, used to retrieve data tags of the three-dimensional data of the three-dimensional model processed by the first operation;

[0045] A mask array acquisition module, used to extract coordinates of data points on a plurality of three-dimensional models corresponding to data markers of the three-dimensional data processed by the first operation, and generate a mask array corresponding to each data marker;

[0046] an unlabeled three-dimensional image data generating module, used to generate unlabeled three-dimensional image data having the same dimension as the three-dimensional image data before the first operation;

[0047] A mask processing module, used for performing mask processing on the non-labeled three-dimensional image data using a mask array;

[0048] A third retrieval module is used to retrieve each point in the mask-processed unlabeled three-dimensional image data;

[0049] A determination module, used to determine whether the coordinates of the points in the mask-processed non-marked three-dimensional image data are the same as the coordinate values ​​of the mask array;

[0050] The marking configuration module is used to configure the marking of each point of the unmarked three-dimensional image data processed by the mask to be the data marking value corresponding to each mask array that is the same as the coordinate of each point.

[0051] Optionally, it also includes:

[0052] A second data acquisition module is used to acquire intraoral CBCT image data;

[0053] A second data reading module is used to read intraoral CBCT image data;

[0054] A second slice image generating module, used for generating an intraoral CBCT slice image according to the intraoral CBCT image data;

[0055] The image overlay module is used to overlay the tooth slice image on the intraoral CBCT slice image.

[0056] The third object of the present invention is to provide an interactive tooth three-dimensional image display and update system, comprising:

[0057] A user input device configured to input intraoral CBCT image data, original tooth three-dimensional image data, a command for performing a first operation, and a command for updating a slice;

[0058] A processor configured to execute any one of the above methods for displaying and updating an interactive three-dimensional tooth model;

[0059] A display, configured to display intraoral CBCT slice images, three-dimensional model images, and tooth slice images on a user interface;

[0060] The memory is configured to store intraoral CBCT image data, original three-dimensional tooth image data, and post-processed three-dimensional tooth image data.

[0061] Compared with the prior art, the present invention has the following advantages and beneficial effects:

[0062] The embodiment of the present invention discloses an interactive tooth three-dimensional image display and update method, device and system, which converts the three-dimensional model image into a two-dimensional slice image, and updates the slice image to display the three-dimensional model before and after the change through the two-dimensional slice image, thereby using the change of the two-dimensional image to guide the interactive operation of the three-dimensional model, and improve the accuracy and intuitiveness of the interaction. In addition, each tooth three-dimensional model can be operated separately to achieve independent interaction of each tooth. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without creative work. In the drawings:

[0064] Figure 1 A schematic diagram of a method for displaying and updating an interactive three-dimensional tooth image provided by an embodiment of the present invention.

[0065] Figure 2 A background slice diagram of an interactive tooth three-dimensional image display and update method provided by an embodiment of the present invention.

[0066] Figure 3 It is a schematic diagram of the superposition effect of tooth slice images and background slice images at different observation angles obtained from the original tooth three-dimensional image data in an embodiment of the present invention, as well as the obtained three-dimensional model diagram.

[0067] Figure 4 It is a slice image updated after user interaction and a changed three-dimensional model image in an embodiment of the present invention.

[0068] Figure 5 The schematic diagram of an interactive tooth three-dimensional image display and update device according to an embodiment of the present invention.

[0069] Figure 6 This is a schematic diagram of a display and update system for an interactive three-dimensional tooth image according to an embodiment of the present invention.

[0070] 601-first data acquisition module, 602-second data acquisition module, 701-first data reading module, 702-second data reading module, 8-first retrieval module, 9-rendering module, 10-first operation module, 1101-second retrieval module, 1102-mask array acquisition module, 1103-unlabeled three-dimensional image data generation module, 1104-mask processing module, 1105-third retrieval module, 1106-determination module, 1107-label configuration module, 1201-first slice image generation module, 1202-second slice image generation module 1202, 13-image display module, 14-image overlay module, 1501-user input device, 1502-processor, 1503-display, 1504-memory. DETAILED DESCRIPTION

[0071] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with embodiments and drawings. The exemplary embodiments of the present invention and their description are only used to explain the present invention and are not intended to limit the present invention.

[0072] In the following description, a large number of specific details are set forth in order to provide a thorough understanding of the present invention. However, it is apparent to one of ordinary skill in the art that these specific details are not necessarily employed to practice the present invention. In other embodiments, in order to avoid obscuring the present invention, well-known structures, circuits, materials, or methods are not specifically described.

[0073] Throughout the specification, references to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present invention. Therefore, the phrases "one embodiment," "an embodiment," "an example," or "an example" appearing in various places throughout the specification do not necessarily all refer to the same embodiment or example. In addition, particular features, structures, or characteristics may be combined in one or more embodiments or examples in any suitable combination and / or sub-combination. In addition, it will be appreciated by those of ordinary skill in the art that the figures provided herein are for illustrative purposes and that the figures are not necessarily drawn to scale. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0074] Example

[0075] In one embodiment, a method for displaying and updating an interactive three-dimensional tooth image includes:

[0076] S101: Acquire original tooth three-dimensional image data corresponding to the intraoral CBCT image data.

[0077] The original three-dimensional tooth image data is segmented from the intraoral CBCT image data by a segmentation method, and the original three-dimensional tooth image data can also be extracted from the intraoral CBCT image data by other methods. The original three-dimensional tooth image data is marked with data, and each tooth has a corresponding data mark to distinguish different teeth. The number of marks is greater than or equal to 1, and the mark can be a value with practical significance, or other forms of marks that are only used to distinguish objects.

[0078] S201: reading original tooth three-dimensional image data and generating and displaying original tooth slice images, and acquiring and displaying a plurality of first three-dimensional models corresponding to respective teeth according to the original tooth three-dimensional image data.

[0079] The original three-dimensional tooth image data is data that can produce slice images. Based on the obtained original three-dimensional tooth image data, a two-dimensional original tooth slice image is generated. The slice image is an image formed by two-dimensional data obtained by observing the three-dimensional data from any direction, and is displayed through a user interface embedded in the display. At the same time, the data tags in the original three-dimensional tooth image data are retrieved, and the original three-dimensional tooth image data is rendered according to the data tags to generate three-dimensional models of all teeth corresponding to the data tags. The retrieval adopts a traversal retrieval method to finally obtain the three-dimensional models of all teeth, that is, multiple first three-dimensional models corresponding to each tooth are obtained, each first three-dimensional model represents the shape of a tooth, and the three-dimensional model of each tooth is displayed on the user interface.

[0080] S301: Perform a first operation on at least one first three-dimensional model.

[0081] According to the need, at least one or more first three-dimensional models corresponding to each tooth are operated including but not limited to rotation, movement, and deletion. Since one first three-dimensional model corresponds to one tooth, each first three-dimensional model can be operated separately to achieve independent interaction of each tooth.

[0082] S401: Slice update:

[0083] Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data;

[0084] An updated tooth slice image is generated and displayed according to the post-processed tooth three-dimensional image data, and a plurality of changed second three-dimensional models are acquired.

[0085] A spatial coordinate system is established for the tooth three-dimensional model including the plurality of first three-dimensional models, the data tags of the three-dimensional data of the tooth three-dimensional model processed by the first operation are traversed and retrieved, the coordinates of the data points on the plurality of three-dimensional models corresponding to each data tag are extracted, and a plurality of mask arrays corresponding to each data tag are generated, the mask array being the coordinate array. One data tag corresponds to one mask array.

[0086] Generate unlabeled three-dimensional image data, and use the obtained mask array to perform mask processing on the unlabeled three-dimensional image data. Then retrieve each point in the masked unlabeled three-dimensional image data. If the coordinates of a point in the unlabeled three-dimensional image data are the same as the coordinate values ​​of a mask array, configure the mark of this point to be the data mark value corresponding to the mask array, and obtain the post-processed tooth three-dimensional image data.

[0087] The post-processed three-dimensional tooth image data is obtained with data tags, and is rendered according to the data tags to obtain the second three-dimensional model of each tooth after the change. At the same time, an updated tooth slice image is generated according to the post-processed three-dimensional tooth image data, and displayed through the display 1503, so that the updated tooth slice image can be compared with the original tooth slice image to observe the change of the three-dimensional model. At the same time, the post-processed three-dimensional tooth image data not only includes the changed three-dimensional data obtained after operating one or more first three-dimensional models, but also includes the three-dimensional data corresponding to other first three-dimensional models that have not been operated. Accordingly, the updated tooth slice image also displays the second three-dimensional model corresponding to the first three-dimensional model that has not been operated, that is, the teeth that have not been operated are also displayed in the updated tooth slice image at the same time.

[0088] S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models.

[0089] Using the same method, steps S301 and S401 are repeated according to the obtained multiple second three-dimensional models. That is, when the tooth three-dimensional model needs to be changed again, the first operation is performed on one or more second three-dimensional models, and then the slices are updated. Based on the second three-dimensional model, a new updated tooth slice image is obtained and displayed, and the changed multiple third three-dimensional models are obtained at the same time. Similarly, the first operation is performed on the third three-dimensional model, and then the slices are updated, and this is repeated.

[0090] Through the implementation of this embodiment, the three-dimensional model image can be converted into a two-dimensional slice image, and the three-dimensional model before and after the change can be updated and displayed through the two-dimensional slice image through the slice update process, so as to use the change of the two-dimensional image to guide the interactive operation of the three-dimensional model, improve the accuracy and intuitiveness of the interaction. In addition, each first three-dimensional model can be operated separately to realize the independent interaction of each tooth.

[0091] In some embodiments, in order to better observe the changes of the three-dimensional model before and after the change, a background image is set, and the tooth slice image obtained after each update is superimposed on the background image, so as to facilitate the observation of the changes of the tooth slice image.

[0092] Specifically, the following scheme is adopted:

[0093] like Figure 1 As shown, a method for displaying and updating an interactive three-dimensional tooth image comprises:

[0094] S101: Acquire intraoral CBCT image data and corresponding original tooth three-dimensional image data;

[0095] S102: reading intraoral CBCT image data and generating and displaying an intraoral CBCT slice image, with the intraoral CBCT image serving as a background image;

[0096] S201: reading original tooth 3D image data and generating original tooth slice images, superimposing and displaying the original tooth slice images on the background image, and acquiring and displaying a plurality of first 3D models corresponding to each tooth according to the original tooth 3D image data;

[0097] S301: performing a first operation on at least one first three-dimensional model;

[0098] S401: Slice update:

[0099] Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data;

[0100] Generate updated tooth slice images according to the post-processed tooth three-dimensional image data, obtain the changed multiple second three-dimensional models, and superimpose the updated tooth slice images on the background image and display them;

[0101] S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models.

[0102] The dimension of the original tooth three-dimensional image data is the same as the dimension of the slice image data corresponding to the background image, so that the slice image of the three-dimensional data can be superimposed on the background slice image.

[0103] Through the technical solution of this embodiment, the original tooth slice image can be superimposed on the background image, and each updated tooth slice image can be superimposed on the background image. Since the intraoral CBCT slice image is a picture containing teeth, periodontal tissues and other tissues, after superimposing the tooth slice image on the intraoral CBCT slice image, the position of each tooth in the mouth can be seen more clearly, and the relative movement of the three-dimensional model can be observed. In this way, even if an error occurs during user operation, it can be discovered in time through the slice image and adjustments can be made quickly, thereby improving the accuracy of the slice image display and avoiding major diagnosis and treatment risks caused by user operation errors.

[0104] At the same time, by superimposing each updated tooth slice image on the background image, the tooth slice image is displayed in the same display area, and the relative changes of the slice image can be found more accurately and intuitively.

[0105] The following is attached Figure 2 , 3 4 provides a more detailed description of the display and update method of the interactive three-dimensional tooth image according to the embodiment of the present invention.

[0106] Figure 1 The method for displaying and updating a three-dimensional image and its slices in an embodiment of the present invention comprises the following steps: first, reading the intraoral CBCT image data, and generating an intraoral CBCT slice image. The intraoral CBCT slice image is used as a background image and displayed. The displayed image is as follows: Figure 2 As shown in 200 , FIG. 200 is divided into a top view 201 , a front view 202 , and a side view 203 , and the slice images in these three directions all contain teeth and tissues surrounding the teeth. Figure 2 The coordinate axes 204 of the figures are drawn on the images for the convenience of observation, and are not slice image data. Figure 3 , Figure 4 There is also such a coordinate axis in Figure 3 The middle is 305, Figure 4 The number is 405.

[0107] Then read the original tooth 3D image data and generate the original tooth slice image, superimpose it on the background image and display it, and obtain the 3D model image. The effect diagram is as follows Figure 3 As shown in 300. Figure 3 Compare Figure 2 There is one more picture, which is a three-dimensional model display picture 304. The three-dimensional model display picture 304 is a three-dimensional model picture obtained based on the data of the original tooth three-dimensional image. From the picture 304, it can be seen that there are multiple first three-dimensional models, each of which represents a tooth. 306 is one of the first three-dimensional models, representing one of the teeth. Each first three-dimensional model can be moved or rotated independently.

[0108] Figure 3 The slices 301, 302, 303 in Figure 2 201, 202, 203 correspond to each other, and the slice images 301, 302, 303 are respectively a top view, a front view, and a side view; and the slice images 301, 302, 303 all contain background images, from which we can see the periodontal and other tissues around the periodontal, which is a diagram of the tooth slice image corresponding to the three-dimensional image superimposed on the background image. Figure 3 The slice images corresponding to the three annotations are slice images of the first three-dimensional model 306 at different viewing angles. Figure 3 Only part of the slices of the first 3D model can be observed in the image. This is because the 3D model is a spatial 3D model and the slice coordinates of some models are not in the current background slice. Figure 2 within the displayed range.

[0109] The user moves the first 3D model of a single or multiple teeth through interactive operations (such as translation, rotation, etc.), such as moving Figure 3 Model 306 in Figure 4In 400, the position of the second 3D model 406 is located, that is, the first 3D model 306 and the second 3D model 406 are images of the same tooth before and after movement. Then the user issues a command to update the slice images 301, 302 and 303, and the corresponding images after the update are 401, 402, 403, and the updated images are also superimposed on the background image. Figure 3 , 4 It can be seen that Figure 4 The slice images 307, 308, 309 corresponding to the first three-dimensional model 306 at the positions 407, 408, 409 have all disappeared, and the three positions 407, 408, 409 have all displayed background slice images instead of the slice images of the model 306, and a new slice image 410 has appeared, which is the intuitive embodiment of the second three-dimensional model 406 obtained after the movement on the slice image. At this point, the slice image update of the three-dimensional image is completed.

[0110] The same method can be used to move other first three-dimensional models to obtain slice images corresponding to the updated second three-dimensional models.

[0111] In another embodiment of the present invention, a device for displaying and updating an interactive three-dimensional tooth image is provided. Figure 5 As shown in, it includes: a first data acquisition module 601, used to acquire original tooth three-dimensional image data; a first data reading module 701, used to read the original tooth three-dimensional image data; a first retrieval module 8, used to retrieve data tags in the three-dimensional image data; a rendering module 9, used to render the tooth three-dimensional image data according to the data tags to obtain multiple three-dimensional models; a first operation module 10, used to perform any one or more of the operations including moving, rotating, and deleting on the three-dimensional model; a first processing module, used to assign the data tags of the tooth three-dimensional image data including multiple three-dimensional models before the first operation to the non-tagged three-dimensional image data with the same dimension and without data tags; a first slice image generation module 1201, used to generate a two-dimensional slice image according to the tooth three-dimensional image data; an image display module 13, used to display the slice image and the three-dimensional model image.

[0112] Furthermore, the first processing module includes: a second retrieval module 1101, which is used to retrieve data tags of the three-dimensional data of the three-dimensional model processed by the first operation; a mask array acquisition module 1102, which is used to extract the coordinates of the data points on the multiple three-dimensional models corresponding to the data tags of the three-dimensional data processed by the first operation, and generate a mask array corresponding to each data tag; an unlabeled three-dimensional image data generation module 1103, which is used to generate unlabeled three-dimensional image data with the same dimension as the three-dimensional image data before the first operation; a mask processing module 1104, which is used to perform mask processing on the unlabeled three-dimensional image data using the mask array; a third retrieval module 1105, which is used to retrieve each point in the masked unlabeled three-dimensional image data; a determination module 1106, which is used to determine whether the coordinates of the points in the masked unlabeled three-dimensional image data are the same as the coordinate values ​​of the mask array; a tag configuration module 1107, which is used to configure the tags of each point of the masked unlabeled three-dimensional image data to be the data tag values ​​corresponding to each mask array that are the same as the coordinates of each point.

[0113] Furthermore, it also includes: a second data acquisition module 602, used to acquire intraoral CBCT image data; a second data reading module 702, used to read intraoral CBCT image data; a second slice image generation module 1202, used to generate intraoral CBCT slice images according to the intraoral CBCT image data; an image overlay module 14, used to overlay the tooth slice image on the intraoral CBCT slice image.

[0114] In another embodiment of the present invention, a system for displaying and updating an interactive three-dimensional tooth image is provided. Figure 6 As shown, it includes a user input device 1501, which is configured to input intraoral CBCT image data, original tooth three-dimensional image data, and input a command for performing a first operation and a slice update command in an interactive manner; a processor 1502, which is configured to execute the process of the interactive tooth three-dimensional model display and update method of the above embodiments; a display 1503, which is configured to display intraoral CBCT slice images, three-dimensional model images, and tooth slice images on a user interface, wherein the user interface is embedded in the display 1503; and a memory 1504, which is configured to store intraoral CBCT image data, original tooth three-dimensional image data, and post-processed tooth three-dimensional image data. The intraoral CBCT image data includes at least one slice image, the original tooth three-dimensional image data includes at least one three-dimensional data of a first three-dimensional model, and the post-processed tooth three-dimensional image data includes at least one three-dimensional data of a second three-dimensional model, and both the original tooth three-dimensional image data and the post-processed tooth three-dimensional image data meet the format or data composition requirements for generating slice images.

[0115] The methods, processes, equipment, etc. not mentioned in this patent application are all obtained or performed by using existing methods or by using existing methods.

[0116] A person of ordinary skill in the art can understand that all or part of the steps in realizing the above-mentioned facts and methods can be completed by instructing the relevant hardware through a program, and the program involved or the program described can be stored in a computer-readable storage medium. When the program is executed, it includes the following steps: At this time, the corresponding method steps are derived, and the storage medium can be ROM / RAM, a disk, an optical disk, etc.

[0117] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for displaying and updating an interactive three-dimensional tooth image, characterized in that: include: S101: Acquire original tooth three-dimensional image data corresponding to intraoral CBCT image data; S201: reading original tooth three-dimensional image data and generating and displaying original tooth slice images, and acquiring and displaying a plurality of first three-dimensional models corresponding to respective teeth according to the original tooth three-dimensional image data; S301: performing a first operation on at least one first three-dimensional model; S401: Slice update: Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data; Generate and display updated tooth slice images according to the post-processed tooth three-dimensional image data, and obtain a plurality of changed second three-dimensional models; S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models; The first treatment is: Obtaining a mask array based on the three-dimensional data of the three-dimensional tooth model processed by the first operation; Generate unlabeled three-dimensional image data, wherein the unlabeled three-dimensional image data is data having the same dimension as the three-dimensional image data of teeth including the plurality of first three-dimensional models before the first operation and having no data label; The unlabeled three-dimensional image data is masked through a mask array, and the data labels of the tooth three-dimensional image data including multiple first three-dimensional models before the first operation are assigned to the unlabeled three-dimensional image data subjected to masking to obtain post-processed tooth three-dimensional image data.

2. A method for displaying and updating an interactive three-dimensional tooth image, characterized in that: include: S101: Acquire intraoral CBCT image data and corresponding original tooth three-dimensional image data; S102: reading intraoral CBCT image data and generating and displaying an intraoral CBCT slice image, with the intraoral CBCT image serving as a background image; S201: reading original tooth 3D image data and generating original tooth slice images, superimposing and displaying the original tooth slice images on the background image, and acquiring and displaying a plurality of first 3D models corresponding to each tooth according to the original tooth 3D image data; S301: performing a first operation on at least one first three-dimensional model; S401: Slice update: Performing a first processing on the three-dimensional tooth image data after the first operation to obtain changed post-processed three-dimensional tooth image data; Generate updated tooth slice images according to the post-processed tooth three-dimensional image data, obtain the changed multiple second three-dimensional models, and superimpose the updated tooth slice images on the background image and display them; S501: Repeat steps S301 and S401 multiple times according to multiple second three-dimensional models; The first treatment is: Obtaining a mask array based on the three-dimensional data of the three-dimensional tooth model processed by the first operation; Generate unlabeled three-dimensional image data, wherein the unlabeled three-dimensional image data is data having the same dimension as the three-dimensional image data of teeth including the plurality of first three-dimensional models before the first operation and having no data label; The unlabeled three-dimensional image data is masked through a mask array, and the data labels of the tooth three-dimensional image data including multiple first three-dimensional models before the first operation are assigned to the unlabeled three-dimensional image data subjected to masking to obtain post-processed tooth three-dimensional image data.

3. A method for displaying and updating an interactive three-dimensional tooth image according to claim 1 or 2, characterized in that: The process of acquiring a plurality of first three-dimensional models corresponding to each tooth according to the original three-dimensional tooth image data in S201 is as follows: The data tags for distinguishing each tooth in the original three-dimensional tooth image data are retrieved, and the original three-dimensional tooth image data is rendered according to the data tags to obtain a plurality of first three-dimensional models.

4. A method for displaying and updating an interactive three-dimensional tooth image according to claim 1, characterized in that: The assignment process is: The process of obtaining the mask array is as follows: establishing a spatial coordinate system for the tooth three-dimensional model including the plurality of first three-dimensional models, retrieving data tags of the three-dimensional data of the tooth three-dimensional model processed by the first operation, extracting the coordinates of the data points on the plurality of three-dimensional models corresponding to each data tag, and generating a plurality of mask arrays corresponding to each data tag; The process of assigning the mark is as follows: each point in the unmarked three-dimensional image data to be subjected to mask processing is retrieved; if the coordinates of a point in the unmarked three-dimensional image data are the same as the coordinate values ​​of a mask array, the mark of this point is configured to be the data mark value corresponding to the mask array, and the post-processed tooth three-dimensional image data is obtained.

5. A method for displaying and updating an interactive three-dimensional tooth image according to claim 1 or 2, characterized in that: The first operation includes any one or more of moving, rotating, and deleting.

6. A device based on the method for displaying and updating an interactive three-dimensional tooth image according to any one of claims 1 to 5, characterized in that include: A first data acquisition module, used for acquiring original three-dimensional tooth image data; A first data reading module, used for reading original three-dimensional tooth image data; A first retrieval module, used to retrieve data tags in the three-dimensional image data; A rendering module, used for rendering the three-dimensional image data of teeth according to the data tags to obtain multiple three-dimensional models; The first operation module is used to perform any one or more operations including moving, rotating and deleting on the three-dimensional model; A first processing module, configured to assign data tags of the three-dimensional tooth image data including a plurality of three-dimensional models before the first operation to non-tagged three-dimensional image data having the same dimension and without data tags; A first slice image generation module, used for generating a two-dimensional slice image according to the three-dimensional tooth image data; The image display module is used to display slice images and three-dimensional model images.

7. The device according to claim 6, characterized in that The first processing module includes: A second retrieval module, used to retrieve data tags of the three-dimensional data of the three-dimensional model processed by the first operation; A mask array acquisition module, used to extract coordinates of data points on a plurality of three-dimensional models corresponding to data markers of the three-dimensional data processed by the first operation, and generate a mask array corresponding to each data marker; an unlabeled three-dimensional image data generating module, used to generate unlabeled three-dimensional image data having the same dimension as the three-dimensional image data before the first operation; A mask processing module, used for performing mask processing on the non-labeled three-dimensional image data using a mask array; A third retrieval module is used to retrieve each point in the mask-processed unlabeled three-dimensional image data; A determination module, used to determine whether the coordinates of the points in the mask-processed non-marked three-dimensional image data are the same as the coordinate values ​​of the mask array; The marking configuration module is used to configure the marking of each point of the unmarked three-dimensional image data processed by the mask to be the data marking value corresponding to each mask array that is the same as the coordinate of each point.

8. The device according to claim 6 or 7, characterized in that Also includes: A second data acquisition module is used to acquire intraoral CBCT image data; A second data reading module is used to read intraoral CBCT image data; A second slice image generating module, used for generating an intraoral CBCT slice image according to the intraoral CBCT image data; The image overlay module is used to overlay the tooth slice image on the intraoral CBCT slice image.

9. An interactive tooth three-dimensional image display and update system, characterized in that: include: A user input device configured to input intraoral CBCT image data, original tooth three-dimensional image data, a command for performing a first operation, and a command for updating a slice; A processor configured to execute the method for displaying and updating an interactive three-dimensional tooth model according to any one of claims 1 to 5; A display, configured to display intraoral CBCT slice images, three-dimensional model images, and tooth slice images on a user interface; The memory is configured to store intraoral CBCT image data, original three-dimensional tooth image data, and post-processed three-dimensional tooth image data.

Images