Intraoral scanner and computer-implemented method for updating digital 3D scans

By comparing and updating digital 3D scans, the problems of data inconsistency and scanning session interruption in the intraoral scanner system are solved, and a more accurate and continuous scanning process is achieved, reducing the risk of treatment failure.

CN119013687APending Publication Date: 2024-11-223SHAPE AS
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380032382.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-17
Filing Date
2023-03-15
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Existing intraoral scanner systems are prone to data inconsistency or errors when obtaining digital dental impressions, resulting in failure of subsequent treatment or needing to do a scan. It is difficult for the dentist to ensure that the continuous scanning session is not interrupted when interacting with the scanner.

Method used

By comparing the current digital 3D scan with the new digital 3D scan, identifying inconsistent scanning areas and automatically replacing them, ensuring the accuracy and continuity of scan data, using a computer processor to update the surface information representing physical objects, and ensuring the continuity of scan sessions .

Benefits of technology

Reduces the risk of errors in the final scan, improves the accuracy and consistency of scan data, ensures the continuity of scan sessions when the dentist interacts with the scanner, and reduces the need to redo the scan.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119013687A_ABST
    Figure CN119013687A_ABST
Patent Text Reader

Abstract

According to an embodiment, a computer-implemented method and a scanner system are disclosed. A computer-implemented method is disclosed for updating a current digital 3D scan representing a surface of a physical object with at least one new 3D scan, wherein the update of the current digital 3D scan provides an updated digital 3D scan representation of the surface of the physical object. The computer-implemented method may include obtaining the current digital 3D scan; obtaining the at least one new digital 3D scan; determining an inconsistent digital 3D scan, wherein at least part of the new digital 3D scan does not overlap at least part of the current digital 3D scan; and creating the updated digital 3D scan representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a computer-implemented method and scanner system. In particular, the present disclosure relates to determining an inconsistent digital 3D scan and applying the inconsistent digital 3D scan to a current digital 3D scan. Background Art

[0002] Intraoral scanning, i.e. scanning the patient's dentition in situ to obtain a digital dental impression, has become a common alternative to obtaining a physical dental impression. This has many advantages, such as providing a better patient experience. The digital dental impression obtained by intraoral scanning can be digitally processed, and for example, a restorative, orthodontic or other dental treatment can be digitally simulated and designed. In the case where a component for treatment is required (e.g., a crown or aligner), this can be manufactured based on the digital model using a 3D manufacturing machine (such as milling or 3D printing).

[0003] One of the important aspects of taking digital impressions using an intraoral scanner (IOS) is to obtain the best possible digital impression during the patient's visit. If the digital impression has errors, such as missing data or data representing unwanted components (such as saliva), subsequent treatment may fail and the patient must be called to the dentist for another scan, or worse, the treatment may not provide the desired results.

[0004] Therefore, the IOS system may include different tools to correct or modify the failed sections of the scan in order to obtain a usable scan. Alternatively, the scan may have to be redone, which prolongs the time of seeing the dentist.

[0005] In another case, the dentist may wish to reuse the digital impression in a subsequent scanning session and update the digital impression with data from the relevant area. This may be, for example, a case where a scan and a digital impression are used interchangeably, where the scan represents the portion of the dentition that the dentist wants to obtain. For example, a small intermediate scan, a scan patch, represents only a portion of the full scan and is therefore not a digital impression as understood herein.

[0006] One such tool is to mark the area that needs to be rescanned and then remove the area and replace it with the new scan data. However, this introduces a manual step in which the dentist or technician scanning needs to interact with the scanner system independently. In addition, if the individual scanner does not identify a certain area as having incorrect data or the area is not correctly marked, there will still be errors in the final scan.

[0007] Therefore, there still exists a need to correct partial scans during scanning of a patient to reduce the risk of obtaining an erroneous final scan.In addition, the present disclosure also relates to ensuring that a continuous scanning session is not interrupted in the event that the dentist must interact with the scanner interface. Summary of the invention

[0008] One aspect of the present disclosure is to reduce the risk of obtaining a final scan with errors.

[0009] Yet another aspect of the present disclosure is to ensure that a continuous scanning session is not interrupted in the event that the dentist must interact with the scanner interface.

[0010] According to these aspects, a computer-implemented method of updating a current digital 3D scan representing a surface of a physical object using at least one new 3D scan is disclosed, wherein the updating of the current digital 3D scan provides an updated digital 3D scan representation of the surface of the physical object. The computer-implemented method may include: obtaining a current digital 3D scan; obtaining at least one new digital 3D scan; determining an inconsistent digital 3D scan by comparing the current digital 3D scan to the at least one new digital 3D scan, wherein at least a portion of the new digital 3D scan does not overlap with at least a portion of the current digital 3D scan; and creating an updated digital 3D scan representation representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan.

[0011] The computer-implemented method may include obtaining a current digital 3D scan containing surface information of an area of ​​a surface of a physical object. In addition, the method includes obtaining at least one new digital 3D scan containing new surface information of at least a portion of an area of ​​the surface of the physical object. The obtaining of the at least one new digital 3D scan is completed later than the obtaining of the current digital 3D scan. For example, by comparing the current digital 3D scan with the new digital 3D scan, any visual changes of the surface of the physical object (e.g., a tooth) can be identified. In addition, the method may include determining an inconsistent digital 3D scan containing new surface information of the physical object, and wherein the determination of the inconsistent digital 3D scan includes comparing the current digital 3D scan with the at least one new digital 3D scan. The inconsistent digital 3D scan corresponds to a difference in surface information of the current digital 3D scan and surface information of the at least one new digital 3D scan. These differences may be a change in the color of the surface, a change in the shape of the surface, the progression of caries, the progression of cracks, any visual change of the surface, or a physical object that affects the surface. At least a portion of the new digital 3D scan non-partially overlaps with at least a portion of the current digital 3D scan, and the new digital 3D scan contains new information about an area of ​​the physical object corresponding to the non-partially overlapping surface. A portion of the new digital 3D scan and a portion of the current digital 3D scan correspond to regions of a surface of the physical object. A non-partial overlap between the current digital 3D scan and the new digital 3D scan corresponds to a surface region where surface information of the two scans does not match, i.e., an inconsistent digital 3D scan. Furthermore, the method comprises determining an updated digital 3D scan representation representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan such that surface information of the current digital 3D scan is replaced by the new surface information.

[0012] The non-overlap between the two scans does correspond to the same area of ​​the surface of the physical object, and non-overlapping scans means that the surface information of the two scans is different due to changes in the color of the surface, changes in the shape of the surface, changes in the progression of caries, changes in the progression of cracks, any visual changes in the surface, or physical objects affecting the surface.

[0013] A computer-implemented method may include: obtaining a current digital 3D scan containing surface information for a surface area of ​​a physical object; obtaining at least one new digital 3D scan containing new surface information for at least a portion of an area of ​​the surface of the physical object; determining an inconsistent digital 3D scan, wherein determining the inconsistent digital 3D scan comprises comparing the surface information to the new surface information, and wherein the inconsistent digital 3D scan comprises at least a portion of the new surface information that does not overlap with at least a portion of the surface information; and determining an updated digital 3D scan representation representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan, such that at least a portion of the surface information of the current digital 3D scan is replaced by at least a portion of the new surface information.

[0014] The disclosed method provides a scanning method in which inconsistent scan areas in a current digital scan are identified and automatically replaced with a new digital 3D scan.

[0015] At least one new digital 3D scan may be received from the intraoral scanner.

[0016] The digital 3D scan obtained typically represents a surface, such as a surface of a dental object such as a restoration, a tooth or teeth, the maxillary and / or mandibular bone of a patient, or the like.

[0017] According to these aspects, a scanner system for intraoral scanning of a dental object is disclosed. The scanner system may include a scanning probe for receiving an image of the dental object, a peripheral output device for visualizing a digital 3D representation of the dental object, and a computer processor coupled to the scanning probe and the peripheral output device. As disclosed herein, the computer processor may receive data from the scanning probe and output the calculated data to the peripheral output device, wherein the computer processor includes a method for updating a current digital 3D scan representing a surface of the dental object with at least one new 3D scan to provide an updated digital 3D scan representation of the surface of the dental object. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Various aspects of the present disclosure may be best understood from the following detailed description in conjunction with the accompanying drawings. For clarity, the drawings are schematic and simplified, and only details used to improve understanding of the claims are shown, while other details are omitted. Throughout the text, the same figure numbers are used for the same parts or corresponding parts. The various features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and / or technical effects will become apparent from and will be explained with reference to the drawings described below, in which:

[0019] Figure 1The steps of one embodiment of the computer-implemented method disclosed herein are illustrated;

[0020] Figure 2a , Figure 2b and Figure 2c The diagram above shows Figure 1 The outcome of the discussion;

[0021] Figure 3 illustrates the steps of another embodiment of the computer-implemented method disclosed herein; and

[0022] Figure 4 An embodiment of a scanner system disclosed herein is illustrated. DETAILED DESCRIPTION

[0023] The specific embodiments described below in conjunction with the accompanying drawings are intended to be a description of various configurations. The specific embodiments contain specific details for the purpose of providing a thorough understanding of various concepts. However, it is obvious to those skilled in the art that these concepts can be practiced without these specific details. Several aspects of the devices, systems, media, programs, and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). Depending on the specific application, design constraints, or other reasons, these elements can be implemented using electronic hardware, computer programs, or any combination thereof.

[0024] Figure 1 An example of a computer-implemented method for updating a current digital 3D scan representing a surface of a physical object 100 is schematically illustrated. The physical object is a dental object of a patient and is related to Figure 1 The method described is for the case where the scanning process involves the same dental object of the patient.

[0025] In step 101, a jaw scan is obtained, i.e., a scan of the patient's jaw(s). The jaw scan is not necessarily complete, and thus may be a partial jaw scan. The jaw scan may be obtained directly (e.g., by intraoral scanning), or the jaw scan may be loaded into a computer from an earlier scanning process (e.g., from scanning a physical impression of the patient's dentition).

[0026] Alternatively, in addition to a jaw scan, other types of current digital 3D scans may be obtained. For example, a current digital 3D scan may, for example, represent at least a portion of a patient's oral cavity, a jaw in the patient's oral cavity, a preparation, teeth of the patient's oral cavity, and / or a restoration. Therefore, these terms are not limiting and may be used interchangeably throughout the disclosure.

[0027] A scan patch is subsequently obtained in step 102. A scan patch is a small digital representation of a segment of the patient's jaw. Similar to the jaw scan described above, other types of new digital 3D scans (such as a scan patch) may be obtained.

[0028] Typically, the current digital 3D scan and the new digital 3D scan may represent the same dental object, however, in some cases, they may be different. For example, the current digital 3D scan may represent a dental preparation, wherein the new digital 3D scan may represent a crown restoration (or a portion thereof) arranged on the dental preparation.

[0029] In step 103, the scan patch is compared to the jaw scan to determine one of the following:

[0030] (a) the scan patch is a non-uniform scan surface of a jaw scan, wherein at least a portion of the scan patch does not overlap with at least a portion of the jaw scan;

[0031] (b) the scan patch is an overlaid scan surface of a jaw scan; or

[0032] (c) The scan patch is the new scan surface of the jaw scan.

[0033] The result (a) that the scan patch is an inconsistent scan surface of the jaw scan may occur when the scan patch corresponds to a portion of the jaw scan but is inconsistent because it does not meet certain criteria.

[0034] In one embodiment as shown in step 103, an inconsistency criterion may be established that defines when the new digital 3D scan does not overlap with the current digital 3D scan. When comparing the scan patch to the jaw scan, the method checks the scan patch against the inconsistency criterion and determines the scan patch to be inconsistent if the scan patch meets the inconsistency criterion. A portion of the new digital 3D scan that does not overlap with the current digital 3D scan means that a portion of the new digital 3D scan does not match the current digital 3D scan.

[0035] Therefore, it can be understood that in other embodiments, the step of determining inconsistent digital 3D scans may also include:

[0036] - establishing an inconsistency criterion that defines when a new digital 3D scan does not overlap with a current digital 3D scan;

[0037] - Checking new digital 3D scans against inconsistency criteria; and

[0038] - determining the inconsistent digital 3D scan as a portion of the at least one new digital scan that meets the inconsistency criterion.

[0039] In one embodiment, the inconsistency criterion may be, for example, a distance threshold limit or a distance threshold interval, wherein the new digital 3D scan (e.g., a scan patch) meets the inconsistency criterion when at least the distance between the new digital 3D scan (e.g., a scan patch) and the current digital 3D scan (a jaw scan) is within the distance threshold limit or the distance threshold interval. Typically, comparing distances will be done by looking at the distances between data points in the two scans. Corresponding data points between the two scans may be determined, for example, using a matching algorithm, and if the average distance between the corresponding data points is above the distance threshold, then the scan patches are inconsistent.

[0040] In this context, distance can be understood as distance in space, for example, morphological or Cartesian distance or Euclidean distance in color space (such as RGB color or LAB color). Classification based on semantic segmentation (such as teeth or gums), surface properties (such as roughness or scattering properties). In other words, distance should be understood as the difference or difference of one or more features at the data point level.

[0041] A data point may be understood as a 3D point in a point cloud, a collection (such as a group) of 3D points, or a neighbor point and / or a next neighbor point, a vertex in a mesh or a collection of vertices in a mesh, one or more voxels, a likelihood distribution, color information in RGB or LAB color space, a surface normal, or any suitable collection of individual data points in a digital 3D scan.

[0042] In one embodiment, step 103 of comparing the scan patch to the jaw scan to determine inconsistent digital 3D scans may involve identifying an area of ​​the jaw scan that corresponds to the scan patch.

[0043] In such Figure 1 In one embodiment disclosed in , this step may also include projecting the inconsistent digital 3D scan (scan patch) onto the current digital 3D scan (jaw scan) in step 103, and applying the data of the inconsistent 3D scan (scan patch) to the corresponding data of the projected area on the current digital 3D scan (jaw scan) in step 106.

[0044] This projection can be done in a number of different ways.

[0045] In one embodiment, the inconsistent digital 3D scan (scan patch) is projected onto the current digital 3D (jaw scan) scan along the line of sight axis.

[0046] In case an intraoral scanner has been used to obtain the scan patch, the line of sight axis may correspond to the optical axis of the intraoral scanner used to obtain the at least one new digital 3D scan (scan patch).

[0047] In another embodiment, individual data points in the new digital 3D scan (scan patch) are analyzed while inconsistency is established by evaluating an inconsistency criterion applied to the current digital 3D scan.

[0048] Other means of determining corresponding surfaces may be accomplished, for example, by other projection methods. In some embodiments, corresponding surfaces may be found by, for example, determining the closest point between the scan patch and the jaw scan (e.g., by using a matching algorithm). In other embodiments, a computer-implemented method may look along the surface normals of the scan and use these for projection, apply feature or landmark detection, or any other appropriate method to obtain correspondence between the inconsistent digital 3D scans and the data points of the current digital 3D scan.

[0049] As discussed herein, identifying inconsistent digital 3D scans can be accomplished in many different ways, and those skilled in the art presented by the present disclosure will be able to provide further embodiments, understanding that when viewing two scans (typically comparing the scans) and looking for surfaces or data that do not overlap but represent new information about the area that has been obtained, (one or more) inconsistent digital 3D scans can be determined.

[0050] For example, a tooth whose morphology has changed will not create an overlapping scan, but rather a new scan of a surface replacing the previous surface. The method as disclosed determines this by looking at the inconsistency between the two surfaces, and can, for example, determine that the new surface should replace the previous surface.

[0051] In some embodiments, corresponding scan regions are identified to establish what should be compared, using, for example, an inconsistency criterion.

[0052] For example, when the inconsistent digital 3D scan represents an inconsistent scan area or an inconsistent scan segment of a larger scan, determining the corresponding scan area may be relevant. It may for example be an inconsistent scan patch as discussed, where the scan patch represents a part or segment of a larger scan.

[0053] In general, an inconsistency criterion may be understood as a rule set for determining when a corresponding 3D scan is inconsistent, for example, when a corresponding data point does not fall within a criterion or within an interval of a criterion.

[0054] Result (b) occurs by determining overlapping digital 3D scans, ie the scan patch is an overlapping scan surface of the jaw scan, wherein the new digital 3D scan (scan patch) overlaps at least part of the current digital 3D scan (jaw scan).

[0055] In the current embodiment, full scan patches (eg, new digital 3D scans) overlap in order to be determined to be overlapping, however, in another embodiment, scan patches may be considered overlapping when only a portion of the scan patches overlap.

[0056] Similarly, for the inconsistency criteria, in one embodiment, the step of determining overlapping digital 3D scans may include establishing overlap criteria that define when a new digital 3D scan (scan patch) overlaps with a current digital 3D scan (jaw scan). Thus, the new digital 3D scan is checked against the overlap criteria, and if at least one of the new digital 3D scans meets the overlap criteria, the new digital 3D scan is determined to be an overlapping digital 3D scan.

[0057] The overlap criterion may include a topological threshold, wherein the new digital 3D scan meets the overlap criterion when a match between a surface of the new digital 3D scan and at least a portion of the current digital 3D scan is above the topological threshold.

[0058] In one embodiment, the overlap criterion may be that the new digital 3D scan (jaw scan) does not meet the inconsistency criterion. For example, if the distance between the data points is below a distance threshold set in the inconsistency criterion, the scan patch overlaps with the jaw scan.

[0059] In one embodiment, when result (a), i.e., the scan patches are inconsistent, and result (b), i.e., the scan patches overlap, cannot be determined, but it is determined that the scan patches can be spliced ​​to the jaw scan, (c), i.e., the scan patch is a new scan surface of the jaw scan, may occur.

[0060] In one embodiment, if none of the results (a), (b) and (c) can be established, an invalid scan patch can be determined, i.e., (d). In this case, the invalid scan patch is discarded or ignored in step 103, and the scanning process returns to step 102, where a new scan patch can be obtained.

[0061] If the comparison step 103 provides any of result (a), ie inconsistent scan patches, result (b), ie overlapping scan patches, and result (d), ie new scan patches, the method may subsequently update the jaw scan in an update step 107 .

[0062] If the scan patch is identified as an inconsistent scan surface as result (a), an updated digital 3D scan is created in an updating step 106, i.e., an updated jaw scan in the current embodiment. An updated jaw scan representing the physical object is created by applying the inconsistent digital 3D scan (i.e., the scan patch) to the current digital 3D scan (i.e., the jaw scan). For some embodiments, step 106 has also been described together with the result (a) in step 103 described above, because these steps are often actually performed together, and therefore are kept together in the present disclosure for ease of reading.

[0063] In one embodiment, applying the inconsistent digital 3D scan (scan patch) to the current digital 3D scan may include overwriting data of the projected area on the current digital 3D scan (jaw scan) with data corresponding to the projected inconsistent digital 3D scan (scan patch).

[0064] Alternatively, applying the inconsistent digital 3D scan (scan patch) to the current digital 3D scan may include adding data of the inconsistent digital 3D scan to corresponding data in the projected area on the current digital 3D scan (jaw scan) in a weighted manner according to a distance value of each corresponding data point, such that if the distance value of the corresponding data point is high, the weight of the added data point from the inconsistent digital 3D scan is high relative to the corresponding data point on the current digital 3D scan.

[0065] In other words, this will have the effect of the new data points of the inconsistent scan patch (the inconsistent digital 3D scan) pulling the surface of the jaw scan (the current digital 3D scan) into its place. This will create a smooth transition along the boundary between the new inconsistent data and the current data, suppressing noise and blending both the surface and / or color.

[0066] Individual data points in the new digital 3D scan may alternatively or additionally be applied to the current digital 3D scan in a weighted order or in a discrete manner according to the distance value.

[0067] In one example, data points of the new digital 3D scan are applied to the current digital 3D scan, such as in a weighted order, relative to distance values ​​between corresponding data points.

[0068] In another example, such as a segmentation order, data points of the new digital 3D scan are applied in a first manner whose distance metric relative to corresponding data points in the current digital 3D scan is above a threshold, and data points of the new digital 3D scan are applied in a second manner whose distance metric relative to corresponding data points in the current digital 3D scan is below the threshold.

[0069] The first manner and the second manner may be a discrete order or a continuous weighted order or a combination thereof.

[0070] If the scan patch is identified as an overlapping digital 3D scan, as result (b) in step 103, the updating step 107 may include a step 105 of merging the overlapping digital 3D scan (scan patch) with the current digital 3D scan (jaw scan) so as to obtain an updated digital 3D scan (updated jaw scan).

[0071] If the scan patch is identified as a new scan surface of the jaw scan, such as result (c) in step 103 , the updating step 107 may include the step 104 of stitching the scan patch to the jaw scan.

[0072] Generally this will be a normal scanning operation for an intraoral scanner, where a scan patch is added to the jaw scan, thereby extending the scanned surface / volume. Stitching scans is generally known, and involves identifying a common reference in the scans to be stitched, and then combining the scans by aligning them at the common reference.

[0073] As mentioned above, the scanning can be done by an intraoral scanner. In such a case, multiple new digital 3D scans (scan patches) are continuously received as a scan stream. Therefore, in step 103, the scan patches need to be continuously compared with the jaw scan. For example, this occurs when Figure 1 In an embodiment, after updating the jaw scan with the previous scan patch in step 107, the method returns to step 102 to receive the next scan patch in the scan stream.

[0074] Thus, as an example, the method may comprise the step of successively stitching a plurality of new digital 3D scans (scan patches) to each other.

[0075] Similarly, the method may include the steps of: continuously determining inconsistent digital 3D scans, wherein at least a portion of at least one new digital 3D scan does not overlap with at least a portion of a current digital 3D scan; and continuously creating updated digital 3D scans representing the physical object by applying the inconsistent digital 3D scans to the current digital 3D scan.

[0076] Additionally, the computer-implemented method may include the step of continuously checking the at least one new digital 3D scan against an inconsistency criterion, and / or the step of continuously determining overlapping digital 3D scans in which at least a portion of the new digital 3D scan overlaps with at least a portion of the current digital 3D scan.

[0077] It should be understood that when inconsistent digital 3D scans or overlapping digital 3D scans are determined, these are not necessarily established as separate scan objects or files in the computer-implemented method. In one embodiment, annotations may be completed in the current digital 3D scan or the new digital 3D scan to identify portions thereof as inconsistent digital 3D scans and / or overlapping digital 3D scans.

[0078] Furthermore, when creating an updated digital 3D scan, a blending algorithm may be used when inconsistent digital 3D scans or overlapping digital 3D scans are applied to a current digital 3D scan. This avoids jagged edges / overlaps, unnatural changes in color, etc. Such blending algorithms or techniques are known and used by those skilled in the art when combining 3D digital models.

[0079] The scans obtained may be different types of scans, for example, they may store data and represent the scanned object in different ways. For example, a digital 3D scan may be volumetric information, a mesh, or a point cloud.

[0080] Furthermore, it should be understood that in some embodiments, the scan represents the geometry of the surface of the object. However, additional information may also be obtained and updated in the methods disclosed herein. Such information may be, for example, color, fluorescence, and infrared.

[0081] For example, inconsistency criteria and / or overlap criteria may also include requirements for such additional information.

[0082] Despite Figure 1 The scanning method may further comprise the step of pre-processing the at least one new digital 3D scan (scan patch) as discussed in and disclosed herein.

[0083] One pre-processing step may for example be a so-called soft tissue removal process, where the pre-processing applies a removal process to at least one new digital 3D scan for removing unwanted scan elements. Soft tissue may for example be cheeks or tongue that get in the way when scanning. Pre-processing may also remove metal objects (such as dentist mirrors or other dentist tools).

[0084] The removal process may be, for example, a trained machine learning algorithm.

[0085] Figure 2a , Figure 2b and Figure 2c Different actual scanning situations that may lead to different scanning results (a), (b) and (c) as described above are illustrated by way of example.

[0086] Figure 2aAn intraoral scanner 200 is shown scanning teeth 201 in a jaw. The teeth are represented by the shaded area. A current digital scan 202 (eg, a tooth scan) of at least a portion of the teeth has been obtained and is shown as a solid line surrounding the shaded area representing the teeth.

[0087] The intraoral scanner obtains image sub-segments of the teeth while scanning. The sub-segments are partially determined by the field of view 203 defined by the dashed lines A and B. The images taken by the sub-segments can subsequently be further processed into scan patches that are partial 3D representations of the objects scanned by the intraoral scanner.

[0088] exist Figure 2a , an inconsistent segment 204 has been recorded during a previous scanning segment. As shown, it can be seen that in the inconsistent segment, the current digital scan does not follow the shaded area representing the teeth. Such an inconsistent segment may, for example, have been previously created if saliva or foreign objects were present during the scanning segment. However, in the current scanning session, the intraoral scanner obtains a scan patch 205 shown by the shaded line segments, wherein the surface represented in the scan patch follows the surface of the teeth.

[0089] A method as disclosed herein will determine, in one embodiment as discussed, that (a) the scan patch is an inconsistent scan surface of the tooth scan 202 , wherein at least a portion of the scan patch does not overlap with at least a portion of the jaw scan 202 .

[0090] Thus, an updated dental scan (not shown) may be created by overlaying data from the dental scan 202 in the field of view 203 with data from a scan patch taken in the field of view 203 .

[0091] As discussed herein, inconsistent digital 3D scans (e.g. Figure 2a The scan patch 204 in question is not necessarily the result of a scanning error. It can also be used to update a scan of a tooth or other dental object after it has been modified. For example, if a crown is planned to be provided on a tooth, three scanning steps can be performed, the first scanning step being on an original tooth that may be damaged and for which the crown treatment is therefore planned. The tooth is subsequently prepared and a second scanning session is performed, in which the inconsistent scan is determined when the tooth has been prepared and the first scan is updated with the inconsistent scan so that the first scan represents the prepared tooth. Finally, a third scanning session can be performed after the crown has been placed, in which the inconsistent scan is determined based on the updated scan representing the prepared tooth and the crown scan received in the third scanning session. Thus, a further update of the scan can be accomplished, wherein the portion of the scan representing the prepared tooth is overwritten by the scan representing the crown.

[0092] Figure 2b An embodiment is illustrated in which the method determines that (b) a scan patch 206 is an overlapping scan surface of a dental scan and merges the scan data of the scan patch with the dental scan in the field of view 203 of the intraoral scanner, wherein the scan patch 206 is shown by a shaded line segment superimposed on a line segment representing a jaw scan 202.

[0093] In such Figure 2c In another case shown in FIG. 1 , the method determines that (c) the scan patch 207 represented by the shaded line segment is a new scan surface of the jaw scan. This is a case where the method determines that the scan patch has some overlap with the tooth scan 202, but a surface has been obtained without a reference, e.g., it cannot be determined to be overlapping or inconsistent. In such a case, the method in the current embodiment determines that the scan patch represents a new surface of the tooth 201 and splices the scan patch to the tooth scan 202, effectively increasing the area of ​​the scanned surface of the tooth obtained.

[0094] Another embodiment 300 of a computer-implemented method for updating a current digital 3D scan representing a surface of a physical object with at least one new 3D scan is shown in FIG. 2 .

[0095] In step 301, a sequence of scan patches for generating a current digital 3D representation is obtained. Each scan patch representing a captured portion of a dental object is made via a dental imaging device, such as an intraoral scanner.

[0096] In step 302, the current digital 3D representation is identified as "outdated". This may be done manually by user input, if the current digital 3D representation is loaded into the system and / or has a timestamp older than a predetermined time, it may be done. As will be appreciated by those skilled in the art, many other criteria may be established for identifying the current 3D representation as outdated.

[0097] In step 303, a subsequent scan patch is obtained.

[0098] In step 304, the subsequent scan patches are compared with the current digital 3D model to determine whether the at least one subsequent scan patch is inconsistent with the current digital 3D model.

[0099] This may be achieved by determining whether data points in at least a portion of a subsequent scan patch differ from at least a portion of the current digital 3D representation.

[0100] If it is determined that the scan patch is inconsistent, then an updated digital 3D representation may be generated in step 305 by replacing data points from the inconsistent scan patch with corresponding data points in the current digital 3D representation.

[0101] After updating the current digital 3D representation in step 305 , the method may return to step 303 and obtain a further subsequent scan patch.

[0102] In some embodiments, a step is performed to align the new 3D scan with the current digital 3D scan. This is typically the case when the current digital 3D scan has been taken in a different scanning session and the new 3D scan needs to be arranged in the same coordinate system as the current digital 3D scan.

[0103] Thus, it should be understood that the overlapping and inconsistent scanned surfaces discussed herein may be both aligned and non-aligned. In general, as discussed herein, alignment involves bringing a dataset or surface representation, such as a current digital 3D scan (such as a jaw scan) and the at least one new digital 3D scan (such as a scan patch), into a common coordinate system. Thus, for example, Figure 1 As discussed in , the inconsistent scan patches in result (a) can be aligned when they are spliced ​​together with the previous scan patches, the overlapping scan patches in result (b) can be aligned when they are spliced ​​together with the previous scan patches, and the new scan patches in result (c) can be aligned when they are spliced ​​together with the previous scan patches.

[0104] However, in one embodiment, aligning the new 3D scan with the current digital 3D scan may be achieved by using overlapping digital 3D scans.

[0105] In other embodiments, the step of aligning the at least one new 3D scan with the current digital 3D scan comprises using alignment mark data from physical marks at the physical object.

[0106] The updated digital 3D scan is typically output to a peripheral output device, such as a monitor, which a user can visually follow as the patient is scanned. The monitor may, for example, be part of a scanning system, such as an intraoral scanner.

[0107] Figure 4 An embodiment of a scanner system 400 for intra-oral scanning of dental objects is shown.

[0108] The scanner system may include a scanning probe 401 for receiving an image of a dental object.

[0109] A laptop computer 406 may be provided in wireless communication with the scanning probe, the laptop computer 406 having a peripheral output device 402 in the form of a monitor for visualizing a digital 3D representation 404 of a dental object. Alternatively, a desktop computer or other computing device (e.g., a desktop) may be provided in communication with the scanning probe. The communication may be done wirelessly as described, or may be done wired.

[0110] A computer processor 405 and other electronic hardware may be disposed in the scanning probe and enable wireless communication via a controller 406 in the scanning probe and a controller 407 in the laptop computer 406 .

[0111] The laptop receives data from the scanning probe and outputs the calculated data to the monitor.

[0112] As discussed herein, a computer-implemented method for updating a current digital 3D scan representing a surface of a dental object with at least one new 3D scan to provide an updated digital 3D scan representation of the surface of the dental object may be performed by the scanning system 400 .

[0113] The computer processors provided in scanning probes and laptop computers are generally composed of different types of electronic hardware. The electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other appropriate hardware configured to perform various functions described throughout this disclosure. Computer programs should be broadly interpreted as instructions, instruction sets, codes, code segments, program codes, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executable programs, execution threads, processes, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description languages, or otherwise.

[0114] The scanner system disclosed herein may be an intraoral scanning device (such as the TRIOS series scanners from 3Shape A / S), or a laboratory-based scanner (such as the E series scanners from 3Shape A / S). The scanning device may employ scanning principles such as triangulation-based scanning, confocal scanning, focused scanning, ultrasonic scanning, x-ray scanning, stereoscopic vision, motion structure, optical coherence tomography OCT, or any other scanning principle. In an embodiment, the scanning device is operated by projecting a pattern and translating a focal plane along an optical axis of the scanning device and capturing a plurality of 2D images at different focal plane positions, such that each captured series of 2D images corresponding to each focal plane forms a stack of 2D images. The acquired 2D images are also referred to herein as raw 2D images, where raw in the context of this document means that the images have not been image processed. The focal plane position is preferably moved along the optical axis of the scanning system, such that for a given view of the object, i.e., for a given arrangement of the scanning system relative to the object, the 2D images captured at a plurality of focal plane positions along the optical axis form a stack of the 2D images (also referred to herein as sub-scans). After the scanning device is moved relative to the object or after imaging the object in different views, a stack of new 2D images of the view can be captured. The focal plane position can be changed by at least one focusing element (e.g., moving the focusing lens). The scanning device is generally moved and angled during the scanning session so that at least some groups of sub-scans overlap at least partially to enable stitching during the scan. The result of the stitching is a digital 3D representation of the surface that is larger than the surface that can be captured by a single sub-scan, i.e., larger than the field of view of the 3D scanning device. Stitching, also known as registration, is performed by identifying the overlapping areas of the 3D surface in the 3D surface of the previous sub-scan / record, and converting the new sub-scan to a common coordinate system so that the overlapping areas match, ultimately generating a digital 3D model. For this purpose, an iterative closest point (ICP) algorithm can be used. Another example of a scanning device is a triangulation scanner, in which a time-varying pattern is projected onto a dental object, and a sequence of images of different pattern configurations is acquired by one or more cameras positioned at an angle relative to the projection unit.

[0115] The scanning device includes one or more light projectors configured to generate an illumination pattern to be projected onto a three-dimensional dental object during a scanning session. The (one or more) light projectors preferably include a light source, a mask having a spatial pattern, and one or more lenses (such as a collimating lens or a projection lens). The light source can be configured to generate light of a single wavelength or a combination of wavelengths (monochromatic or polychromatic). The combination of wavelengths can be generated by using a light source configured to generate light including different wavelengths (such as white light). Alternatively, the (one or more) light projectors can include a plurality of light sources (such as LEDs) that individually generate light of different wavelengths (such as red, green, and blue), which can be combined to form light including different wavelengths. Therefore, the light generated by the light source can be defined by a wavelength that defines a specific color, or by a range of different wavelengths that define a combination of colors (such as white light). In an embodiment, the scanning device includes a light source configured to excite a fluorescent material of a tooth to obtain fluorescent data from a dental object. Such a light source can be configured to generate a narrow range of wavelengths. In another embodiment, the light from the light source is infrared (IR) light that can penetrate dental tissue. The (one or more) light projectors can be a DLP projector that uses a micromirror array to generate a time-varying pattern, or a diffractive optical element (DOF), or a backlit mask projector, where a light source is placed behind a mask having a spatial pattern, whereby the light projected on the surface of the dental object is patterned. The backlit mask projector can include a collimating lens for collimating light from the light source, the collimating lens being placed between the light source and the mask. The mask can have a checkerboard pattern so that the generated illumination pattern is a checkerboard pattern. Alternatively, the mask can feature other patterns such as lines or dots, etc.

[0116] The scanning device preferably also includes optical components for directing light from the light source to the surface of the dental object. The specific arrangement of the optical components depends on whether the scanning device is a focused scanning device, a scanning device using triangulation, or any other type of scanning device. The same applicant also describes a focused scanning device in EP 2 442 720 B1, the entire content of which is incorporated herein.

[0117] Using the optical components of the scanning device, light reflected from the dental object in response to the illumination of the dental object is directed toward (one or more) image sensors. (One or more) image sensors are configured to generate multiple images based on the incident light received from the illuminated dental object. The image sensor can be a high-speed image sensor, such as an image sensor configured to acquire images with an exposure of less than 1 / 1000 seconds or a frame rate of more than 250 frames per second (fps). As an example, the image sensor can be a rolling shutter (CCD) or a global shutter sensor (CMOS). (One or more) image sensors can be monochrome sensors including an array of color filters (such as Bayer filters and / or additional filters), which can be configured to substantially remove one or more color components from the reflected light before the reflected light is converted into an electrical signal and retain only other unremoved components. For example, such additional filters can be used to remove a portion of the white light spectrum (such as a blue component) and retain only the red component and the green component in the signal generated in response to the excitation fluorescent material of the tooth.

[0118] The dental scanning system preferably also includes a processor configured to generate scan data (intraoral scan data) by processing a two-dimensional (2D) image acquired by the scanning device. The processor may be part of the scanning device. As an example, the processor may include a field programmable gate array (FPGA) and / or an advanced RISC machine (ARM) processor located on the scanning device. The scan data includes information related to a three-dimensional dental object. The scan data may include any of the following: a 2D image, a 3D point cloud, depth data, texture data, intensity data, color data, and / or a combination thereof. As an example, the scan data may include one or more point clouds, each of which includes a set of 3D points describing a three-dimensional dental object. As another example, the scan data may include an image, each image including image data described, for example, by image coordinates and a timestamp (x, y, t), wherein depth information may be inferred from the timestamp. The (one or more) image sensors of the scanning device may acquire multiple original 2D images of a dental object in response to irradiating the object using one or more light projectors. Multiple original 2D images may also be referred to herein as stacks of 2D images. The 2D image may subsequently be provided as an input to a processor that processes the 2D image to generate scan data. The processing of the 2D image may include a step of determining which portion of each of the 2D images is in focus in order to infer / generate depth information from the image. The depth information may be used to generate a 3D point cloud, which includes, for example, a set of 3D points in a space described by Cartesian coordinates (x, y, z). The 3D point cloud may be generated by a processor or another processing unit. Each 2D / 3D point may also include a timestamp indicating when the 2D / 3D point was recorded (i.e., which image in the stack of 2D images the 2D / 3D point originated from). The timestamp is related to the z coordinate of the 3D point, i.e., the z coordinate may be inferred from the timestamp. Therefore, the output of the processor is scan data and the scan data may include, for example, image data and / or depth data described by image coordinates and timestamps (x, y, t) or alternatively described as (x, y, z). The scanning device may be configured to transmit other types of data in addition to the scan data. Examples of data include 3D information, texture information such as infrared (IR) images, fluorescent images, reflectance color images, X-ray images, and / or combinations thereof.

[0119] Although some embodiments have been described and shown in detail, the present disclosure is not limited to such details, but may also be implemented in other ways within the scope of the subject matter defined in the appended claims. In particular, it should be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope of the present invention.

[0120] Benefits, other advantages, and solutions to problems have been described herein with respect to specific embodiments. However, benefits, advantages, solutions to problems, and any (one or more) components / (one or more) units that may cause any benefit, advantage, or solution to appear or become more significant should not be construed as key, essential, or necessary features or components / elements of any or all claims or the present invention. Therefore, the scope of the present invention is limited only by the appended claims, in which, unless explicitly stated, reference to a component / unit / element in the singular does not mean "one and only one", but "one or more". A claim may refer to any of the preceding claims, and "any" is understood to mean "any or more" of the preceding claims.

[0121] It is intended that structural features of the apparatus described above in the detailed description and / or claims may be combined with steps of the method when appropriately replaced by corresponding processes.

[0122] As used, the singular forms "a", "an" and "the" are intended to also include the plural forms (i.e., have the meaning of "at least one"), unless expressly stated otherwise. It will also be understood that the terms "includes", "comprises", "including" and / or "comprising", when used in this specification, specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or combinations thereof. It will also be understood that, unless expressly stated otherwise, when an element is referred to as being "connected" or "coupled" to another element, the element may be directly connected or coupled to the other element, but there may also be intermediate elements. In addition, "connected" or "coupled" as used herein may include wirelessly connected or coupled. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. Unless expressly stated otherwise, the steps of any disclosed method are not limited to the exact order stated herein.

[0123] It should be understood that throughout the specification, references to "one embodiment" or "embodiment" or "aspect" or features included as "possible" mean that the particular features, structures or characteristics described in conjunction with this embodiment are included in at least one embodiment of the present disclosure. In addition, in one or more embodiments of the present disclosure, the particular features, structures or characteristics may be appropriately combined. The previous description is provided to enable those skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects.

[0124] The claims are not intended to be limited to the aspects shown herein, but are to be accorded the full scope consistent with the language of the claims, wherein elements referred to in the singular are not intended to mean "one and only one" unless specifically so stated, but rather to mean "one or more." Unless specifically stated otherwise, the term "some" means one or more.

Claims

1. A computer-implemented method for updating a current digital 3D scan, the current digital 3D scan representing a surface of a physical object, by using at least one new 3D scan, in, the updating of the current digital 3D scan providing an updated digital 3D scan representation of the surface of the physical object, The computer-implemented method comprises the following steps: obtaining the current digital 3D scan, the current digital 3D scan comprising surface information of a surface area of ​​the physical object; obtaining the at least one new digital 3D scan, the at least one new digital 3D scan comprising new surface information of at least a partial area of ​​the surface of the physical object; determining an inconsistent digital 3D scan, wherein the determination of the inconsistent digital 3D scan comprises comparing the surface information with the new surface information, and wherein the inconsistent digital 3D scan comprises at least a portion of the new surface information that does not overlap with at least a portion of the surface information; and Determining an updated digital 3D scan representation representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan such that at least a portion of the surface information of the current digital 3D scan is replaced by at least a portion of the new surface information.

2. The computer-implemented method of claim 1, in, The steps to identify inconsistent digital 3D scans also include: · establishing an inconsistency criterion defining when the new digital 3D scan does not overlap with the current digital 3D scan; checking the new digital 3D scan against the inconsistency criteria; and • Determining the inconsistent digital 3D scan as a portion of the at least one new digital scan that meets the inconsistency criteria.

3. The computer-implemented method of claim 2, in, The inconsistency criterion comprises a distance threshold, wherein the new digital 3D scan meets the inconsistency criterion when a distance between the at least one new digital 3D scan and the current digital 3D scan is above the distance threshold.

4. A computer-implemented method according to claim 1, 2 or 3, in, The method further comprises the following steps: • Determining an overlapping digital 3D scan in which at least a portion of the new digital 3D scan overlaps with at least a portion of the current digital 3D scan.

5. The computer-implemented method of claim 4, in, The step of creating the updated digital 3D scan further comprises merging the overlapping digital 3D scan with the current digital 3D scan.

6. A computer-implemented method according to claim 4 or 5, in, The step of determining overlapping digital 3D scans also includes: · establishing overlap criteria defining when the new digital 3D scan overlaps with the current digital 3D scan; checking the new digital 3D scan against the overlap criteria; and • Determining the overlapping digital 3D scan as a part of the at least one new digital 3D scan that meets the overlapping criteria.

7. A computer-implemented method according to any one of the preceding claims, in, The method further comprises the step of aligning the new 3D scan with the current digital 3D scan.

8. A computer-implemented method according to claim 7 and any one of claims 3 to 7, in, The step of aligning the new 3D scan with the current digital 3D scan comprises using the overlapping digital 3D scans.

9. A computer-implemented method according to claim 7 or 8, in, The step of aligning the at least one new 3D scan with the current digital 3D scan comprises using alignment mark data from physical marks at the physical object.

10. A computer-implemented method according to any one of the preceding claims, in, The at least one new digital 3D scan is received from an intraoral scanner.

11. A computer-implemented method according to any one of the preceding claims, in, Multiple new digital 3D scans are continuously received as a scan stream.

12. The computer-implemented method of claim 12, in, The method further comprises the following steps: • Continuously stitching the multiple new digital 3D scans to each other.

13. A computer-implemented method according to any one of the preceding claims, in, At least the following steps of the computer-implemented method are performed continuously: determining an inconsistent digital 3D scan, wherein the determination of the inconsistent digital 3D scan comprises comparing the surface information with the new surface information, and wherein the inconsistent digital 3D scan comprises at least a portion of the new surface information that does not overlap with at least a portion of the surface information; and Determining an updated digital 3D scan representation representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan such that at least a portion of the surface information of the current digital 3D scan is replaced by at least a portion of the new surface information.

14. The computer-implemented method of claim 13, in, Any of the following steps of the method are performed continuously: checking the at least one new digital 3D scan against the inconsistency criteria; and / or • Determining an overlapping digital 3D scan in which at least a portion of the new digital 3D scan overlaps with at least a portion of the current digital 3D scan.

15. A computer-implemented method according to any one of the preceding claims, in, The step of creating an updated digital 3D scan representing the physical object by applying the inconsistent digital 3D scan to the current digital 3D scan further comprises: Projecting the inconsistent digital 3D scan onto the current digital 3D scan; and - Applying the data of the inconsistent 3D scan to the data of the projection area on the current digital 3D scan such that at least part of the surface information of the current digital 3D scan is replaced by at least part of the new surface information.