System and method for generating digital three-dimensional tooth models

By generating a virtual three-dimensional tooth model and using texture data to identify the tooth condition, the problem of difficulty in early detection of tooth condition in the prior art is solved, and accurate monitoring and prevention of tooth condition is achieved.

CN113811916BActive Publication Date: 2024-11-153SHAPE AS
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202080035006.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-11
Filing Date
2020-03-11
Publication Date
2024-11-15
Estimated Expiration
2040-03-11

AI Technical Summary

Technical Problem

The prior art is difficult to detect and monitor the development of dental conditions early, especially dental caries, which lead to difficult identification of caries in the early stages of formation and may lead to irreversible dental damage.

Method used

By generating a virtual three-dimensional model representing tooth condition, using digital 3D models and texture data, including fluorescence data and color data, to identify areas of tooth condition, and using recognition and severity functions to determine the severity of tooth condition, generating visual indicators Shows tooth condition.

Benefits of technology

Early detection and monitoring of dental conditions is achieved, the existence and severity of caries can be accurately identified, timely prevention and treatment measures are provided, and tooth damage is avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113811916B_ABST
    Figure CN113811916B_ABST
Patent Text Reader

Abstract

According to one embodiment, a method for generating a digital three-dimensional model representing the development of a dental condition of teeth is disclosed. The method includes obtaining a first digital 3D model of a patient's set of teeth including first texture data and a second digital 3D model of the patient's set of teeth including second texture data at different time points. The first digital 3D model including the first texture data and the second digital 3D model including the second texture data are placed in a common texture space by unifying the textures. Finally, based on a comparison of the first texture data and the second texture data of corresponding areas in the first digital 3D model and the second digital 3D model placed in the common texture space, a digital three-dimensional model representing the development of a dental condition is generated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a system and method for generating a digital three-dimensional tooth model. In particular, the present disclosure relates to unifying textures between multiple digital three-dimensional tooth models. The present disclosure also relates to generating a digital three-dimensional model representing a patient's dental condition (e.g., caries, fluorosis, gingivitis) or the progression of a dental condition. In addition, the present disclosure relates to identifying healthy areas in a digital 3D model of a patient's teeth. Background Art

[0002] Dental diseases often progress over time and, without proper care, can lead to irreversible conditions that may even require the removal of the diseased tooth. Early detection and monitoring of the progression of dental conditions is therefore necessary. This will allow for preventive or corrective measures to be taken in a timely manner.

[0003] For example, dental conditions such as caries (also known as cavities or cavities) are one of the most common and prevalent persistent diseases today, and one of the most preventable.

[0004] Often, caries may be found as occlusal caries, which form at the very top of the tooth where food particles repeatedly come into direct contact with the tooth. It is at this location that bacteria fester and become a threat to oral hygiene. If the tooth and surrounding area are not properly cared for, bacteria begin to digest sugars left over from food in the mouth and convert them into acids as waste products. These acids may be strong enough to demineralize the enamel on the tooth and form small holes – the first stage of caries. As the enamel begins to break down, the tooth loses its ability to naturally strengthen the tooth’s calcium and phosphate structure through the properties of saliva, and over time, the acids penetrate the tooth and destroy it from the inside out.

[0005] Although tooth decay can have an impact on your teeth if you don’t pay attention to it, tooth decay or cavities are largely preventable with a good oral hygiene regimen. This includes regular dental checkups. The dentist will typically look at the teeth and may use a tool called a probe to probe them, looking for pits or damaged areas. The problem with these methods is that they often fail to identify holes when they happen to be forming. Sometimes, if too much force is used, the probe can puncture porous tooth enamel. This can cause irreversible hole formation and allow the bacteria that cause the holes to spread to healthy teeth.

[0006] Caries that destroy tooth enamel cannot be reversed. Most cavities will continue to worsen and deepen. Over time, the tooth may decay down to the root, which can cause significant discomfort to the patient if not treated. How long this takes will vary from person to person, as well as the general level of oral hygiene.

[0007] Caries that are caught in the very early stages are reversible. White spots may indicate early caries that are forming a porous structure in the tooth enamel. In the early stages of caries development, the decay can be stopped. It can even be reversed because the material dissolved into the enamel can be replaced. Fluoride and other prevention methods also help teeth in the early stages of caries to repair themselves (remineralize). Brown / black spots are the last stage of early caries. Once caries has progressed, the porous tooth structure may collapse, creating an irreversible hole in the enamel so that only a dentist can repair the tooth. The standard treatment for the hole is then to fill the tooth with a filling usually made of dental amalgam or composite resin. Sometimes bacteria may infect the pulp inside the tooth, even though the portion of the tooth that one may see remains relatively intact. In this case, the tooth often requires root canal treatment or even extraction of the damaged tooth.

[0008] It can be observed that the development of dental caries is a process that is easily treatable if it is detected early. If not detected and treated, dental caries may progress through the outer enamel layer of the tooth to the softer dentin, requiring tooth extraction or causing inflammation of the periodontal tissue surrounding the tooth.

[0009] Therefore, there is a need to provide a solution to allow professionals, such as dentists, to detect and monitor the development of dental conditions, such as caries, in a patient's teeth, preferably early in the process. Summary of the invention

[0010] According to an embodiment, a method for generating a virtual three-dimensional model representing a dental condition at an area is disclosed. The method includes obtaining a first digital 3D model of a patient's set of teeth and area-specific texture data corresponding to different areas of the first digital 3D model, the texture data including fluorescence data and color data. Thereafter, an area containing a dental condition is identified. This is based on a recognition value that meets a recognition threshold criterion, wherein the recognition value is calculated by applying a recognition function to the texture data associated with the area of ​​the first digital 3D model. Once the area containing the dental condition is identified, a severity value is determined for at least one area that has been identified as an area containing the dental condition. This is performed by applying a severity function to at least one of the texture data associated with the identified area. Finally, a virtual three-dimensional model including a visual indicator is generated based on the determined severity value of the area containing the dental condition, such as caries. The disclosed method is a computer-implemented method.

[0011] According to one embodiment, a computer-implemented method for identifying healthy tooth regions is disclosed. The method includes obtaining a digital 3D model of a patient's set of teeth and region-specific texture data corresponding to different regions of the digital 3D model, the texture data including at least one of fluorescence data or color data. In one embodiment, for at least one texture component of the obtained texture data, a reference value is determined based on a texture value distribution associated with at least one texture component of the texture data, and regions having corresponding values ​​of the texture component corresponding to the at least one texture component within a specific range of the determined reference value are identified as healthy regions. Alternatively, for the texture data, a reference value is determined based on a texture value distribution associated with the texture data, and regions having texture values ​​within a defined range of the determined reference value are identified as healthy regions. The disclosed computer method can be implemented as an automatic method.

[0012] The texture value distribution may be associated with texture values ​​of the texture data or values ​​derived therefrom, such as from a particular channel of the texture data, the texture values ​​being associated with a region of a morphological entity, such as a particular tooth or jaw as a whole.

[0013] According to one embodiment, a computer program product embodied in a non-transitory computer readable medium is disclosed. The computer program product including computer readable program code is executable by a hardware data processor to cause the hardware data processor to perform a method for identifying healthy tooth regions. The method includes obtaining a digital 3D model of a patient's set of teeth and region-specific texture data corresponding to different regions of the digital 3D model, the texture data including at least one of fluorescence data or color data. In one embodiment, for at least one texture component of the obtained texture data, a reference value is determined based on a texture value distribution associated with at least one texture component of the texture data, and a region having a corresponding value of the texture component corresponding to the at least one texture component within a specific range of the determined reference value is identified as a healthy region. Alternatively, for the texture data, a reference value is determined based on a texture value distribution associated with the texture data, and a region having a texture value within a defined range of the determined reference value is identified as a healthy region. In one embodiment, the computer program product including computer readable program code is executable by a hardware data processor to cause the hardware data processor to perform the disclosed method to automatically identify healthy tooth regions.

[0014] According to one embodiment, a method of generating a digital three-dimensional model representing the development of a dental condition of teeth is disclosed. The method includes obtaining a first digital 3D model of a patient's set of teeth and region-specific texture data at a first time point, the texture data including fluorescence data and color data corresponding to different regions of the first digital 3D model. Determining a severity value associated with a severity level of the dental condition for at least one region of the first digital 3D model identified as containing the dental condition by applying a severity function to at least one of the texture data associated with the identified region. Similarly, at a second time point after the first time point, obtaining a second digital 3D model of the patient's set of teeth and region-specific texture data including fluorescence data and color data corresponding to different regions of the second digital 3D model. Determining a severity value associated with a severity level of the dental condition for at least one region of the first digital 3D model identified as containing the dental condition by applying a severity function to at least one of the texture data associated with the identified region. Determining a set of severity differences between the severity values ​​of corresponding regions between the first digital 3D model and the second digital 3D model. Finally, generating a digital 3D model including the set of severity differences. The disclosed method is a computer-implemented method.

[0015] According to one embodiment, a method for generating a 3D graphical model of an oral cavity of a patient over time is disclosed. The method includes obtaining a plurality of scans, each scan representing an oral cavity of the patient at a specific time, and wherein each scan includes texture data; determining at least one texture modification parameter, and presenting the plurality of scans in a time series, wherein the texture of at least one, preferably each, of the corresponding plurality of scans has been modified based on one of the at least one texture modification parameter. The disclosed method is a computer-implemented method.

[0016] According to one embodiment, a method for generating a digital three-dimensional (3D) model representing the development of a dental condition, such as caries of a tooth, is disclosed. The method includes obtaining a first digital 3D model of a patient's set of teeth including first texture data at a first time point; obtaining a second digital 3D model of the patient's set of teeth including second texture data at a second time point; placing the first digital 3D model including the first texture data and the second digital 3D model including the second texture data in a common texture space by unifying the texture; and generating a digital three-dimensional model representing the development of the dental condition based on a comparison of the first texture data and the second texture data of corresponding areas in the first digital 3D model and the second digital 3D model, wherein the texture data are placed in the common texture space. The disclosed method is a computer-implemented method.

[0017] According to one embodiment, a method for generating a digital three-dimensional (3D) model is disclosed. The method comprises:

[0018] obtaining, at a first point in time, a first digital 3D model of a patient's set of teeth including first texture data;

[0019] obtaining, at a second point in time, a second digital 3D model of the patient's set of teeth including second texture data;

[0020] placing a first digital 3D model including first texture data and a second digital 3D model including second texture data in a common texture space by unifying the textures; and

[0021] A first digital 3D model including first texture data and a second digital 3D model including second texture data are displayed on a display unit, wherein the texture data are placed in a common texture space.

[0022] The scan may typically be presented as a digital 3D model of the patient's oral condition, such as a first digital 3D model or a second digital 3D model. The oral condition may include at least one of teeth, gums, soft tissue, or other foreign matter (such as implants, bridges, etc.). Typically, the oral condition includes the patient's teeth, preferably with the patient's gums. In some embodiments, the patient's gums may be removed from the teeth after applying a segmentation technique and then deforming the gums (including standard model gums or artificially generated gums with teeth).

[0023] Modifying the plurality of scans based on one of the at least one texture modification parameters may include applying one of the at least one texture modification parameters to texture data associated with the scans.

[0024] The plurality of scans may be arranged in a time series according to a timestamp associated with the time at which each scan was taken, with or without the application of texture modification parameters. The time series may be represented as a timeline with a plurality of time point entries. In one embodiment, selecting a particular time point renders the associated scan as a digital 3D model on a display. In another embodiment, a user may select more than one time point and more than one scan, as the digital 3D models associated with the individually selected time points may be displayed simultaneously, for example on dual displays (discussed later).

[0025] In embodiments where textures of multiple scans are modified, textures represented in multiple scans are presented along a time series with the texture data in a common texture space. This allows for user-friendly scan visualization and reliable monitoring of oral conditions, as the dental professional's attention is not diverted by texture variations between multiple scans, and scans are processed (e.g., compared) consistently regardless of the variations under which the scans were acquired.

[0026] The term color may refer to a combination of values ​​of the red, green, and blue color channels or to any other representation of a color as a combination of values ​​of different color channels, such as representations in different color spaces. Colors may be represented in different color spaces or converted from one color space to another, such as from a device-dependent color space (such as the RGB color space) to a device-independent color space (such as the CIELAB color space) and vice versa. A color space is usually defined as a three-dimensional numerical scheme in which each human-perceivable color usually has unique coordinates. For example, LAB is a color space defined by the CIE in 1976 to simulate various aspects of human visual representation.

[0027] The method may further include displaying the generated digital 3D model representing the development of a dental condition, such as caries, on a display unit. In one embodiment, before comparing the first texture data and the second texture data, the first digital 3D model and the second digital 3D model are segmented, i.e., individual dental objects such as teeth, tooth separation information or gums are segmented and identified as separate dental objects.

[0028] In various embodiments of the present disclosure, the digital 3D model may also include a 3D representation of the oral condition including the patient's set of teeth.

[0029] The present disclosure and various embodiments are described with respect to a specific dental condition, namely caries as an example. However, the methods disclosed herein can also be used for other dental conditions. The skilled person will understand that, depending on the dental condition, different parts of the oral condition can be used for visualization and comparison. For example, for gingivitis, the relevant oral condition will use the patient's gums.

[0030] The term "based on comparison of first texture data and second texture data" includes two cases: a) direct comparison of the first texture data and the second texture data, and b) indirect comparison of the first texture data and the second texture data, for example by applying a function such as a scoring function or a severity function to the texture data (discussed later).

[0031] The region in the present disclosure may refer to at least the smallest entity that defines the digital 3D model. For example, if the digital 3D model is represented as a polygonal mesh, the region may refer to a facet or even a vertex. Alternatively, if the digital 3D model includes voxels, the region may refer to a voxel. In some embodiments, the region may also include a set of regions, i.e., a plurality of minimal entities grouped together, so that the disclosed method or any one of its steps is performed on a set of regions rather than only on the minimal entity. Therefore, a set of regions may be defined by the edges of the outermost facets. In another embodiment, the region may include an underlying mesh defined by edges, vertices, and faces corresponding to the surface portion of the model that is automatically identified by the processor (e.g., based on segmentation) or identified by means of user input (e.g., using a tool available in a user interface to mark the surface portion). In one case, it is necessary to compare the texture data of digital 3D models represented in different ways, then the method may further include transforming at least one digital 3D model in the same representation to another representation before any processing (e.g., comparison). For example, if one digital 3D model is represented as a polygonal mesh and the other as voxels, at least one of the digital 3D models may be transformed into one of a polygonal mesh representation, a voxel representation, or any other representation so that all models that need to be compared or presented are in the same representation.

[0032] In any of the embodiments disclosed above, the first digital 3D model and the second digital 3D model may be presented on a dual display in a side-by-side manner or in a manner superimposed on each other. The dual display may be understood to include at least two physically different display units or a single display unit, whose display area is divided into at least two display parts, such as display blocks. The term side-by-side manner may be understood to include displaying the two digital models in any of a horizontal layout, a vertical layout, or an inclined layout (e.g., a diagonal layout), wherein each of the first digital 3D model and the second digital 3D model is displayed separately on the dual display from the same viewpoint (e.g., an occlusal view or a lingual view, etc.). Representing the models in this manner may allow for rapid visualization and evaluation of the same viewing angles of different digital 3D models with corresponding texture data.

[0033] During visualization in a side-by-side manner or in a timeline, the method may further include, typically based on user input, a) linking at least two digital 3D models, and / or b) unlinking different digital 3D models. In the former case a), the method may further include: receiving a user model movement instruction for moving the model, including at least one of a displacement (translation), scaling, panning and / or rotation of the model. In response to the model movement instruction, the linked models move at least substantially the same amount and in the same direction at the same time. The user instruction may be received by a button such as a direction / rotation / panning / zoom button in a user interface and / or by interacting with one of the models such as by selecting a model using a mouse and moving the selected model. In the latter case b), the method may further include receiving a user instruction for moving, including at least one of a displacement, scaling, panning and / or rotation of the model. Unlike case a); in case b), only the 3D model selected before receiving the instruction is subjected to movement.

[0034] By performing an intraoral scan of the patient's teeth using an intraoral color scanner, obtaining a first digital 3D model with region-specific color data can be achieved. Similarly, the intraoral scanner is configured to excite the fluorescent material of the teeth to obtain a first digital 3D model with region-specific fluorescence data. The fluorescence data can be obtained by the red pixels and green pixels of the scanner's RGB sensor. Therefore, the texture data may include five texture components, namely the RGB channels from the color data and the RG channels from the fluorescence data. Intraoral scanning also allows obtaining topological information of the patient's teeth, i.e., three-dimensional data including the tooth arrangement. Further description is included below.

[0035] In various embodiments, the texture data may include color data and / or fluorescence data. The color data may be obtained by scanning the patient's teeth using a scanner system (e.g., an intraoral scanner capable of recording tooth color). Such a scan allows detection and monitoring of changes in tooth color between two scans acquired at different time points. Such a scan also typically captures topological information of the patient's teeth and may be used to generate a first digital 3D model and a second digital 3D model. Fluorescence data may be obtained by scanning the patient's teeth using a scanner system (e.g., an intraoral scanner capable of exciting a fluorescent material of the tooth) and receiving a fluorescence signal including RGB components in response. Such acquisition of fluorescence data at different time points allows detection and monitoring of changes in fluorescence data associated with the tooth (particularly fluorescence data from a carious area of ​​the tooth) between two scans. In order to obtain fluorescence data, the fluorescence signal received from the tooth in response to exciting the fluorescent material of the tooth is preferably passed through a color filter to at least substantially remove one or more color components from the fluorescence signal and retain only other components that are not removed (e.g., remove a blue component from the fluorescence signal but retain red and green components). Thus, the blue component may be filtered out, thereby obtaining fluorescence data through the red and green pixels of the RGB sensor. In one embodiment, the generation of the first digital 3D model and the second digital 3D model is based on topological information of the patient's teeth collected during fluorescence data acquisition. Alternatively, the generation of the first digital 3D model and the second digital 3D model is based on topological information of the patient's teeth collected during color data acquisition, for example, using topological information obtained when the patient's teeth are illuminated using illumination light that is also used to acquire color data. In this case, the corresponding fluorescence data can be superimposed on the generated first digital 3D model and the second digital 3D model, which may or may not include color data. In one embodiment, the first digital 3D model and the second digital 3D model without texture data can be obtained by scanning a plaster model of the patient's teeth or by removing the color data from a digital 3D model that includes color data and is obtained by scanning the patient's teeth using an intraoral scanner. With respect to measuring fluorescence, reference is provided to U.S. application Ser. No. 14 / 411,160, entitled "3D Intraoral Scanner for Measuring Fluorescence," the disclosure of which is incorporated herein by reference.

[0036] In one embodiment, a digital 3D model based on intraoral topological information is generated based on light reflected from surfaces within the oral cavity. When the surfaces within the oral cavity are illuminated by illumination light from a light source of a 3D scanner system such as an intraoral scanner, the light reflected from the surfaces within the field of view is detected by an image sensor of the 3D scanner system. Based on the reflected light, a data processing unit can calculate sub-scans of areas of the surface arranged within the field of view. For example, when the handheld portion of the 3D scanner system is moved relative to the oral cavity so that different areas of the surface are arranged in the field of view, a series of sub-scans can be calculated. A digital 3d model of the surface / tooth group within the oral cavity can be generated by stitching the sub-scans. Such a 3D scanner system can employ different scanning principles, ranging from focused scanning, confocal scanning, triangulation or other scanning techniques.

[0037] The term 3D model may refer to a three-dimensional tooth model including topological surface information with or without information of sub-surface topology. The sub-surface information may be obtained using scanning techniques that utilize illumination light that can penetrate the patient's tooth surface and in response allow acquisition of sub-surface information.

[0038] In one embodiment, the wavelength of light used to illuminate the tooth surface to obtain color data and / or topological information for generating the digital 3D model is different from the wavelength of light used to illuminate the tooth surface to obtain fluorescence data. In another embodiment, the light used to illuminate the tooth surface to obtain color data and / or topological information for generating the digital 3D model includes multiple wavelengths, which includes the wavelength of light used to illuminate the tooth surface to obtain fluorescence data. In yet another embodiment, the light used to illuminate the tooth surface to obtain color data and / or topological information for generating the digital 3D model includes multiple wavelengths but does not have the wavelength of light used to illuminate the tooth surface to obtain fluorescence data.

[0039] In one embodiment, a first digital 3D model including first texture data and a second digital 3D model including second texture data are placed in a common texture space. Placing the models in a common texture space with a unified texture allows for accurate visualization and comparison between the first texture data and the second texture data to generate a digital 3D model representing the development of a dental condition. This may include determining at least one texture modification parameter and applying at least one of the at least one texture modification parameter to at least one of the first texture data or the second texture data.

[0040] There may be variations during the recording of the texture data at different time points, such as the first time point and the second time point, resulting in the obtained texture data being unsuitable for comparison. Such variations may include, but are not limited to, at least one of the following: ambient light in the room in which the texture data was recorded or the intraoral scanner used to record the texture data, for example due to differences between scanners, between reflectors in different tips, between color calibrations. This will affect any detection and monitoring of the patient's dental health, as actual clinically relevant differences may not be correctly determined. Placing the first texture data and the second texture data in a common texture space is particularly useful, as doing so will at least substantially overcome the problems associated with variations and allow for more accurate and reliable visualization and comparison based on the first texture data and the second texture data.

[0041] The phrase "texture space" may refer to a particular organization of textures, such as a color space. Placing the first texture data and the second texture data in a common texture space is accomplished by unifying the textures, which may refer to minimizing variations between the first texture data and the second texture data. Unifying the textures may generally be understood as texture calibration, and may include a transformation that includes minimizing differences between texture component values ​​of comparable regions of the first texture data and the second texture data.

[0042] In one embodiment, texture calibration comprises minimizing the difference between texture component values ​​of comparable areas of first texture data and second texture data, wherein the texture component values ​​are related to the texture data in a texture space in which the texture data is obtained or present in the digital 3D model, such as an RGB color space. This allows finding at least one transformation operator to calibrate the texture data, which may include one of the first texture data or the second texture data. The calibration produces calibrated texture data and thus unification of the texture. The calibrated texture data can then be associated with the digital 3D model whose texture data is calibrated.

[0043] In another embodiment, texture calibration includes i) converting the first texture data and the second texture data to a uniform texture space or other texture space for comparable areas, and ii) minimizing the difference between the converted first texture data and the converted second texture data. This allows finding at least one transformation operator to calibrate the texture data, which may include one of the first texture data or the second texture data. The calibration produces calibrated texture data and thus produces a uniformity of texture. The calibrated texture data is converted to a target texture space, i.e., a texture space in which the texture data will be visualized and / or compared with other texture data. Such a conversion may also be part of the calibration. After the conversion, the calibrated texture data can then be associated with the digital 3D model whose texture data is calibrated. The uniform texture space may include a perceptually uniform texture space, with respect to human texture (e.g., color) vision, such as a LAB color space. Other texture spaces refer to texture spaces other than the texture space in which the texture data is obtained or exists in the digital 3D model before the conversion. For example, if the first and second texture data are originally represented in an RGB color space, these texture data can be converted to a LAB color space. The values ​​of the texture components of the converted first and second texture data in the LAB color space are minimized, and then at least one transformation operator for calibrating the texture data (e.g., the first texture data) to the calibrated texture data is identified. The calibrated (e.g., first) texture data is then converted into the RGB color space in which the second texture data already exists.

[0044] In one embodiment, placing a first digital 3D model comprising first texture data and a second digital 3D model comprising second texture data in a common texture space with the texture data comprises determining at least one texture modification parameter and applying at least one of the at least one texture modification parameter to at least one of the first texture data or the second texture data.

[0045] The at least one texture modification parameter comprises at least one transformation operator configured to minimize a variation between texture values ​​of comparable regions of the first digital 3D model and the second digital 3D model. The at least one transformation operator may allow one of: i) transforming the first and second texture data from one texture space to a uniform or other texture space and minimizing a difference between the transformed first and second texture data, iii) minimizing a difference between the transformed first and second texture data after the first and second texture data have been transformed to the uniform or other texture space, or ii) minimizing a difference between the first texture data and the second texture data, the first texture data and the second texture data being in a texture space in which the first and second texture data are obtained or present in the first and second digital 3D models.

[0046] By applying at least one texture modification parameter associated with one or more texture components in at least one of the first digital 3D model or the second digital 3D model, texture calibration can be achieved by local adjustment of values ​​or global adjustment. Local adjustment involves texture calibration applied to a selected area of ​​a tooth for which caries is to be identified. Global adjustment involves texture calibration applied to an entire tooth for which caries is to be identified. In one embodiment, multiple teeth can be subjected to local adjustment or global adjustment.

[0047] According to one embodiment, a method for placing a digital 3D model in a common texture space is disclosed. The method includes:

[0048] selecting one of the first digital 3D model or the second digital 3D model;

[0049] selecting at least one region from the selected digital 3D model, the selected region being used for texture calibration;

[0050] identifying a comparable region on another model including an unselected one of the first digital 3D model or the second digital 3D model;

[0051] generating at least one texture modification parameter including a transformation operator based on texture data of a selected region of a selected model and texture data of a comparable region of another model that is not selected; and

[0052] The at least one generated texture modification parameter is applied to texture data of a comparable region of another model that is not selected.

[0053] The above method may further include displaying, on a display unit, another model that is not selected, having at least one generated texture modification parameter applied to the texture data of the comparable region.

[0054] In the embodiment of the preceding paragraph, application of the at least one generated texture modification parameter produces a texture calibration, such as a color calibration, which results in minimizing a shift between textures, such as color between the selected region and the comparable region, the selected region and the comparable region together constituting the comparable region.

[0055] In one embodiment, at least one texture modification parameter is based on first texture data and second texture data. Applying at least one texture modification parameter including a transformation operator to the second texture data calibrates the second texture data and brings the calibrated second texture data to a common texture space defined by the first texture data. In another embodiment, at least one texture modification parameter is based on the first texture data and the second texture data. Applying at least one texture modification parameter including a transformation operator to the first texture data calibrates the first texture data and brings the calibrated first texture data to a common texture space defined by the second texture data. In yet another embodiment, at least one texture modification parameter is based on standard texture data of a standard digital 3D model. At least one texture modification parameter includes a first transformation operator based on the first texture data and the standard texture data and a second transformation operator based on the second texture data and the standard texture data. Applying the first transformation operator to the first texture data and applying the second transformation operator to the second texture data brings the first texture data and the second texture data to a common texture space, which is defined by the standard texture data. In yet another embodiment, at least one texture modification parameter is based on predefined texture data. At least one texture modification parameter includes a first transformation operator based on the first texture data and the predefined texture data and a second transformation operator based on the second texture data and the predefined texture data. Applying a first transform operator to the first texture data and applying a second transform operator to the second texture data brings the first texture data and the second texture data into a common texture space, which is defined by the predefined texture data.

[0056] In order to place the first digital 3D model and the second digital 3D model in a common texture space, target texture data defining a target texture space is selected / defined. Such selection / definition may be based on at least one of the first digital 3D model, the second digital 3D model, a standard digital 3D model, or a predefined texture space. Thus, determining at least one texture modification parameter is based on a reference selected from one of the first digital 3D model, the second digital 3D model, the standard digital 3D model, the predefined texture space, or a combination thereof. The at least one texture modification parameter may be determined based on the target texture space and the texture space of one or more digital 3D models that need to at least substantially match the target texture space by unification of textures.

[0057] In one embodiment, generating at least one texture modification parameter includes a first identified value of a texture component from a comparable region. Such values ​​for defining a color may include a 3-dimensional vector and may be represented in different color spaces, such as RGB, LAB, HSV, etc. RGB is typically the most common color space, but preferably, it may be represented in a LAB color space by converting the texture component from one color space to another. The identified value may be used to determine the difference in value. The following method is disclosed with respect to the RGB color space, but may work with other color spaces, such as the LAB color space. A reference table is generated, the reference table including a region-specific relationship between a reference and a calibrated model. An illustrative table is included below.

[0058]

[0059] Table 1

[0060] Where C_R1 refers to the color in region 1 in the reference, R_R1, G_R1, B_R1 represent the RGB values ​​of region 1 in the reference, and C_CR1 refers to the color in region 1 in the calibrated model, R_C R 1. G_C R 1. B_C R 1 represents the RGB value of region 1 in the model undergoing calibration. It will be appreciated that the table may include values ​​for other regions (eg, region 2) and other models (eg, other models undergoing calibration).

[0061] In various embodiments, the reference is selected from one of the first digital 3D model, the second digital 3D model, the standard digital 3D model, the predefined texture space, or a combination thereof. It will be appreciated that when the standard digital 3D model or the predefined texture space is used as a reference, unifying the texture between the first texture data and the second texture data will require calibrating each of the first texture data and the second texture data so as to reduce the texture value difference between the first texture data and the second texture data.

[0062] Generating at least one texture modification parameter may also include determining a difference between values ​​identified for comparable regions. The difference may generally be calculated as (for illustration, the difference is shown for region 1)

[0063] D(C_R1,C_C R 1) = Sqrt((R_R1–R_C R 1)^2+(G_R1–G_C R 1)^2+(B_R1–B_C R 1)^2)

[0064] Where D(C_R1,C_CR1) represents the difference.

[0065] Generating at least one texture modification parameter may also include determining a transformation operator of a texture, such as a color, based on the calculated difference to modify the texture (e.g., color) subject to the calibration model. Such a transformation operator may result in minimizing the difference (e.g., minimum average difference) between textures (e.g., colors) of comparable regions. As an example, the transformation operator may include applying a 3x3 matrix M as follows:

[0066] C_C R 1_calibrated = M*C_C R 1

[0067] where C_CR1_calibrated texture (eg color) is after applying transformation operator M to pre-calibrated texture for region 1 in the calibration model. The transformation operator can also be a 3x3 matrix combined with an offset, or just an offset or a higher order transformation.

[0068] The same principles can be applied to other areas, allowing for local or global adjustments.

[0069] Other conventionally known techniques for unifying textures may be applied. These may include techniques for converting textures from one texture space to another, such as from RGB color space to uniform texture space; and / or techniques for minimizing differences, such as a linear least squares algorithm or a linear least squares algorithm with constraints.

[0070] According to an embodiment, determining at least one texture modification parameter is based on a reference area including one of a first digital 3D model, a second digital 3D model, and a standard digital 3D model. The method may be configured to automatically select an area. Additionally or alternatively, the referenced portion may be user-selected. For example, a user interface may include an eyedropper tool that allows a user to select an area of ​​a model, for example, by using a mouse, based on which at least one texture modification parameter is determined. In particular, the eyedropper tool allows a user to select a texture such as a color by moving the eyedropper over different areas with separate colors and then sampling the color (e.g., by performing a cursor operation such as a click and drag operation on a touch screen or performing a touch and drag operation). The sampled color may be used to determine a transformation operator, as described above.

[0071] In different embodiments, the values ​​of the texture components (e.g., RGB components of the color) of different regions may be weighted in different ways before calculating the difference. For example, a number that determines the blue overlay may be used; a number that indicates the number of colors that have been averaged may also be used, including a number based on the data quality of the viewing angle and the amplitude of the checkerboard pattern.

[0072] In any embodiment where a difference between texture data for determining at least one texture modification parameter is determined, the method may include averaging the calculated difference (e.g., D(C_R1, C_C)) if the calculated difference is above a certain threshold. R 1)) as outliers. Regions resulting in differences above a certain threshold may be prevented from being used to determine at least one texture modification parameter, since these differences may represent actual changes between the texture data of the first digital 3D model and the texture data of the second digital 3D model. Thus, such regions may not be used to generate a transformation operator for placing the models in a common texture space.

[0073] In different embodiments, a texture (e.g., color) for modification based on at least one texture modification parameter can be identified based on at least one of: by distributing the modified color evenly on the model to be modified, by selecting areas with the highest blue coverage, by selecting only the color on the teeth, by selecting only the color on the gums, areas with color selected by a user, areas selected by a user that are indicated as unchanged, by selecting a specific ratio between the amount of color on the gums and teeth, by selecting areas on the teeth that are generally unchanged such as smooth surfaces on incisors, or by selecting areas with small geometric differences and excluding areas with large geometric changes.

[0074] In one embodiment, a scoring function is applied to at least a portion of the first texture data to generate a first set of classification scores corresponding to different regions of the first digital 3D model; and / or a scoring function is applied to at least a portion of the second texture data to generate a second set of classification scores corresponding to different regions of the second digital 3D model. The set of classification scores represents a collection of scores associated with different regions of the model individually. Typically, the scoring function is applied to texture data associated with the patient's teeth, but the scoring function can be applied to other parts of the oral cavity to identify other dental conditions, such as gums, to identify gingivitis.

[0075] Processing the texture data by applying the scoring function includes detecting one or more caries sites present on the patient's teeth, which will be visualized in the digital 3D model (described later).

[0076] In various embodiments, the scoring function comprises a mathematical relationship comprising one of: i) different texture components from a region of texture data, ii) a single texture component from a region of texture data, iii) the same or different texture components from different regions of texture data, or iv) a single texture component from a region of first texture data and different texture components from a region of second texture data. In addition, the method comprises applying the scoring function to at least a portion of the first texture data, including using texture component values ​​from the first texture data in the scoring function, and applying the scoring function to at least a portion of the second texture data, including using texture component values ​​from the second texture data in the scoring function.

[0077] In one embodiment, the scoring function may include a mathematical relationship that includes different texture (e.g., color) components from the region, typically producing a numerical value, i.e., a classification score. The classification score may indicate a contrast or a version of a contrast between at least two texture components, such as between a red component and a green component of a region, or indicate a representation loss of a component (e.g., a green component) from a region. For example, the mathematical relationship is based on a red component and a green component. The method also includes applying a scoring function to at least a portion of the first texture data and at least a portion of the second texture data. Such an application includes using texture component values ​​from the first texture data, such as a red component value and a green component value of a region, in the scoring function to generate a first set of classification scores. In addition, the application includes using texture component values ​​from the second texture data, such as a red component value and a green component value of a region, in the scoring function to generate a second set of classification scores.

[0078] In one embodiment, the scoring function is defined by Scoring Function 1:

[0079] f(R,G)=(RG) / (R+G)

[0080] Where R represents the value of the red channel, and G represents the value of the green channel of the region, which is obtained from the texture data (such as fluorescence data) of the digital 3D model. The scoring function shown represents the contrast, where the higher the value of f(R,G), the higher the contrast and the higher the severity of caries.

[0081] In another embodiment, the scoring function is defined by Scoring Function 2:

[0082] f(R,G)=(n1*(n2R+n3) / ((n4G+n7)+n8)–n9) / n 10

[0083] Wherein, R represents the value of the red channel, G represents the value of the green channel of the region, which is obtained from the texture data (such as fluorescence data) of the digital 3D model, and n1 to n 10The scoring function shown represents a comparative version, where the higher the value of f(R,G), the higher the severity of caries.

[0084] For example, the equation of the above embodiment can be written as:

[0085] f(R,G)=(300*r / (g+0.0000001)-150) / 255

[0086] in,

[0087] r=((90 / 255)*R)+(60 / 255),

[0088] g=((185 / 255))*G+(70 / 255)

[0089] In another embodiment, the scoring function comprises a mathematical relationship that includes a single texture component of a region. One such scoring function comprises:

[0090] Scoring function 3: f(G) = (1 – G)

[0091] Where G represents the value of the green channel of the region obtained from texture data (such as fluorescence data) of the digital 3D model. The scoring function shown represents the loss of representation of the green component, wherein the lower the value of f(G), the higher the severity of caries. Applying the scoring function includes using the green component value of the region from the texture data in the scoring function. Typically the use of the texture component value is region specific.

[0092] In another embodiment, the classification score is based on healthy areas. This includes a mathematical relationship between one of: i) the same texture (e.g., color) component from different areas (e.g., a healthy area and an area containing a lesion), or ii) different texture (e.g., color) components from different areas (e.g., a healthy area and an area containing a lesion). The method also includes applying a scoring function to at least a portion of the first texture data and at least a portion of the second texture data. Such application includes using texture component values ​​from the first texture data, such as color component values ​​of the same or different texture components of different areas, in the scoring function to generate a first set of classification scores. In addition, the application includes using texture component values ​​from the second texture data, such as color component values ​​of the same or different texture components of different areas, in the scoring function to generate a second set of classification scores.

[0093] In various embodiments, the scoring function may be defined by one of the following mathematical relations:

[0094] Scoring function 4: f = (G HA -G L )) / G HA

[0095] Scoring function 5: f = (R HA -R L )) / R HA

[0096] Scoring function 6: f=((G HA -G L )) / G HA )+((R HA -R L )) / R HA )

[0097] Scoring function 7: f = (G L +R L ) / (G HA +R HA )

[0098] Scoring function 8: f = 1-((G L +R L ) / (G HA +R HA ))

[0099] Among them, G HA and R HA is the average of the green and red components from the healthy area, and is the G of the green and red components from the area containing the lesion L and R L Value. HA and R HA may represent a value obtained from a 3D model comprising a tooth for which the classification score was calculated, or such an average value may represent an average value obtained from healthy areas of different 3D models of the same patient, for example from a 3D model generated based on a previous scan. Thus, scoring functions 4 and 5 represent mathematical relationships between the same texture (e.g. color) components from different areas (e.g. healthy areas and areas containing lesions), and scoring functions 6 to 8 represent mathematical relationships between different texture (e.g. color) components from different areas (e.g. healthy areas and areas containing lesions).

[0100] In the texture data represented by the fluorescence data, the presence of less green light in an area can generally indicate a loss of healthy tooth material, which can indicate the condition of the tooth. Similarly, the presence of more red light in the area indicates a carious area. Therefore, the scoring function can be designed to output a numerical value that captures this principle of specifying the condition of the tooth in the digital 3D model.

[0101] In yet another embodiment, the scoring function may include a mathematical relationship including a single texture component from a region of the first texture data and a different texture component from a region of the second texture data. One such scoring function includes:

[0102] Scoring function 9: f = (1 – G f )+(1–R c )+(1–G c )+(1–B c )

[0103] Among them, G f The value of the green component of the region from the fluorescence data, R c , G c , B c The value of the RGB component of the region from the color data may be represented. Applying the scoring function to at least a portion of the first texture data and at least a portion of the second texture data includes using a green value from the fluorescence data and an RGB color value from the color data in the scoring function. Typically the use of the texture component values ​​is region specific.

[0104] In an embodiment where the classification score is based on a healthy region, the method includes estimating a weighted average / mean value of at least one texture component, such as a green component, from a healthy region of at least one tooth. This can be achieved by, for example, sampling at each vertex or facet in a mesh forming a 3D model for which the classification is to be calculated, a value of at least one component value from the texture data and generating a histogram from the sampled texture values. Such a histogram typically includes a distribution including a distribution of gum texture values, a distribution of healthy tooth texture values, a distribution of diseased tooth texture values, and noise. If the model is segmented, the histogram can be based on a single dental object or a group of dental objects. The dental object group can include teeth with or without gums. Therefore, for the texture value distribution, the digital 3D model as a whole can include a group of dental objects, including teeth with gums but preferably without gums. The method also includes identifying an area representing a healthy region and determining a weighted average / mean value of at least one texture component of the healthy region. This weighted average / mean value can be based on the mode, median, or mean of the distribution.

[0105] The distribution of diseased tooth color values ​​and gum color values ​​may overlap, for example in fluorescence data, because they are both black and red, making it difficult to distinguish between the two. However, by segmenting the 3D model into different dental objects such as gums or teeth and tooth types, it is possible to identify which parts of the mesh belong to the teeth and which parts belong to the gums, filter out the gums and only sample the fluorescence color values ​​from the teeth, thus overcoming the above problem. The distribution of healthy tooth color values ​​has a higher color intensity, allowing healthy areas to be identified and allowing the average to be calculated. From a multimodal distribution consisting of the distribution of healthy tooth color values ​​and the multimodal noise distribution, the distribution pattern of color values ​​belonging to healthy teeth can be found. Therefore, the healthy tooth color distribution can be identified and its average can be calculated.

[0106] The disclosure for identifying healthy areas may be described with respect to severity values, but is equally applicable to all disclosed embodiments requiring identification of healthy areas or determinations based on healthy areas. Healthy (teeth) areas may be understood as areas that may be used as references in several disclosed methods, such as in identification functions, severity functions, or scoring functions, when generating a virtual three-dimensional model representing a dental condition or the development of a dental condition. Healthy (teeth) areas may also include areas that may be classified as areas in good health. Such areas are typically areas that may be identified as areas in good health with a fairly high probability.

[0107] According to one embodiment, the identification of the area containing the dental condition and / or severity value may require the identification of a healthy dental area. In one embodiment, the identification of the healthy area in the obtained first digital 3D model may be performed by a user. The user may perform a visual inspection of at least one of the texture data to manually identify the healthy area. For example, the user may visually inspect the texture (color) data on the first digital 3D model and select an area with a mouse, thereby registering the selected area as a healthy area.

[0108] Additionally or alternatively, healthy areas in the obtained first digital 3D model can be automatically identified, for example, based on an evaluation of one or more texture components obtained from the fluorescence data and / or the color data. For example, the one or more texture components include one or more of a red channel, a green channel, or a combination of red and green channels from the fluorescence data. In another example, the one or more texture components may include one or more of a red channel, a green channel, a blue channel, or a combination of two or more of the red, green, or blue channels. In yet another example, different channels from the color data and the fluorescence data may also be utilized.

[0109] In one embodiment, for at least one texture component of one of the obtained texture data, an evaluation of one or more texture components may be performed by determining a reference value based on a texture value distribution associated with at least one texture component of one of the texture data. Thereafter, an area having a corresponding value of a texture component corresponding to the at least one texture component within a specific range of the determined reference value is identified as a healthy area. Alternatively, for one of the obtained texture data, a reference value is determined based on a texture value distribution associated with one of the obtained texture data, and an area having a texture value within a defined range of the determined reference value is identified as a healthy area. In this embodiment, the determination and identification is based on one of the texture data as a whole, i.e., the contribution of all texture components from one of the texture data is considered, rather than selecting one or more texture components from one of the texture data.

[0110] In any of the foregoing embodiments, the texture value may include an intensity value of at least one texture component / intensity value of one of the texture data or any value derivable from the intensity value. Texture value distribution may be understood as the frequency of value distribution on the region (e.g., different facets / vertices of a mesh) forming the obtained digital 3D model or dental object. Examples of such texture value distribution include histograms such as color intensity histograms, which may represent the frequency of intensity distribution on different regions (e.g., different facets / vertices of a mesh) forming the obtained digital 3D model or dental object. Such a color intensity histogram may be used for one of the texture data, such as fluorescence data or a texture component (e.g., a red channel or a green channel) of one of the texture data. The determination of the reference value includes calculating a value based on the texture value distribution of one of the obtained texture data or at least one texture component of one of the texture data. Such calculation may include calculating one of an average, a weighted average, a median, a mode, or fitting a distribution to the data and selecting the mode of the fitted distribution. Texture values ​​of the components or the texture data as a whole for identifying healthy regions or for the purposes of different disclosed functions may be determined by conventionally known techniques in the field of computer modeling and digital imaging.

[0111] For example, the texture value distribution includes a color histogram generated by extracting specific color components (channels) from a digital 3D model or a specific dental object and plotting counts of color intensities (e.g., number of regions). After the scanning period is completed, the obtained texture data (fluorescence data and color data) can be stored in different vertices of the final 3D mechanical model using the concept of vertex color. In this case, each vertex can contain two color components, one for normal color texture represented in RGB space [R: 0-255; G: 0-255B: 0-255] and one for fluorescence data also represented in RGB space [R: 0-255; G: 0-255; B: 0]. For fluorescence data, no blue data component is available because this color is filtered out during or after the scanning process. When extracting the histogram of different color components of the fluorescence texture data, the red (R) data component from each vertex is extracted, and similarly, the green (G) component can be extracted to generate a green histogram of the fluorescence texture. This means that when displaying a histogram of fluorescent texture data for the green component, low intensity green values ​​originate from vertices that contain primarily red components, and vice versa, so filtering low intensity green values ​​may be useful when determining a reference value.

[0112] In one embodiment, the determination of the reference value may be performed for the first digital 3D model as a whole. In other words, the texture value distribution of the first digital 3D model as a whole represents a texture value associated with the entire digital 3D model or a model portion of more than a single dental object, i.e., a collection of dental objects (e.g., teeth) but less than the entire digital 3D model. The model portion of more than a single dental object may include more than one tooth with gums, but preferably without gums. The selection of more than one dental object may be automatically achieved by manually selecting an area or by selecting a dental object after segmenting the digital 3D dental model. The user may have the possibility to update the automatic selection. Thus, the identification of a dental condition and the determination of a severity value may utilize healthy areas from any part of the dental model. Using the digital 3D model as a whole disclosed in the present embodiment may be useful in cases where it is difficult to obtain a reliable reference value from the texture value or texture value distribution of the dental object being examined for the presence of a dental condition. This may occur when the dental object including the area where the examined dental condition exists has a severe dental condition such as a large caries lesion or a tooth cover, which is usually substantially covered by non-tooth material such as a dental filling. This approach may be computationally faster when determining severity values ​​for different dental objects, since reference values ​​are determined for the entire model as a whole rather than on a single tooth basis and healthy areas are identified. Thus, texture values ​​from healthy areas identified according to this embodiment may be used whenever applicable.

[0113] In another embodiment, before determining the reference value, the first digital 3D model obtained is segmented into individual dental objects and the evaluation is performed on an individual tooth basis. The individual dental objects may represent multiple individual teeth and gums and may also include non-tooth materials such as dental fillings and implants. This allows the use of texture value distributions specific to individual dental objects, such as existing teeth, adjacent teeth, or the same tooth type for the dental condition being examined. Thus, the identification of the dental condition and the determination of the severity value are based on healthy areas from a specific dental object (e.g., tooth), i.e., on an individual tooth basis. This may be particularly useful, for example, molars and premolars are typically darker in color than other teeth (e.g., incisors) and may have lower texture values. When using healthy areas to determine the severity level, locally calculated healthy areas on the basis of individual teeth may perform better than globally (i.e., using the digital 3D model as a whole).

[0114] Because dental objects are individually identifiable, segmentation also provides the possibility to identify dental conditions and / or determine severity values ​​using texture values ​​or healthy areas from individual dental objects, such as existing teeth, adjacent teeth, the same tooth type, or healthy areas of the dental condition being examined. In one embodiment, identification on an individual tooth basis includes identifying a healthy area of ​​a tooth including the area of ​​existence of the dental condition being examined; and a texture value distribution associated with one of at least one texture component derived from the tooth of the dental condition being examined or texture data obtained. Since the healthy area is local to the tooth being evaluated for the dental condition, this approach provides the most reliable results when determining the presence and severity values ​​of the dental condition. In another embodiment, identification on an individual tooth basis includes identifying a healthy area of ​​a tooth adjacent to the tooth of the dental condition being examined and a texture value distribution associated with one of at least one texture component derived from the adjacent teeth or texture data obtained. In yet another embodiment, identification on an individual tooth basis includes identifying in the first digital 3D model a healthy area of ​​a tooth of the same tooth type as the tooth including the area of ​​existence of the dental condition being examined and a texture value distribution associated with one of at least one texture component derived from the tooth of the same tooth type as the tooth of the dental condition being examined or texture data obtained. The same tooth type may refer to a tooth type in the oral cavity, such as an incisor, a canine, a premolar or a molar. The same tooth type may be identified by applying a feature detection technique that allows detecting features of the dental object in the segmented first digital 3D model obtained, thereby allowing identifying the same dental object type based on at least substantially the same set of features, such as landmarks. In cases where it is difficult to obtain reliable reference values ​​from texture values ​​or texture value distributions of the dental object present in the examined dental condition, embodiments utilizing adjacent teeth or the same tooth type may be useful. This may be the case when the dental object including the area in which the examined dental condition is present has a severe dental condition such as a large caries lesion or a tooth coverage, which is typically substantially covered by non-tooth material such as a dental filling. Therefore, where applicable, texture values ​​from a healthy area identified according to these embodiments may be used, i.e., from a healthy area of ​​a tooth present in the examined dental condition, from an adjacent tooth of a tooth present in the examined dental condition or from the same tooth type as the tooth present in the examined dental condition.

[0115] The texture value distribution from the digital 3D model as a whole or from the dental object may include texture value distributions from different regions, including healthy regions, regions that may have dental conditions, and possible noise signals. Therefore, filtering can be applied to obtain filtered texture values ​​that may correspond to potential healthy regions. In one embodiment, before determining the reference value, the texture values ​​are filtered to obtain a filtered texture value distribution. This is achieved by filtering out texture components or texture data with corresponding texture values ​​outside a defined texture value range, and the reference value is determined based on the texture value distribution that falls within the defined texture value range. Healthy regions typically have higher texture values ​​than dental condition regions, and dental condition regions typically have texture values ​​that represent a concentration of low texture values. Filtering can be used by defining at least a minimum threshold, i.e., at least one of the lower thresholds. For example, for a darker face color histogram, texture values ​​(intensities) below a certain value (e.g., 15) can be filtered out. A maximum threshold, i.e., an upper threshold, can also be used to filter out regions that may represent high texture values, such as texture values ​​that represent oversaturated conditions such as highlights. Filtering, in particular the minimum value threshold, allows the removal of outliers (e.g., potential diseased areas) that may negatively impact the determination of the reference value, thereby affecting the identification of the healthy area. Thus, the disclosed filtering improves the reliability of determining the reference value and identifying the healthy area. Those skilled in the art will appreciate that filtering may be applied on a texture value distribution or when selecting texture values ​​that fall within a range before defining the texture value distribution.

[0116] In any of the foregoing embodiments, filtering can be performed automatically or with user intervention. For example, a user can define a threshold to define a defined texture value range. Likewise, an automatically defined texture value range can be updated with user intervention.

[0117] In another embodiment, filtering is performed on the morphological entity data represented in the first digital 3D model to identify the texture value distribution of the healthy area. This is achieved by segmenting the first digital 3D model into dental objects and identifying additional sub-tooth information (such as clefts, cusps, facial and buccal surfaces, etc.). The filtering can be configured to filter out texture value data corresponding to one or more sub-tooth information.

[0118] In several embodiments, the healthy area is identified based on one of: i) at least one of the texture data as a whole, or ii) only one texture component, individually for each texture component, one of a combination of two or more texture components. That is, the texture value distribution based on which the reference value is determined and the healthy area is identified is based on one of the above-mentioned texture data. In one embodiment, the healthy area is identified using the texture value distribution of only one texture component from one of the texture data. The selection of one texture component is based on the texture value distribution that meets the defined criteria. Therefore, the texture component value from the identified healthy area is used in the identification function and the severity function. Since only one texture component is used to identify the healthy area, the calculation can be performed faster. In addition, selecting the texture component that meets the defined criteria can also improve the accuracy of the healthy area identification. In another embodiment, the healthy area is identified separately for each texture component of one of the texture data. If the texture component in one of the texture data is not available (e.g., fluorescence data), the missing texture component can be used from other texture data (e.g., color data). That is, for each texture component, a texture value distribution is defined, and a healthy area specific to each texture component is identified. Texture component values ​​from healthy regions identified specific to a texture component are used for specific texture components in identification functions and severity functions. For example, a healthy region identified based on a color intensity distribution of a green channel is used to provide green channel intensity values ​​for the healthy region in the identification function and severity function. Similarly, a healthy region identified based on a color intensity distribution of a red channel is used to provide red channel intensity values ​​for the healthy region in the identification function and severity function. When texture values ​​of a texture component are used in an identification function or a severity function, this can allow the use of healthy regions identified specifically using texture components. In another embodiment, healthy regions are identified based on a combination of two or more texture components. For example, this can be used by identifying a first healthy region using a texture value distribution of a first texture component (e.g., a red channel) and identifying a second healthy region using a texture value distribution of a second texture component (e.g., a green channel). The overlap of a first healthy region and a second healthy region can define a healthy region from which texture component values ​​are selected for use in the identification function and severity function. Using overlapping healthy regions as healthy regions can improve the reliability of healthy region identification. In yet another embodiment, the texture value distribution of at least one texture data as a whole is used to identify the healthy area, i.e., instead of using individual texture value distributions of different texture components, a texture value distribution of one of the texture data including the combined effect of the different texture components is used. Thus, texture component values ​​from the identified healthy area are used in the identification function and the severity function. Since one of the texture data as a whole is used to identify the healthy area, the method can be computationally faster.

[0119] In view of the above embodiments, it is apparent to those skilled in the art that the determination of reference values ​​and the identification of healthy areas can be based on a combination of a morphological entity and a texture value obtainable from the morphological entity. The morphological entity can include one of the first digital 3D model as a whole, an existing dental object of the dental condition being examined, an adjacent tooth, or a tooth of the same tooth type as the existing tooth of the dental condition being examined. Similarly, the texture value can include at least one of the texture data or at least one of the texture components from at least one of the texture data. As previously described, the present disclosure generally provides guidance on situations where a particular morphological entity and texture value may be preferred over another.

[0120] In view of the above embodiments, it will be apparent to those skilled in the art that other scoring functions may also be utilized to generate a set of classification scores for different regions of the digital 3D model. Such scoring functions may also include dental condition-specific scoring functions. Obviously, the selection of which scoring function to use may be determined by the specificity and sensitivity of the scores generated by the different scoring functions, where the specificity is related to the percentage of healthy areas that are correctly identified as not having a dental condition, and the sensitivity is related to the percentage of diseased areas that are correctly identified as having a dental condition. For example, the selection may be based on the sum of the specificity and sensitivity that meet respective thresholds and the specificity and sensitivity that also meet a minimum threshold. Similarly, the selection of the recognition function and the severity function may be based on the specificity and sensitivity that meet the minimum threshold criteria.

[0121] In one embodiment, the method comprises mapping the generated first set of classification scores onto at least a portion of a first digital 3D model or a copy of the first digital 3D model. The first digital 3D model or the copy thereof comprises first texture data or is free of first texture data. Additionally or alternatively, the method comprises mapping the generated second set of classification scores onto at least a portion of a second digital 3D model or a copy of the second digital 3D model. The second digital 3D model or the copy thereof comprising the mapped second set of classification scores comprises second texture data or is free of second texture data.

[0122] In one embodiment, the first digital 3D model, the copy of the first digital 3D model, the second digital 3D model, and the copy of the second digital 3D model without texture data may be obtained by scanning a toothpaste model of a patient's teeth or by removing the color data from a digital 3D model that includes color data and is obtained by scanning the patient's teeth using an intraoral scanner. In embodiments where the first digital 3D model, the copy of the first digital 3D model, the second digital 3D model, and the copy of the second digital 3D model include texture data, such texture data may include color data and / or fluorescence data.

[0123] In various embodiments, the visual indicator may include a pointer, a heat map, or any other graphical representation typically superimposed on the 3D model of the patient's teeth that indicates a region-specific severity value or severity level or other attribute, such as a score value, rate, or progression of a dental condition. The visual indicator may be presented with different attributes to indicate different severity value ranges or different severity levels. In the case of a heat map, the different attributes may include different colors. For example, a moderate severity level may be represented by orange, while a high severity level may be represented by red.

[0124] Mapping the first set of classification scores typically includes representing, on the first digital 3D model or a copy thereof, classification scores included in the first set of classification scores. Additionally or alternatively, mapping the second set of classification scores includes representing, on the second digital 3D model or a copy thereof, classification scores included in the second set of classification scores. Because the classification scores are determined for a specific area from the digital 3D model, mapping the classification scores includes superimposing or overlaying the classification scores on the specific area. Such superimposition or overlaying allows the classification scores to be represented on the digital 3D model by a visual indication such as a color or a marking.

[0125] Typically, mapping the first set of classification scores typically includes representing classification scores included in the first set of classification scores that fall within predefined different score ranges on the first digital 3D model or a copy thereof with different visual indications (e.g., colors or markings). Additionally or alternatively, mapping the second set of classification scores includes representing classification scores included in the second set of classification scores that fall within predefined different score ranges on the second digital 3D model or a copy thereof with different visual indications. As previously described, the classification scores can indicate not only the presence of caries, but also the severity of caries. The method includes defining different score ranges associated with the severity of caries, and each score range can be associated with a specific color or marking. Therefore, more than one classification score included in a set of classification scores is classified in a defined score range and is mapped to the digital 3D model accordingly with a color or marking associated with the score range in which the classification score is classified. An illustrative classification of classification scores associated with severity and associated colors is shown below.

[0126]

[0127]

[0128] Wherein, CS is the classification score of a region of the digital 3D model, and S1 to S3 are the classification scores of the defined range.

[0129] Table 2

[0130] It is apparent that a skilled person may change at least one of the granularity of the categories by increasing or decreasing the number of categories, changing the score range and changing the associated color. Such changes are within the scope of the present disclosure.

[0131] In one embodiment, the method includes comparing first texture data and second texture data, including determining a difference score between a first set of classification scores and a second set of classification scores for more than one corresponding region. The difference score is calculated for corresponding regions from the first digital 3D model and the second digital 3D model, i.e., regions from the first digital 3D model that correspond to regions from the second digital 3D model. The difference between the classification scores can be used to represent caries progression in a particular region between the first time point and the second time point.

[0132] In another embodiment, the method comprises comparing the first texture data and the second texture data. This comparison comprises determining, for more than one corresponding region, a texture difference between texture values ​​comprised in the first texture data and texture values ​​comprised in the second texture data. Thus, in this embodiment, instead of calculating a difference between classification scores, the identification of caries development may be determined based on a difference in texture data. This difference is region specific, i.e. texture data from a region of the first digital 3D model is compared with texture data from a corresponding region of the second digital 3D model.

[0133] In one embodiment, generating a digital three-dimensional model representing caries development includes mapping difference values ​​and / or texture difference values ​​onto a digital 3D model. The digital 3D model includes at least one of a first digital 3D model, a second digital 3D model, a copy of the first digital 3D model, or a copy of the second digital 3D model. The first digital 3D model or the copy of the first digital 3D model includes first texture data or does not have the first texture data. Additionally or alternatively, the second digital 3D model or the copy of the second digital 3D model includes second texture data or does not have the second texture data.

[0134] Since the difference number or texture difference value is determined for the corresponding area of ​​the digital 3D model, mapping the difference number or texture difference value includes superimposing or overlaying the difference number or texture difference value on the area for which the difference number or texture difference value is calculated. For a digital 3D model including one of the first digital 3D model or the second digital 3D model, such superimposition or overlay is performed on the corresponding area considered to be the corresponding area. The copy of the first digital 3D model or the copy of the second digital 3D model, when used as a digital 3D model representing the development of caries, can utilize areas that reflect the corresponding areas of the first digital 3D model or the second digital 3D model, respectively. Such superimposition or overlay allows the difference number or texture difference value to be represented on the digital 3D model by a visual indication such as a color or a mark.

[0135] In one embodiment, mapping differential scores or texture differences includes representing differential scores and / or texture differences that fall within predefined different difference ranges with different visual indications (such as colors or markers).

[0136] The differential scores and texture differences can represent the severity of caries development between a first time period and a second time period. The method includes defining different defined difference ranges related to the severity of caries development (different for differential scores and texture differences), and each differential score and / or texture difference can be associated with a specific color or marker. Thus, more than one differential score or texture difference is classified in one of the defined difference ranges and is accordingly mapped onto the digital 3D model with the color or marker associated with the difference range in which the differential score or texture difference is classified.

[0137] An illustrative classification based on differential scores or texture differences related to caries development and associated colors is shown below. For simplicity, two embodiments covering differential scores and texture differences are presented in the same table.

[0138] category Predefined difference range Associated Colors Small changes DS <DS1 and / or TDV <TDV1 green Mild changes DS1 ≤ DS < DS2 and / or TDV1 ≤ TDV < TDV2 yellow Moderate changes DS2 ≤ DS < DS3 and / or TDV2 ≤ TDV < TDV3 orange color Big changes DS3≤DS and / or TDV3≤TDV red

[0139] Where DS is the differential score of the corresponding region, and DS1 to DS3 are differential scores of the defined ranges, TDV is the texture differential score of the corresponding region, and TDV1 to TDV3 are texture differences of the defined ranges.

[0140] Table 3

[0141] Based on the above table, those skilled in the art will understand that the development of caries is based on differential scores or texture differences or a combination of differential scores and texture differences. In the case of a combination, according to an embodiment, if only one of the two conditions is met, the priority rule can resolve the conflict. For example, if DS3 ≤ DS but the condition TDV3 ≤ TDV is not met, the method can include applying the priority rule to classify the development of caries and presenting the caries on the digital 3D model with the associated color accordingly. One such rule can include giving priority to differential scores for moderate and large changes, while giving priority to texture differences for small or mild changes, that is, for the given example, if DS3 ≤ DS but TDV3 ≤ TDV is not met, the associated color is red. According to the illustrated rule, if DS < DS1 is not met but TDV < TDV1 is met, the associated color is green. Other priority rules can also be adopted and are within the scope of the present disclosure. In the case of a combination, according to another embodiment, the determination of the area affected by the tooth condition can be based on the sum or weighted sum of the differential score and the texture difference. The sum or weighted sum results in a summed score, which can be associated with different ranges and visual indications reflecting the severity of the development of the tooth condition.

[0142] Obviously, the technician can change at least one of the granularity of the categories by increasing or decreasing the number of categories, changing the predefined difference range, changing the associated color and priority rules. Such changes are within the scope of the present disclosure.

[0143] In one embodiment, the comparison of the first texture data and the second texture data includes determining the caries progression rate for more than one corresponding area based on i) the difference value and the time span between the second time point and the first time or ii) the texture difference value and the time span between the second time point and the first time point.

[0144] In one embodiment, generating a digital three-dimensional model representing caries development includes mapping a caries development rate onto at least one of a first digital 3D model, a second digital 3D model, a copy of the first digital 3D model, or a copy of the second digital 3D model. The first digital 3D model or the copy of the first digital 3D model includes first texture data or lacks first texture data. Additionally or alternatively, the second digital 3D model or the copy of the second digital 3D model includes second texture data or lacks second texture data.

[0145] Mapping the rate of change based on the difference number or texture difference value includes superimposing or overlaying the rate of change on the area for which the difference number or texture difference value is calculated. As mentioned above; because the difference number or texture difference value is determined for the corresponding area of ​​the first and second digital 3D models, this superimposition or overlay is performed on the area reflecting the corresponding area in the digital 3D model. This superimposition or overlay allows taking into account the time span between at least two acquired models, and representing the rate of change on the digital 3D model by a visual indication such as a color or a mark.

[0146] In one embodiment, mapping caries progression rates comprises representing the rates of change, preferably region specific, falling within predefined different rate ranges, with different visual indications (eg colors or markings).

[0147] The rate of change may represent the severity of caries progression between the first time period and the second time period. The method includes pre-defining different rates of change associated with the severity of caries progression, and each rate of change may be associated with a specific color or mark. Thus, more than one rate of change is classified as one of the defined rates of change and is correspondingly mapped onto the digital 3D model using the color or mark associated with the rate of change into which the rate of change is classified.

[0148] An illustrative classification based on the rate of change associated with caries progression and associated color is shown below.

[0149] category Predefined rate ranges Associated Colors Small rate RoC<RoC1 green Mild Rate RoC1≤RoC<RoC2 yellow Medium speed RoC2≤RoC<RoC3 orange color High speed RoC2≤RoC red

[0150] Among them, RoC is the rate of change of the corresponding area, and RoC1 to RoC3 are the rates of change of the defined range.

[0151] Table 4

[0152] In one embodiment, the classification of the change rate can be based on the change rate calculated according to different scores or texture difference values. In another embodiment, the classification can be based on the combined change rate calculated according to different scores and texture difference values.

[0153] Obviously, the technician can change at least one of the granularity of the categories by increasing or decreasing the number of categories, changing the range of the change rate, and changing the associated color. Such changes are within the scope of the present disclosure.

[0154] A mapped representation of caries or caries progression by one of difference scores, texture differences or rates of change on a digital 3D model may provide improved visibility on the tooth surface compared to how identified carious areas are seen on the physical tooth.

[0155] In one embodiment, a method for generating a representative digital 3D model is disclosed.

[0156] The method includes:

[0157] processing the first texture data and the second texture data to determine a velocity function based on changes in the texture data at the first point in time and the second point in time;

[0158] determining future texture data at a future time point based on the velocity function, wherein the future texture data is determined before the patient's set of teeth reaches the future texture data; and

[0159] Generate a representative digital 3D model of the patient's teeth, wherein:

[0160] i) in the future the texture data is mapped onto a representative digital 3D model; and / or

[0161] ii) Mapping the progression of caries onto a representative digital 3D model based on a comparison of future texture data and the last acquired texture data for the patient.

[0162] In one embodiment of the above method, before processing the first texture data and the second texture data, the first texture data and the second texture data are placed in a common texture space by unifying the textures.

[0163] According to an embodiment, a velocity function is determined based on a change in one or more components of the texture data or a severity value between a time span between obtaining texture data corresponding to a first digital 3D model and obtaining texture data corresponding to a second digital 3D model. In addition, future texture data or a severity value at a future time point is determined based on the velocity function, wherein the future texture data is determined before the patient's set of teeth reaches the future texture data. A representative digital 3D model of the patient's teeth is generated. The representative digital 3D model includes the future texture data mapped onto the representative digital 3D model. Additionally or alternatively, the representative digital 3D model of the patient's teeth includes a future dental condition determined based on calculating a severity value using the determined future texture data, mapped onto the representative digital 3D model.

[0164] The representative digital 3D model may include at least one of a first digital 3D model, a copy of the first digital 3D model, a second digital 3D model, or a copy of the second digital 3D model. The first digital 3D model or the copy of the first digital 3D model may include or not include the first texture data. Similarly, the second digital 3D model or the copy of the second digital 3D model may include or not include the second texture data. Generally, the representative digital 3D model preferably includes a digital 3D model associated with the last acquired texture data, and such a digital 3D model may include or not include the last acquired texture data. In one embodiment, a velocity function may be generated for a corresponding area associated with the first texture data and the second texture data. However, the velocity function may be generated as an average of the entire tooth for which a representative model is to be formed. It is understood that the calculation of the velocity function may also be based on the first texture data and the last acquired texture data at the first time point and the time point at which the last texture data is acquired. Alternatively, the calculation of the velocity function may be based on the second texture data and the last acquired texture data at the second time point and the time point at which the last texture data is acquired. In some cases, the last acquired texture data is the second texture data, so the time point of the last acquired texture data is the second time point. In various embodiments, the comparison of future texture data and last acquired patient texture data is based on a direct comparison of texture data or an indirect comparison of texture data via a scoring function, as disclosed earlier. In various embodiments, the velocity function is a rate of change, as disclosed earlier. In various embodiments, the velocity function is defined by a linear rate function or a nonlinear rate function defining caries progression between a first time point and a second time point.

[0165] In one embodiment, the method comprises presenting at least one of the first digital 3D model, the second digital 3D model, or a digital 3D model representing the development of caries in a time series, wherein the first digital 3D model and the second digital 3D model are placed in a common texture space. Such a representation may be particularly helpful in observing the development of caries over a period of time. The first digital 3D model and the second digital 3D model may be arranged in a time series according to timestamps associated with when scans that produced the first digital 3D model and the second digital 3D model were performed.

[0166] Placing the first digital 3D model and the second digital 3D model in a common texture space may be understood as placing the first texture data and the second texture data in the common texture space.

[0167] In one embodiment, corresponding regions in the first digital 3D model and the second digital 3D model comprise regions from both representations that are positionally related when the first digital 3D model and the second digital 3D model are placed in a common coordinate system.

[0168] Placing the first digital 3D model and the second digital 3D model in a common coordinate system refers to at least substantially aligning the two models. This can be achieved by alignment techniques described later in this disclosure. In order to identify corresponding areas or comparable areas between the first digital 3D model and the second digital 3D model, the models can first be brought into a common coordinate system. During this placement of the models in the common coordinate system, one model can be overlaid or superimposed on the other model.

[0169] The term "positionally related" regions refers to regions that have at least one of an anatomical relationship (e.g., correspondence) or a spatial relationship (e.g., correspondence) with each other. Such anatomical relationship is based on landmarks such as the buccal groove, the distal concave groove, the lingual groove, the mesial lingual cusp, the Lewis offset, the distal cusp, and the like.

[0170] Placing the first digital 3D model and the second digital 3D model in the same coordinate system can be performed automatically or with user intervention. By placing the models in the same coordinate system, the alignment can be determined from the transformation matrix that locally and / or globally aligns the first digital 3D model and the second digital 3D model. In one embodiment, the first digital 3D model and the second digital 3D model are segmented, and each tooth from the two models is automatically or manually assigned an identifier based on its characteristics, such as shape, features such as landmarks and the position of each tooth. Once the correspondence between the teeth in the two models is established based on the identifiers, the teeth with the same identifier in the two models are individually aligned. Any changes in the dental arches in the two models can be adjusted by a balancing step, for example, to evenly distribute the changes on either side of the dental arch. In another embodiment, the user can select more than 2 corresponding points on the digital 3D model, such corresponding points represent points that are substantially fixed, i.e., have not moved, in the two models between the first time point and the second time point. By aligning the corresponding points, the models are at least substantially aligned. This can be further supplemented by selecting an area in at least one model, which represents a portion of the two models that remains substantially fixed, i.e., has not moved, between the first time point and the second time point, such as a portion of a wrinkle. The two models are further aligned taking into account the selection of immovable areas such as wrinkles. In yet another alignment, the models can be manually aligned by superimposing one model on the other, and the user can manually move one model in different degrees of freedom until the user is satisfied with the alignment.

[0171] In some embodiments, the method comprises globally aligning the first and second digital 3D models. This is advantageous, for example, when the method is used to monitor caries progression of individual teeth, where direct comparison between tooth portions of the globally aligned digital 3D models can be used to detect any caries progression over time. The alignment provides for determining a spatial correspondence between the digital 3D models.

[0172] In some embodiments, the global alignment is based on parts of the digital 3D model corresponding to parts of the set of teeth that were most likely at least substantially fixed, i.e., did not change / move, during the time that passed between the first and second digital 3D models under recording. For example, the folds of the patient's upper jaw may be used for global alignment of the digital 3D model and teeth that are not expected to move during orthodontic treatment that corrects only the position of the anterior teeth (e.g., the patient's molars). The global alignment may be based, for example, on 3 points defined on teeth of one or more quadrants in the corresponding parts of the digital 3D model, an operator-selected region of the digital 3D model, or the set of teeth of the patient.

[0173] For a series of digital 3D models, alignment may include aligning each digital 3D model with the previous digital 3D model in the series, i.e. the most recent digital 3D model before. However, in some cases, it may also be advantageous to allow the operator to decide which previous digital 3D model a given digital 3D model should be aligned with.

[0174] In some embodiments, the method includes locally aligning the segmented teeth of the first and second digital 3D models. In the context of the present application, the phrase "locally aligning the segmented teeth" refers to the situation where one or more segmented teeth of one digital 3D model are individually aligned with the corresponding teeth of the other digital 3D model. Local alignment can be achieved by aligning the corresponding digital 3D models of the teeth segmented from the digital 3D model, for example aligning the digital 3D model of the canine teeth segmented from the digital 3D model. The 3D model of the segmented teeth of the first digital 3d model is therefore aligned with the corresponding 3D model of the teeth in the second digital 3d model on a tooth-to-tooth basis. That is, the alignment is local at the scale of an individual tooth, rather than at the global scale of the entire group of teeth. Therefore, the transformation used to align different segmented teeth may be different compared to the global alignment in which the same transformation is applied to all teeth and gums.

[0175] Local alignment of the segmented 3D models of teeth provides the advantage that the corresponding teeth of the digital 3D models can be accurately aligned regardless of any relative movement of the teeth between the recordings of the digital 3D models. A true anatomical correspondence between the teeth of the digital 3D models can thus be obtained.

[0176] Comparable or corresponding regions may be identified in a variety of ways. In one embodiment, the first digital 3D model and the second digital 3D model are superimposed on each other and brought into a common coordinate system. Thereafter, one of the first digital 3D model or the second digital 3D model is selected as a master model. At least one vector is drawn from an area of ​​the master model, and an area in an unselected representation is identified where at least one vector intersects with the unselected model. The identified area of ​​the master representation from which the at least one vector is drawn and the unselected representation where the at least one vector intersects is identified as a comparable or corresponding region.

[0177] In another embodiment, comparable or corresponding areas can be identified based on the following process. A point Mi from an area of ​​the crown surface of one of the first digital 3D model or the second digital 3D model is selected. Next, for point Mi, at least one nearest point Ni is identified on at least one area of ​​the crown surface on the other of the second digital 3D model or the first digital 3D model that meets predefined criteria. The predefined criteria may include a calculated sum of distances from Mi to Ni, where the calculated sum is below a predefined threshold. In the case where multiple points Ni are identified for a single point Mi to meet the predefined criteria, an elimination routine can be used to select one of the related points Ni. For example, the elimination routine can be based on selecting the nearest point Ni (i.e., the related point Ni) with the smallest calculated sum of distances from Mi. The area containing point Mi and the area containing point Ni or related point Ni that meets the predefined criteria define comparable or corresponding areas. Other elimination routines may also be used, such as the angle formed by the distance vector from point Mi and the facet of another model at point Ni (i.e., the related point Ni) meets a predefined angle threshold, which is also within the scope of the present disclosure. Such elimination routines may also include combined elimination routines, such as satisfying more than one criterion, such as the disclosed minimum calculation sum criterion and the disclosed distance vector angle criterion. In another embodiment, feature-based recognition techniques, such as landmark comparisons between two models, may be applied to identify regions that anatomically correspond to each other. Thus, corresponding regions or comparable regions are anatomically related regions.

[0178] In one embodiment, one of the first digital 3D model or the second digital 3D model may be selected as a reference model, while the other of the first digital 3D model or the second digital 3D model is a non-reference model. After the models are placed in a common coordinate system, an area from the reference model may overlap with one or more areas of the non-reference model. In one embodiment, the comparable or corresponding areas include areas from the reference model and areas from the non-reference model that have the greatest overlap with the reference area. In another embodiment, the comparable or corresponding areas include areas from the reference model and all areas that overlap with the reference area. In another embodiment, the comparable or corresponding areas include areas from the reference model and a subset of all areas that overlap with the reference area, the subset being defined by a selection threshold, such as a minimum percentage of overlap of areas from the non-reference model that overlap with areas from the reference model. In embodiments where a region from a reference model, i.e., a reference region, overlaps with more than one region from a non-reference model, the texture value and / or classification score of the region from the reference model is compared to one of i) the texture value and / or classification score of the region with the greatest overlap with the reference region, ii) the average or weighted average of the texture values ​​and / or classification scores of all regions overlapping with the reference region, or iii) the average or weighted average of the texture values ​​and / or classification scores of a subset of all regions overlapping with the reference region. The weighted average may be calculated based on a particular criterion, such as a separate percentage of overlap of regions from the non-reference model that overlap with the region from the reference model. Other criteria for calculating the weighted average may also be used and are within the scope of the present disclosure.

[0179] It should be noted that the identification of the comparable regions for unifying the textures and the corresponding regions for comparing the texture data may adopt the same technique or different techniques. The techniques for identifying comparable regions disclosed in different embodiments may also be used to generally identify comparable regions, for example, for determining a set of severity differences or for mapping, i.e., superimposing the set of severity differences.

[0180] Selecting corresponding or comparable areas on the aligned 3D tooth models provides the advantage that spatially and / or anatomically related areas between models can be compared.Determining at least one texture modification parameter or the progression of caries on the tooth surface between different time points provides a more accurate measurement.

[0181] Detecting the development of caries by comparing texture data from two digital 3D models acquired at different time points can be extended to comparing several digital 3D models and monitoring the development of caries in the patient's teeth over time. Monitoring can involve several other digital 3D models recorded between, before and / or after the first and second digital 3D models, thereby recording multiple digital 3D models. The comparison can then be, for example, between two subsequently acquired digital 3D models, or between the most recently acquired digital 3D model and the first digital 3D model acquired for the patient. In a first example, the development since the last visit can be detected. In a second example, the overall development since the start of monitoring is detected. However, in some cases, it may also be advantageous to allow the operator to decide which previous digital 3D model a given digital 3D model should be compared with. In some embodiments, a user interface configured to implement the disclosed method provides an operator with which to decide which of several acquired digital 3D models should be compared.

[0182] The method may further comprise segmentation of the first and second digital 3D models, typically prior to the comparison of the first texture data and the second texture data. The segmentation identifies portions of the first and second digital 3D models corresponding to different teeth. The segmentation provides that the identified teeth and gums can be separated and treated as separate 3D portions of individual teeth and gums. Furthermore, such segmentation allows comparison of the same dental object or regions in the same dental object in the first digital 3D model and the second digital 3D model.

[0183] According to one embodiment, a method for generating a digital three-dimensional (3D) model representing caries of a tooth is disclosed. The method comprises:

[0184] obtaining a digital 3D model of the patient's teeth, the digital 3D model including the teeth;

[0185] obtaining fluorescence data in response to illuminating the tooth with a probe light comprising light of a first wavelength capable of exciting a fluorescent material of the tooth;

[0186] applying a scoring function to the acquired fluorescence data to obtain a tooth region specific score value; and

[0187] A score value is superimposed as a visual indication on the obtained digital 3D model including texture data or without texture data, wherein the visual indication of the score value represents the presence or absence of caries.

[0188] The scoring function may include a mathematical relationship that includes one of: i) different texture components from a region of texture data, ii) a single texture component from a region of texture data, iii) the same or different texture components from different regions of texture data, or iv) a single texture component from a region of first texture data and different texture components from a region of second texture data.

[0189] In some embodiments, the first wavelength is in the range of 250 nm to 500 nm, such as in the range of 350 nm to 450 nm. In some embodiments, the light source emitting the first wavelength light is an LED emitting blue or violet light, which can be used to excite fluorescent materials of teeth.

[0190] In one embodiment, the identification function is based on the distance between the texture data of the area where the dental condition is present and the texture data of the healthy area in the texture space. The distance may represent the deviation of the texture components of the area from the texture components of the healthy area. The distance may include a Euclidean distance, where the texture components of the texture data represent different dimensions of the texture space. For example, the deviation from the healthy area may be defined as a Euclidean distance in the color space. In one embodiment, such a distance between the fluorescence data and the color data may be represented as

[0191]

[0192]

[0193] In another embodiment, the distance between the fluorescence data and the color data can be expressed as

[0194]

[0195]

[0196] r fluo,h and g fluo,h The corresponding values ​​of the red and green texture components of the fluorescence data from the healthy region,

[0197] r fluo and g fluo are the corresponding values ​​of the red and green texture components of the fluorescence data from that region,

[0198] r h , g h and b h are the corresponding values ​​of the red, green, and blue texture components of the color data from the healthy region,

[0199] r, g, and b are the corresponding values ​​of the red, green, and blue texture components of the color data from that region.

[0200] The identification function may define a mathematical relationship that includes at least one texture component of the color data and at least one texture component of the fluorescence data from the region, and at least one texture component of the color data and at least one texture component of the fluorescence data from the healthy region. In one embodiment, the at least one texture component of the fluorescence data from the region and / or the healthy region in the identification function includes only at least one of a red texture component or a green texture component. The identification function may not have a blue texture component of the fluorescence data.

[0201] In one embodiment, the identification function is expressed as:

[0202]

[0203]

[0204] Where IV is the identification value,

[0205] r fluo,h and g fluo,h are the corresponding values ​​of the red and green texture components of the fluorescence data from the healthy region,

[0206] r fluo and g fluo are the corresponding values ​​of the red and green texture components of the fluorescence data from that region,

[0207] r h , g h and b h are the corresponding values ​​of the red, green, and blue texture components of the color data from the healthy region,

[0208] r, g, and b are the corresponding values ​​of the red, green, and blue texture components of the color data from that region.

[0209] In another embodiment, the identification function is expressed as

[0210]

[0211]

[0212] Where IV is the identification value,

[0213] g fluo,h is the value of the green texture component of the fluorescence data from the healthy area,

[0214] g fluo is the value of the green texture component of the fluorescence data from that region,

[0215] r h , g h and bh are the corresponding values ​​of the red, green, and blue texture components of the color data from the healthy region,

[0216] r, g, and b are the corresponding values ​​of the red, green, and blue texture components of the color data from that region,

[0217] The severity function defines a mathematical relationship that includes the texture components of the fluorescence data from the region and the same texture components of the fluorescence data from the healthy region. In one embodiment, the severity function is different from the identification function. The severity function can be expressed as

[0218]

[0219] Where SV is the severity value

[0220] g fluo,h is the value of the green texture component of the fluorescence data from the healthy area,

[0221] g fluo is the value of the green texture component of the fluorescence data from that region,

[0222] Applying the recognition function may include using texture component values ​​from the area where the examined dental condition is present and the identified healthy area in the recognition function. Similarly, applying the severity function may include using texture component values ​​from the area where the examined dental condition is present and the healthy area in the severity function. The area is the area where the examined dental condition is present.

[0223] The texture component value from the healthy region includes a texture component value from the healthy region or a value derived from texture component values ​​of more than one identified healthy region. In the latter embodiment where the texture value can be derived from more than one identified healthy region, such derivation can include calculating one of an average, a weighted average, a median, a mode of texture values ​​from more than one healthy region.

[0224] The identification threshold criteria may include a threshold value that can be used to identify the presence of a dental condition. Depending on the selection of the threshold value, an identification value above or below the threshold value can be identified as the presence of a dental condition. Alternatively, the identification threshold criteria may include a range of values ​​within which identification values ​​are identified as the presence of a dental condition.

[0225] In one embodiment, the severity level of the dental condition is determined based on the determined severity value that meets the severity threshold criteria. The severity threshold criteria may include a threshold value that can be used to determine the severity level. Alternatively, the recognition threshold criteria may include different value ranges, and the severity values ​​that fall within a specific range are determined as the severity level. For example, the severity level can be divided into initial, moderate, and severe categories. Such classification can be applied and mapped in a similar manner as disclosed in connection with the classification of classification scores within different ranges, and represented as different colors, as also described in Table 2.

[0226] Threshold criteria associated with whether an identified area includes a dental condition, the severity level or progression of a dental condition can be determined by using different methods. For example, for each function (e.g., identification, or severity or scoring), one or more of a visual-tactile, radiographic method, or histological evaluation can be performed on a test tooth or test jaw model in order to define a function-specific threshold criterion or range for classifying a lesion or difference or range. Reference is made to Anahita Jablonski-Momeni et al., "Use of ICDAS-II, Fluorescence-Based Methods, and Radiography in Detection and Treatment Decision of Occlusal Caries Lesions: An In Vitro Study," International Journal of Oral Hygiene, 2012; 2012: 371595.

[0227] In one embodiment, generating the virtual three-dimensional model including the visual indicator includes mapping the region-specific severity value or severity level onto at least a portion of the obtained first digital 3D model or a copy thereof. The first digital 3D model or the copy thereof including the mapped severity value or the mapped severity level may include at least one of the texture data or no texture data associated with the first digital 3D model.

[0228] In one embodiment, a second digital 3D model of a patient's set of teeth and region-specific texture data are obtained, which include fluorescence data and color data corresponding to different regions of the second digital 3D model. The second digital 3D model and the specific region texture data are obtained at a second time point different from the time point when the first digital 3D model and the region-specific texture data corresponding to different regions of the first digital 3D model are obtained. Regions containing dental conditions can be identified for the second digital 3D model based on identification values ​​that meet identification threshold criteria. The identification values ​​can be calculated by applying an identification function to the texture data associated with the regions of the second digital 3D model. In addition, a severity value can be determined by applying a severity function to at least one of the data included in the texture data associated with the regions of the second digital 3D model identified as containing the dental condition.

[0229] In one embodiment, a set of severity differences between severity values ​​of corresponding areas between a first digital 3D model and a second digital 3D model are calculated; and a digital 3D model including the set of severity differences is generated. The set of severity differences can be represented by a visual indicator, for example as a heat map specific to an overlay region including different colors. The severity differences can be classified into different categories according to the size of the difference, such as small changes, mild changes, moderate changes, and large changes. Such classification can be applied and mapped in a similar manner as related to texture difference values ​​classified in different ranges and represented in different colors, as also described in Table 3. Because the severity values ​​for each model are calculated with respect to healthy areas from the same model, this method is not affected by the ambient light conditions under which the model or texture data was obtained, because the healthy areas and the areas of presence and severity of the dental condition being examined are affected by the same lighting conditions. Therefore, even if the first digital 3D model and the second digital 3D model are obtained under different ambient light conditions, the severity values ​​determined between the two models can be compared without the need to unify the textures.

[0230] In one embodiment, corresponding regions from the first digital 3D model and the second digital 3D model are positionally related, i.e., spatially related regions and / or anatomically related regions. Corresponding regions between the first digital 3D model and the second digital 3D model can be identified by segmenting the first digital 3D model individually into separate dental objects and segmenting the second digital 3D model individually into separate dental objects. This is followed by identifying corresponding dental objects from the segmented first digital 3D object and the segmented second digital 3D model, and locally aligning the identified corresponding dental objects. Corresponding regions are identified by identifying alignment regions in the locally aligned corresponding dental objects. Different embodiments related to positionally related regions are described earlier in this disclosure.

[0231] Corresponding dental objects can be identified in a variety of ways. In one embodiment, the first digital 3D model and the second digital 3D model are globally aligned, for example by using at least three corresponding points from the two models, which are preferably selected from the non-moving parts of the two models. The corresponding points can be aligned using an iterative closest point (ICP) technique to globally align the two models. The two models are segmented separately, and the vectors (e.g., normal vectors from the surface) of the dental objects from the first digital 3D model are projected onto the second digital 3D model. The dental objects of the second digital 3D model with which the vectors intersect are identified as dental objects corresponding to the dental objects of the first digital 3D model from which the vectors are projected. In another embodiment, corresponding dental objects can be identified by applying a feature detection technique that allows the detection of features of the segmented dental objects in the two models, thereby allowing dental objects representing at least substantially the same feature set (e.g., landmarks) to be identified from the two models. Therefore, the corresponding dental objects include dental objects from the first digital 3D model and the second digital 3D model having at least substantially the same feature set. Local alignment of the identified corresponding dental objects and identification of corresponding regions will be described later.

[0232] In one embodiment, generating a digital 3D model including a set of severity differences includes mapping the region-specific severity differences to at least a portion of a first digital 3D model obtained or a copy thereof. The first digital 3D model including the set of severity differences or a copy thereof includes at least one of the texture data or no texture data associated with the first digital 3D model. Additionally or alternatively, generating a digital 3D model including the set of severity differences includes mapping the region-specific severity differences to at least a portion of a second digital 3D model obtained or a copy thereof. The second digital 3D model including the set of severity differences or a copy thereof includes at least one of the texture data or no texture data associated with the second digital 3D model. The mapped differences can be presented as visual indicators, such as pointers or heat maps with different attributes (e.g., colors) for differences falling into different ranges.

[0233] In one embodiment, for more than one corresponding area, the rate of progression of the dental condition is determined based on the severity difference and the time span between obtaining the texture data corresponding to the first digital 3D model and the texture data corresponding to the second digital 3D model. In addition, a digital 3D model including the rate of progression of the dental condition can be generated. The rate of progression can be represented by a visual indicator, for example as a heat map specific to the superimposed area including different colors. The severity difference can be classified into different categories based on the size of the rate, such as a small rate, a mild rate, a medium rate, and a large rate. Such classification can be applied and mapped in a similar manner to the rate of change classified in different ranges and represented in different colors, as also described in Table 4.

[0234] In one embodiment, generating a digital 3D model includes mapping a region-specific rate of development of a dental condition onto at least a portion of a first digital 3D model obtained or a copy thereof. The first digital 3D model or a copy thereof including the set of severity differences includes at least one of the texture data or no texture data associated with the first digital 3D model. Additionally or alternatively, generating a digital 3D model includes mapping a region-specific rate of development of a dental condition onto at least a portion of a second digital 3D model obtained or a copy thereof. The second digital 3D model or a copy thereof including the set of severity differences includes at least one of the texture data or no texture data associated with the second digital 3D model. The mapped rates may be presented as a visual indicator, such as a pointer or heat map having different attributes (e.g., color) for rates falling within different ranges.

[0235] Since determined values ​​such as severity values, severity levels, and severity differences are region specific, the stated mapping includes overlaying or superimposing the determined values ​​on specific regions. Such overlay or overlay allows the determined values ​​to be represented on the digital 3D model by visual indications such as colors or markings. The mapping may be performed by applying the mapping techniques disclosed in one or more of the earlier disclosed embodiments.

[0236] According to one embodiment, a data processing system is disclosed. The data processing system includes a module or a computing unit, such as a hardware processor, which is configured to perform one or more steps of the method disclosed in one or more embodiments of the present disclosure. The data processing system may include other modules, such as a memory.

[0237] According to one embodiment, a computer program product embodied in a non-transitory computer readable medium is disclosed. The computer program product includes computer readable program code executable by a hardware data processor to cause the hardware data processor to perform a method when the computer readable program code is executed by the hardware data processor. The method may include one or more functions that allow one or more system components to perform one or more steps of the method disclosed in one or more embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0238] Embodiments of the present disclosure and their advantages may be best understood from the following illustrative and non-limiting detailed description taken in conjunction with the accompanying drawings, in which:

[0239] Figure 1 A method for presenting a plurality of scans in a time series according to an embodiment is shown;

[0240] Figure 2 A method for generating a digital three-dimensional model according to an embodiment is shown;

[0241] Figure 3A method for displaying a digital model according to an embodiment is shown;

[0242] Figure 4 A method for placing a digital 3D model in a common texture space according to an embodiment is shown;

[0243] Figure 5 A method for generating a digital three-dimensional (3D) model according to an embodiment is shown;

[0244] Figure 6 A method for identifying corresponding areas or comparable areas according to an embodiment is shown;

[0245] Figure 7 A method for generating a representative digital 3D model according to an embodiment is shown;

[0246] Figure 8 shows two digital 3D models obtained at different points in time according to an embodiment, wherein texture data is placed in a common texture space;

[0247] Fig.9A shows a digital model including texture data obtained at a point in time according to an embodiment;

[0248] Fig. 9B shows a digital model including texture data obtained at a point in time according to an embodiment;

[0249] Fig.10 shows a mapped classification score superimposed on a digital 3D model according to an embodiment;

[0250] Fig.11 shows a mapped texture difference superimposed on a digital 3D model according to an embodiment;

[0251] Fig. 12A shows a first set of classification scores mapped according to an embodiment;

[0252] Fig. 12B showing a second set of classification scores mapped according to an embodiment;

[0253] Fig. 12C shows the classification score differences of the mapping according to an embodiment;

[0254] Fig.13 A data processing system according to an embodiment is shown;

[0255] Fig.14A A method of unifying textures according to an embodiment is shown;

[0256] Fig. 14B A method of unifying textures according to an embodiment is shown;

[0257] Fig.15 A method for generating a virtual three-dimensional model representing a dental condition according to an embodiment is shown;

[0258] Fig.16 A method for generating a virtual three-dimensional model representing a dental condition according to an embodiment is shown;

[0259] Fig.17 A method for generating a virtual three-dimensional model representing a dental condition according to an embodiment is shown;

[0260] Fig.18 A method for identifying healthy tooth areas according to an embodiment is shown;

[0261] Fig.19 Methods for identifying healthy tooth regions according to several embodiments are shown;

[0262] Fig. 20A Determining a reference value for identifying a healthy area according to an embodiment is shown;

[0263] Fig. 20B Determining a reference value for identifying a healthy area according to an embodiment is shown;

[0264] Fig.21 A method of generating a digital three-dimensional model representing the development of a dental condition according to an embodiment is shown; and

[0265] Fig. 22 A data processing system according to an embodiment is shown. DETAILED DESCRIPTION

[0266] In the following description, reference is made to the accompanying drawings which show, by way of illustration, how the invention may be practiced.

[0267] Figure 1 A method for generating a 3D graphical model of an oral condition of a patient over time according to an embodiment is shown. The method 100 includes obtaining a plurality of scans at 102, each scan representing an oral condition of a patient at a particular time, wherein each scan includes texture data. At 104, at least one texture modification parameter is determined, and at 106, a texture of at least one, preferably each, of the corresponding plurality of scans is modified based on one of the at least one texture modification parameter. Thereafter, at 108, the plurality of scans whose textures are modified in step 106 are presented in a time series.

[0268] Figure 2A method for generating a digital three-dimensional (3D) model representing a dental condition of a tooth, such as the development of caries, to generate a digital three-dimensional model according to an embodiment is shown. The method 200 includes, at 202, obtaining a first digital 3D model of a patient's tooth set including first texture data at a first time point; and at 204, obtaining a second digital 3D model of the patient's tooth set including second texture data at a second time point. At 206, the first digital 3D model including the first texture data and the second digital 3D model including the second texture data are placed in a common texture space by unifying the texture. Thereafter, at 208, a digital three-dimensional model representing the development of caries is generated based on a comparison of the first texture data and the second texture data of corresponding areas in the first digital 3D model and the second digital 3D model placed in the common texture space.

[0269] refer to Fig.14A , which shows a method of unifying textures according to an embodiment. According to the present disclosure, the first texture data 1402 and the second texture data 1404 of the comparable area are directly used to determine at least one texture modification parameter 1406. The texture modification parameter 1406 can be applied to at least one of the first texture data and the second texture data, for example, applied to the first texture data 1402 to generate unified first texture data 1408, which is used as the second texture data 1404 in a common texture space.

[0270] Reference now Fig. 14B , which illustrates a method of unifying textures according to an embodiment. First texture data 1402 and second texture data 1404 of comparable regions, according to the previous disclosure, are indirectly used to determine at least one texture modification parameter 1414. This requires first converting the first texture data and the second texture data to a texture space (e.g., a LAB color space) that is different from the texture space (e.g., an RGB color space) in which the first texture data and the second texture data are available. Such a conversion produces a transformed first texture data 1410 and a transformed second texture data 1412. The transformed first texture data 1410 and the transformed second texture data 1412 are directly used to determine at least one texture modification parameter 1414 according to the previous disclosure. The texture modification parameter 1414 can be applied to at least one of the transformed first texture data or the transformed second texture data, for example, to the transformed first texture data 1402, which is then converted to the texture space (e.g., an RGB color space) in which the digital 3D model will be visualized and compared. This results in unified first texture data 1416, which is in a common texture space as the second texture data 1404.

[0271] Figure 3A method for generating a digital three-dimensional (3D) model according to an embodiment is shown. The method 300 includes, at 302, obtaining a first digital 3D model of a patient's teeth set including first texture data at a first time point; and at 304, obtaining a second digital 3D model of the patient's teeth set including second texture data at a second time point. At 306, the first digital 3D model including the first texture data and the second digital 3D model including the second texture data are placed in a common texture space by unifying the texture. Thereafter, at 308, the first digital 3D model including the first texture data and the second digital 3D model including the second texture data placed in the common texture space are displayed on a display unit.

[0272] Figure 4 A method for placing a digital 3D model in a common texture space according to an embodiment is shown. The method 400 includes selecting one of a first digital 3D model or a second digital 3D model at 402, and selecting at least one region from the selected digital 3D model at 404, the selected region being used for texture calibration. At 406, a comparable region on another model including one of the first digital 3D model or the second digital 3D model that is not selected is identified. At 408, at least one texture modification parameter including a transformation operator is generated based on the selected region of the selected model and the comparable region of the other model that is not selected; and at 410, the at least one generated texture modification parameter is applied to the comparable region of the other model that is not selected.

[0273] Figure 5 A method for generating a digital three-dimensional (3D) model representing caries of a tooth according to a disclosed embodiment is shown. The method 500 includes obtaining a digital 3D model of a patient's teeth at 502, the digital 3D model including the teeth; and obtaining fluorescence data in response to illuminating the teeth with a probe light at 504, the probe light including light of a first wavelength capable of exciting a fluorescent material of the teeth. At 506, a scoring function is applied to the obtained fluorescence data to obtain a tooth region-specific score value. The scoring function includes a mathematical relationship including one of: i) different texture components from a region of texture data, ii) a single texture component from a region of texture data, iii) the same or different texture components from different regions of texture data, or iv) a single texture component from a region of first texture data and different texture components from a region of second texture data. Finally, at 508, a score value is superimposed as a visual indication onto the obtained digital 3D model including or without texture data, wherein the visual indication of the score value indicates the presence or absence of caries. It will be obvious to the skilled person that a similar approach can be applied when a severity function replaces the scoring function and a severity value replaces the score value as a visual indication superimposed on the obtained digital 3D model.

[0274] Figure 6 A method for identifying corresponding areas or comparable areas in a first digital 3D model and a second digital 3D model is shown. Method 600 includes superimposing one of the first digital 3D model or the second digital 3D model on the other of the second digital 3D model or the first digital 3D model at 602. At 604, one of the first digital 3D model or the second digital 3D model is selected as a main model. At 606, at least one vector from an area of ​​the main model is drawn, and an area where at least one vector in an unselected representation intersects with an unselected representation is identified. Finally, at 608, an area of ​​the main model from which at least one vector is drawn and an identified area of ​​the unselected model where at least one vector intersects are identified as corresponding areas or comparable areas. It is apparent to those skilled in the art that the disclosed method can be used in one or more embodiments where corresponding or comparable areas need to be identified.

[0275] Figure 7 A method for generating a representative digital 3D model including future texture data according to an embodiment is shown. The method 700 includes, at 702, processing first texture data and second texture data to determine a velocity function based on changes in the texture data at a first time point and a second time point. At 704, future texture data for a future time point is determined based on the velocity function, wherein the future texture data is determined before the patient's set of teeth reaches the future texture data. Finally, a representative digital 3D model of the patient's teeth is generated at 706, wherein the future development of caries is mapped onto the representative digital 3D model based on a comparison of the future texture data with the texture data last acquired for the patient. It will be apparent to a skilled person that the disclosed method can be used for one or more embodiments where it is necessary to determine a velocity function and generate a digital 3D model including future texture data or a tooth condition.

[0276] Figure 8 Two digital 3D models with texture data in a common texture space obtained at different time points according to an embodiment are shown. A first digital 3D model 802 and a second digital 3D model 804 are obtained at a first time point and a second time point, respectively. It can be observed that the first digital 3D model and the second digital 3D model have texture data that do not have a uniform texture. Therefore, in this example, the first digital 3D model is subjected to process 810, such as Figure 3 or Figure 4 The method disclosed in , which modifies a first digital 3D model to generate a transformed model 806, such that the first digital 3D model (in the form of the transformed model) and the second digital 3D model are placed in a common texture space by unifying the texture.

[0277] Fig.9AA digital model including texture data obtained at a time point according to an embodiment is shown. A digital 3D model such as the first digital 3D model 902 includes texture data including color data. The texture data represents a region 908 of a tooth 906 and a region 912 of a tooth 910 that represent relatively darker areas, such as brown or black. Darker areas may indicate the presence of carious areas. Fig. 9B A digital model including texture data obtained at a time point according to an embodiment is shown. A digital 3D model such as the first digital 3D model 904 includes texture data including fluorescence data. The texture data represents an area 914 of tooth 906 and an area 916 of tooth 910, which represent relatively dark areas. Darker areas may indicate the presence of caries areas.

[0278] Fig.10 A mapped classification score superimposed on a digital 3D model according to an embodiment is shown. The determined classification score can be mapped onto the digital 3D model 1002. Such classification scores (1004, 1006, 1008) can be presented by different visual indications, such as different colors depending on the category (e.g., initial or moderate) to which the score belongs. For example, caries 1006 represents initial caries, while 1004 and 1008 represent moderate caries, according to the associated colors 1014 and 1016 indicating moderate and initial caries, respectively. The digital 3D model may include texture data or may not have texture data. A slider 1012 may be provided to change the transparency of the texture data. Similarly, a slider 1010 that allows the transparency of the mapped classification score to be changed may be provided. The model may be represented in relation to a timeline 1018 so that a user can select a model for a particular point in time. It will be apparent to the skilled person that the methods disclosed herein can be used to map information, such as severity values / severity levels, on a digital 3D model, where the severity values / severity levels are presented with different visual indications (e.g., colors) depending on the category the mapped information belongs to. Similarly, other features such as sliders, timelines, or other features can be well used in conjunction with the mapped information and are within the scope of the present disclosure.

[0279] Fig.11A mapped texture difference overlaid on a digital 3D model according to an embodiment is shown. The digital 3D model includes a plurality of teeth. For illustrative purposes, only one tooth is shown. At a first time point, time #2, the tooth includes color data representing at least a portion 1106 of the first texture data, and at a second time point, time #3, the tooth includes color data representing at least a portion 1108 of the second texture data. A texture (color) difference based on the difference between at least a portion 1106 and at least a portion 1108 is calculated and mapped to the digital 3D model of the tooth, as shown in 1114, 1138, and 1140. Based on the texture difference based on the color data, each value can be visually represented with a different color. Similarly, at a first time point, time #2, the tooth includes fluorescence data representing at least a portion 1110 of the first texture data, and at a second time point, time #3, the tooth includes fluorescence data representing at least a portion 1112 of the second texture data. A texture difference value based on the difference between at least a portion 1110 and at least a portion 1112 is calculated and mapped onto the digital 3D model of the tooth, as shown at 1116, 1122, and 1124. Based on the texture difference value based on the fluorescence data, each value can be visually represented with a different color. The illustrative digital 3D model 1104 representing the development of caries includes texture difference values ​​(based on color data or fluorescence data) mapped onto the digital 3D model 1104. For example, for tooth 1132, texture difference value 1134 is visually represented. Similarly, 1136 visually represents the texture difference values ​​of different teeth of the digital 3D model 1104. The texture difference value can be represented in different colors based on the texture difference value and the color associated with the texture difference value range, which can be set or changed by using pointers 1128 and 1130 on the slider 1126. The transparency of the texture data and / or texture difference value on the digital 3D model can be changed by slider controls 1118 and 1120, respectively. The selection of which models and / or texture data need to be compared to calculate the texture difference value can be selected from the timeline 1102. It will be apparent to the skilled person that the method disclosed herein can be used to map a set of severity differences between severity values ​​of a first digital 3D model and a second digital 3D model onto a digital 3D model, wherein the set of severity differences is presented with different visual indications (e.g., colors) depending on the category to which the severity difference information belongs. Similarly, other functions such as sliders, slider controls, timelines, etc. can also be well used in conjunction with the mapping information and are within the scope of the present disclosure.

[0280] like Fig.10 As shown, the classification scores can be mapped onto the digital 3D model. Similarly, Fig. 12AA first set of classification scores according to an embodiment of the mapping is shown. For example, for a first time point 1216, a first set of classification scores including classification scores 1210 and 1208 of teeth 1206 and 1204 is mapped onto a first digital 3D model 1202. The representation of the classification scores in different colors on the digital 3D model 1202 according to a color scheme 1212 is an indication of the severity of caries. Fig. 12B A second set of classification scores mapped according to an embodiment is shown. For example, for a second time point 1222, a second set of classification scores including classification scores 1220 and 1224 for teeth 1206 and 1204 is mapped onto a second digital 3D model 1230. The representation of the classification scores in different colors on the digital 3D model 1230 according to the color scheme 1212 is an indication of the severity of caries. The transparency of the texture data and / or the classification scores on the digital 3D model can be changed by slider controls 1226 and 1228, respectively. It is obvious to the skilled person that the methods disclosed herein can be used to map information, such as severity values / severity levels associated with a first time point 1216 and a second time point 1222, on different digital 3D models, respectively, wherein the severity values / severity levels are presented with different visual indications, such as colors 1212, depending on the category to which the mapped information belongs. Similarly, other functions such as sliders, timelines, and other functions can be well used in conjunction with the mapped information and are within the scope of the present disclosure.

[0281] Fig. 12C Graph 1 shows the mapping classification score differences according to an embodiment. Fig. 12A and Fig. 12BAs shown, the classification score difference based on the first set of classification scores and the second set of classification scores can be calculated and represented on the digital 3D model 1236 representing the development of caries. For example, the difference score 1240 represents the difference between the classification score 1220 and the classification score 1210, and the difference score 1238 represents the difference between the classification score 1224 and the classification score 1208. The difference score is calculated based on the comparison of the first texture data and the second texture data obtained at the first time point 1216 and the second time point 1222, respectively. The transparency of the texture data and / or the difference score on the digital 3D model 1236 can be changed by the slider controls 1234 and 1232, respectively. The difference score can be represented in different colors based on the difference score and the color associated with the difference score range, which can be set or changed by using the pointers 1246 and 1244 on the slider 1250. The difference score range is illustrated by three ranges 1248, 1242 and 1252. It will be apparent to a skilled person that the method disclosed herein can be used to map a set of severity differences between severity values ​​of a first digital 3D model and a second digital 3D model onto a digital 3D model, wherein the set of severity differences are presented with different visual indications, such as colors, depending on the category to which the severity difference information belongs. Similarly, other functions such as sliders, slider controls, timelines, etc. can also be well used in conjunction with the mapping information and are within the scope of the present disclosure.

[0282] Fig.13A data processing system according to an embodiment is shown. System 1300 includes a scanner system 1302, which is configured to generate a first digital 3D model having first texture data and a second digital 3D model having second texture data. Processor 1310 is configured to receive the first digital 3D model having the first texture data and the second digital 3D model having the second texture data. Models with corresponding texture data can be received from scanner system 1302 and / or from database 1304. Processor 1310 may include one or more of a variety of devices, but not limited to: a unification module 1312, a texture data comparator 1314, a score generator 1316, a score comparator 1318, a rate generator 1320 or a mapping module 1322. Unification module 1312 is configured to place the first digital 3D model and the second digital 3D model in a common texture space. The unification module is therefore configured to determine at least one texture modification parameter and apply the determined at least one texture modification parameter to at least one of the first texture data or the second texture data. Texture data comparator 1314 is configured to calculate texture difference. The score generator 1316 is configured to determine a set of classification scores based on the texture data. The score comparator 1318 is configured to calculate a difference score. The rate generator 1320 is configured to determine a development rate or speed function. The mapping module 1322 is configured to map information including one or more of the set of classification scores, texture differences, difference scores, development rates, or future textures onto the digital 3D model. The processor may include additional means, such as means for automatically arranging the digital model in a time series along a timeline, means for receiving user input at the user interface 1308, such as user input at a transparency slider (e.g., Fig. 12C 1232 and 1234 or Fig.11 1118 and 1120 in the ) or the color range slider (e.g. Fig. 12C 1250 or Fig.11 1126 in the figure), and means for generating different digital 3D models with mapping information. The processor unit is configured to provide the generated 3D model with mapping information on the display unit 1306. Obviously, some elements are not listed but are within the scope of the present disclosure, such as memory, or corresponding / comparable area identifiers.

[0283] Fig.15A method 1500 for generating a virtual three-dimensional model representing a dental condition is shown according to an embodiment. The method includes obtaining, at 1502, a first digital 3D model of a patient's set of teeth and region-specific texture data corresponding to different regions of the first digital 3D model, the texture data including fluorescence data and color data. Thereafter, at 1504, an area containing the dental condition is identified. This is based on a recognition value that satisfies a recognition threshold criterion, wherein the recognition value is calculated by applying a recognition function to the texture data associated with the area of ​​the first digital 3D model. Once the area containing the dental condition is identified, at 1506, a severity value of at least one area that has been identified as containing the dental condition is determined. This is performed by applying a severity function to at least one of the texture data associated with the identified area. Finally, at 1508, a virtual three-dimensional model including a visual indicator is generated based on the determined severity value of the area containing the dental condition, such as caries. The disclosed method is a computer-implemented method.

[0284] Fig.16 A method 1600 for generating a virtual three-dimensional model representing a tooth condition according to an embodiment is shown. Steps 1602, 1606, 1608, and 1610 are respectively similar to steps 1502, 1504, 1506, and 1508 ( Fig.15 ) are the same. In this embodiment, the healthy region 1604 is identified before the region containing the dental condition is identified at 1606. As previously described, such identification can be based on an evaluation of one or more texture components obtained from the fluorescence data and / or the color data.

[0285] Fig.17 The method for generating a virtual three-dimensional model representing a tooth condition according to an embodiment is shown. Steps 1702, 1704, 1706 and 1708 are respectively similar to the step 1502 ( Fig.15 )、1604( Fig.16 ), 1504 and 1506( Fig.15 ). At step 1710, a severity level of the dental condition is determined based on the determined severity value that satisfies the severity threshold criteria. At 1712, a virtual three-dimensional model is generated. The model includes a visual indicator including a region-specific severity level mapped onto at least a portion of the obtained first digital 3d model or a copy thereof. The first digital 3d model or a copy thereof including the mapped severity value or the mapped severity level includes at least one of the texture data or no texture data associated with the first digital 3d model.

[0286] Fig.18A method 1800 for identifying healthy tooth regions according to an embodiment is shown. At 1802, a digital 3D model of a patient's set of teeth and region-specific texture data corresponding to different regions of the digital 3D model are obtained. The texture data includes at least one of fluorescence data or color data. At 1804, for at least one texture component of the obtained texture data, a reference value is determined based on a texture value distribution associated with the at least one texture component of the texture data. Additionally or alternatively, for the texture data, a reference value is determined at 1806 based on a texture value distribution associated with the texture data. If the reference value is based on at least one texture component, then at 1808, a region having a corresponding value of a texture component corresponding to the at least one texture component within a specific range of the determined reference value is determined to be a healthy region. However, if the reference value is based on the texture data, then at 1808, a region having a texture value within a defined range of the determined reference value is determined to be a healthy region.

[0287] Fig.19 A method 1900 for identifying healthy tooth regions according to several embodiments is shown. Steps 1902, 1906, 1908, and 1910 are similar to steps 1802, 1804, 1806, and 1808 ( Fig.18 ), except that the introduction of one or more of steps 1904 and 1912 affects the options available in the subsequent steps 1804, 1806, and 1808. In one embodiment, at 1904, before determining the reference value, the obtained digital 3D model is segmented into individual dental objects and healthy areas are identified on an individual tooth basis. The individual dental objects may represent multiple individual teeth and gums, and may also include non-tooth materials, such as dental fillings and implants. This allows the use of texture value distributions that are specific to individual dental objects (i.e., on an individual tooth basis), such as teeth being examined for the presence of a dental condition, adjacent teeth, or the same tooth type. In another embodiment, in combination with or without the aforementioned embodiment of segmenting the obtained digital 3D model, at 1912, a filtered texture value distribution is obtained by filtering out texture components or texture data having corresponding texture values ​​outside a defined value range before determining the reference value; and at 1906 / 1908, the determination of the reference value is based on the texture value distribution that falls within the defined value range.

[0288] Fig. 20ADetermining reference values ​​for identifying healthy regions according to an embodiment is shown. The embodiment shows a texture value distribution 2000, as shown by the intensity distribution of the texture component (from the red channel of the fluorescence data), where the distribution represents the number of regions (e.g., facets) (represented by counts) and their corresponding texture component values, such as color intensity, plotted in a histogram. The distribution is filtered using a lower threshold 2006, and a mathematical operation such as the mean is applied to the filtered distribution to identify a reference value (about 65) corresponding to the mean 2004.

[0289] Fig. 20B Determining reference values ​​for identifying healthy regions according to an embodiment is shown. The embodiment shows a texture value distribution 2002, as shown by the intensity distribution of the texture component (from the green channel of the fluorescence data), where the distribution represents the number of regions (e.g., facets) (represented by counts) and their corresponding texture component values, such as color intensity, plotted in a histogram. A lower threshold 2008 and an upper threshold 2012 are used to filter the distribution and apply mathematical operations such as peaks to the filtered distribution to identify a reference value (about 37.5) corresponding to a peak 2010.

[0290] Fig.21 A method 2100 of generating a digital three-dimensional model representing the development of a dental condition is shown according to one embodiment. At 2102, at a first point in time, a first digital 3D model of a patient's set of teeth and region-specific texture data including fluorescence data and color data corresponding to different regions of the first digital 3D model are obtained. At 2104, for at least one region of the region of the first digital 3D model identified as containing the dental condition, a severity value associated with a severity level of the dental condition is determined by applying a severity function to at least one of the texture data associated with the identified region. At 2106, at a second point in time after the first point in time, a second digital 3D model of the patient's set of teeth and region-specific texture data including fluorescence data and color data corresponding to different regions of the second digital 3D model are obtained. At 2108, for at least one region of the region of the first digital 3D model identified as containing the dental condition, a severity value associated with a severity level of the dental condition is determined by applying a severity function to at least one of the texture data associated with the identified region. Thereafter, at 2110, a set of severity differences between the severity values ​​of corresponding regions between the first digital 3D model and the second digital 3D model are calculated. At 2112, a digital 3D model including the set of severity differences is generated.

[0291] Fig. 22A data processing system according to an embodiment is shown. System 2200 includes a scanner system 2202 configured to generate a first digital 3D model and region-specific texture data corresponding to the first digital 3D model. Scanner system 2202 may also be configured to generate a second digital 3D model and region-specific texture data corresponding to the second digital 3D model. Processor 2210 is configured to receive the first digital 3D model and texture data corresponding to the first model, and may also be configured to receive the second digital 3D model and texture data corresponding to the second model. Models with corresponding texture data may also be received from scanner system 1302 and / or from database 2204. Processor 2210 may include one or more of a variety of devices, but is not limited to a healthy area identifier 2212, an identification module 2214, a severity module 2218, a corresponding area identifier 2220, a severity value comparator 2222, a rate generator 2224, a mapping module 2226, and a memory 2228.

[0292] A healthy region identifier 2212, an identification module 2214, a severity module 2218, a corresponding region identifier 2220, a severity value comparator 2222, a rate generator 2224, a mapping module 2226, and a memory 2228. The healthy region identifier is configured to identify a healthy region in the obtained first digital 3D model, the identification comprising identification based on an evaluation of one or more texture components obtained from the fluorescence data and / or the color data. The identification module 2214 is configured to identify a region containing a dental condition based on an identification value that meets an identification threshold criterion, the identification value being calculated by applying an identification function to texture data associated with the region of the first digital 3D model. The severity module 2218 is configured to determine a severity value for at least one region of the region of the first digital 3D model identified as containing a dental condition by applying a severity function to at least one of the texture data associated with the identified region. The disclosed modules may operate on a second digital 3D model and its corresponding texture data. The severity comparator 2222 is configured to calculate a set of severity differences between severity values ​​of corresponding areas between the first digital 3D model and the second digital 3D model. The corresponding area identifier 2220 is used to identify corresponding areas between the first digital 3D model and the second digital 3D model. The rate generator 2224 is configured to determine a development rate or speed function. The mapping module 2226 is configured to map information including one or more of severity values, severity levels, severity difference groups, development rates, or future textures on the digital 3D models. The processor may include additional devices, such as devices for automatically arranging digital models in a time series along a timeline; devices for receiving user input at the user interface 2208, such as in a transparency slider (e.g. Fig. 12C 1232 and 1234 or Fig.111118 and 1120 in the example, or a color range slider (e.g. Fig. 12C 1250 or Fig.11 1126 in ), or setting a threshold for filtering texture values; and means for generating different digital 3D models with mapping information. The processor unit is configured to provide the generated 3D model with mapping information on the display unit 2206.

[0293] Although some embodiments have been described and shown in detail, the present disclosure is not limited to such details, but may also be embodied in other ways within the scope of the subject matter defined in the appended claims. In particular, it should be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope of the present invention.

[0294] A claim may refer back to any of the preceding claims, and "any" is understood to mean "any one or more" of the preceding claims.

[0295] It should be emphasized that the terms "include / comprising / including" used in this specification are used to specify the existence of stated features, integers, operations, steps or components, but do not exclude the existence or addition of one or more other features, integers, steps, components or groups thereof.

[0296] In the claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims or described in different embodiments does not indicate that a combination of these measures cannot be used to advantage.

Claims

1. A method for generating a virtual three-dimensional model representing a dental condition at a region, the method comprising: obtaining a first digital 3D model of the patient's set of teeth and regional texture data corresponding to different regions of the first digital 3D model, the texture data comprising fluorescence data and color data; identifying a region containing a dental condition based on an identification value that satisfies an identification threshold criterion, the identification value being calculated by applying an identification function to texture data associated with the region of the first digital 3D model; for at least one region of the first digital 3D model identified as containing a region of the dental condition, determining a severity value by applying a severity function to at least one of the texture data associated with the identified region; and Based on the severity value determined for the region containing the dental condition, a virtual three-dimensional model is generated that includes a visual indicator.

2. The method according to claim 1, further comprising evaluating one or more texture components obtained from the fluorescence data and / or the color data to identify healthy areas in the obtained first digital 3D model, wherein The assessment includes: For at least one texture component of one of the obtained texture data, determining a reference value based on a texture value distribution associated with at least one texture component of one of the texture data, and identifying a region having a corresponding value of a texture component corresponding to the at least one texture component within a range of the determined reference value as a healthy region; or For one of the obtained texture data, a reference value is determined based on a texture value distribution associated with the one of the obtained texture data, and a region having a texture value within a defined range of the determined reference value is identified as a healthy region.

3. The method of claim 1 , further comprising identifying healthy areas on an individual tooth basis, the identifying comprising one of the following: identifying a healthy region of a tooth including a region examined for the presence of a dental condition, and a texture value distribution associated with one of the at least one texture component or the obtained texture data is derived from the tooth examined for the presence of the dental condition; or identifying a healthy region of a tooth adjacent to a tooth being inspected for the presence of a dental condition, and a texture value distribution associated with one of the at least one texture component or the obtained texture data is derived from the adjacent tooth; or A healthy area of ​​a tooth of the same tooth type as the tooth being examined for the presence of the dental condition is identified in the first digital 3D model, and a texture value distribution associated with the at least one texture component or one of the obtained texture data is derived from a tooth of the same tooth type as the tooth being examined for the presence of the dental condition.

4. The method according to claim 2, further comprising: Before determining the reference value, a filtered texture value distribution is obtained by filtering out texture components or texture data having corresponding texture values ​​outside a defined value range; and A reference value is determined based on a distribution of texture values ​​falling within a defined value range.

5. The method according to claim 1, wherein: The identification function is based on the distance between texture data of the region and texture data of a healthy region in a texture space.

6. The method according to claim 5, wherein: The distance comprises a Euclidean distance and the texture components of the texture data represent different dimensions of the texture space.

7. The method according to claim 1, wherein: The identification function defines a mathematical relationship including at least one texture component of the color data and at least one texture component of the fluorescence data from the region and at least one texture component of the color data and at least one texture component of the fluorescence data from a healthy region.

8. The method according to claim 1, wherein: At least one texture component of the fluorescence data from the region and / or the healthy region in the identification function comprises only at least one of a red texture component or a green texture component.

9. The method according to claim 1, wherein: The identification function does not have the blue texture component of the fluorescence data.

10. The method according to claim 1, wherein: The identification function is expressed as: Where IV is the identification value, r fluo,h and g fluo,h are the values ​​of the red and green texture components of the fluorescence data from the healthy area, r fluo and g fluo are the corresponding values ​​of the red and green texture components of the fluorescence data from the region, r h , g h , and b h are the corresponding values ​​of the red, green, and blue texture components of the color data from the healthy region, r, g, and b are the respective values ​​of the red, green, and blue texture components of the color data from the region.

11. The method according to claim 1, wherein: The identification function is expressed as: Where IV is the identification value, g fluo,h is the value of the green texture component of the fluorescence data from the healthy area, g flio is the value of the green texture component of the fluorescence data from the region, r h , g h , and b h are the corresponding values ​​of the red, green and blue texture components of the color data from the healthy region, r, g, and b are the respective values ​​of the red, green, and blue texture components of the color data from the region.

12. The method according to claim 1, wherein: The severity function defines a mathematical relationship that includes a texture component of the fluorescence data from the region and the same texture component of the fluorescence data from a healthy region.

13. The method according to claim 1, wherein: The severity function is expressed as: Where SV is the severity value, g fluo,h is the value of the green texture component of the fluorescence data from the healthy area, g fluo is the value of the green texture component of the fluorescence data from the region.

14. The method according to claim 1, wherein: Applying the identification function includes using texture component values ​​from the region and the healthy region in the identification function, and Applying the severity function includes using texture component values ​​from the region and the healthy region in a severity function.

15. The method of claim 1, further comprising determining a severity level of the dental condition based on the determined severity value satisfying severity threshold criteria.

16. The method according to claim 1, wherein: Generating the virtual three-dimensional model including the visual indicator includes mapping the regional severity value or severity level onto at least a portion of the obtained first digital 3D model or a copy thereof, the first digital 3D model or the copy thereof including the mapped severity value or the mapped severity level including at least one of the texture data or without any texture data associated with the first digital 3D model.

17. The method according to claim 1 also includes obtaining a second digital 3D model of the patient's tooth group and regional texture data including fluorescence data and color data corresponding to different regions of the second digital 3D model, and obtaining the second digital 3D model and the regional texture data at a second time point different from the time point when the first digital 3D model and the regional texture data corresponding to different regions of the first digital 3D model are obtained.

18. The method of claim 1, further comprising: identifying a region containing a dental condition based on an identification value that satisfies an identification threshold criterion, the identification value being calculated by applying an identification function to texture data associated with the region of the second digital 3D model; and The severity value is determined by applying a severity function to at least one of the data included in the texture data associated with the region of the second digital 3D model identified as containing the dental condition.

19. The method of claim 1, further comprising: calculating a set of severity differences between severity values ​​of corresponding regions between the first digital 3D model and the second digital 3D model; and A digital 3D model including the set of severity differences is generated.

20. The method according to claim 1, wherein: A digital 3D model of a set of severity differences was generated including: mapping or mapping the regional severity differences onto at least a portion of the obtained first digital 3D model or a copy thereof, the first digital 3D model or the copy thereof comprising the set of severity differences comprising at least one of the texture data or without any texture data associated with the first digital 3D model, or The regional severity differences are mapped onto at least a portion of the obtained second digital 3d model or a copy thereof, the second digital 3d model or a copy thereof comprising the set of severity differences including the at least one of the texture data or without any texture data associated with the second digital 3d model.