Dynamic tooth chart and automatic charting

Abstract

A method is provided for generating and / or displaying a dynamic tooth chart In some cases, the method can include receiving dataset(s) associated with a patient. Each dataset comprises data corresponding to an imaging modality of a plurality of imaging modalities and provides information on a dentition of the patient. The datasets are processed to generate, for each dataset, one or more tooth portions. Each tooth portion comprises an image of one or more teeth of the patient. The one or more tooth portions are arranged into a dental chart. A visualization of the dental chart of the patient is generated and provided to a user device for presentation in a user interface. In some cases, a method can include determining one or more chart annotations can by performing a shape analysis, a teeth arrangement analysis, and / or a material analysis on 3D dental model(s) and / or 2D images of the patient's jaw.

Description

Attorney Docket No.: 28510.973 (L0805PCT)DYNAMIC TOOTH CHART AND AUTOMATIC CHARTINGTECHNICAL FIELD

[0001] The instant specification generally relates to systems and methods for generating and displaying a dynamic tooth chart, and for enabling automatic tooth charting.BACKGROUND

[0002] Dental charting is a fundamental tool used by dental professionals to record and assess the condition of a patients teeth and supporting oral structures. A dental chart can include notations indicating, for example, the presence of caries, fillings, missing teeth, periodontal conditions, and other oral health conditions. T radition al dental charts rely on a combination of graphical representations and alphanumeric annotations to convey this information. These charts can serve as a clinical reference for ongoing patient care.

[0003] Over time, dental charting systems have evolved to accommodate advances in dental practice, including digital record-keeping and integration with diagnostic imaging technologies. Despite these advancements, many charting systems remain cumbersome to use, prone to inconsistencies in notation, and difficult to interpret across different practitioners or practice management systems. This has highlighted the need fora more standardized, intuitive, and interoperable charting format that enhances accuracy, usability, and communication within the dental profession.SUMMARY

[0004] The below summary is a simplified summary of the disclosure in order to provide a basic understanding of some aspects of the disclosure. This summary is notan extensive overview of the disclosure. It is intended neither to identify key or critical elements of the disclosure, nor delineate any scope of the particular embodiments of the disclosure or any scope of the claims. Its sole purpose is to present some concepts of the disclosure in a simplified form as a prelude to the more detailed description that is presented later.

[0005] In a first implementation, a method comprises receiving one or more datasets associated with a patient. Each data of the one or more datasets can correspond to an imaging modality of a plurality of imaging modalities and can provide information on a dentition of a patient. The method can further comprise processing the one or more datasets to generate, for each dataset of the one or more datasets, one or more tooth portions. Each tooth portion can comprise an image of one or more teeth of the patient. The method can further comprise arranging the one or more tooth portions into a dental chart. The method can further comprise generating a visualization of the dental chart of the patient. TheAttorney Docket No.: 28510.973 (L0805PCT)method can further comprise providing, to a user device, the visualization of the dental chart for presentation in a user interface (Ul).

[0006] A second implementation may further extend any of the first implementation. In the second implementation, the method may further include normalizing the one or more tooth portions.

[0007] A third implementation may further extend any of the second implementation. In the third implementation, the one or more tooth portions are normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation for coordinated presentation on the dental chart.

[0008] A fourth implementation may further extend any of the first through third implementations. In the fourth implementation, the method may further include determining the imaging modality of the plurality of imaging modalities and selecting the one or more tooth portions corresponding to the determined imaging modality.

[0009] A fifth implementation may further extend any of the fourth implementation. In the fifth implementation, determining the imaging modality may further include identifying a correlation between a context of a dental visit and each of the plurality of imaging modalities; ranking each of the plurality of imaging modalities according to the correlation; and determining the imaging modality with a highest ranking.

[0010] A sixth implementation may further extend any of the fifth implementation. In the sixth implementation, the context of the dental visit corresponds to at leastone of a complaint of the patient, an inputof a user device, a treatment plan, a treatment type, a scheduled dental visit, ora detection of a condition.

[0011] A seventh implementation may further extend any of the first through sixth implementations. In the seventh implementation, the plurality of imaging modalities comprise at least one of an intraoral scan, a near-infrared, a cone bean computed tomography (CBCT), a photograph, a video, a radiograph, fluorescence, or optical coherence tomography.

[0012] An eighth implementation may further extend any of the first through seventh implementations. In the eighth implementation, the visualization of the dental chart comprises at least one of a buccal view (e.g., displaying the side of the teeth that faces the cheeks), an occlusal view (e.g., displaying the biting or chewing surface of the teeth), or a lingual view (e.g., displaying the side of the teeth that faces the longue) of a dental arch of the patient.

[0013] A ninth implementation may further extend any of the first through eighth implementations. In the ninth implementation, the visualization of the dental chart displays a dental arch of the patient in at least one of a two-dimensional view, a three-dimensional view, or a multi-dimensional view.

[0014] A tenth implementation may further extend any of the first through ninth implementations. In the tenth implementation, the visualization comprises two or more imaging modalities.Attorney Docket No.: 28510.973 (L0805PCT)

[0015] An eleventh implementation may further extend any of the first through tenth implementations. In the eleventh implementation, a first tooth portion of the one or more tooth portions has a first imaging modality, and a second tooth portion of the one or more tooth portions has a second imaging modality.

[0016] A twelfth implementation may further extend any of the first through eleventh implementations. In the twelfth implementation, the method may further include receiving, from the user device, a user interaction associated with the visualization of the dental chart; identifying, base don the user interaction, a second imaging modality of the plurality of imaging modalities; and updating the visualization of the dental chart of the patient by selecting the one or more tooth portions that each corresponds to the second imaging modality.

[0017] A thirteenth implementation may further extend any of the first through twelfth implementations. In the thirteenth implementation, the method may further include processing the at least of the one or more datasets using a trained artificial intelligence (Al) model that outputs one or more detected oral conditions; and updating the one or more tooth portions to include a representation of the one or more detected oral conditions detected for one or more teeth represented in the one or more tooth portions.

[0018] A fourteenth implementation may further extend any of the first through thirteenth implementations. In the fourteenth implementation, each dataset comprises data from a particular point in time.

[0019] A fifteenth implementation may further extend any of the first through fourteenth implementations. In the fifteenth implementation, the visualization corresponds to a particular point in time.

[0020] A sixteenth implementation may further extend any of the first through fifteenth implementations. In the sixteenth implementation, the III enables a user of the user device to interact with the visualization by at least one of focusing in a particular section of a dental arch, changing imaging modalities, orchanging a point in time.

[0021] A seventeenth implementation may further extend any of the first through sixteenth implementations. In the seventeenth implementation, the method may further include providing, as input, the one or more datasets to an artificial intelligence model trained to provide an indication of a clinical finding corresponding to a particular imaging modality of the plurality of imaging modalities; receiving, from the artificial intelligence model, the indication of the clinical finding corresponding to the particular imaging modality; and including the clinical finding in the visualization of the dental chart of the patient.Attorney Docket No.: 28510.973 (L0805PCT)

[0022] An eighteenth implementation may further extend any of the seventeenth implementation. In the eighteenth implementation, including the clinical finding in the visualization of the dental chart can further include determining a second imaging modality of the plurality of imaging modalities other than the particular imaging modality; and selecting the one or more tooth portions corresponding to the second imaging modality.

[0023] A nineteenth implementation may further extend any of the eighteenth implementation. In the nineteenth implementation, determining the second imaging modality can further include identifying a correlation between the clinical finding and each of the plurality of imaging modalities; ranking each of the plurality of imaging modalities; and determining the second imaging modality with a highest ranking.

[0024] A twentieth implementation may further extend any of the first through nineteenth implementations. In the twentieth implementation, the method may further include receiving, from at least one artificial intelligence model, a plurality of indications of a clinical finding, wherein each indication corresponds to a particular imaging modality of the plurality of imaging modalities.

[0025] A twenty-first implementation may further extend any of the twentieth implementation. In the twenty-first implementation, the method may further include identifying a primary imaging modality corresponding to the clinical finding; identifying a primary indication of the plurality of indications, wherein the primary indication corresponds to the primary imaging modality; and including the primary indication in the visualization of the dental chart of the patient.

[0026] A twenty-second implementation may further extend any of the twentieth through twenty-first implementations. In the twenty-second implementation, the method may further include generating an overall indication of the clinical finding by aggregating the plurality of indications of the clinical finding; and including the overall indication of the clinal finding in the visualization of the dental chart of the patient.

[0027] A twenty-third implementation may further extend any of the first through twenty-second implementations. In the twenty-third implementation, the data corresponding to the imaging modality comprises data associated with a plurality of image sources.

[0028] A twenty-fourth implementation may further extend any of the twenty-third implementation. In the twenty-fourth implementation, the method may further include providing, as input, the image data associated with the plurality of image sources to an artificial intelligence model trained to provide a confidence score associated with an identified clinical finding for each of the plurality of image sources; receiving, as output form the artificial intelligence model, a plurality of confidence scores associated with a clinical finding for the plurality of image sources; identifying an image source of the plurality of image sources with a highest confidence score; and including, in the visualization of the dental chart, the image source with the highest confidence score.Attorney Docket No.: 28510.973 (L0805PCT)

[0029] A twenty-fifth implementation may further extend any of the first through twenty-fourth implementations. In the twenty-fifth implementation, the visualization comprises a first portion displaying a dental arch of the patient in a panoramic format and a second portion displaying the dental arch of the patient in an arch format.

[0030] A twenty-sixth implementation may further extend any of the first through twenty-fourth implementations. In twenty-sixth implementation, the method may further comprise receiving, from the user device, via one or more controls of the III, a modification to a measurement of a tooth of the one or more teeth of the patient; generating one or more updated tooth portions to reflect the modification; generating an updated visualization of the dental chart to include the one or more updated tooth portions; and providing, to the user device, the updated visualization of the dental chart.

[0031] In a twenty-seventh implementation, a system comprises a memory and a processing device to execute instructions from the memory. The processing device is configured to receive one or more datasets associated with a patient, wherein each dataset of the one or more datasets comprises data corresponding to an imaging modality of a plurality of imaging modalities and provides information on a dentition of the patient. The processing device is further configured to process the one or more datasets to generate, for each dataset of the one or more datasets, one or more tooth portions, wherein each tooth portion comprises an image of one or more teeth of the patient. The processing device is further configured to arrange the one or more tooth portions into a dental chart. The processing device is further configured to generate a visualization of the dental chart of the patient. The processing device is further configured to provide, to a user device, the visualization of the dental chart for presentation in a user interface (Ul).

[0032] A twenty-eighth implementation may further extend any of the twenty-seventh implementation. In the twenty-eighth implementation, the processing device is further configured to normalize the one or more tooth portions.

[0033] A twenty-ninth implementation may further extend any of the twenty-eighth implementation. In the twenty-ninth implementation, the one or more tooth portions are normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation for coordinated presentation on the dental chart.

[0034] A thirtieth implementation may further extend any of the twenty-seventh through twentyninth implementations. In the thirtieth implementation, the processing device is further configured to determine the imaging modality of the plurality of imaging modalities and select the one or more tooth portions corresponding to the determined imaging modality.

[0035] A thirty-first implementation may further extend any of the thirtieth implementation. In the thirty-first implementation, to determine the imaging modality, the processing device is furtherAttorney Docket No.: 28510.973 (L0805PCT)configured to identify a correlation between a context of a dental visit and each of the plurality of imaging modalities; rank each of the plurality of imaging modalities according to the correlation; and determine the imaging modality with a highest ranking.

[0036] A thirty-second implementation may further extend any of the thirty-first implementation. In the thirty-second implementation, the context of the dental visit corresponds to at least one of a complaint of the patient, an inputof a user of the user device, a treatment plan, a treatment type, a scheduled dental visit, or a detection of a condition.

[0037] A thirty-third implementation may further extend any of the twenty-seventh through thirty-second implementations. In the thirty-third implementation, the plurality of imaging modalities comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).

[0038] A thirty-fourth implementation may further extend any of the twenty-seventh through thirty-third implementations. In the thirty-fourth implementation, the visualization of the dental chart comprises at least one of a buccal view, an occlusal view, or a lingual view of a dental arch of the patient.

[0039] A thirty-fifth implementation may further extend any of the twenty-seventh through thirtyfourth implementations. In the thirty-fifth implementation, the visualization of the dental chart displays a dental arch of the patient in at least one of a two-dimensional view, a three-dimensional view, ora multidimensional view.

[0040] A thirty-sixth implementation may further extend any of the twenty-seventh through thirtyfifth implementations. In the thirty-sixth implementation, the visualization comprises two or more imaging modalities.

[0041] A thirty-seventh implementation may further extend any of the twenty-seventh through thirty-sixth implementations. In the thirty-seventh implementation, a first tooth portion of the one or more tooth portions has a first imaging modality and a second tooth portion of the one or more tooth portions has a second imaging modality.

[0042] A thirty-eighth implementation may further extend any of the twenty-seventh through thirtyseventh implementations. In the thirty-eighth implementation, the processing device is further configured to receive, from the user device, a user interaction associated with the visualization of the dental chart; identify, based on the user interaction, a second imaging modality of the plurality of imaging modalities; and update the visualization of the dental chart of the patient by selecting the one or more tooth portions that each corresponds to the second imaging modality.

[0043] A thirty-ninth implementation may further extend any of the twenty-seventh through thirtyeighth implementations. In the thirty-ninth implementation, the processing device is further configured to process the at least one of the one or more datasets using a trained artificial intelligence (Al) model thatAttorney Docket No.: 28510.973 (L0805PCT)outputs one or more detected oral conditions; and update the one or more tooth portions to include a representation of the one or more detected oral conditions detected for one or more teeth represented in the one or more tooth portions.

[0044] A fortieth implementation may further extend any of the twenty-seventh through thirty-ninth implementations. In the fortieth implementation, each dataset comprises data from a particular point in time.

[0045] A forty-first implementation may further extend any of the twenty-seventh through fortieth implementations. In the forty-first implementation, the visualization corresponds to a particular point in time.

[0046] A forty-second implementation may further extend any of the twenty-seventh through forty-first implementations. In the forty-second implementation, the III enables a user of the user device to interact with the visualization by at least one of focusing in a particular section of a dental arch, changing imaging modalities, orchanging a point in time.

[0047] A forty-third implementation may further extend any of the twenty-seventh through forty-second implementations. In the forty-third implementation, the processing device is further configured to provide, as input, the one or more datasets to an artificial intelligence model trained to provide an indication of a clinical finding corresponding to a particular imaging modality of the plurality of imaging modalities; receive, from the artificial intelligence model, the indication of the clinical finding corresponding to the particular imaging modality; and include the clinical finding in the visualization of the dental chart of the patient.

[0048] A forty-fourth implementation may further extend any of the forty-third implementation. In the forty-fourth implementation, to include the clinical finding in the visualization of the dental chart, the processing device is further configured to determine a second imaging modality of the plurality of imaging modalities other than the particular imaging modality; and select the one or more tooth portions corresponding to the second imaging modality.

[0049] A forty-fifth implementation may further extend any of the forty-fourth implementation. In the forty-fifth implementation, to determine the second imaging modality, the processing device is further configured to identify a correlation between the clinical finding and each of the plurality of imaging modalities; rank each of the plurality of imaging modalities according to the correlation; and determine the second imaging modality with a highest ranking.

[0050] A forty-sixth implementation may further extend any of the twenty-seventh through fortyfifth implementations. In the forty-sixth implementation, the processing device is further configured to receive, from at least one artificial intelligence model, a plurality of indications of a clinical finding,Attorney Docket No.: 28510.973 (L0805PCT)wherein each indication corresponds to a particular imaging modality of the plurality of imaging modalities.

[0051] A forty-seventh implementation may further extend any of the forty-sixth implementation. In the forty-seventh implementation, the processing device is further configured to identify a primary imaging modality corresponding to the clinical finding; identify a primary indication of the plurality of indications, wherein the primary indication corresponds to the primary imaging modality; and include the primary indication in the visualization of the dental chart of the patient.

[0052] A forty-eighth implementation may further extend any of the forty-sixth through fortyseventh implementations. In the forty-eighth implementation, the processing device is further configured to generate an overall indication of the clinical finding by aggregating the plurality of indications of the clinical finding; and include the overall indication of the clinical finding in the visualization of the dental chart of the patient.

[0053] A forty-ninth implementation may further extend any of the twenty-seventh through fortyeighth implementations. In the forty-ninth implementation, the data corresponding to the imaging modality comprises image data associated with a plurality of image sources.

[0054] A fiftieth implementation may further extend any of the forty-ninth implementation. In the fiftieth implementation, the processing device is further configured to provide, as input, the image data associated with the plurality of image sources to an artificial intelligence model trained to provide a confidence score associated with an identified clinical finding for each of the plurality of image sources; receive, as output from the artificial intelligence model, a plurality of confidence scores associated with a clinical finding for the plurality of image sources; identify an image source of the plurality of image sources with a highest confidence score; and include, in the visualization of the dental chart, the image source with the highest confidence score.

[0055] A fifty-first implementation may further extend any of the twenty-seventh through fiftieth implementations. In the fifty-first implementation, the visualization comprises a first portion displaying a dental arch of the patient in a panoramic format and a second portion displaying the dental arch of the patient in an arch format.

[0056] A fifty-second implementation may further extend any of the twenty-seventh through fifty-first implementations. In the fifty-second implementation, the processing device is further configured to receive, from the user device, via one or more controls of the III, a modification to a measurement of a tooth of the one or more teeth of the patient; generate one or more updated tooth portions to reflect the modification; generate an updated visualization of the dental chart to include the one or more updated tooth portions; and provide, to the user device, the updated visualization of the dental chart.Attorney Docket No.: 28510.973 (L0805PCT)

[0057] In a fifty-third implementation, a non-transitory computer-readable storage medium comprises instructions that, when executed by a processing device, cause the processing device to receive one or more datasets associated with a patient, wherein each dataset of the one or more datasets comprises data corresponding to an imaging modality of a plurality of imaging modalities and provides information on a dentition of the patient. The instructions further cause the processing device to process the one or more datasets to generate, for each dataset of the one or more datasets, one or more tooth portions, wherein each tooth portion comprises an image of one or more teeth of the patient. The instructions further cause the processing device to arrange the one or more tooth portions into a dental chart. The instructions further cause the processing device to generate a visualization of the dental chart of the patient. The instructions further cause the processing device to provide, to a user device, the visualization of the dental chart for presentation in a user interface (III).

[0058] A fifty-fourth implementation may further extend any of the fifty-third implementation. In the fifty-fourth implementation, the processing device is further caused to normalize the one or more tooth portions.

[0059] A fifty-fifth implementation may further extend any of the fifty-fourth implementation. In the fifty-fifth implementation, the one or more tooth portions are normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation for coordinated presentation on the dental chart.

[0060] A fifty-sixth implementation may further extend any of the fifty-third through fifty-fifth implementations. In the fifty-sixth implementation, the processing device is further caused to determine the imaging modality of the plurality of imaging modalities; and select the one or more tooth portions corresponding to the determined imaging modality.

[0061] A fifty-seventh implementation may further extend any of the fifty-sixth implementation. In the fifty-seventh implementation, to determine the imaging modality, the processing device is further caused to identify a correlation between a context of a dental visit and each of the plurality of imaging modalities; rank each of the plurality of imaging modalities according to the correlation; and determine the imaging modality with a highest ranking.

[0062] A fifty-eighth implementation may further extend any of the fifty-seventh implementation. In the fifty-eighth implementation, the context of the dental visit corresponds to at least one of a complaint of the patient, an input of a user of the user device, a treatment plan, a treatment type, a scheduled dental visit, or a detection of a condition.

[0063] A fifty-ninth implementation may further extend any of the fifty-third through fifty-eighth implementations. In the fifty-ninth implementation, the plurality of imaging modalities comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).Attorney Docket No.: 28510.973 (L0805PCT)

[0064] A sixtieth implementation may further extend any of the fifty-third through fifty-ninth implementations. In the sixtieth implementation, the visualization of the dental chart comprises at least one of a buccal view, an occlusal view, or a lingual view of a dental arch of the patient.

[0065] A sixty-first implementation may further extend any of the fifty-third through sixtieth implementations. In the sixty-first implementation, the visualization of the dental chart displays a dental arch of the patient in at least one of a two-dimensional view, a three-dimensional view, or a multidimensional view.

[0066] A sixty-second implementation may further extend any of the fifty-third through sixty-first implementations. In the sixty-second implementation, the visualization comprises two or more imaging modalities.

[0067] A sixty-third implementation may further extend any of the fifty-third through sixty-second implementations. In the sixty-third implementation, a first tooth portion of the one or more tooth portions has a first imaging modality and a second tooth portion of the one or more tooth portions has a second imaging modality.

[0068] A sixty-fourth implementation may further extend any of the fifty-third through sixty-third implementations. In the sixty-fourth implementation, the processing device is further caused to receive, from the user device, a user interaction associated with the visualization of the dental chart; identify, based on the user interaction, a second imaging modality of the plurality of imaging modalities; and update the visualization of the dental chart of the patient by selecting the one or more tooth portions that each corresponds to the second imaging modality.

[0069] A sixty-fifth implementation may further extend any of the fifty-third through sixty-fourth implementations. In the sixty-fifth implementation, the processing device is further caused to process the at least one of the one or more datasets using a trained artificial intelligence (Al) model that outputs one or more detected oral conditions; and update the one or more tooth portions to include a representation of the one or more detected oral conditions detected for one or more teeth represented in the one or more tooth portions.

[0070] A sixty-sixth implementation may further extend any of the fifty-third through sixty-fifth implementations. In the sixty-sixth implementation, each dataset comprises data from a particular point in time.

[0071] A sixty-seventh implementation may further extend any of the fifty-third through sixty-sixth implementations. In the sixty-seventh implementation, the visualization corresponds to a particular point in time.

[0072] A sixty-eighth implementation may further extend any of the fifty-third through sixty-seventh implementations. In the sixty-eighth implementation, the III enables a user of the user device to interactAttorney Docket No.: 28510.973 (L0805PCT)with the visualization by at least one of focusing in a particular section of a dental arch, changing imaging modalities, orchanging a point in time.

[0073] A sixty-ninth implementation may further extend any of the fifty-third through sixty-eighth implementations. In the sixty-ninth implementation, the processing device is further caused to provide, as input, the one or more datasets to an artificial intelligence model trained to provide an indication of a clinical finding corresponding to a particular imaging modality of the plurality of imaging modalities; receive, from the artificial intelligence model, the indication of the clinical finding corresponding to the particular imaging modality; and include the clinical finding in the visualization of the dental chart of the patient.

[0074] A seventieth implementation may further extend any of the sixty-ninth implementation. In the seventieth implementation, to include the clinical finding in the visualization of the dental chart, the processing device is further caused to determine a second imaging modality of the plurality of imaging modalities other than the particular imaging modality; and select the one or more tooth portions corresponding to the second imaging modality.

[0075] A seventy-first implementation may further extend any of the seventieth implementation. In the seventy-first implementation, to determine the second imaging modality, the processing device is further caused to identify a correlation between the clinical finding and each of the plurality of imaging modalities; rank each of the plurality of imaging modalities according to the correlation; and determine the second imaging modality with a highest ranking.

[0076] A seventy-second implementation may further extend any of the fifty-third through seventy-first implementations. In the seventy-second implementation, the processing device is further caused to receive, from at least one artificial intelligence model, a plurality of indications of a clinical finding, wherein each indication corresponds to a particular imaging modality of the plurality of imaging modalities.

[0077] A seventy-third implementation may further extend any of the seventy-second implementation. In the seventy-third implementation, the processing device is further caused to identify a primary imaging modality corresponding to the clinical finding; identify a primary indication of the plurality of indications, wherein the primary indication corresponds to the primary imaging modality; and include the primary indication in the visualization of the dental chart of the patient.

[0078] A seventy-fourth implementation may further extend any of the seventy-second through seventy-third implementations. In the seventy-fourth implementation, the processing device is further caused to generate an overall indication of the clinical finding by aggregating the plurality of indications of the clinical finding; and include the overall indication of the clinical finding in the visualization of the dental chart of the patient.Attorney Docket No.: 28510.973 (L0805PCT)

[0079] A seventy-fifth implementation may further extend any of the fifty-third through seventyfourth implementations. In the seventy-fifth implementation, the data corresponding to the imaging modality comprises image data associated with a plurality of image sources.

[0080] A seventy-sixth implementation may further extend any of the seventy-fifth implementation. In the seventy-sixth implementation, the processing device is further caused to provide, as input, the image data associated with the plurality of image sources to an artificial intelligence model trained to provide a confidence score associated with an identified clinical finding for each of the plurality of image sources; receive, as output from the artificial intelligence model, a plurality of confidence scores associated with a clinical finding for the plurality of image sources; identify an image source of the plurality of image sources with a highest confidence score; and include, in the visualization of the dental chart, the image source with the highest confidence score.

[0081] A seventy-seventh implementation may further extend any of the fifty-third through seventy-sixth implementations. In the seventy-seventh implementation, the visualization comprises a first portion displaying a dental arch of the patient in a panoramic format and a second portion displaying the dental arch of the patient in an arch format.

[0082] A seventy-eighth implementation may further extend any of the fifty-third through seventyseventh implementations. In the seventy-eighth implementation, the processing device is further caused to receive, from the user device, via one or more controls of the III, a modification to a measurement of a tooth of the one or more teeth of the patient; generate one or more updated tooth portions to reflect the modification; generate an updated visualization of the dental chart to include the one or more updated tooth portions; and provide, to the user device, the updated visualization of the dental chart.

[0083] In a seventy-ninth implementation, a method comprises identifying one or more datasets associated with a dental arch of a patient, wherein each of the one or more datasets corresponds to an imaging modality of a plurality of imaging modalities. The method further comprises segmenting each dataset into a plurality of sections, wherein each section of the plurality of sections corresponds to a portion of the dental arch of the patient. The method further comprises generating a corresponding normalized section of each dataset by normalizing, for each dataset, each section of the plurality of sections. The method further comprises generating, for each section of the plurality of sections, a tooth portion comprising the corresponding normalized section of each dataset.

[0084] An eightieth implementation may further extend any of the seventy-ninth implementation. In the eightieth implementation, the portion of the dental arch corresponds to one or more teeth of the dental arch of the patient.

[0085] An eighty-first implementation may further extend any of the seventy-ninth through eightieth implementations. In the eighty-first implementation, the plurality of imaging modalitiesAttorney Docket No.: 28510.973 (L0805PCT)comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).

[0086] An eighty-second implementation may further extend any of the seventy-ninth through eighty-first implementations. In the eighty-second implementation, a dataset of the one or more datasets corresponds to one of a buccal view, an occlusal view, or a lingual view of the dental arch of the patient.

[0087] An eighty-third implementation may further extend any of the seventy-ninth through eighty-second implementations. In the eighty-third implementation, each section is normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation.

[0088] In an eighty-fourth implementation, a system comprises a memory and a processing device to execute instructions from the memory. The processing device is configured to identify one or more datasets associated with a dental arch of a patient, wherein each of the one or more datasets corresponds to an imaging modality of a plurality of imaging modalities. The processing device is further configured to segment each dataset into a plurality of sections, wherein each section of the plurality of sections corresponds to a portion of the dental arch of the patient. The processing device is further configured to generate a corresponding normalized section of each dataset by normalizing, for each dataset, each section of the plurality of sections. The processing device is further configured to generate, for each section of the plurality of sections, a tooth portion comprising the corresponding normalized section of each dataset.

[0089] An eighty-fifth implementation may further extend any of the eighty-fourth implementation. In the eighty-fifth implementation, the portion of the dental arch corresponds to one or more teeth of the dental arch of the patient.

[0090] An eighty-sixth implementation may further extend any of the eighty-fourth through eightyfifth implementations. In the eighty-sixth implementation, the plurality of imaging modalities comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).

[0091] An eighty-seventh implementation may further extend any of the eighty-fourth through eighty-sixth implementations. In the eighty-seventh implementation, a dataset of the one or more datasets corresponds to one of a buccal view, an occlusal view, or a lingual view of the dental arch of the patient.

[0092] An eighty-eighth implementation may further extend any of the eighty-fourth through eightyseventh implementations. In the eighty-eighth implementation, each section is normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation.Attorney Docket No.: 28510.973 (L0805PCT)

[0093] In an eighty-ninth implementation, a non-transitory computer-readable storage medium comprises instructions that, when executed by a processing device, cause the processing device to identify one or more datasets associated with a dental arch of a patient, wherein each of the one or more datasets corresponds to an imaging modality of a plurality of imaging modalities. The instructions further cause the processing device to segment each dataset into a plurality of sections, wherein each section of the plurality of sections corresponds to a portion of the dental arch of the patient. The instructions further cause the processing device to generate a corresponding normalized section of each dataset by normalizing, for each dataset, each section of the plurality of sections. The instructions further cause the processing device to generate, for each section of the plurality of sections, a tooth portion comprising the corresponding normalized section of each dataset.

[0094] A ninetieth implementation may further extend any of the eighty-ninth implementation. In the ninetieth implementation, the portion of the dental arch corresponds to one or more teeth of the dental arch of the patient.

[0095] A ninety-first implementation may further extend any of the eighty-ninth through ninetieth implementations. In the ninety-first implementation, the plurality of imaging modalities comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).

[0096] A ninety-second implementation may further extend any of the eighty-ninth through ninety-first implementations. In the ninety-second implementation, a dataset of the one or more datasets corresponds to one of a buccal view, an occlusal view, ora lingual view of the dental arch of the patient.

[0097] A ninety-third implementation may further extend any of the eighty-ninth through ninety-second implementations. In the ninety-third implementation, each section is normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation.

[0098] In a ninety-fourth implementation, a method comprises receiving scan data comprising at least one of a three-dimensional (3D) model of a jaw of a patient, one or more two-dimensional (2D) color intraoral images of the patient, or one or more near-infrared imaging (NIRI) intraoral images of the patient. The method further comprises identifying a subset of the scan data for each tooth of the patient. The method further comprises determining one or more chart annotations for a dental chart of the patient, wherein the one or more chart annotations are determined by at least one of: performing, for each subset of the scan data, a shape analysis to identify a status of the tooth of the patient; performing, for each subset of the scan data, a teeth arrangement analysis to identify a positioning of the tooth of the patient; or performing, for each subset of the scan data, a material classification to identify a composition of the tooth of the patient.Attorney Docket No.: 28510.973 (L0805PCT)

[0099] A ninety-fifth implementation may further extend any of the ninety-fourth implementation. In the ninety-fifth implementation, identifying the subset of the scan data for each tooth of the patient comprises at least one of: segmenting the 3D model to generate a series of secondary 3D models, wherein each secondary 3D model in the series of secondary 3D models corresponds to a tooth of the patient; identifying a portion of the one or more 2D color intraoral images corresponding to the tooth of the patient; or identifying a portion of the one or more NIRI intraoral images corresponding to the tooth of the patient.

[0100] A ninety-sixth implementation may further extend any of the ninety-fifth implementation. In the ninety-sixth implementation, performing the teeth arrangement analysis comprises: generating, based on the 3D model, a jaw line reference curve for the patient; identifying, based on segmentation data of the secondary 3D model, a location of the tooth; making a comparison of the location of the tooth to the jaw line reference curve; and determining, based on the comparison, the positioning of the tooth, wherein the positioning comprises one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0101] A ninety-seventh implementation may further extend any of the ninety-fifth implementation. In the ninety-seventh implementation, the method may further comprise comparing a first secondary 3D model corresponding to a first tooth of the patient to a second secondary 3D model corresponding to a second tooth of the patient, wherein the second tooth is symmetrically opposite the first tooth in the jaw of the patient; determining, based on the comparison, an asymmetry metric representing a dissimilarity between the first tooth and the second tooth; and adding the asymmetry metric to at least one of the subset of the scan data for the first tooth or the subset of the scan data for the second tooth.

[0102] A ninety-eighth implementation may further extend any of the ninety-seventh implementation. In the ninety-eighth implementation, the method may further comprise responsive to determining that the asymmetry metric satisfies a condition, performing an error recovery operation corresponding to the dissimilarity between the first tooth and the second tooth.

[0103] A ninety-ninth implementation may further extend any of the ninety-fourth through ninetyeighth implementations. In the ninety-ninth implementation, the method may further comprise providing, to a user device, the one or more chart annotations to include in the dental chart of the patient; and providing the one or more chart annotations to a dental practice management system.

[0104] A one hundredth implementation may further extend any of the ninety-fourth through ninety-ninth implementations. In the one hundredth implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutmentAttorney Docket No.: 28510.973 (L0805PCT)indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0105] A one hundred first implementation may further extend any of the ninety-fourth through one hundredth implementations. In the one hundred first implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model is trained to provide, as output, at least one of a tooth identification, an outlier shape, or one or more indicators of dental accessories; and receiving, as output from the machine learning model, at least one of the tooth identifications, the outlier shape, or the one or more indicators of dental accessories.

[0106] A one hundred second implementation may further extend any of the one hundred first implementation. In the one hundred second implementation, the method may further comprise providing at least one of the tooth identification or the outlier shape to a classifier, wherein the classifier outputs one or more indicators of the status of the tooth, the one or more indicators comprising at leastone of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, or a partially hatched tooth indicator.

[0107] A one hundred third implementation may further extend any of the one hundred first through one hundred second implementations. In the one hundred third implementation, the method may further comprise providing the one or more indicators of dental accessories as input to a second machine learning model, wherein the second machine learning model outputs one or more additional indicators comprising at least one of a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0108] A one hundred fourth implementation may further extend any of the ninety-fourth through one hundred third implementations. In the one hundred fourth implementation, performing the material classification comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs a classification of at least one of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, or a bridge.

[0109] A one hundred fifth implementation may further extend any of the one hundred fourth implementation. In the one hundred fifth implementation, the method may further comprise segmenting the classification of the at least one of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge from the corresponding tooth, wherein the segmentation provides at least one of a location or a size corresponding to the classification of the at least one of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge.Attorney Docket No.: 28510.973 (L0805PCT)

[0110] A one hundred sixth implementation may further extend any of the ninety-fourth through one hundred fifth implementations. In the one hundred sixth implementation, the method may further comprise providing the one or more chart annotations to a diagnostic system, wherein an outcome of the diagnostic system comprises the one or more chart annotations.

[0111] A one hundred seventh implementation may further extend any of the ninety-fourth through one hundred sixth implementations. In the one hundred seventh implementation, the method may further comprise identifying, for the tooth of the patient, a caries indication identified by a caries diagnostic system; and responsive to determining that the one or more chart annotations for the tooth of the patient satisfies a caries condition, providing an updated caries identification to the caries diagnostic system.

[0112] A one hundred eighth implementation may further extend any of the ninety-fourth through one hundred seventh implementations. In the one hundred eighth implementation, the method may further comprise responsive to identifying, based on the one or more chart annotations, that the tooth is a restoration, providing an indication of the restoration to a timelapse diagnostic system.

[0113] A one hundred ninth implementation may further extend any of the ninety-fourth through one hundred eighth implementations. In the one hundred ninth implementation, the method may further comprise responsive to identifying, based on the one or more chart annotations, that the patient is in active orthodontic treatment, providing an indication of the active orthodontic treatment to a timelapse diagnostic system.

[0114] A one hundred tenth implementation may further extend any of the ninety-fourth through one hundred ninth implementations. In the one hundred tenth implementation, the method may further comprise responsive to identifying, based on the one or more chart annotations, that the tooth is an implant, providing an indication of the implant to a tooth strength assessment system.

[0115] A one hundred eleventh implementation may further extend any of the ninety-fourth through one hundred tenth implementations. In the one hundred eleventh implementation, the method may further comprise determining an orthodontic treatment plan for the patient, wherein the orthodontic treatment plan comprises a first location of a dental attachment for the tooth of the patient; identifying, based on the one or more chart annotations, a second location of the dental attachment for the tooth of the patient; and responsive to determining that the first location and the second location differ, providing, to a user device, an indication of a displacement of the dental attachment.

[0116] A one hundred twelfth implementation may further extend any of the ninety-fourth through one hundred eleventh implementations. In the one hundred twelfth implementation, the method may further comprise validating a first set of the one or more chart annotations corresponding to a first scan of the patient taken at a first point in time by comparing the first set of the one or more chart annotationsAttorney Docket No.: 28510.973 (L0805PCT)to a second set of chart annotations corresponding to a second scan of the patient taken at a second point in time, wherein the second point in time predates the first point in time.

[0117] A one hundred thirteenth implementation may further extend any of the ninety-fourth through one hundred twelfth implementations. In the one hundred thirteenth implementation, the method may further comprise receiving second scan data comprising one or more geometrical connections between the 3D model and the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to segmenting the 3D model, projecting segmentation results onto the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the shape analysis, mapping the status of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the teeth arrangement analysis, mapping the positioning of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; and responsive to performing the material classification, mapping the composition of the tooth the 3D model.

[0118] A one hundred fourteenth implementation may further extend any of the ninety-fourth through one hundred thirteenth implementations. In the one hundred fourteenth implementation, determining the one or more chart annotations for the dental chart of the patient comprises: providing at least one of a secondary 3D model corresponding to the tooth of the patient, the one or more two-dimensional (2D) color intraoral images, or the one or more near-infrared imaging (NIRI) intraoral images as input to a machine learning model, wherein the machine learning model outputs one or more chart annotation indicators, wherein the one or more chart annotation indicators correspond to at least one of a status indicator, a positioning indicator, or a composition indicator.

[0119] A one hundred fifteenth implementation may further extend any of the one hundred fourteenth implementation. In the one hundred fifteenth implementation, the status indicator represents at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0120] A one hundred sixteenth implementation may further extend any of the one hundred fourteenth through one hundred fifteenth implementations. In the one hundred sixteenth implementation, the positioning indicator reflects one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0121] A one hundred seventeenth implementation may further extend any of the one hundred fourteenth through one hundred sixteenth implementations. In the one hundred seventeenthAttorney Docket No.: 28510.973 (L0805PCT)implementation, the composition indicator reflects at least one of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, ora bridge.

[0122] In a one hundred eighteenth implementation, a system comprises a memory and a processing device to execute instructions from the memory. The processing device is configured to receive scan data comprising at least one of a three-dimensional (3D) model of ajaw of a patient, one or more two-dimensional (2D) color intraoral images of the patient, or one or more near-infrared imaging (NIRI) intraoral images of the patient. The processing device is further configured to identify a subset of the scan data for each tooth of the patient. The processing device is further configured to determine one or more chart annotations for a dental chart of the patient, wherein the one or more chart annotations are determined by at least one of: performing, for each subset of the scan data, a shape analysis to identify a status of the tooth of the patient; performing, for each subset of the scan data, a teeth arrangement analysis to identify a positioning of the tooth of the patient; or performing, for each subset of the scan data, a material classification to identify a composition of the tooth of the patient.

[0123] A one hundred nineteenth implementation may further extend any of the one hundred eighteenth implementation. In the one hundred nineteenth implementation, to identify the subset of the scan data for each tooth of the patient, the instructions comprise at least one of: segmenting the 3D model to generate a series of secondary 3D models, wherein each secondary 3D model in the series of secondary 3D models corresponds to a tooth of the patient; identifying a portion of the one or more 2D color intraoral images corresponding to the tooth of the patient; or identifying a portion of the one or more NIRI intraoral images corresponding to the tooth of the patient.

[0124] A one hundred twentieth implementation may further extend any of the one hundred nineteenth implementation. In the one hundred twentieth implementation, performing the teeth arrangement analysis comprises: generating, based on the 3D model, ajaw line reference curve for the patient; identifying, based on segmentation data of the secondary 3D model, a location of the tooth; making a comparison of the location of the tooth to the jaw line reference curve; and determining, based on the comparison, the positioning of the tooth, wherein the positioning comprises one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0125] A one hundred twenty-first implementation may further extend any of the one hundred nineteenth through one hundred twentieth implementations. In the one hundred twenty-first implementation, the processing device is further configured to compare a first secondary 3D model corresponding to a first tooth of the patient to a second secondary 3D model corresponding to a second tooth of the patient, wherein the second tooth is symmetrically opposite the first tooth in the jaw of the patient; determine, based on the comparison, an asymmetry metric representing a dissimilarity betweenAttorney Docket No.: 28510.973 (L0805PCT)the first tooth and the second tooth; and add the asymmetry metric to at least one of the subset of the scan data for the first tooth or the subset of the scan data for the second tooth.

[0126] A one hundred twenty-second implementation may further extend any of the one hundred twenty-first implementation. In the one hundred twenty-second implementation, the processing device is further configured to, responsive to determining that the asymmetry metric satisfies a condition, perform an error recovery operation corresponding to the dissimilarity between the first tooth and the second tooth.

[0127] A one hundred twenty-third implementation may further extend any of the one hundred eighteenth through one hundred twenty-second implementations. In the one hundred twenty-third implementation, the processing device is further configured to provide, to a user device, the one or more chart annotations to include in the dental chart of the patient; and provide the one or more chart annotations to a dental practice management system.

[0128] A one hundred twenty-fourth implementation may further extend any of the one hundred eighteenth through one hundred twenty-third implementations. In the one hundred twenty-fourth implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0129] A one hundred twenty-fifth implementation may further extend any of the one hundred eighteenth through one hundred twenty-fourth implementations. In the one hundred twenty-fifth implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model is trained to provide, as output, at least one of a tooth identification, an outlier shape, or one or more indicators of dental accessories; and receiving, as output from the machine learning model, at least one of the tooth identifications, the outlier shape, or the one or more indicators of dental accessories.

[0130] A one hundred twenty-sixth implementation may further extend any of the one hundred twenty-fifth implementation. In the one hundred twenty-sixth implementation, performing the shape analysis further comprises: providing at least one of the tooth identification or the outlier shape to a classifier, wherein the classifier outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, or a partially hatched tooth indicator.Attorney Docket No.: 28510.973 (L0805PCT)

[0131] A one hundred twenty-seventh implementation may further extend any of the one hundred twenty-fifth through one hundred twenty-sixth implementations. In the one hundred twenty-seventh implementation, the processing device is further configured to provide the one or more indicators of dental accessories as input to a second machine learning model, wherein the second machine learning model outputs one or more additional indicators comprising at least one of a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0132] A one hundred twenty-eighth implementation may further extend any of the one hundred eighteenth through one hundred twenty-seventh implementations. In the one hundred twenty-eighth implementation, performing the material classification comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs a classification of at leastone of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, ora bridge.

[0133] A one hundred twenty-ninth implementation may further extend any of the one hundred twenty-eighth implementation. In the one hundred twenty-ninth implementation, performing the material classification further comprises: segmenting the classification of the at leastone of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge from the corresponding tooth, wherein the segmentation provides at leastone of a location or a size corresponding to the classification of the at leastone of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge.

[0134] A one hundred thirtieth implementation may further extend any of the one hundred eighteenth through one hundred twenty-ninth implementations. In the one hundred thirtieth implementation, the processing device is further configured to provide the one or more chart annotations to a diagnostic system, wherein an outcome of the diagnostic system comprises the one or more chart annotations.

[0135] A one hundred thirty-first implementation may further extend any of the one hundred eighteenth through one hundred thirtieth implementations. In the one hundred thirty-first implementation, the processing device is further configured to identify, for the tooth of the patient, a caries indication identified by a caries diagnostic system; and responsive to determining that the one or more chart annotations for the tooth of the patient satisfies a caries condition, provide an updated caries identification to the caries diagnostic system.

[0136] A one hundred thirty-second implementation may further extend any of the one hundred eighteenth through one hundred thirty-first implementations. In the one hundred thirty-second implementation, the processing device is further configured to, responsive to identifying, based on theAttorney Docket No.: 28510.973 (L0805PCT)one or more chart annotations, that the tooth is a restoration, provide an indication of the restoration to a timelapse diagnostic system.

[0137] A one hundred thirty-third implementation may further extend any of the one hundred eighteenth through one hundred thirty-second implementations. In the one hundred thirty-third implementation, the processing device is further configured to, responsive to identifying, based on the one or more chart annotations, that the patient is in active orthodontic treatment, provide an indication of the active orthodontic treatment to a timelapse diagnostic system.

[0138] A one hundred thirty-fourth implementation may further extend any of the one hundred eighteenth through one hundred thirty-third implementations. In the one hundred thirty-fourth implementation, the processing device is further configured to, responsive to identifying, based on the one or more chart annotations, that the tooth is an implant, provide an indication of the implant to a tooth strength assessment system.

[0139] A one hundred thirty-fifth implementation may further extend any of the one hundred eighteenth through one hundred thirty-fourth implementations. In the one hundred thirty-fifth implementation, the processing device is further configured to determine an orthodontic treatment plan for the patient, wherein the orthodontic treatment plan comprises a first location of a dental attachment for the tooth of the patient; identify, based on the one or more chart annotations, a second location of the dental attachment for the tooth of the patient; and responsive to determining that the first location and the second location differ, provide, to a user device, an indication of a displacement of the dental attachment.

[0140] A one hundred thirty-sixth implementation may further extend any of the one hundred eighteenth through one hundred thirty-fifth implementations. In the one hundred thirty-sixth implementation, the processing device is further configured to validate a first set of the one or more chart annotations corresponding to a first scan of the patient taken at a first point in time by comparing the first set of the one or more chart annotations to a second set of chart annotations corresponding to a second scan of the patient taken at a second point in time, wherein the second point in time predates the first point in time.

[0141] A one hundred thirty-seventh implementation may further extend any of the one hundred eighteenth through one hundred thirty-sixth implementations. In the one hundred thirty-seventh implementation, the processing device is further configured to receive second scan data comprising one or more geometrical connections between the 3D model and the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to segmenting the 3D model, project segmentation results onto the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the shape analysis, map the statusAttorney Docket No.: 28510.973 (L0805PCT)of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the teeth arrangement analysis, map the positioning of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; and responsive to performing the material classification, map the composition of the tooth the 3D model.

[0142] A one hundred thirty-eighth implementation may further extend any of the one hundred eighteenth through one hundred thirty-seventh implementations. In the one hundred thirty-eighth implementation, to determine the one or more chart annotations for the dental chart of the patient, the processing device is further configured to provide at least one of a secondary 3D model corresponding to the tooth of the patient, the one or more two-dimensional (2D) color intraoral images, or the one or more near-infrared imaging (NIRI) intraoral images as input to a machine learning model, wherein the machine learning model outputs one or more chart annotation indicators, wherein the one or more chart annotation indicators correspond to at least one of a status indicator, a positioning indicator, or a composition indicator.

[0143] A one hundred thirty-ninth implementation may further extend any of the one hundred thirty-eighth implementation. In the one hundred thirty-ninth implementation, the status indicator represents at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, ora braces indicator.

[0144] A one hundred fortieth implementation may further extend any of the one hundred thirtyeighth through one hundred thirty-ninth implementations. In the one hundred fortieth implementation, the positioning indicator reflects one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0145] A one hundred forty-first implementation may further extend any of the one hundred thirtyeighth through one hundred fortieth implementations. In the one hundred forty-first implementation, the composition indicator reflects at least one of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, or a bridge.

[0146] In a one hundred forty-second implementation, a non-transitory computer-readable storage medium comprises instructions that, when executed by a processing device, cause the processing device to receive scan data comprising at least one of a three-dimensional (3D) model of a jaw of a patient, one or more two-dimensional (2D) color intraoral images of the patient, or one or more nearinfrared imaging (NIRI) intraoral images of the patient. The instructions further cause the processing device to identify a subset of the scan data for each tooth of the patient. The instructions further cause the processing device to determine one or more chart annotations for a dental chart of the patient,Attorney Docket No.: 28510.973 (L0805PCT)wherein the one or more chart annotations are determined by at least one of: performing, for each subset of the scan data, a shape analysis to identify a status of the tooth of the patient; performing, for each subset of the scan data, a teeth arrangement analysis to identify a positioning of the tooth of the patient; or performing, for each subset of the scan data, a material classification to identify a composition of the tooth of the patient.

[0147] A one hundred forty-third implementation may further extend any of the one hundred forty-second implementation. In the one hundred forty-third implementation, to identify the subset of the scan data for each tooth of the patient, the processing device is further caused to at least one of: segment the 3D model to generate a series of secondary 3D models, wherein each secondary 3D model in the series of secondary 3D models corresponds to a tooth of the patient; identify a portion of the one or more 2D color intraoral images corresponding to the tooth of the patient; or identify a portion of the one or more NIRI intraoral images corresponding to the tooth of the patient.

[0148] A one hundred forty-fourth implementation may further extend any of the one hundred forty-third implementation. In the one hundred forty-fourth implementation, performing the teeth arrangement analysis comprises: generating, based on the 3D model, a jaw line reference curve for the patient; identifying, based on segmentation data of the secondary 3D model, a location of the tooth; making a comparison of the location of the tooth to the jaw line reference curve; and determining, based on the comparison, the positioning of the tooth, wherein the positioning comprises one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0149] A one hundred forty-fifth implementation may further extend any of the one hundred forty-third through one hundred forty-fourth implementations. In the one hundred forty-fifth implementation, the processing device is further caused to compare a first secondary 3D model corresponding to a first tooth of the patient to a second secondary 3D model corresponding to a second tooth of the patient, wherein the second tooth is symmetrically opposite the first tooth in the jaw of the patient; determine, based on the comparison, an asymmetry metric representing a dissimilarity between the first tooth and the second tooth; and add the asymmetry metric to at least one of the subset of the scan data for the first tooth or the subset of the scan data for the second tooth.

[0150] A one hundred forty-sixth implementation may further extend any of the one hundred fortyfifth implementation. In the one hundred forty-sixth implementation, the processing device is further caused to, responsive to determining that the asymmetry metric satisfies a condition, perform an error recovery operation corresponding to the dissimilarity between the first tooth and the second tooth.

[0151] A one hundred forty-seventh implementation may further extend any ofthe one hundred forty-second through one hundred forty-sixth implementations. In the one hundred forty-seventh implementation, the processing device is further caused to provide, to a user device, the one or moreAttorney Docket No.: 28510.973 (L0805PCT)chart annotations to include in the dental chart of the patient; and provide the one or more chart annotations to a dental practice management system.

[0152] A one hundred forty-eighth implementation may further extend any of the one hundred forty-second through one hundred forty-seventh implementations. In the one hundred forty-eighth implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0153] A one hundred forty-ninth implementation may further extend any of the one hundred forty-second through one hundred forty-eighth implementations. In the one hundred forty-ninth implementation, performing the shape analysis comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model is trained to provide, as output, at least one of a tooth identification, an outlier shape, or one or more indicators of dental accessories; and receiving, as out

[0154] A one hundred fiftieth implementation may further extend any of the one hundred fortyninth implementation. In the one hundred fiftieth implementation, performing the shape analysis further comprises: providing at least one of the tooth identification or the outlier shape to a classifier, wherein the classifier outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, or a partially hatched tooth indicator.

[0155] A one hundred fifty-first implementation may further extend any of the one hundred fortyninth through one hundred fiftieth implementations. In the one hundred fifty-first implementation, the processing device is further caused to provide the one or more indicators of dental accessories as input to a second machine learning model, wherein the second machine learning model outputs one or more additional indicators comprising at least one of a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

[0156] A one hundred fifty-second implementation may further extend any of the one hundred forty-second through one hundred fifty-first implementations. In the one hundred fifty-second implementation, performing the material classification comprises: providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs a classification of at leastone of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, ora bridge.Attorney Docket No.: 28510.973 (L0805PCT)

[0157] A one hundred fifty-third implementation may further extend any of the one hundred fifty-second implementation. In the one hundred fifty-third implementation, performing the material classification further comprises: segmenting the classification of the at least one of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge from the corresponding tooth, wherein the segmentation provides at least one of a location or a size corresponding to the classification of the at least one of the partial restoration, the veneer, the inlay, the onlay, the overlay, the filling, the full restoration crown, or the bridge.

[0158] A one hundred fifty-fourth implementation may further extend any of the one hundred forty-second through one hundred fifty-third implementations. In the one hundred fifty-fourth implementation, the processing device is further caused to provide the one or more chart annotations to a diagnostic system, wherein an outcome of the diagnostic system comprises the one or more chart annotations.

[0159] A one hundred fifty-fifth implementation may further extend any of the one hundred forty-second through one hundred fifty-fourth implementations. In the one hundred fifty-fifth implementation, the processing device is further caused to identify, for the tooth of the patient, a caries indication identified by a caries diagnostic system; and responsive to determining that the one or more chart annotations for the tooth of the patient satisfies a caries condition, provide an updated caries identification to the caries diagnostic system.

[0160] A one hundred fifty-sixth implementation may further extend any of the one hundred forty-second through one hundred fifty-fifth implementations. In the one hundred fifty-sixth implementation, the processing device is further caused to, responsive to identifying, based on the one or more chart annotations, that the tooth is a restoration, provide an indication of the restoration to a timelapse diagnostic system.

[0161] A one hundred fifty-seventh implementation may further extend any of the one hundred forty-second through one hundred fifty-sixth implementations. In the one hundred fifty-seventh implementation, the processing device is further caused to, responsive to identifying, based on the one or more chart annotations, that the patient is in active orthodontic treatment, provide an indication of the active orthodontic treatment to a timelapse diagnostic system.

[0162] A one hundred fifty-eighth implementation may further extend any of the one hundred forty-second through one hundred fifty-seventh implementations. In the one hundred fifty-eighth implementation, the processing device is further caused to, responsive to identifying, based on the one or more chart annotations, that the tooth is an implant, provide an indication of the implant to a tooth strength assessment system.

[0163] A one hundred fifty-ninth implementation may further extend any of the one hundred forty-second through one hundred fifty-eighth implementations. In the one hundred fifty-ninth implementation,Attorney Docket No.: 28510.973 (L0805PCT)the processing device is further caused to determine an orthodontic treatment plan for the patient, wherein the orthodontic treatment plan comprises a first location of a dental attachment for the tooth of the patient; identify, based on the one or more chart annotations, a second location of the dental attachment for the tooth of the patient; and responsive to determining that the first location and the second location differ, provide, to a user device, an indication of a displacement of the dental attachment.

[0164] A one hundred sixtieth implementation may further extend any of the one hundred forty-second through one hundred fifty-ninth implementations. In the one hundred sixtieth implementation, the processing device is further caused to validate a first set of the one or more chart annotations corresponding to a first scan of the patient taken at a first point in time by comparing the first set of the one or more chart annotations to a second set of chart annotations corresponding to a second scan of the patient taken at a second point in time, wherein the second point in time predates the first point in time.

[0165] A one hundred sixty-first implementation may further extend any of the one hundred forty-second through one hundred sixtieth implementations. In the one hundred sixty-first implementation, the processing device is further caused to receive second scan data comprising one or more geometrical connections between the 3D model and the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to segmenting the 3D model, project segmentation results onto the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the shape analysis, map the status of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; responsive to performing the teeth arrangement analysis, map the positioning of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; and responsive to performing the material classification, map the composition of the tooth the 3D model.

[0166] A one hundred sixty-second implementation may further extend any of the one hundred sixty-first implementation. In the one hundred sixty-second implementation, to determine the one or more chart annotations for the dental chart of the patient, the processing device is further caused to provide at least one of a secondary 3D model corresponding to the tooth of the patient, the one or more two-dimensional (2D) color intraoral images, or the one or more near-infrared imaging (NIRI) intraoral images as input to a machine learning model, wherein the machine learning model outputs one or more chart annotation indicators, wherein the one or more chart annotation indicators correspond to at least one of a status indicator, a positioning indicator, or a composition indicator.Attorney Docket No.: 28510.973 (L0805PCT)

[0167] A one hundred sixty-third implementation may further extend any of the one hundred sixty-second through one hundred sixty-second implementations. In the one hundred sixty-third implementation, the status indicator represents at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, ora braces indicator.

[0168] A one hundred sixty-fourth implementation may further extend any of the one hundred sixty-second through one hundred sixty-third implementations. In the one hundred sixty-fourth implementation, the positioning indicator reflects one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

[0169] A one hundred sixty-fifth implementation may further extend any of the one hundred sixty-second through one hundred sixty-fourth implementations. In the one hundred sixty-fifth implementation, the composition indicator reflects at least one of a partial restoration, a veneer, an inlay, an onlay, an overlay, a filling, a full restoration crown, ora bridge.BRIEF DESCRIPTION OF THE DRAWINGS

[0170] Aspects and embodiments of the present disclosure will be understood more fully from the detailed description given below and from the accompanying drawings of various aspects and embodiments of the disclosure, which, however, should not be taken to limit the disclosure to the specific aspects or embodiments, but are for explanation and understanding only.

[0171] FIG.1 illustrates a workflow for detecting, predicting, diagnosing, and reporting on oral conditions and / or oral health problems, in accordance with embodiments of the present disclosure.

[0172] FIG.2 illustrates an architecture comprising a set of systems for detecting, predicting, diagnosing, reporting on and treating oral conditions and / or oral health problems, in accordance with embodiments of the present disclosure.

[0173] FIG.3 shows a block diagram of an example system for generating and / or displaying a dynamic tooth chart, in accordance with some embodiments of the present disclosure.

[0174] FIG.4 illustrates a flow diagram of an example method for generating and / or displaying a dynamic tooth chart, in accordance with some embodiments of the present disclosure.

[0175] FIG.5 illustrates a flow diagram of an example method for generating a tooth portion of a dynamic tooth chart, in accordance with some embodiments of the present disclosure.

[0176] FIG.6 illustrates an example visualization of a dynamic tooth chart, in accordance with some embodiments of the present disclosure.

[0177] FIGs.7A-B illustrates an example visualization of a dynamic tooth chart, in accordance with some embodiments of the present disclosure.Attorney Docket No.: 28510.973 (L0805PCT)

[0178] FIGs.8A-C illustrate examples of visualizations of a dynamic tooth chart using various imaging modalities, in accordance with some embodiments of the present disclosure.

[0179] FIG.9 illustrates an example III displaying the visualization of the patients dental arches in multiple imaging modalities simultaneously, in accordance with some embodiments of the present disclosure.

[0180] FIG. 10 illustrates an example III portion displaying one or more visualizations of the patients dental arches in multiple imaging modalities displayed in conjunction with two photographs of the patient, in accordance with some embodiments of the present disclosure.

[0181] FIG. 11 illustrates an example visualization of a dental chart in which periodontal data is projected onto an imaging modality, in accordance with embodiments of the present disclosure.

[0182] FIG. 12 illustrates a flow diagram of an example data flow for an automated dental charting system, in accordance with some embodiments of the present disclosure.

[0183] FIG. 13 illustrates a flow diagram of an example method for automatically generating tooth annotations for a dental chart, in accordance with some embodiments of the present disclosure.

[0184] FIG. 14 illustrates an example of automatically generated chart annotations displayed in an example dental chart, in accordance with some embodiments of the present disclosure.

[0185] FIG. 15 illustrates an example 2D color image and NIRI image depicting a healthy tooth, in accordance with some embodiments of the present disclosure.

[0186] FIG. 16 illustrates an example 2D color image and NIRI image depicting a crown on a tooth, in accordance with some embodiments of the present disclosure.

[0187] FIG. 17 illustrates an example 2D color image and NIRI image depicting a metal filling on a tooth, in accordance with some embodiments of the present disclosure.

[0188] FIG. 18 illustrates an example 2D color image and NIRI image depicting a composite filling on a tooth, in accordance with some embodiments of the present disclosure.

[0189] FIG. 19 illustrates an example 2D color image and NIRI image depicting a composite buccal filling on a tooth, in accordance with some embodiments of the present disclosure.

[0190] FIG.20 illustrates an example 2D color image and NIRI image depicting the presence of an aligner attachment on a tooth, in accordance with some embodiments of the present disclosure.

[0191] FIG.21 illustrates a block diagram of an example computing device, in accordance with some embodiments of the present disclosure.DETAILED DESCRIPTION

[0192] Described herein are embodiments for generating and displaying a dynamic tooth chart which can include automatically generated tooth annotations. The current standard in dentistry is to useAttorney Docket No.: 28510.973 (L0805PCT)a generic tooth chart to record and view dental and periodontal findings for a patient. However, there is little consistency in the visualization and arrangement of the teeth within the chart. For example, clinical findings can be indicated in the tooth chart using a variety of shapes and symbols, but there is no universal method for charting the different findings. Additionally, the shapes and symbols do not accurately reflect the actual condition of the patients teeth. Examples of clinical findings can include existing conditions / restorations, planned treatment, watch, abnormalities, periodontal, pathology / disease, lab / medication prescriptions, medical history, notes, and so on. This lack of consistency results in the need fora legend to enable doctors, specialist, and / or third-party payors to use the tooth chart to relay patient information in an efficient and effective manner.

[0193] In dental practice, creating and maintaining accurate dental charts for each patient can be a time-consuming and error-prone process that typically relies on manual examination and documentation by a dental practitioner. This manual approach can be inefficient, particularly given the complexity of some dental conditions, the variety of restorative materials, and the need to track changes over time. A dental visit can involve a dental practitioner performing an evaluation, taking records (including dental and periodontal charting), making a diagnosis, and / or creating a treatment plan for the required dental work. Doctors and their teams may have different needs for patient data depending on the focus or reason for the visit. For example, one may need to record or see different levels of data for diagnostic purposes versus treatment purposes.

[0194] Some dental practitioners may use a practice management system (PMS) for managing patient records, which can include a digitization of the paper tooth chart. However, PMS platforms and digitized dental charts face numerous challenges that hinder their effectiveness and usability, including, for example, information overload, lack of standardization, and reconciling conflicting data. The amount of data a dental practitioner considers when making a diagnosis is ever increasing, and practitioners are often presented with excessive data that can be difficult to sift through and prioritize. Additionally, interpreting and integrating data from multiple imaging modalities, such as 3D scans, color images, near-infrared images, to provide a comprehensive and reliability assessment of dental status can be challenging. This can slow down the charting process, as well as increase the risk of overlooking critical details essential for patient care. Additionally, the presentation of the information is often static and is not tailored to the individual patient or doctor’s current needs. These limitations hinder the efficiency, accuracy, and consistency of dental diagnostics and treatment planning.

[0195] Another concern with conventional dental charting systems is the lack of standardization across different systems and practices. Dental practitioners can use a variety of tooth chart formats, symbols, shading, and / or color to represent various clinical findings. The tooth chart’s generalized visualization can result in complex, complicated, and inefficient workflows that make it difficult for aAttorney Docket No.: 28510.973 (L0805PCT)dental practitioner to find, understand, and analyze the available information fora patient. Without a universally accepted format, dental practitioners often encounter inconsistencies in notation and data presentation, making it challenging to interpret charts accurately. This fragmentation comprises the continuity of patient care and can lead to errors in diagnosis or treatment planning.

[0196] Usability is another persistent pain point. Many existing systems are not intuitive, requiring extensive training or cumbersome workarounds to input and retrieve information. This inefficiency can detract the time that practitioners could otherwise spend focusing on patient care. Additionally, these systems often rely on generic templates that fail to capture the nuanced and specific needs of diverse dental cases, further limiting their clinical utility. Another challenge arises when there is conflicting data among various imaging modalities, where a dental practitioner is to prioritize the data and exclude irrelevant information. Inaccurate and / or conflicting data can create confusion and undermine the credibility of dental records.

[0197] Accordingly, aspects and implementations of the present disclosure address the abovenoted and other challenges by providing systems and method for generating and / or displaying a dynamic tooth chart, which can include automatically generated tooth annotations. In some embodiments, an oral health diagnostics system can include a dynamic tooth charting system and an auto charting system, as described throughout. In some embodiments, the dynamic tooth charting system can generate and display visualizations of a dental chart that dynamically change based on context, such as a patients chief complaint, a treatment plan, and / or a scheduled service. The dynamic tooth charting system can serve as a visualization platform that enables viewing of dental records across multiple imaging modalities, normalizes dental records for consistent presentation, and / or provides interactive tools for switching between imaging modalities, adjusting overlay transparency, focusing on particular sections of the dental arch, and comparing historical data with current data. In some embodiments, the auto charting system can automatically generate tooth annotations by analyzing multi-modal intraoral scan data, such as 3D dental models, 2D color images, and NIRI images, e.g., using machine learning models and data processing techniques. The auto charting system can perform shape analysis, teeth arrangement analysis, and / or material classification to detect dental features such as restorations, dental accessories, missing teeth, and / or irregular tooth positioning, in embodiments. The output can include chart annotations identifying tooth status, positioning, and material composition.

[0198] In some embodiments, the auto charting system and the dynamic tooth charting system can be combined to provide an integrated dental charting solution. The auto charting system can process scan data to automatically generate chart annotations, including tooth identifications, restoration classifications, and / or arrangement indicators. The automatically generated annotations canAttorney Docket No.: 28510.973 (L0805PCT)be provided to the dynamic tooth charting system for inclusion in the visualization of the dental chart. The dynamic tooth charting system can display the auto-generated annotations overlaid on the patients imaging data across multiple modalities. A dental practitioner can interact with the combined system to review the automatically generated annotations, make manual adjustments or corrections as needed, and / or switch between imaging modalities to verify findings. The combined system can provide both automated analysis capabilities and flexible visualization tools within a single integrated platform.

[0199] In some embodiments, the dynamic tooth charting system described herein can dynamically change the visualization of a dental chart (sometimes referred to herein as a dynamic tooth chart), e.g., based on a patients chief complai nt(s), a treatment or phased plan, and / or a scheduled service. For example, the dynamic tooth chart can automatically change from a comprehensive view to a more limited, problem-focused view (e.g., based on a use case). Additionally, or alternatively, the tooth chart can be changed between views manually by the user via a control panel. The dynamic tooth chart can expand its functionality as more data is provided (e.g., as more imaging is provided). In some embodiments, the dynamic tooth chart system enables visualization of historical data as compared with current data. In some embodiments, the dynamic tooth chart is not limited to teeth, and can include, for example, gums, bones, periodontal status, etc. For example, the dynamic tooth chart can include a hard tissue chart, a periodontal chart, and / or other charts.

[0200] In some embodiments, the dynamic tooth charting system can serve as a single platform for visualization of any imaging modality and record type for diagnostic record charting, treatment planning (e.g., including gathering and / or recording clinical findings on the actual image modality), patient education, evaluation of remotely monitored data, and / or simulation purposes. In some embodiments, the dynamic tooth charting system can serve as the data source for artificial intelligence (Al) assisted treatment decision support workflows (e.g., periodontal, restorative, and / or orthodontic). The dynamic tooth charting system can be used for all patient types, including primary, mixed (primary and permanent), and all permanent dentitions.

[0201] In some embodiments, the dynamic tooth charting system can provide a visualization of a tooth chart that enables one-to-many imaging modalities, where a mapping from one imaging modality allows an overlay to be projected onto any image type and displayed in the same layout. For example, radiograph data and Al detected clinical findings or treatment recommendations can be projected onto an intraoral scan, near-infrared, CBCT, photograph, video, and / or any other image modality.

[0202] In some embodiments, the dynamic tooth charting system can normalize dental records in terms of brightness, color, and / or orientation, with an option to disable for view of original state. In some embodiments, the dynamic tooth charting system can enable portions of the dental chart in various imaging modalities to automatically adjust to align to predetermined boundary. For example, theAttorney Docket No.: 28510.973 (L0805PCT)dynamic tooth charting system can automatically adjust the three-dimensional modality to match radiographic imaging (e.g., pan-ceph imaging). In some embodiments, the dynamic tooth charting system can enable a portion of the dynamic tooth chart to be swapped from one imaging modality to another (e.g., on demand by a user), while staying within the boundaries of the tooth chart visualization.

[0203] In some embodiments, the tooth chart visualization can include a portion designated as a dynamic record viewer that is context sensitive. In some embodiments, the dynamic record viewer can be configured to display information that is relevant to the current clinical context, such as the patients chief complaint, the type of dental examination being performed, orthe specific area of interest selected by the user (e.g., the dental practitioner). For example, when a dental practitioner selects a particular tooth or region within the chart, the dynamic record viewer can automatically present the corresponding imaging records, such as intraoral photographs, x-rays, and / or 3D scans, that illustrate the condition or finding associated with the selection. The content and / or layout of the dynamic record viewer can adapt in real-time (or near real-time) based on user interactions or predefined clinical workflows so that the dental practitioner is presented with pertinent data, avoiding having to manually search through disparate records.

[0204] In some embodiments, the dynamic tooth charting system can enable a user to correct for distortions, such as patient positioning, tube head angulation associated with an x-ray, jewelry artifacts associated with x-rays, etc. In some embodiments, the dynamic tooth charting system can provide automated and / or user-guided tools for identifying and compensating for such distortions within the displayed dental records. For example, image processing algorithms can detect and adjust for misalignments caused by improper patient positioning or tube head angulation, thereby improving the accuracy and consistency of the visualized data. In some embodiments, the dynamic tooth charting system can identify and mitigate the visual impacts of artifacts introduced by jewelry or other foreign objects, e.g., by filtering out the affected regions, and / or by alerting the user of their presence. By enabling these correction capabilities within the user interface, the dynamic tooth charting system can enable dental practitioners to review and interpret dental records with greater confidence and precision, thus reducing the likelihood of diagnostic errors attributed to image distortions.

[0205] In some embodiments, the dynamic tooth charting system can track information over time, thus enabling a dental practitioner to view the temporal charts in the dynamic tooth chart visualization. Since the dynamic tooth charting system can provide information about the patients oral health over time, disease progression can be easily observed, thus facilitating making a treatment decision. In some embodiments, the dynamic tooth charting system can aggregate and display historical dental records, such as previous scans, x-rays, and / or clinical findings, alongside current data with the same charting interface. A dental practitioner can review changes in dental conditions, monitor diseaseAttorney Docket No.: 28510.973 (L0805PCT)progression, and / or assess the outcomes of prior treatment by navigating through different time points, and / or comparing side-by-side visualizations. In some embodiments, the dynamic tooth charting system can provide tools for highlighting differences and / or trends between time-separate records, which can help facilitate early detection of issues and support more informed clinical decision-making.

[0206] In some embodiments, the dynamic tooth charting system can generate and display a visualization of a tooth chart that displays patient data using images by recreating the most common type of dental chart using the patients imaging. In some embodiments, a scan of maxillary (or upper) teeth and a scan of the mandibular (or lower) teeth can be converted into a linear form to display the buccal and / or lingual surfaces, with occlusal images in between each arch view.

[0207] In some embodiments, the dynamic tooth charting system can generate and display a visualization of a tooth chart that display all image modalities in a single account to mimic and merge multiple patterns currently used in dentistry, such as panoramic x-ray and the tooth chart. For example, the dynamic tooth charting system can display an intraoral scan, a CBCT, or a near-infrared of the upper jaw in a linear appearance and an intraoral scan, a CBCT, or a near-infrared of the lower jaw in a slight U-shaped curve, to resemble a panoramic x-ray. In a portion of the user interface, the dynamic tooth charting system can display an occlusal view of both arches to show all surfaces of the teeth simultaneously in a pattern that is familiar to dental practitioners. In some embodiments, the dynamic tooth charting system can provide controls to enable a user to layer the different types of images, thus enabling the userto view multiple image modalities in one visualization with adjustment tools for transparency, hide / show, and / or a slider to reveal layers not initially displayed. The overall focus of the visualization can be based on a variety of frameworks, such as, evaluation type, treatment type, and / or a patients chief complaint(s).

[0208] In some embodiments, the dynamic tooth charting system can generate and display a visualization in which the teeth are unraveled and positioned in a standard tooth chart grid layout. A user may toggle between the various modalities. Such embodiments can facilitate orthodontic treatment planning (e.g., interproximal reduction (IPR) planning). In traditional orthodontia, a doctor might use a tooth chart as a reference and record of where to perform, and / or the amount performed, of IPR with no regards to the individual’s’ clinical condition (e.g., amount of enamel). This can lead to an underperformance of IPR, leading to unexpressed tooth movements and resulting in additional orthodontic treatment (e.g., additional aligners). The dynamic tooth charting system can provide the user the ability to visualize different layers of the tooth, showing the patient that IPR involves a negligible amount of reduction, and / or track the amount of reduction overtime.

[0209] In some embodiments, the dynamic tooth charting system can enable or facilitate charting. In some embodiments, the dynamic tooth charting system can enable periodontal charting. TheAttorney Docket No.: 28510.973 (L0805PCT)dynamic tooth charting system can project periodontal data, such as periodontal probings, gingival recession, bleeding points, furcation movement, gingival defects, mobility, mucogingival junction, etc., onto any imaging modality. In some embodiments, the dynamic tooth charting system can include indications of occlusion data, such as bruxism, occlusal trauma, excursive movements (canine guidance, lateral an protrusive movements), etc.

[0210] In some embodiments, the dynamic tooth charting system can enable patient education, e.g., by providing treatment plan presentations and obtaining informed consent. For example, the visualizations generated by the dynamic tooth charting system can enable patient education by simplifying complex concepts into easy-to-understand visualizations. In some embodiments, the dynamic tooth charting system can provide phased treatment presentation or report with explanations and interactive educations educational components. In some embodiments, the dynamic tooth charting system can provide a shareable dashboard forthe patient to understand their oral health score and education to change their behavior. In some embodiments, the dashboard can include gamification components to influence behavioral changes. In some embodiments, the dynamic tooth charting system can include simulations, e.g., by projecting clinical findings (e.g., Al-detected clinical findings) in-face photos and / or videos, to help a patient understand their oral health status. In some embodiments, the dynamic tooth charting system can include treatment plans, e.g., to provide third-party payors a summary of clinical findings planned and / or completed treatment for pre-estimates / billi ng, optionally including a list of probabilities of success for each treatment option.

[0211] In some embodiments, the auto charting system described herein can leverage multimodel intraoral scan data (e.g., 3D dental models, color images, NIRI images) to identify, classify, and / or document the condition of each tooth and / or related dental structures. In some embodiments, the auto charting system can integrate data processing techniques, machine learning, and / or cross-validation techniques to detect dental features and restorations, as well as assess teeth arrangement and changes overtime. The resulting tooth annotations can be used to populate a dental chart In some embodiments, the auto charting system can interface with the dynamic tooth charting system, e.g., to populate the visualization of the tooth chart with the automatically generated tooth annotations.

[0212] In some embodiments, the auto charting system can receive (or otherwise identify) scan data, which can include multi-model intraoral scan data, such as a 3D model of a patients dentition, 2D color images, and / or NIRI images. The auto charting system can perform semantic segmentation and / or instance segmentation on the 3D model data to identify and isolate individual teeth and surrounding soft tissues. The segmentation can provide the foundation for subsequent analyses. The auto charting system can then perform multiple analyses on the segmented data (optionally in parallel), including a shape analysis, a material analysis, and / or a teeth arrangement analysis. The shapeAttorney Docket No.: 28510.973 (L0805PCT)analysis can use the segmented 3D model data (and optionally the color and / or NIRI image data) to determine indications of tooth identity, optionally including distinguishing between natural, primary, and / or non-natural structures such as abutments, scan bodies, and dental accessories (e.g., brackets or attachments). The material analysis can utilize the 2D color and / or NIRI images, mapped to the segmented 3D model, to differentiate between natural tooth material and various restorative materials. The results of the material analysis can be the identification of crowns, bridges, veneers, inlays, onlays, overlays, and / or significant fillings. The teeth arrangement analysis can compare the spatial positioning of each tooth relative to a modeled jawline curve. The result of the teeth arrangement analysis can include the detection of missing teeth and / or irregular tooth placements. The results from these analyses can be aggregated to generate annotations for each tooth of a dental chart The annotations can include multiple findings per tooth.

[0213] In some embodiments, the auto charting system can incorporate cross-validation techniques, such as symmetry checks between corresponding teeth on opposite sides of the jaw, and / or comparisons across multiple scans of the same patient For example, if, as a part of a symmetry check, a tooth’s classification or detected condition significantly deviates from its symmetric counterpart, the auto charting system can determine a potential error in segmentation, identification, and / or material analysis. Upon making such a determination, the auto charting system can implement a correction or review of the identified asymmetry. As another example, as part of a multi-scan comparison check, the auto charting system can compare scans of the same patient taken at different times to validate findings, e.g., by checking for consistency in tooth identification and tracking the progression of a condition across visits. The auto charting system can use multi-scan comparisons to confirm genuine tooth changes, e.g., due to restorations or tooth movements, and avoid false findings caused by imaging artifacts or algorithmic misclassifications, for example. Thus, the cross-validation techniques can be used to correct errors and / or validate findings.

[0214] In some embodiments, the final output of the auto charting system can be an automatically populated dental chart that can be reviewed and / or edited by dental practitioners, and / or integrated into dental practice management systems. In some embodiments, the auto charting system can populate a dental chart to include the automatically generated annotations, including tooth identity, whether it is natural or primary, the presence and / or type of restorations such as crowns, bridges, veneers, inlay, and / or fillings, and / or the presence of dental accessories such as attachments or brackets. The annotations can also indicate spatial arrangement, e.g., noting missing teeth or irregular positioning. The dental chart can be designed to be easily reviewed and / or edited by dental practitioners, e.g., by providing a user interface (Ul) that display the dental chart including the annotations. For example, a dental practitioner can interact with the dental chart presented on the Ul by selecting individual teeth orAttorney Docket No.: 28510.973 (L0805PCT)conditions, verifying the tooth classifications), and / or making manual adjustments or additions as needed. As an illustrative example, if the auto charting system misidentified a tooth, missed a restoration, or failed to detect a specific clinical condition, the dental practitioner can directly edit the chart to correct the findings. In some embodiments, the III can enable annotation, deletion, and / or reclassification of findings, as well as the addition of notes or comments for further clinical context. In some embodiments, the dental chart can be integrated into a dental practice management system, and can provide a reliable, up-to-date, and clinically meaningful record that supports diagnostics, treatment planning, and ongoing patient care.

[0215] Embodiments described herein provide for an improved method and apparatus for generating and / or displaying a dynamic tooth chart that is patient-friendly, time-efficient, and capable of providing consistent and accurate indicators of clinical findings, thereby enhancing the overall quality of dental care and patient experience. Embodiments described herein directed to the dynamic tooth charting system provide technical improvements over traditional tooth charting systems that directly impact computer resource consumption and system efficiency. By normalizing and aligning diverse patient records (e.g., including 2D and 3D scans, x-rays, photographs, and / or Al-generated insights) into a standardized, context-sensitive chart format, the dynamic tooth charting system can reduce the need for multiple, redundant data processing pipelines and disparate visualization modules. For example, rather than maintaining separate viewers and data structures for each imaging modality, aspects of the present disclosure utilize a unified data model and normalization process, allowing all records to be displayed and manipulated within a single, familiar user interface. This consolidation can reduce memory usage and computational overhead, as they dynamic tooth charting system can reuse normalized data blocks across different views and clinical contexts without reprocessing the underlying images each time. Furthermore, the prioritization and context-sensitive selection of image modalities enables the most relevant data to be loaded and rendered fora given clinical scenario, minimizing unnecessary data retrieval and graphical processing. The ability to dynamically update the chart as new records are added, rather than reloading or recalculating the entire dataset, further streamlines resource utilization. Collectively, these technical features result in faster response times, lower GPU and / or GPU demands, and more scalable performance, particularly in environments where large volumes of multimodal dental data is accessed and visualized.

[0216] Embodiments described herein directed to the auto charting system provide technical improvements over traditional dental charting and diagnostics methods, such as computational efficiency and resource utilization. By utilizing multi-modal intraoral scan data, the methods and systems described herein enable a more comprehensive and precise analysis of dental structures and conditions than previously possible with manual charting or x-ray based automation. By employing multiAttorney Docket No.: 28510.973 (L0805PCT)-modal approach that integrates 3D models, color images, and NIRI images, the methods and systems described herein enable more targeted and context-aware processing, reducing the need for redundant and exhaustive analysis across all data types. The segmentation and ML models described herein help facilitate the accurate identification and classification of teeth, restorations, and / or dental accessories, while material analysis using NIRI and / or color imaging provides reliable differentiation between natural and artificial materials. Additionally, the use of segmentation and ML models allows for the extraction of relevant features and conditions in a streamlined, parallelized workflow, minimizing unnecessary data handling and computations. The integration of spatial arrangement analysis further enables the detection of missing teeth and / or irregular positioning, enhancing the completeness of dental records. Additionally, cross-validation techniques (e.g., symmetry checks and multi-scan comparisons) improve the robustness and reliability of the results by automatically correcting errors and validating findings. The cross-validation techniques further enhance efficiency by providing automated error correction and validation, reducing the need for repeated manual review or reprocessing. These technical advancements streamline the charting process, reduce clinician workload, minimize the risk of human error, and provide a more actionable data for diagnostics and treatment planning, resulting in faster processing times, lower memory and computational demands, and a scalable solution that can be deployed efficiently in clinical environments with limited hardware resources. Additionally, the automated charting data can be leveraged to refine other dental algorithms, such as caries detection and time-lapse analysis, further elevating the standard of care and efficiency in dental practice.

[0217] FIG.1 illustrates a workflow 125 for detecting, predicting, diagnosing, and reporting on oral conditions (e.g., oral health conditions) by an oral health diagnostics system 118, in accordance with embodiments of the present disclosure. The workflow 125 may be a general digital workflow covering use of radiographs and / or other oral state capture modalities within a digital platform of integrated products / services to provide identifications of oral conditions and / or actionable symptom recommendations and / or diagnoses of oral health problems associated with such oral conditions. The workflow 125 may be used to assist doctors and / or users of an oral health diagnostics system 118 to assess a patients oral health, identify oral conditions, diagnose dental health problems, provide actionable symptom recommendations, provide treatment recommendations, and so on. The workflow 125 may be executed by a digital platform of integrated products that provide dental condition identifications, actionable symptom recommendations and / or diagnoses of oral health problems using analysis of data from one or more oral state capture modalities, including radiographs (e.g., generated by radiography machines).

[0218] A patient may have one or more oral conditions 110. Oral conditions 110 may include or be related to caries, gum recession, gingival swelling, tooth wear, bleeding, malocclusion, tooth crowding,Attorney Docket No.: 28510.973 (L0805PCT)tooth spacing, plaque, tooth stains, and / or tooth cracks, for example. In some embodiments, the oral conditions 110 may include restorative conditions 134, orthodontic conditions 136, systematic conditions 138, oral hygiene conditions 140, salivary conditions 142, and so on. Restorative conditions 134 may include conditions such as caries that are addressable by performing restorative dental treatment. Such restorative dental treatment may include drilling and filling caries, performing root canals, forming preparations of teeth and applying caps or crowns to the preparations, pulling teeth, adding bridges to teeth, and so on. Restorative conditions may also include results of past restorative treatments of the patients oral cavity. Examples of past restorations include fillings, caps, crowns, bridges, and so on. Orthodontic conditions may include conditions treatable via orthodontic treatment. Such orthodontic conditions may include a malocclusion (e.g., tooth crowding, overbite, underbite, posterior crossbite, posterior open bite, tooth gaps, etc.). Orthodontic conditions may be associated with restorative conditions in some instances. For example, tooth crowding may cause caries, which results in restorative treatment. Systematic conditions 138 may include conditions such as periodontitis, periodontal bone loss, gum recession, tooth wear, and so on. Systematic conditions 138 may be associated with restorative conditions 134 and / or orthodontic conditions 136. Oral hygiene conditions 140 may include brushing and flossing related conditions, such as development of calculus on teeth, caries, and so on. Oral hygiene conditions 140 may be related to restorative conditions 134, orthodontic conditions 136 and / or systematic conditions 138 in embodiments. Salivary conditions 142 may include a pH level of a patients mouth that is outside of normal, a low level of saliva, and so on. Salivary conditions 142 may be related to restorative conditions 134, orthodontic conditions 136, systematic conditions 138 and / or oral hygiene conditions 140 in embodiments. For example, the detection and identification of salivary conditions may be used as an input to an ML model that can use such information to assess periodontal disease, acid reflux, vomiting, poor diet, oral cancer, and / or oropharyngeal cancer. For example, biomarkers of saliva may be used to assist in the assessment and / or management of periodontal disease. Tooth erosion, caries and / or saliva biomarkers may be used to identify acid reflux, vomiting and / or poor diet. In some instances, an oral condition of a patient may include a cross-classification. Such oral conditions may belong to multiple different categories of oral conditions 110. For example, caries may be a restorative condition 134, an orthodontic condition 136 and an oral hygiene condition 140.

[0219] A patient may have one or more oral health problems that may be root problems for the oral conditions and / or that may be caused by the oral conditions. In some embodiments, an oral condition also constitutes an oral health problem. Examples of oral health problems include caries, periodontal disease, a tooth root issue, a cracked tooth, a broken tooth, oral cancer, a cause of bad breath, and / or a cause of a malocclusion.Attorney Docket No.: 28510.973 (L0805PCT)

[0220] A dental practice (e.g., a group practice or solo practice) may capture data about a patients oral state using one or more oral state capture modalities 115. A common oral state capture modality used by dental practices are radiographs (i.e., x-rays) 148 generated by radiography machines. There are multiple different types of x-rays that a genal practice may capture of a patients oral cavity, including bite-wing x-rays, panoramic x-rays and periapical x-rays.

[0221] A bite-wing x-ray is a type of dental radiograph used to detect dental caries (cavities) and monitor the health of teeth and supporting bone. During a bite-wing x-ray, the patient bites down on a small tab or wing-shaped device attached to the x-ray film or sensor. This helps keep the film or sensor in place while the x-ray is taken. An x-ray machine (also referred to as a radiography machine) is positioned outside the mouth to capture images of the upper and lower teeth on one side of the mouth at a time. Accordingly, a bite-wing x-ray includes upper and lower teeth of one side of a patients mouth. In embodiments, bite-wing x-rays are useful for detecting cavities between teeth and for assessing the fit of dental fillings and crowns. Bite-wing x-rays may also be used to help in diagnosing gum disease and / or to monitor bone levels around the teeth in embodiments.

[0222] A periapical x-ray, also known as a periapical radiograph, is a type of dental x-ray that focuses on specific areas of the mouth, particularly individual teeth and the surrounding bone. During a periapical x-ray, the dentist or dental radiographer positions an x-ray machine so that it captures detailed images of one or more teeth from crown to root, as well as the surrounding bone structure and supporting tissues. Periapical x-rays may provide a comprehensive view of the entire tooth, including the root tip (apex) and the bone around the tooth's root. In embodiments, periapical x-rays may be used to help diagnose oral health problems such as tooth decay (caries), infections or abscesses at the root of a tooth, bone loss around a tooth due to periodontal (gum) disease, abnormalities in the root structure or surrounding bone, evaluation of dental trauma or injuries, and so on. Periapical x-rays may also be used to assist in assessment of the status of teeth prior to dental procedures such as root canal treatment or extraction.

[0223] A panoramic x-ray, also known as a panoramic radiograph or orthopantomogram (OPG), is a type of dental radiograph that provides a comprehensive view of the entire mouth, including the teeth, jaws, temporomandibular joints (TMJ), and surrounding structures in a single image. During a panoramic x-ray, the patient stands or sits in an upright position while an x-ray machine rotates around their head in a semi-circle. The x-ray machine captures a continuous image as it moves, creating a detailed panoramic view of the entire oral and maxillofacial region. In embodiments, a panoramic x-ray may be used to assist in evaluation of the development and position of teeth, including impacted teeth, assessing the health of the jawbone and surrounding structures, detecting cysts, tumors, or other abnormalities in the jaw or adjacent tissues, planning orthodontic treatment by assessing toothAttorney Docket No.: 28510.973 (L0805PCT)alignment and development, evaluating the placement and condition of dental implants, and / or diagnosing temporomandibular joint (TMJ) disorders or other jaw-related issues.

[0224] Another oral state capture modality that is increasingly common in dental practices are intraoral scans 146, and three-dimensional (3D) models of dental arches (or portions thereof) based on such intraoral scans. Intraoral scans are produced by an intraoral scanning system that generally includes an intraoral scanner and a computing device connected to the intraoral scanner by a wired or wireless connection. The intraoral scanner is a handheld device equipped with one or more small cameras and / or optical sensors. The dentist or dental professional moves the intraoral scanner around the patient's mouth, capturing multiple 3D images or scans of the teeth and surrounding structures from various angles. As the intraoral scanner captures the images or scans, they may be processed and displayed on a computer screen in real-time or near real-time. The collected images or scans are stitched together to create a complete 3D digital model of the patient's teeth and oral cavity. This digital impression can be manipulated, analyzed, and shared electronically with dental laboratories or specialists as needed.

[0225] An intraoral scan application executing on the computing device of an intraoral scanning system may generate a 3D model (e.g., a virtual 3D model) of the upper and / or lower dental arches of the patient from received intraoral scan data (e.g., images / scans). To generate the 3D model(s) ofthe dental arches, the intraoral scan application may register and stitch together the intraoral scans generated from an intraoral scan session. In one embodiment, performing image registration includes capturing 3D data of various points of a surface in multiple intraoral scans, and registering the intraoral scans by computing transformations between the intraoral scans. The intraoral scans may then be integrated into a common reference frame by applying appropriate transformations to points of each registered intraoral scan.

[0226] In one embodiment, registration is performed for each pair of adjacent or overlapping intraoral scans. Registration algorithms may be carried out to register two adjacent intraoral scans for example, which essentially involves determination of the transformations which align one intraoral scan with the other. Registration may involve identifying multiple points in each intraoral scan (e.g., point clouds) of a pair of intraoral scans, surface fitting to the points of each intraoral scans, and using local searches around points to match points of the two adjacent intraoral scans. For example, the intraoral scan application may match points, edges, curvature features, spin-point features, etc. of one intraoral scan with the closest points, edges, curvature features, spin-point features, etc. interpolated on the surface ofthe other intraoral scan, and iteratively minimize the distance between matched points. Registration may be repeated for each adjacent and / or overlapping scans to obtain transformations (e.g., rotations around one to three axes and translations within one to three planes) to a commonAttorney Docket No.: 28510.973 (L0805PCT)reference frame. Using the determined transformations, the intraoral scan application may integrate the multiple intraoral scans into a first 3D model of the lower dental arch and a second 3D model of the upper dental arch.

[0227] The intraoral scan data may further include one or more intraoral scans showing a relationship of the upper dental arch to the lower dental arch. These intraoral scans may be usable to determine a patient bite and / or to determine occlusal contact information for the patient. The patient bite may include determined relationships between teeth in the upper dental arch and teeth in the lower dental arch.

[0228] Oral state capture modalities 115 may additionally or alternatively include one or more types of images 144 (e.g., 2D and / or 3D images) of a patients oral cavity. In addition to generating intraoral scans, intraoral scanning systems may additionally be used to generate color 2D images of a patients oral cavity. These color 2D images may be registered to the intraoral scans generated by the intraoral scanning system, and may be used to add color information to 3D models of a patients dental arches. Intraoral scanning systems may additionally or alternatively generate 2D near infrared (NIR) images, images generated using fluorescent imaging, images generated under particular wavelengths of light, and so on. Such image generation may be interleaved with 3D image or intraoral scan generation by an intraoral scanner.

[0229] Dental practices may additionally include cameras for generating 3D images ofa patients oral cavity and / or cameras for generating 2D images of a patients oral cavity. Additionally, a patient may generate images of their own oral cavity using personal cameras, mobile devices (e.g., tablet computers or mobile phones), and so on. In some instances, patients may generate images of their oral cavity based on the instruction of an application or service such as a virtual dental care application or service. In some cases, images of a patients oral cavity (e.g., those taken by a dental practitioner or by a patient themselves) may be taken while the patient wears a cheek retractor to retract the lips and cheeks of the patient and provide better access for dental imaging (i.e., for intraoral photography).

[0230] Some dental practices also use cone beam computed tomography (CBCT) 150 as an oral state capture modality 115. CBCT is a medical imaging technique that uses a cone-shaped X-ray beam to create detailed 3D images of the dental and maxillofacial structures. CBCT scanners may be specifically designed for imaging the head and neck region, including the teeth, jawbones, facial bones, and surrounding tissues. A CBCT machine emits a cone-shaped X-ray beam that rotates around the patient's head. A detector on the opposite side of the machine captures a sequence of X-ray images from different angles. The x-ray images are processed to reconstruct them into a detailed 3D volumetric dataset. This dataset provides a comprehensive view of the patient's oral anatomy in three dimensions. CBCT scans may facilitate accurate diagnosis of various dental and maxillofacial conditions, includingAttorney Docket No.: 28510.973 (L0805PCT)impacted teeth, dental infections, bone abnormalities, and temporomandibular joint disorders. In embodiments, CBCT imaging may be used for various dental and maxillofacial applications, including implant planning, orthodontic treatment planning, endodontic evaluations, oral surgery, and periodontal assessments.

[0231] In some embodiments, oral state capture modality 115 can include fluorescence imaging. Fluorescence imaging can refer to an optical imaging technique in which a dental tissue or material is illuminated with excitation light to induce emission of fluorescence radiation. The emitted fluorescence is captured by an imaging sensor. For example, for fluorescence imaging, an intraoral scanner may emit light at one or more particular frequencies. The light at the one or more particular frequencies may cause illuminated teeth to fluoresce. Areas of the teeth having caries, calculus, etc. may exhibit a different fluorescence than healthy areas of teeth, for example. The fluorescence of the teeth may have different colors, which may be captured in a color image.

[0232] In some embodiments, oral state capture modality 115 can include optical coherence tomography (OCT). OCT imaging can refer to a non-invasive optical imaging modality that directs low-coherence light toward a dental tissue and detects back-reflected signals to generate depth-resolved images based on optical interference. The resulting image data can represent internal tissue morphology.

[0233] For image-based oral state capture modalities, multiple depictions and views of the oral cavity and internal structures can be captured (e.g., in radiographs, intraoral scans, etc.). Examples of views include occlusal views, buccal views, lingual views, proximal-distal views, panoramic views, periapical views, bitewings views, and so on.

[0234] Oral state capture modalities 115 may additionally or alternatively include sensor data 152 from one or more worn sensors. In some instances, a patient may be prescribed a compliance device (e.g., an electronic compliance indicator), an orthodontic aligner, a palatal expander, a sleep apnea device, a night guard, a retainer, or other dental appliance to be worn by the patient. Any such dental appliance may include one or more integrated sensors, which may include force sensors, pressure sensors, pH sensors, sensors for measuring saliva bacterial content, temperature sensors, contact sensors, bio sensors, and so on. Sensor data from the sensor(s) of a dental appliance worn by a patient may be reported to oral health diagnostics system 118 in embodiments. Additionally, or alternatively, a patient may wear one or more consumer health monitoring tools or fitness tracking devices, such as a watch, ring, etc. that includes sensors for tracking patient activity, heartbeat, blood pressure, electrical heart activity (e.g., generates an electrocardiogram), breathing, sleep patterns, body temperature, and so on. Data collected by such fitness tracking devices may also be reported to the oral health diagnostics system 118 in embodiments.Attorney Docket No.: 28510.973 (L0805PCT)

[0235] Oral state capture modalities 115 may additionally or alternatively include patient input 156. Patient input may include patient complaints of pain, numbness, bleeding, swelling, clicking, etc. in one more regions of their mouth. Patient input may further include input on overall health, such as information on underlying health conditions (e.g., diabetes, high blood pressure, etc.), on patient age, and so on. Such patient input may be captured and input into an oral health diagnostics system 118 in embodiments. For example, a doctor or patient may type up notes or annotations indicating the patient input, which may be ingested by the oral health diagnostics system 118 with other oral state capture modalities 115.

[0236] In some embodiments, an oral health diagnostics system 118 may include one or more system integrations 184 with external systems, which may or may not be dental related. Such system integrations 184 may be for data to be provided to the oral health diagnostics system 118 and / orfor the oral health diagnostics system 118 to provide data to the other system(s).

[0237] Dental practices generally use a dental practice management system (DPMS) 154 for managing the dental practices. A DPMS 154 is a software solution designed to streamline and automate various administrative and clinical tasks within a dental practice. DPMS 154 are tailored for the needs of dental offices and help dentists and their staff manage patient information, appointments, billing, and other aspects of dental practice management efficiently. A DPMS 154 allows a dental practice to maintain comprehensive patient records, including demographic information, medical history, treatment plans, and clinical notes. The DPMS 154 provides a centralized database that enables dental staff to access patient information quickly and efficiently. DPMS 154 generally includes features for scheduling patient appointments, managing appointment calendars, and sending appointment reminders to patients. DPMS 154 provides tools for creating and managing treatment plans for patients, including digital charting of dental procedures, diagnoses, and treatment progress. This helps dentists and hygienists track patient care effectively and ensure continuity of treatment. DPMS 154 may help to automate billing processes, including generating invoices, processing payments, and managing insurance claims. It can also verify patient insurance coverage, estimate treatment costs, and submit claims electronically to insurance providers for faster reimbursement. DPMS 154 may generate financial reports and analytics to help dental practicestrack revenue, expenses, and profitability.

[0238] In embodiments, data from a DPMS 154 is used as one type of oral state capture modality 115. Oral health diagnostics system 118 may interface with a DPMS 154 to retrieve patient records for a patient, including pastoral conditions of the patient, doctor notes, patient information (e.g., name, gender, age, address, etc.), and so on.Attorney Docket No.: 28510.973 (L0805PCT)

[0239] In addition to an ability to ingest data from a DPMS 154, oral health diagnostics system 118 in embodiments may be able to generate reports and / or other outputs that can be ingested by the DPMS 154. Accordingly, once the oral health diagnostics system 118 performs an assessment of a patients oral conditions, oral health problems, treatment recommendations, etc., the oral health diagnostics system 118 may format such data into a format that can be understood by the DPMS 154. The oral health diagnostics system may then automatically add new data entries to the DPMS 154 for a patient based on an analysis of patient data from one or more oral state capture modalities 115.

[0240] The oral health diagnostics system 118 may have a system integration with one or more oral state capture systems (e.g., such as an intraoral scanner or intraoral scanning system) 194, from which intraoral scans 146, images 144, 3D models, and / or data from other oral state capture modalities may be received. Examples of oral state capture systems include an intraoral scanning system, a radiograph system or machine, a CBCT machine, and so on.

[0241] In embodiments, an output of oral health diagnostics system 118 may be provided to a dental computer aided drafting (CAD) system 196, such as Exocad® by Align Technology. The dental CAD system 196 may be used for designing dental restorations such as crowns, bridges, inlays, onlays, veneers, and dental implant restorations. The dental CAD system 196 may provide a comprehensive suite of tools and features that enable dental professionals to create precise and customized dental restorations digitally. The dental CAD system 196 may import digital impressions (e.g., 3D digital models of a patients dental arches) captured using intraoral scanners, and may further import data on a patients oral health from oral health diagnostics system 118. For example, the oral health diagnostics system 118 may export a report on a patients oral health to the dental CAD system 196, which may be used together with a digital impression of the patients dental arches to develop an appropriate restoration for the patient, for implant planning, for planning of surgery for implant placement, and so on.

[0242] In embodiments, oral health diagnostics system 118 may have a system integration 184 with a patient engagement system (e.g., which may include a patient portal and / or patient application) 192. The patient portal may be a portal to an online patient-oriented service. Similarly, the patient application may be an application (e.g., on a patients mobile device, tablet computer, laptop computer, desktop computer, etc.) that interfaces with a patient-oriented service.

[0243] In an example, oral health diagnostics system 118 may integrate with a virtual care system. The virtual care system may provide a suite of digital tools and services designed to enhance patient care and communication between orthodontists / dentists and their patients. The virtual care system may leverage technology to facilitate remote monitoring, consultation, and treatment planning, allowing patients to receive dental care more conveniently and effectively.Attorney Docket No.: 28510.973 (L0805PCT)

[0244] In one embodiment, the patient engagement system 192 is or includes a virtual care system that may provide remote monitoring, teleconsultation, treatment planning, patient education and engagement, data management, and data analytics. With respect to remote monitoring, the virtual care system enables orthodontists and dentists to remotely monitor their patients' treatment progress (e.g., for orthodontic treatment) using advanced digital tools. This may include the use of smartphone apps, patient portals, or other software platforms that allow patients to capture and upload photos or videos of their teeth and orthodontic appliances. Such patient uploaded data may be provided to oral health diagnostics system 118 for automated assessment in embodiments. With regards to patient education and engagement, the virtual care system may provide reports, presentations, etc. generated by oral health diagnostics system 118 to patients (e.g., via a patient portal and / or application). For example, the dental health diagnostics system 118 may automatically generate informational videos, treatment progress trackers, compliance reminders, reports, presentations, and so on that are tailored to a patients oral health, which may be provided to the patient via the patient portal and / or application.

[0245] In embodiments, oral health diagnostics system 118 may have a system integration 184 with one or more treatment planning system 190 and / or treatment management system 191 such as ClinCheck® provided by Align Technology®. For example, oral health diagnostics system 118 may have a system integration with an orthodontic treatment planning system and / or with a restorative dental treatment planning system. A treatment planning system 190 may use digital impressions and / or a report output by oral health diagnostics system 118 to plan an orthodontic treatment and / or a restorative treatment (e.g., to plan an ortho-restorative treatment). The treatment planning system 190 may plan and simulate orthodontic and / or restorative treatments. Treatment management system 191 may then receive data during treatment and determine updates to the treatment based on the treatment plan and the updated data.

[0246] In an example, an orthodontic treatment planning system may use advanced 3D imaging technology to create virtual models of patients' teeth and jaws based on digital impressions or intraoral scans. These digital models may be used to plan and simulate the entire course of orthodontic treatment, including the movement of individual teeth and the progression of treatment overtime. Orthodontists can specify the desired tooth movements, treatment duration, and other parameters, taking into account a report provided by oral health diagnostics system 118, to create personalized treatment plans tailored to each patient's unique anatomy, oral health, and preferences. The orthodontic treatment planning system enables orthodontists to simulate the step-by-step progression of orthodontic treatment virtually, showing patients how their teeth will gradually move and align over the course of treatment. Orthodontists can visualize the planned tooth movements in 3D and make adjustments as needed to optimize treatment outcomes. The orthodontic treatment planning systemAttorney Docket No.: 28510.973 (L0805PCT)may provide orthodontists and patients with visualizations of the predicted treatment outcomes, including before-and-after simulations that demonstrate the expected changes in tooth position and alignment, and how those changes might affect the patients overall oral health as optionally predicted by the oral health diagnostics system 118. These visualizations help patients understand the proposed treatment plan and make informed decisions about their orthodontic care.

[0247] During treatment, updated data may be gathered about a patients dentition, and such data (e.g., in the form of one or more oral state capture modalities 115) may be processed by the oral health diagnostics system 118, optionally in view of an already generated orthodontic treatment plan, to generate an updated report of the patients overall oral health. The updated report may be provided by the oral health diagnostics system 118 to the orthodontic treatment planning system and / or orthodontic treatment management system to enable the orthodontic treatment planning / management system to perform informed modifications to the treatment plan. Thus, integration of the oral health diagnostics system with the orthodontic treatment planning system and / or treatment management system supports an iterative design process, allowing orthodontists to review and refine treatment plans based on patient feedback, clinical considerations, treatment progress, and automated reports output by oral health diagnostics system 118. This enables orthodontists to make adjustments to the treatment plan within the orthodontic treatment planning system and / or treatment management system and generate updated simulations to assess the impact of these changes on the final treatment outcome.

[0248] Accordingly, oral health diagnostics system 118 may perform treatment planning and / or management on its own and / or based on integration with one or more treatment planning systems for planning and / or managing orthodontic treatment, restorative treatment, and / or ortho-restorative treatment. An output of such planning may be an orthodontic treatment plan, a restorative treatment plan, and / or an ortho-restorative treatment plan. A doctor may provide one or more modifications to the generated treatment plan, and the treatment plan may be updated based on the doctor modifications.

[0249] In addition to those systems mentioned herein that oral health diagnostics system 118 may integrate with, oral health diagnostics system 118 may integrate with any system, application, etc. related to dentistry and / or orthodontics.

[0250] Oral health diagnostics system 118 may execute a workflow 125 that includes processing and analysis of data 160 from one or more oral state capture modalities 115. The workflow 125 may be roughly divided into activities 120 associated with an initial analysis 122 of a patients oral health and operations associated with a clinical analysis 124 of the patients oral health in some embodiments. One of more of the operations of the workflow may be performed by and / or assisted by application of artificial intelligence and / or machine learning models in embodiments. Multiple embodiments are discussed with reference to machine learning models herein. It should be understood that suchAttorney Docket No.: 28510.973 (L0805PCT)embodiments may also implement other artificial intelligence systems or models, such as large language models in addition to or instead of traditional machine learning models such as artificial neural networks.

[0251] The workflow may include performing oral condition detection at block 162. To perform oral condition detection, a segmentation pipeline may process the data 160 to segment the data into one or more teeth and into one or more oral conditions that may be associated with the one or more of the teeth. The segmentation pipeline may include multiple different trained machine learning models and additional logic that operate on the data and / or on outputs of other trained machine learning models and / or logic to identify specific teeth and apply tooth numbering to the teeth, identify oral conditions, associate the oral conditions to specific teeth, determine locations on the teeth at which the oral conditions are identified, and so on. The output of block 162 may include masks indicating pixels of input image data (e.g., radiographs, 3D models, 2D images, etc.) associated with particular dental conditions, indications of which teeth have detected oral conditions, masks indicating, for each tooth in the input data, which pixels represent that tooth, and so on. The output of block 162 may be inputinto one or more of block 164, block 165 and / or block 166 in embodiments.

[0252] At block 164, trends analysis may be performed based on the output of block 162 and on prior oral conditions of the patient detected at one or more previous times. T rends analysis may include comparing oral conditions at one or more previous times to current oral conditions of the patient. Based on the comparison, an amount ofchange of one or more of the oral conditions may be determined, a rate ofchange of the one or more oral conditions may be determined, and so on. Trends analysis may be performed using traditional image processing and image comparison. Additionally, or alternatively, trends analysis may be performed by inputting current and pastoral conditions and / or data from one or more oral state capture modalities into one or more trained machine learning models. An output of block 164 may be provided to block 165 and / or block 166 in embodiments.

[0253] At block 165, predictive analysis may be performed on the output of block 162, on the output of block 164 and / or on prior oral conditions of the patient detected atone or more previous times. Predictive analysis may include predicting future oral conditions of the patient based on input data. Predictive analysis may be performed with or without an input of prior oral conditions. If prior oral conditions are used in addition to current oral conditions to predict future conditions, then the accuracy of the prediction may be increased in embodiments. In some embodiments, predictive analysis is performed by projecting identified trends determined from the trends analysis into the future. In some embodiments, predictive analysis is performed by inputting the current and / or past oral conditions into one or more trained machine learning models that output predictions of future dental conditions.Predictive analysis may be performed using traditional image processing and image comparison.Attorney Docket No.: 28510.973 (L0805PCT)Additionally, or alternatively, predictive analysis may be performed by inputting current and / or past oral conditions, trends and / or data from one or more oral state capture modalities into one or more trained machine learning models. In embodiments, the predictive analysis generates synthetic image data, which may include panoramic views, periapical views, bitewing views, buccal views, lingual views, occlusal views, and so on of the predicted future oral conditions. Generated synthetic image data may be in the form of synthetic radiographs, synthetic color images, synthetic 3D models, and so on. An output of block 165 may be provided to block 166 in embodiments.

[0254] At block 166, automated diagnostics of a patients oral health may be performed based on data 160 and / or based on outputs of block 162, block 164 and / or block 165 in embodiments. In embodiments, one or more trained machine learning (ML) models and / or artificial intelligence (Al) models may process input data to perform the diagnostics. An output of the ML models and / or Al models may include actionable symptom recommendations usable to diagnose oral health problems and / or actual diagnoses of oral health problems associate with the detected oral conditions.

[0255] At block 168, based on the data 160, oral conditions identified at block 162, output of trends analysis performed at block 164, output of predictive analysis performed at block 165 and / or output of diagnostics performed at block 166, processing logic may generate one or more treatment recommendations for a patient. The treatment recommendations may include multiple different treatment options, with different probabilities of success associated with the different treatment options.

[0256] At block 170, processing logic may generate one or more treatment simulations based on one or more of the treatment recommendations. The treatment simulations may include an alternative predictive analysis that shows predicted states of oral conditions and / or oral health problems of the patient after treatment is performed, or after one or more stages of treatment are performed. Treatment simulations may include generated synthetic image data, which may be in the form of synthetic radiographs, synthetic color images, synthetic 3D models, and so on. The synthetic image data may show what a patients oral cavity would look like after treatment and / or after one or more intermediate and / or final stages of a multi-stage treatment (e.g., such as orthodontic treatment or ortho-restorative treatment).

[0257] Post treatment simulations may be compared to predicted simulations of the predicted states of the oral conditions absent treatment (e.g., as determined at block 165) in embodiments.

[0258] In embodiments, a report may be generated including the data 160 and / or outputs of one or more of blocks 162, 164, 165, 166, 168 and / or 170. The report may include labeled images, a dental chart, notes, annotations, and / or other information. The report may include a dynamic presentation (e.g., a video) that shows progression of dental conditions overtime in some embodiments. The reportAttorney Docket No.: 28510.973 (L0805PCT)may be stored in a data store and / or exported to one or more other systems (e.g., DPMS 154, treatment planning system 190, patient engagement system 192, dental CAD system 196).

[0259] The oral health diagnostics system 128 may perform multiple dental practice actions 128 and / or patient actions 130 in addition to, or instead of, storing a generated report and / or exporting the report to other systems. Examples of dental practice actions 128 that may be performed include data mining 172, patient management 174 and / or insurance adjudication 176. Examples of patient actions 128 that may be performed include treatments 178, patient visits 180 and / or virtual care 182. One or more of the actions may be performed based on leveraging external systems in embodiments. For example, virtual care 182 may be performed based on leveraging a patient portal and / or application of a virtual dental care system. Patient visits 180 may be performed based on leveraging a DPMS 154. Treatments 178 may be performed based on leveraging a treatment planning system 190 for planning, tracking and / or managementof a treatment. Patient management 174 and / or insurance adjudication 176 may be performed based on leverage of a DPMS 154.

[0260] Data mining 172 may include analysis of patient data of a dental practice in embodiments. Data mining may be performed for a single dental practice or for multiple different dental practices. Data mining may be performed to determine strengths and weaknesses of a dental practice relative to other dental practices and / or to determine strengths and weaknesses of individual doctors relative to other doctors within a dental practice and / or outside of a dental practice (e.g., in a geographic region). As a result of data mining 172, a report may de generated indicating things for a doctor to focus on, types of procedures that a doctor should perform more, oral state capture modalities that a doctor should use more frequently, and so on.

[0261] Patient management 174 for a dental practice may include a range of tasks and processes aimed at providing quality care and ensuring positive experiences for patients throughout their interactions with the dental practice. Patient management may include appointment scheduling, patient registration and check-in, medical and dental history and records management (e.g., including information about past treatments, allergies, medications, and relevant medical conditions for each patient), treatment planning and coordination, financial management and billing (e.g., including collecting payments, processing insurance claims, providing cost estimates, and discussing payment options or financing arrangements with patients), patient communication and education (e.g., providing information about treatments, procedures, and oral hygiene instructions, as well as addressing patient concerns, answering questions, and maintaining open lines of communication throughout the treatment process), follow-up and recall, and patient satisfaction and feedback management.

[0262] Insurance adjudication 176 for a dental practice refers to the process of evaluating and determining the coverage and reimbursement for dental services provided to patients by their dentalAttorney Docket No.: 28510.973 (L0805PCT)insurance carriers. Insurance adjudication 176 involves submitting claims to insurance companies, reviewing the claims for accuracy and completeness, and processing them according to the terms of the patient's insurance policy. After providing dental services (e.g., treatment) to a patient, the dental practice submits a claim to the patient's insurance company electronically or via paper. The claim includes information such as the patient's demographic details, treatment provided, diagnosis codes, procedure codes (CPT or ADA codes), and any other relevant documentation. In embodiments, such documentation is automatically prepared by oral health diagnostics system 118. Upon receiving an insurance claim, the insurance company reviews the claim to determine coverage eligibility and benefits according to the terms of the patient's insurance policy. The insurance company evaluates the claim and calculates the amount of coverage and reimbursement based on the patient's benefits plan, contractual agreements with the dental office, and applicable fee schedules. The adjudication process may involve verifying the accuracy of the submitted information, applying deductibles, copayments, and coinsurance, and determining the allowed amount for each covered service. In embodiments, oral health diagnostics system 118 may automatically generate responses to inquiries from insurance companies about already submitted claims. After adjudicating a claim, the insurance company sends an Explanation of Benefits (EOB) to the dental office and the patient. The EOB outlines the details of the claim, including the services rendered, the amount covered by insurance, any patient responsibility (such as copayments or deductibles), and the reason for any denials or adjustments. If the claim is approved, the insurance company issues payment to the dental office for the covered services. The dental office then reconciles the payment received with the treatment provided and updates the patient's financial records accordingly. If there are any discrepancies or denials, the dental office may need to follow up with the insurance company to resolve issues or appeal denied claims. In embodiments, oral health diagnostics system 118 automatically handles such follow-ups. After insurance adjudication, the dental office bills the patient for any remaining balance or patient responsibility not covered by insurance, such as deductibles, copayments, or non-covered services. The patient is responsible for paying these amounts according to the terms of their insurance policy and the dental office's financial policies.

[0263] In some embodiments, the workflow 125 can be implemented with just a few clicks of a web portal or dental practice application to enable doctors to purchase and activate one or more oral health diagnostics services. When patient records (e.g., data from one or more oral state capture modalities 115, such as intraoral scans 146, virtual care images 144, digital x-rays 148, etc.) are collected as a routine part of a dental appointment, these records may be uploaded to a digital platform of the oral health diagnostics system 118. The oral health diagnostics system 118 may start an analysis for the different oral (e.g., clinical) conditions that have been activated for the patient by the doctor, andAttorney Docket No.: 28510.973 (L0805PCT)may generate a report on the different identified oral conditions. In seconds the doctor may receive a report that has visual indications with colored clues of assessments for a number of possible dental conditions, dental health problems, and so on. As an example, the oral health diagnostics system 118 can send this data to the treatment planning system 190 or treatment management system 191 to process.

[0264] In some embodiments, the treatment planning system 190 can integrate this information with an orthodontic treatment plan. The doctor can share the analysis visually chairside with the patient and provide treatment recommendations based on the diagnosis. This can occur on the treatment planning and / or management system 190, 191 or on an application on an intraoral scanning system or x-ray system, for example. The doctor can also share the analysis with the patient and send visual assessments via patient engagement system 192. Integrated education modules may provide interactive context sensitive education tools designed to help the doctor diagnose and help convert the patient to the treatment in embodiments.

[0265] Some of the analyses that are performed to assess the patients dental health are oral health condition progression analyses that compare oral conditions of the patient at multiple different points in time. For example, one carries assessment analysis may include comparing caries at a first point in time and a second point in time to determine a change in severity of the caries between the two points in time, if any. Other time-based comparative analyses that may be performed include a timebased comparison of gum recession, a time-based comparison of tooth wear, a time-based comparison of tooth movement, a time-based comparison of tooth staining, and so on. In some embodiments, processing logic automatically selects data collected at different points in time to perform such timebased analyses. Alternatively, a user may manually select data from one or more points in time to use for performing such time-based analyses.

[0266] In one embodiment, the different types of oral conditions for which analyses are performed and that are included in the detected oral conditions include tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, calculus, bone loss, bridges, fillings, implants, crowns, impacted teeth, root-canal fillings, and caries. Additional, fewer and / or alternative oral conditions may also be analyzed and reported. In embodiments, multiple different types of analyses are performed to determine presence, location and / or severity of one or more of the oral conditions. One type of analysis that may be performed is a point-intime analysis that identifies the presence and / or severity levels of one or more oral conditions at a particular point-in-time based on data generated at that point-in-time (e.g., at block 162). For example, a single x-ray image of a dental arch may be analyzed to determine whether, at a particular point-intime, a patients dental arch included any caries, gum recession, tooth wear, problem occlusionAttorney Docket No.: 28510.973 (L0805PCT)contacts, crowding, spacing or tooth gaps, plaque, tooth stains, and / or tooth cracks. Another type of analysis that may be performed is a time-based analysis that compares oral conditions at two or more points in time to determine changes in the oral conditions, progression of the oral conditions and / or rates of change of the oral conditions (e.g., at block 164). For example, in embodiments a comparative analysis is performed to determine differences between x-rays taken at different points in time. The differences may be measured to determine an amount of change, and the amount of change together with the times at which the intraoral scans that were used to generate the x-rays were taken may be used to determine a rate of change. This technique may be used, for example, to identify an amount of change and / or a rate of change for tooth wear, staining, plaque, crowding, spacing, gum recession, caries development, tooth cracks, and so on.

[0267] In embodiments, one or more trained models are used to perform at least some of the one or more oral condition analyses. The trained models may include physics models and / or machine learning models, for example. In one embodiment, a single model may be used to perform multiple different analyses (e.g., to identify any combination of tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, and / or caries). Additionally, or alternatively, different models may be used to identify different oral conditions. For example, a first model may be used to identify tooth cracks, a second model may be used to identify tooth wear, a third model may be used to identify gum recession, a fourth model may be used to identify problem occlusal contacts, a fifth model may be used to identify crowding and / or spacing of teeth and / or other malocclusions, a sixth model may be used to identify plaque, a sixth model may be used to identify tooth stains, and / or a seventh model may be used to identify caries.

[0268] In one embodiment, at block 162 intraoral data from one or more points in time are input into one or more trained machine learning models that have been trained to receive the intraoral data as an input and to output classifications of one or more types of oral conditions. In one embodiment, the trained machine learning model(s) is trained to identify areas of interest (AO Is) from the input intraoral data and to classify the AOIs based on oral conditions. The AOIs may be or include regions associated with particular oral conditions. The regions may include nearby or adjacent pixels or points that satisfy some criteria, for example. The intraoral data that is input into the one or more trained machine learning model may include three-dimensional (3D) data and / or two-dimensional (2D) data. The intraoral data may include, for example, one or more 3D models of a dental arch, one or more projections of one or more 3D models ofa dental arch onto one or more planes (optionally comprising height maps), one or more x-rays of teeth, one or more CBCT scans, a panoramic x-ray, near-infrared and / or infrared imaging data, color image(s), ultraviolet imaging data, intraoral scans, one or more bitewing x-rays, one or more periapical x-rays, and so on. If data from multiple imaging modalities are used (e.g., panoramicAttorney Docket No.: 28510.973 (L0805PCT)x-rays, bitewing x-rays, periapical x-rays, CBCT scans, 3D scan data, color images, and NIRI imaging data), then the data may be registered and / or stitched together so that the data is in a common reference frame and objects in the data are correctly positioned and oriented relative to objects in other data. One or more feature vectors may be input into the trained model, where the feature vectors include multiple channels of information for each point or pixel of an image. The multiple channels of information may include color channel information from a color image, depth channel information from intraoral scan data, a 3D model or a projected 3D model, intensity channel information from an x-ray image, and so on.

[0269] The trained machine learning model(s) may output a probability map, where each point in the probability map corresponds to a point in the intraoral data (e.g., a pixel in an intraoral image or pointon a 3D surface) and indicates probabilities that the point represents one or more dental classes. In one embodiment, a single model outputs probabilities associated with multiple different types of dental classes, which includes one or more oral health condition classes. In an example, a trained machine learning model may output a probability map with probability values for a teeth dental class and a gums dental class. The probability map may further include probability values for tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, healthy area (e.g., healthy tooth and / or healthy gum) and / or caries. In the case of a single machine learning model that can identify each of tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, and caries, eleven valued labels may be generated for each pixel, one for each of teeth, gums, healthy area, tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, and caries. The corresponding predictions have a probability nature: for each pixel there are multiple numbers that may sum up to 1.0 and can be interpreted as probabilities of the pixel to correspond to these classes. In one embodiment, the first two values for teeth and gums sum up to 1.0 and the remaining values for healthy area, tooth cracks, gum recession, tooth wear, occlusal contacts, crowding and / or spacing of teeth and / or other malocclusions, plaque, tooth stains, and / or caries sum up to 1.0.

[0270] In some instances, multiple machine learning models are used, where each machine learning model identifies a subset of the possible oral conditions. For example, a first trained machine learning model may be trained to output a probability map with three values, one each for healthy teeth, gums, and caries. Alternatively, the first trained machine learning model may be trained to output a probability map with two values, one each for healthy teeth and caries. A second trained machine learning model may be trained to output a probability map with three values (one each for healthy teeth, gums and tooth cracks) or two values (one each for healthy teeth and tooth cracks). One or moreAttorney Docket No.: 28510.973 (L0805PCT)additional trained machine learning models may each be trained to output probability maps associated with identifying specific types of oral conditions.

[0271] In embodiments, image processing and / or 3D data processing may be performed on radiographs and / or other dental data. Such image processing and / or 3D data processing may be performed using one or more algorithms, which may be generic to multiple types of oral conditions or may be specific to particular oral conditions. For example, a trained model may identify regions on a dental radiograph that include caries, and image processing may be performed to assess the size and / or severity of the identified caries. The image processing may include performing automated measurements such as size measurements, distance measurements, amount of change measurements, rate of change measurements, ratios, percentages, and so on. Accordingly, the image processing and / or 3D data processing may be performed to determine severity levels of oral conditions identified by the trained model(s). Alternatively, the trained models may be trained both to classify regions as caries and to identify a severity and / or size of the caries.

[0272] The one or more trained machine learning models that are used to identify, classify and / or determine a severity level for oral conditions may be neural networks such as deep neural networks or convolutional neural networks. Such machine learning models may be trained using supervised training in embodiments.

[0273] A dentist, after a quick glance at the dental diagnostics summary, may determine that a patient has carries, clinically significant tooth wear, and crowding / spacing and / or other malocclusions and / or oral conditions.

[0274] In embodiments, the oral health diagnostics system, and in particular the dental diagnostics summary, helps a doctor to quickly detect oral conditions (e.g., oral health conditions) and / or oral health problems and their respective severity levels, helps the doctor to make better judgments about treatment of oral conditions and / or oral health problems, and further helps the doctor in communicating with a patient that patients oral conditions and / or oral health problems and possible treatments. This makes the process of identifying, diagnosing, and treating oral conditions and / or oral health problems easier and more efficient. The doctor may select any of the oral conditions and / or oral health problems to determine prognosis of that condition as it exists in the present and how it will likely progress into the future. Additionally, the oral health diagnostics system may provide treatment simulations of how the oral conditions and / or oral health problemswill be affected or eliminated by one or more treatments.

[0275] In embodiments, a doctor may customize the oral conditions, oral health problems and / or areas of interest by adding emphasis or notes to specific oral conditions, oral health problems and / or areas of interest. For example, a patient may complain of a particular tooth aching. The doctor may highlightthat particular tooth on the radiograph. Oral conditions that are found that are associated withAttorney Docket No.: 28510.973 (L0805PCT)the particular highlighted or selected tooth may then be shown in the dental diagnostics summary. In a further example, a doctor may select a particular tooth (e.g., lower left molar), and the dental diagnostics summary may be updated by modifying the severity results to be specific for that selected tooth. For example, if for the selected tooth an issue was found for caries and a possible issue was found for tooth stains, then the dental diagnostics summary would be updated to show no issues found for tooth wear, occlusion, crowding / spacing, plaque, tooth cracks, and gum recession, to show a potential issue found for tooth stains and to show an issue found for caries. This may help a doctor to quickly identify possible root causes for the pain that the patient complained of for the specific tooth that was selected. The doctor may then select a different tooth to get a summary of dental issues for that other tooth.

[0276] FIG.2 illustrates an architecture comprising a set of systems for detecting, predicting, diagnosing, reporting on and treating oral conditions and / or oral health problems, in accordance with embodiments of the present disclosure. The systems in one embodiment include a patient engagement system 205, one or more oral state capture systems 210, a treatment planning and / or management system 220, a treatment management system 221 , a dental CAD system 222, a DPMS 235, an appliance fabrication system 225, and / or an oral health diagnostics system 215.

[0277] In embodiments, oral health diagnostics system 215 corresponds to oral health diagnostics system 118 of FIG. 1.

[0278] Furthermore, in embodiments patient engagement system 205 corresponds to corresponds to patient engagement system 192.

[0279] In further embodiments, treatment planning system 220 may correspond to treatment planning system 190 and / or treatment management system 221 may correspond to treatment management system 191 of FIG. 1. The treatment planning and / or management systems 220, 221 may provide treatment plans, treatment recommendations, orthodontic / restorative integration capabilities, and / or other capabilities. These systems may, in some implementations, take in representations of dentition, identify (through human activities and / or automation) orthodontic / restorative treatments to dentition, provide staging / intermediate positioning / fi nal positioning capabilities of orthodontic / restorative treatments, receive and / or process modifications to the treatment plan, provide updated treatments, support appliance design, etc. In some implementations, the treatment planning systems implement an end-to-end digital treatment planning workflow.

[0280] T reatment planning system 220 may provide controls for modifying and / or moving oral structures, teeth, etc. In some embodiments, treatment planning system 220 Includes hard limits on some movements, oral structure positions, etc., and may determine when and / or where certain types of interactions are permitted. This may include comparison of an instructed movement / position of one orAttorney Docket No.: 28510.973 (L0805PCT)more oral structures against entries in hard limit databases that store information about movements that are and / or not feasible.

[0281] The treatment management system 221 and / or oral health diagnostics system 215 may provide interactive tools to allow users to plan / manage treatments, examine the state of a person’s dentition, evaluate data from x-rays and various oral state capture modalities, and so on. The treatment management system 221 and / or oral health diagnostics system 215 can provide users with an immersive experience where they can evaluate and / or annotate a person’s dentition, plan / implement possible treatments for the person’s dentition, review / approve / implementactions / recommendations, etc. In some implementations, the treatment management system 221 and / or oral health diagnostics system 215 implements one or more standalone tools related to interaction with a segmented radiographic representation of the oral cavity. The oral health diagnostics system 215 may communicate to the treatment planning system 220 and / or treatment management system 221 for ortho-restorative capabilities through APIs or other architecture.

[0282] In some implementations, the oral health diagnostics system 215 is combined with orthorestorative capabilities (e.g., e.g., treatment planning and / or treatment management functionalities). In such implementations, a user might be presented with ortho-restorative capabilities on one or more 3D models of a dental arch (e.g., generated from an intraoral scan scan) of the oral cavity. The 3D model (s) may show teeth represented from an intraoral scan, and may show teeth and other oral structures and / or conditions as determined from a segmented radiographic representation of the oral cavity. In these examples, aspects of the segmented radiographic representation of the oral cavity and the depiction of the oral cavity from the intraoral scan may be overlaid, blended, reconciled, etc. so that a single model would be shown. Staging capabilities for different stages of a treatment plan may be shown. Various annotation tools may be available to interact with the depiction of the oral cavity.

[0283] In further embodiments, oral state capture system(s) 210 may correspond to one or more oral state capture systems 194 of FIG. 1.

[0284] In further embodiments, dental CAD system 222 may correspond to dental CAD system 154 of FIG. 1.

[0285] In further embodiments, DPMS 235 may correspond to DPMS 154 of FIG. 1.

[0286] The appliance fabrication system 225 may include one or more systems that allow appliance design and / or fabrication in embodiments. Appliance fabrication system 225 may include systems for manufacturing dental appliances and / or orthodontic appliances for patients, for example. Such dental and / or orthodontic appliances may include orthodontic aligners (e.g., clear polymeric aligners), palatal expanders, sleep apnea devices, retainers, mouth guards, night guards, and so on. In some embodiments, treatment planning and / or management system 220 generates digital models forAttorney Docket No.: 28510.973 (L0805PCT)one or more molds and / or dental appliances. The digital models for dental appliances may be used to directly print dental appliances using additive manufacturing such as 3D printings. Digital models for molds may be used to print molds associated with dental appliances. Polymeric sheets may then be thermoformed over the printed molds and trimmed to form the dental appliances in embodiments. Appliance fabrication system 225 may include 3D printers, thermoforming machines, automation machines for part movement and handling, quality control stations, and so on.

[0287] Some or all of the indicated systems may be connected via a network 250, which may include one or more public networks (e.g., the Internet) and / or private networks (e.g., intranets).Systems may exchange information such are reports, 3D model files, standard tessellation language interface (STI) files for use in 3D printing, and so on.

[0288] FIG.3 illustrates an oral health diagnostics system 215, in accordance with some embodiments of the present disclosure. Oral health diagnostics system 215 may execute on one or more computing devices 305 that may be coupled to one or more computing devices 360, one or more oral state capture system(s) 210, and / or a data store 308 directly and / or indirectly via network 250 The network 350 may be a local area network (LAN), a public wide area network (WAN) (e.g., the Internet), a private WAN (e.g., an intranet), or a combination thereof. In some embodiments, oral state capture system(s) 310 connect to computing device(s) 305 directly via a wired or wireless connection.

[0289] Computing devices 305 and / or 360 may each include a processing device, memory, secondary storage, one or more input devices (e.g., such as a keyboard, mouse, tablet, and so on), one or more output devices (e.g., a display, a printer, etc.), and / or other hardware components. Computing device 305 and / or computing device(s) 360 may be connected to a data store 308 either directly or via a network (e.g., network 250). Computing device(s) 305 and / or computing device(s) 360 may include one or more physical machines and / or one or more virtual machines hosted by one or more physical machines. The physical machine(s) may be a rackmount server, a desktop computer, or other computing device. In one embodiment, computing device(s) 305 and / or computing device(s) 360 can include a virtual machine managed and provided by a cloud provider system. Each virtual machine offered by a cloud service provider may be hosted on a physical machine configured as part of a cloud. Such physical machines are often located in a data center. The cloud provider system and cloud may be provided as an infrastructure as a service (laaS) layer. One example of such a cloud is Amazon’s® Elastic Compute Cloud (EC2®). In one embodiment, oral health diagnostics system 215 is provided as software as a service (SaaS), which dental practices may subscribe to. In one embodiment, oral health diagnostics system 215 is an application that runs on a computing device (e.g., computing device 305) of a dental practice.Attorney Docket No.: 28510.973 (L0805PCT)

[0290] Data store 308 may be an internal data store, or an external data store that is connected to computing device 305 directly or via a network. Examples of network data stores include a storage area network (SAN), a network attached storage (NAS), and a storage service provided by a cloud computing service provider. Data store 308 may include a file system, a database, or other data storage arrangement.

[0291] In some embodiments, data store 308 can include a dental chart data store 344. In some embodiments, the TMD diagnostics data store 344 can include scan data 351 (e.g., CBCT scan data, intraoral scan data), segmentation data 353, registration data 354, clinical findings data 355, patient data 356, tooth portion data 357, material data 358, arrangement data 352, and / or shape data 359. In some embodiments, scan data 351, segmentation data 353, registration data 354, clinical findings data 355, patient data 356, tooth portion data 357, material data 358, arrangement data 352, and / or shape data 359 can reference a patient identifier.

[0292] In some embodiments, patient data 356 can include information identifying individual patients, including for example a patient identification number by which other data is referenced. In some embodiments, patient data 356 can store one or more generated dynamic charts, e.g., as generated by dynamic chart generator 325.

[0293] In some embodiments, scan data 351 can include image data corresponding to one or more scans (e.g., intraoral scan(s), CBCT scan(s), etc.), corresponding to one or more x-rays (e.g., panoramic x-rays), corresponding to one or more photographs (e.g., generated by a camera and / or a smart phone), corresponding to one or more sensors (e.g., generated by a compliance indicator), and / or other types of image data of a patients dental arch(es), mouth, and / or face. In some embodiments, scan data 351 can include data generated by the oral state capture system 210. In some embodiments, scan data 351 can be used to generate a virtual model (e.g., a virtual 2D model or a virtual 3D model) of a patients dental arch(es). Each virtual model can reflect the condition of the dental arch at a particular point in time. Each virtual model can include a 3D surface and appearance properties mapped to each point of the 3D surface (e.g., mapped to points on the 3D surface as textures).

[0294] In some embodiments, segmentation data 353 can include the segmented image data, e.g., as generated by input preprocessing engine 312, a segmented 3D model, and / or segmented intraoral scans. Segmentation may be performed using one or more trained Al models (e.g., such as neural networks), which may perform instance segmentation and / or semantic segmentation in embodiments. In some embodiments, registration data 354 can include registration data generated by input preprocessing engine 310. In some embodiments, registration data 354 can store one or more transformation matrix that indicates the rotations, translations, and / or deformations that will cause oneAttorney Docket No.: 28510.973 (L0805PCT)image / 3D model (e.g., generated from a first scanning session) to corresponding to another image / 3D model (e.g., generated from a second scanning session).

[0295] In some embodiments, clinical findings data 355 can include information indicating clinical findings for each tooth portion, e.g., as determined by a trained Al model as further described herein. In some embodiments, tooth portion data 357 can include can store data that correspond to tooth portions, e.g., as generated by tooth portion generation engine 320.

[0296] In some embodiments, material data 358 can store data artifacts, e.g., generated by the material analysis engine 326, that characterize the material composition and / or restorative status of each tooth or tooth portion of a patient. In some embodiments, the material data 358 can include segmentation masks that delineate regions of natural tooth structure, restorative materials, and / or dental accessories, e.g., as determined through the analysis of geometrically mapped 2D color and / or NIRI images. For each tooth or tooth portion, the shape analysis engine 326 can generate and store classification labels indicating the presence and / or type of restorations (e.g., composite fillings, metal or ceramic crowns, bridges, veneers, inlays, onlays, overlays, etc.) as well as the spatial context and / or boundaries of these materials within the tooth anatomy. In some embodiments, the shape analysis engine 326 can also generate and store, as part of material data 358, quantitative metrics, such as surface area and / or volumetric estimates of restorative regions. In some embodiments, the shape analysis engine 326 can generate and store, as part of material data 358, confidence scores and / or anomaly flags associated with each classification.

[0297] In some embodiments, arrangement data 352 can store data artifacts, e.g., generated by the teeth arrangement analysis engine 327, that quantitatively describe the positional relationships and / or orientations of each segmented tooth or tooth portion within the dental arch. In some embodiments, the arrangement data 352 can include vector measurements of relative translation, rotation, and / or orientation for each tooth or tooth portion with respect to the jawline reference curve. In some embodiments, the arrangement data 352 can include inter-tooth spacing metrics, e.g., derives from Euclidean distances between adjacent tooth centroids or contact points. In some embodiments, the teeth arrangement analysis engine 327 can determine angular parameters, such as inclination and / or rotation angles, by comparing each tooth’s principal axis to the tangent or normal vector of the jawline curve at the corresponding anatomical location. The angular parameters can be supplemented with alignment labels and / or anomaly flags that identify clinically relevant conditions, such as missing teeth, crowding, diastema, and / or irregular positioning. In some embodiments, the arrangement data 352 can include quantitative arrangement metrics, such as continuity, local curvature, and / or spatial outlier detection. In some embodiments, arrangement data 352 can store the jawline reference curve data, including, e.g., data that defines that geometric and / or anatomical characteristics of the dentalAttorney Docket No.: 28510.973 (L0805PCT)arch baseline. This can include a mathematical representation of the curve itself, such as the coefficients or control points of a piecewise polynomial, spline, or other parametric model used to fit the spatial coordinates of the segmented teeth. This can also include the 3D coordinates of key anatomical landmarks and the sequence of points sampled along the curve, which can serve as reference positions for projecting individual teeth. Associated metadata, such sa the method of curve fitting, smoothing parameters, and / or any outlier exclusion criteria applied during generation, can also be stored. The stored data may also include tangent and / or normal vectors at each sampled point along the curve to enable the computation of relative translation, rotation, and / or orientation of teeth with respect to the jawline.

[0298] In some embodiments, shape data 359 can data artifacts, e.g., generated by the teeth shape analysis engine 328, that characterize the geometric properties and / or structural identity of one or more segmented teeth and / or dental accessories within the 3D model of a patients dentition. In some embodiments, the shape data 359 can include shape descriptions, such as curvature maps, surface area measurements, volumetric estimates, and / or principal axis vectors, e.g., derived from the processed 3D point cloud or mesh data. In some embodiments, the shape analysis engine 328 can, for each tooth or tooth portion, generate classification labels indicating tooth type (e.g., incisor, canine, premolar, molar), primary versus permanent status, and / or the presence of non-natural or anomalous shapes associated with restorations, abutments, scan bodies, preps, and / or partially erupted teeth, for example. These classification labels can be stored in shape data 359. In some embodiments, the shape analysis engine 328 can generate segmentation masks and / or geometric feature embeddings for dental accessories, including brackets, attachments, retainers, and / or wires, based on their spatial patterns, for example. The segmentation masks and / or geometric feature embeddings can be stored in shape data 359. In some embodiments, shape data 359 can include quantitative anomaly flags and / or confidence scores for each classification and / or segmentation output

[0299] In some embodiments, oral state capture system(s) 210 can include an intraoral scanner, a CBCT scanner (and / or another imaging device, such as a CT scanner), an electronic compliance indicator (ECI) device, a camera, a video camera, and / or optionally a computing device. In some embodiments, the computing device can be part of a scanner in the oral state capture system 210. In some embodiments, the computing device can be part of computing device 360, 305, and / or a separate device (not shown), and the oral state capture system 210 can send captured data (e.g., scan data, image data, video data) for processing on a separate device, in some embodiments, the oral state capture system 310 can include a patient or client device that can take 2D or 3D images and / or videos of the patients anatomy in a non-clinical setting (e.g., at a patients home). The oral state capture system 210 can obtain scan data (e.g., stored as scan data 351).Attorney Docket No.: 28510.973 (L0805PCT)

[0300] A CBCT machine is a type of x-ray machine that uses a cone-shaped x-ray beam to capture data about the patients anatomy. The CBCT scan can generate multiple (e.g., 150-200) images form a variety of angles. In some embodiments, the data captured can be used to reconstruct a 3D image of the patients teeth, mouth, jaw, neck, ear, nose and / or throat.

[0301] In some embodiments, oral state capture system 210 includes an intraoral scanning system comprising a scanner for obtaining intraoral scans (e.g., 3D data) of a patients dentition and optionally a computing device. Alternatively, oral state capture system 210 may include an intraoral scanner, and the computing device may connect to the intraoral scanner to effectuate intraoral scanning. In embodiments, the computing device or another computing device of oral state capture system 210 includes an intraoral scan application that processes intraoral scans generated by the intraoral scanner to generate 3D models of the patients upper and / or lower dental arches.

[0302] In some embodiments, the intraoral scanner may include a probe (e.g., a hand held probe) for optically capturing three-dimensional structures. The intraoral scanner may be used to perform an intraoral scan of a patients oral cavity. An intraoral scan application running on a computing device may communicate with the scanner to effectuate the intraoral scan. A result of the intraoral scan may be scan data 351 that may include one or more sets of intraoral scans, which may include intraoral images. Each intraoral scan may include a two-dimensional (2D) or 3D image that may include depth information (e.g., a height map) of a portion of a dental site. In embodiments, intraoral scans include x, y and z information. In one embodiment, the intraoral scanner generates numerous discrete (i.e., individual) intraoral scans.

[0303] In some embodiments, the oral state capture system 210 can include an ECI device. In some embodiments, the ECI device can be used to accurately monitor of a patients compliance to a prescribed aligner schedule. For instance, an aligner that is ECl-capable can have one or more sensors designed to detect temperature and / or proximity to a patients tooth. The sensors can pair to a mobile phone, e.g., via a Bluetooth®-enabled “smart” aligner case, and can receive and / or transmit data between the mobile phone and the ECI. In some embodiments, the ECI device can include a pressure sensorthat can measure pressure and can convert the measured physical pressure exerted on it into an electrical signal. The pressure sensor on the occlusal surface of the teeth can detect the occlusal force or biting pressure, which can be used to detect bruxism (grinding and / or clenching of the teeth).The pressure sensor can include a sensing element that directly responds to pressure, a transducer that converts the physical change in the sensing element into an electrical signal, a signal conditioning component that can amplify, filter, and / or convert the signal into a digital signal, and / or an output component that can transmit the conditioned signal to a processing device. For example, the pressure sensor can be used to measure and analyze the forces exerted during various dentalAttorney Docket No.: 28510.973 (L0805PCT)procedures and treatments, such as occlusal analysis, implantology, orthodontics, prosthodontics, and / or periodontology. In some embodiments, the pressure sensor can measure electrical activity recorded during execution of a sequence of actions (e.g., bruxism-related events such as teeth clenching and teeth grinding, etc., and / or bruxism-unrelated events such as swallowing, lightly nodding the head, lightly shaking the head, speaking, etc.). In some embodiments, the pressure sensor can record a time-averaged value during execution of a particular sequence of actions. The pressure sensor can detect, record, and / or transmit signals to the computing device. The pressure data (e.g., the detected signals) can indicate clenching or grinding of a patient. In some embodiments, the pressure sensor can be attached to a processing device in oral state capture system 210, or can be otherwise connected to a processing device in oral state capture system 210.

[0304] In some embodiments, oral state capture system 210 is connected to data store(s) 308 either directly or via network 250. In some embodiments, oral state captures system 210 transmits image data (e.g., CBCT scan data, intraoral scan data, images) and / or video recording data to data store 308 for storage therein.

[0305] According to an example, a user (e.g., a dental practitioner) may subject a patient to intraoral scanning. In doing so, the user may apply an intraoral scanner to one or more patient intraoral locations. The scanning may be divided into one or more segments (also referred to as roles). As an example, the segments may include a lower dental arch of the patient, an upper dental arch of the patient, one or more preparation teeth of the patient (e.g., teeth of the patient to which a dental device such as a crown or other dental prosthetic will be applied), one or more teeth which are contacts of preparation teeth (e.g., teeth not themselves subject to a dental device but which are located next to one or more such teeth or which interface with one or more such teeth upon mouth closure), and / or patient bite (e.g., scanning performed with closure of the patients mouth with the scan being directed towards an interface area of the patients upper and lower teeth). Via such scanner application, the intraoral scanner may provide scan data 351 to computing device 305 (orto another computing device of oral state capture system 210). The scan data 351 may be provided in the form of intraoral scan data sets, each of which may include 2D intraoral images (e.g., color 2D images) and / or 3D intraoral scans of particular teeth and / or regions of an intraoral site. In one embodiment, separate intraoral scan data sets are created for the maxillary arch, for the mandibular arch, for a patient bite, and / or for each preparation tooth. Alternatively, a single large intraoral scan data set is generated (e.g., for a mandibular and / or maxillary arch). Intraoral scans may be provided from the intraoral scanner to the computing device 305 (or other computing device) in the form of one or more points (e.g., one or more pixels and / or groups of pixels). For instance, the intraoral scanner may provide an intraoral scan as one or more 3D point clouds. The intraoral scans may each comprise height information.Attorney Docket No.: 28510.973 (L0805PCT)

[0306] The manner in which the oral cavity of a patient is to be scanned may depend on the procedure to be applied thereto. For example, if an upper or lower denture is to be created, then a full scan of the mandibular or maxillary edentulous arches may be performed. In contrast, if a bridge is to be created, then just a portion of a total arch may be scanned which includes an edentulous region, the neighboring preparation teeth (e.g., abutment teeth) and the opposing arch and dentition. Alternatively, full scans of upper and / or lower dental arches may be performed if a bridge is to be created.

[0307] By way of non-limiting example, dental procedures may be broadly divided into prosthodontic (restorative) and orthodontic procedures, and then further subdivided into specific forms of these procedures. Additionally, dental procedures may include identification and treatment of gum disease, sleep apnea, and intraoral conditions such as malocclusions, temporomandibularjoint disorder (TMD), gingival recession, tooth grinding, and so on. The term prosthodontic procedure refers, inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of a dental prosthesis ata dental site within the oral cavity (intraoral site), or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such a prosthesis. A prosthesis may include any restoration such as crowns, veneers, inlays, onlays, implants and bridges, for example, and any other artificial partial or complete denture. The term orthodontic procedure refers, inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of orthodontic elements at an intraoral site within the oral cavity, or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such orthodontic elements. These elements may be appliances including but not limited to brackets and wires, retainers, clear aligners, or functional appliances.

[0308] In embodiments, intraoral scanning may be performed on a patients oral cavity during a visitation of a dental office. The intraoral scanning may be performed, for example, as part of a semiannual or annual dental health checkup. The intraoral scanning may also be performed before, during and / or after one or more dental treatments, such as orthodontic treatment and / or prosthodontic treatment. The intraoral scanning may be a full or partial scan of the upper and / or lower dental arches, and may be performed in order to gather information for performing dental diagnostics, to generate a treatment plan, to determine progress of a treatment plan, and / or for other purposes. The scan data 351 generated from the intraoral scanning may include 3D scan data, 2D color images, NIR (near infrared) and / or infrared images, and / or ultraviolet images, of all or a portion of the upper jaw and / or lower jaw. The scan data 351 may further include one or more intraoral scans showing a relationship of the upper dental arch to the lower dental arch. These intraoral scans may be usable to determine a patient bite and / or to determine occlusal contact information for the patient. The patient bite mayAttorney Docket No.: 28510.973 (L0805PCT)include determined relationships between teeth in the upper dental arch and teeth in the lower dental arch.

[0309] Intraoral scanners may work by moving the intraoral scanner inside a patients mouth to capture all viewpoints of one or more tooth. During scanning, the intraoral scanner is calculating distances to solid surfaces in some embodiments. Each intraoral scan is overlapped algorithmically, or ‘stitched’, with the previous set of scans to generate a growing 3D surface. As such, each scan is associated with a rotation in space, or a projection, to how it fits into the 3D surface.

[0310] During intraoral scanning, an intraoral scan application (e.g., executing on computing device 305 or a computing device of oral state capture system 210) may register and stitch together two or more intraoral scans generated thus far from the intraoral scan sessions. In one embodiment, performing registration includes capturing 3D data of various points of a surface in multiple scans, and registering the scans by computing transformations between the scans. One or more 3D surfaces may be generated based on the registered and stitched together intraoral scans during the intraoral scanning. The one or more 3D surfaces may be output to a displayso that a doctor or technician can view their scan progress thus far. As each new intraoral scan is captured and registered to previous intraoral scans and / or a 3D surface, the one or more 3D surfaces may be updated, and the updated 3D surface(s) may be output to the display. In embodiments, separate 3D surfaces are generated for the upper jaw and the lower jaw. This process may be performed in real time or near-real time to provide an updated view of the captured 3D surfaces during the intraoral scanning process.

[0311] When a scan session or a portion of a scan session associated with a particular scanning role (e.g., upper jaw role, lower jaw role, bite role, etc.) is complete (e.g., all scans for an intraoral site or dental site have been captured), the intraoral scan application may automatically generate a virtual 3D model of one or more scanned dental sites (e.g., of an upper jaw and a lower jaw). The final 3D model(s) may each be a set of 3D points and their connections with each other (i.e., a mesh). To generate a virtual 3D model, the intraoral scan application may register and stitch together the intraoral scans generated from the intraoral scan session that are associated with a particular scanning role. The registration performed at this stage may be more accurate than the registration performed during the capturing of the intraoral scans, and may take more time to complete than the registration performed during the capturing of the intraoral scans. In one embodiment, performing scan registration includes capturing 3D data of various points of a surface in multiple scans, and registering the scans by computing transformations between the scans. The 3D data may be projected into a 3D space of a 3D model to form a portion of the 3D model. The intraoral scans may be integrated into a common reference frame by applying appropriate transformations to points of each registered scan and projecting each scan into the 3D space.Attorney Docket No.: 28510.973 (L0805PCT)

[0312] In one embodiment, registration is performed for adjacent or overlapping intraoral scans (e.g., each successive frame of an intraoral video). Registration algorithms are carried out to register two adjacent or overlapping intraoral scans (e.g., two adjacent blended intraoral scans) and / or to register an intraoral scan with a 3D model, which essentially involves determination of the transformations which align one scan with the other scan and / or with the 3D model. Registration may involve identifying multiple points in each scan (e.g., point clouds) of a scan pair (or of a scan and the 3D model), surface fitting to the points, and using local searches around points to match points of the two scans (or of the scan and the 3D model). For example, the intraoral scan application may match points of one scan with the closest points interpolated on the surface of another scan, and iteratively minimize the distance between matched points. Other registration techniques may also be used.Registration data can be stored in data store 108 as a portion of scan data 351, in embodiments.

[0313] The intraoral scan application may repeat registration for all intraoral scans of a sequence of intraoral scans to obtain transformations for each intraoral scan, to register each intraoral scan with previous intraoral scan(s) and / or with a common reference frame (e.g., with the 3D model). The intraoral scan application may integrate intraoral scans into a single virtual 3D model (or two virtual 3D models, one for each dental arch) by applying the appropriate determined transformations to each of the intraoral scans. Each transformation may include rotations about one to three axes and translations within one to three planes.

[0314] The generated virtual 3D model can include color information. In some embodiments, the oral state data 351 can include color information, e.g., from 2D color images captured during the scanning process. The oral state capture system 210 can use the color information to add color texture to the 3D model(s). Once virtual 3D model(s) of the patients dental arches are generated, they may be stored in data store 308 as a portion of scan data 351 in embodiments.

[0315] In some embodiments, computing device 305 is a desktop computer, a laptop computer, a server computer, etc., located at a doctor’s office. In some embodiments, computing device 305 is a server computing device (e.g., of a data center) that may be accessed from client devices (e.g., client devices of doctors, patients, etc.). In some embodiments, computing device 305 is a virtual machine. For example, computing device 305 may be a virtual machine that runs in a cloud computing environment.

[0316] In some embodiments, oral health diagnostics system 215 includes an input preprocessing engine 310, a segmentation engine 312, an oral health diagnostics engine 321 , a treatment recommendation engine 325, an accuracy evaluation engine 336, a visualization engine 330, a report generation engine 333, a user interface 332, a tooth portion generation engine 320, a dynamic chart system 315, and / or an auto charting system 316. Each of the engines and / or systems may include logicAttorney Docket No.: 28510.973 (L0805PCT)for performing one or more operations or sets of operations associated with different capabilities of the oral health diagnostics system. The division of the oral health diagnostics system 215 into various engines is provided for ease of explanation, and does not necessarily represent an actual arrangement or structure of software. For example, the operations and / or functionality described with reference to particular engines may instead be performed by other engines or modules in embodiments, and the functionality of different engines may be combined and / or divided into still further engines in embodiments. In embodiments, one or more of the engines may function as independent threads, and / or separate processes of one or more engines may function as independent threads.

[0317] Input preprocessing engine 310 can receive and process data from one or more oral state capture modalities. Processing of such data may include performing pre-processing of such data prior to providing the data to segmentation engine 312. In some embodiments, input processing engine 310 processes the input image data to determine whether it satisfies one or more image quality criteria. For example, input processing engine 310 may process the image data to determine whether a blurriness of a received image is below a blurriness threshold, whether the image data is of a proper size for processing by the segmentation engine, and so on. If the data is too small, then input processing engine 310 may add dummy pixels to the image to cause it to comply with size criteria. Similarly, if the image is too large, input processing engine may crop the image so that it satisfies size criteria. Input processing engine 310 may additionally perform one or more other alterations to input image data to place the image data into a state for improved processing by segmentation engine 312.

[0318] In some embodiments, input preprocessing engine 310 can be a software program hosted by a device (e.g., computing device 305) to process scan data 351. Input preprocessing engine 310 can perform one or more operations on scan data 351 to prepare the scan data 351 for the dynamic tooth chart and / or the automatically generated chart. Input preprocessing engine 310 can perform operations such as filtering, stabilizing, cropping, image enhancement (e.g., to sharpen an image), segmentation, and / or other operations. In some embodiments, if scan data 351 does not include a 3D model of a dental arch (e.g., includes 2D images or intraoral scans but no 3D models of dental arches), input preprocessing engine 310 can process the 2D image and / or intraoral scans to generate one or more 3D models. In some embodiments, 3D models can be generated from 2D images. In some embodiments, input preprocessing engine 310 can project 3D scan data 351 into 2D, e.g., using a mesh projection algorithm.

[0319] In some embodiments, segmentation engine 312 can be a software program hosted by a device (e.g., computing device 305) to segment the 2D scan data using 2D segmentations techniques. The resulting segmentation can then be back-projected onto the 2D model or intraoral scan, and / or stored in segmentation data 353.Attorney Docket No.: 28510.973 (L0805PCT)

[0320] In some embodiments, segmentation engine 312 can segment scan data 351 into sections of the patients dental arch. A section can include one or more teeth of the patient, in embodiments. In some embodiments, segmentation engine 312 can receive or otherwise identify a dataset of scan data 351 that corresponds to scan data of a patients dental arch in a particular imaging modality.Segmentation engine 312 can segment the dataset into multiple sections. In some embodiments, each section corresponds to an individual tooth, or an individual section of the dental arch corresponding to an individual tooth (e.g., if a tooth is missing, segmentation engine 312 can generate segmentation data corresponding to the area of the dental arch corresponding to the missing tooth). Segmentation data can be stored in segmentation data 353.

[0321] In some embodiments, segmentation engine 312 can include or implement a trained machine learning model that has been trained to perform semantic segmentation and / or instance segmentation of oral structures (e.g., to determine sizes, shapes, locations, tooth numbers, etc. of individual teeth, gingiva, etc.). Applicant hereby incorporates by reference the following application as if set forth fully here, as an example of a machine learning dental segmentation system and method, and training of such a machine learning segmentation system: U.S. Pat. Pub. No. 20210196434A1 , published on July 1 , 2021 , issued on February 20, 2024, U.S. Pat. No. 11 ,903,793 B2.

[0322] In some embodiments, segmentation engine 312 can store segmentation information for scan data 351 as segmentation data 353. In some embodiments, segmentation engine 312 can be or include, for example, a trained machine learning model such as a convolutional neural network (CNN) trained to classify pixels or regions of input images into different classes. This can include performing point-level classification (e.g., pixel-level classification or voxel-level classification) of different types of features and / or objects of subjects of images. The different features and / or objects may include, for example, individual teeth, regions of the dental arch corresponding to individual teeth, gingiva, etc. The trained machine learning model of segmentation engine 312 may output one or more masks, each of which may have a same resolution as an input image. The mask or masks may include a different identifier for each identified feature or object, and may assign the identifiers on a pixel-level or patchlevel basis. In one embodiment, different masks are generated for one or more different classes of features and / or objects and / or for each instance of a feature and / or object. In one embodiment, a single mask or map includes segmentation information for all identified classes of features and / or objects. Some types of features are location-specific features and are represented in one or more masks. In some embodiments, segmentation engine 312 can perform one or more processing and / or computer vision techniques or operations to extract segmentation information from images (e.g., scan data 351). Such image processing and / or computer vision techniques may or may not include the use of trainedAttorney Docket No.: 28510.973 (L0805PCT)machine learning models. Accordingly, in some embodiments, segmentation engine 312 does not include a machine learning module.

[0323] Oral health diagnostics engines 321 may process outputs of the segmentation engine 312 and / or data from one or more oral state capture modalities to generate actionable symptom recommendations and / or diagnoses of oral health problems associated with identified oral conditions. In some embodiments, oral health diagnostics engines 321 include one or more trained machine learning models trained to receive inputs of identified oral conditions and / or data from one or more oral state capture modalities, and to output actionable symptom recommendations and / or diagnoses of oral health problems. In some embodiments, oral health diagnostics engines 321 include one or more decision trees and / or random forest models. Oral health diagnostics engines 312 may or may not include Al models and / or ML models. Oral health diagnostics engines 321 may receive oral condition information for multiple oral conditions, and based on the combined oral condition information may determine underlying oral health problems that may be root causes of the oral conditions or otherwise associated with the oral conditions. For example, oral health diagnostics engine(s) 321 may identify oral cancer, periodontitis, gum disease, caries, an infection around a root canal of a tooth, and / or other oral health problems.

[0324] Different oral conditions may correlate with and / or cause different oral health problems. Accordingly, information on the types of oral conditions, severity of oral conditions, etc. may be used determine actionable symptom recommendations and / or to diagnose oral health problems.

[0325] Additionally, different oral conditions and / or oral health problems may correlate with different overall health problems. Accordingly, if certain oral conditions and / or oral health problems are detected, then this may be evidence that a patient might be suffering from one or more general health conditions. For example, periodontitis has been shown to correlate with diabetes, cardiovascular disease, dementia, psoriasis, lung cancer and chronic obstructive pulmonary disease (COPD). In another example, tooth loss has been found to correlate with cardiovascular disease, COPD, and dementia. Additionally, caries has been found to correlate with diabetes and cardiovascular disease. Accordingly, detections of periodontitis, tooth loss and caries may be indicative of diabetes and / or cardiovascular disease. Similarly, detections of periodontitis and tooth loss may be indicative of COPD and dementia. If periodontitis, tooth loss and / or caries of a threshold level of severity are determined for a patient, then processing logic may output a recommendation that the patient be referred for testing to assess whether the patient has one or more of diabetes, cardiovascular disease, COPD, dementia, psoriasis and / or lung cancer in embodiments.

[0326] In an example, intraoral scans of a patients oral cavity may be received from an intraoral scanner and one or more radiographs of the patients oral cavity may be received from an x-ray system.Attorney Docket No.: 28510.973 (L0805PCT)One or more oral structure determination engines 315, oral condition detection engines 320 and / or oral condition mediation engines 322 configured to operate on intraoral scan data and / or 3D models generated from intraoral scan data may process the intraoral scans and / or a 3D model generated from the intraoral scans to identify gum recession, gum swelling, bleeding, caries, and / or plaque (also known as calculus) on the patients teeth. Additionally, one or more oral structure determination engines 315, oral condition detection engines 320 and / or oral condition mediation engines 322 configured to operate on radiographs may process the radiograph(s) to identify information related to periodontal bone loss, caries, and / or calculus with respect to one or more of the patients teeth. Oral condition detection engine 320 and / or oral condition mediation engine 322 may, for example, combine tooth segmentation information and periodontal bone loss segmentation information from analysis of a radiograph to determine the level of a periodontal bone line atone or more teeth. Oral condition detection engine 320 and / or oral condition mediation engine 322 may determine bone loss values for each tooth and / or region. Based on these bone loss values, oral condition detection engine 320 and / or oral condition mediation engine 322 may determine whether the patient has horizontal bone loss and / or vertical bone loss at one or more teeth or areas. Additionally, or alternatively, oral condition detection engine 320 and / or oral condition mediation engine 322 may determine whether the patient has generalized bone loss (e.g., that applies to all teeth in the upper and / or lower jaw) and / or whether the patient has localized bone loss (e.g., at one or more specific teeth, a particular area of the patients jaw, etc.). Oral condition detection engine 320 and / or oral condition mediation engine 322 may additionally or alternatively determine an angle of a periodontal bone line for the patient at the one or more teeth, wherein the angle of the periodontal bone line may be used to identify at least one of horizontal bone loss or vertical bone loss.

[0327] Based on the determined periodontal bone loss information (e.g., severity of periodontal bone loss for one or more teeth, information on general vs. localized bone loss, angle of bone line, horizontal vs. vertical bone loss, etc.) from analysis of the radiograph and gum recession, gum swelling and / or plaque information from the analysis of the intraoral scan data, and optionally further based on other information such as patient age, patient habits, patient health conditions, etc., oral health diagnostics engine 321 may determine whether a patient has periodontitis and / or a stage of the periodontitis. Other received information used to assess periodontitis may include, for example, pocket depth information received from a DPMS for one or more teeth, smoking status for the patient, and / or medical history for the patient.

[0328] In embodiments, oral health diagnostics engines 321 may use information of multiple different types of identified oral conditions and / or associated severity levels to determine correlations and / or cause and effect relationships between two or more of the identified oral conditions. Multiple oralAttorney Docket No.: 28510.973 (L0805PCT)conditions may be caused by the same underlying root cause. Additionally, some oral conditions may serve as an underlying root cause for other oral conditions. Treatment of the underlying root cause oral conditions may mitigate or halt further development of other oral conditions. For example, malocclusion (e.g., tooth crowding and / or tooth spacing or gaps), tooth wear and caries may all be identified for the same tooth or set of teeth. Oral health diagnostics engine(s) 321 may analyze these identified oral conditions that have a common, overlapping or adjacent area of interest, and determine a correlation or causal link between one or more of the oral conditions. In example, oral health diagnostics engine(s) 321 may determine that the caries and tooth wear for a particular group of teeth is caused by tooth crowding forthat group of teeth. By performing orthodontic treatment for that group of teeth, the malocclusion may be corrected, which may prevent or reduce further caries progression and / or tooth wear for that group of teeth. In another example, plaque, tooth staining, and gum recession may be identified for a region of a dental arch. The tooth staining and gum recession may be symptoms of excessive plaque. The oral health diagnostics engine(s) 321 may determine that the plaque is an underlying cause for the tooth staining and / or gum recession.

[0329] In embodiments, currently identified oral conditions and / or oral health problems may be used by the oral health diagnostics engine(s) 321 to predict future oral conditions that are not presently indicated. For example, a heavy occlusal contact may be assessed to predict tooth wear and / or a tooth crack in an area associated with the heavy occlusal contact. Such analysis may be performed by inputting intraoral data (e.g., current intraoral data and / or past intraoral data) and / or the oral conditions identified from the intraoral data into a trained machine learning model that has been trained to predict future oral conditions based on current oral conditions and / or current dentition (e.g., current 3D surfaces of dental arches). The machine learning model may be any of the types of machine learning models discussed elsewhere herein. The machine learning model may output a probability map indicating predicted locations of oral conditions and / or types of oral conditions. Alternatively, the machine learning model may output a prediction of one or more future oral conditions without identifying where those oral conditions are predicted to be located.

[0330] Oral health condition assessment tools may enable doctors to view and perform assessments of various types of oral conditions. Each type of oral condition may be associated with its own unique oral condition assessment tool or set of oral condition assessment tools in embodiments.

[0331] Accuracy evaluation engine 336 may determine an accuracy of one or more identified oral conditions, actionable symptom recommendations, diagnoses of oral health problems, and so on in embodiments. Alternatively, or additionally, each of the outputs of oral structure determination engines 315, oral condition detection engines 320, oral condition mediation engines 322, and / or oral health diagnostics engines 321 may include probability and / or confidence information indicating a confidenceAttorney Docket No.: 28510.973 (L0805PCT)that detected oral conditions, oral health problems, etc. are correct. Confidence information may be generated for segmented objects and / or for individual pixels in embodiments.

[0332] In some embodiments, accuracy evaluation engine 336 applies one or more confidence thresholds to detections (e.g., outputs of oral condition detection engines 320). Based on the thresholds, accuracy evaluation engine 336 may determine whether objects amount to detections of oral condition classifications, and / or determine sizes of oral condition classifications in embodiments. Confidence thresholds may be automatically or manually adjusted to change the sensitivity of the system to detecting one or more types of oral conditions. In one embodiment, the oral health diagnostics system 215 may be toggled between a standard sensitivity mode and a high sensitivity mode. One or more confidence thresholds may be reduced for the high sensitivity mode as compared to the standard sensitivity mode, increasing instances of detected oral conditions and / or sizes of detected oral conditions.

[0333] In some embodiments, accuracy evaluation engine 336 may flag one or more detected oral conditions and / or diagnoses of oral health problems as suspected oral conditions and / or suspected diagnoses. Suspected oral conditions and / or diagnoses may correspond to edge cases that may be actual oral conditions / diagnoses, or may be false positives. In some embodiments, multiple different suspected diagnoses or oral condition options for a same oral cond ition / oral health problem may be presented, and a user may select from the multiple options. Suspected diagnoses / oral condition options may be presented as bounding boxes in embodiments. In some embodiments, suspected oral conditions / diagnoses may be presented to a user for acceptance or denial. In some embodiments, a bounding box around suspected oral conditions are transformed into a segmentation mask for the oral condition.

[0334] Treatment recommendation engine 325 may provide treatment recommendations based on detected oral conditions and / or based on determined oral health problems and / or actionable symptom recommendations. T reatment recommendation engine 325 may or may not include one or more trained machine learning models. In one embodiment, treatment recommendation engine 325 includes a decision tree that receives an input of oral condition information, diagnosed oral health problems and / or actionable symptom recommendations, and that outputs one or more treatment recommendations. Treatment recommendations may be based on combinations of different oral conditions and / or oral health problems, severity of oral conditions and / or oral health problems, patient age, patient health, and / or other parameters in embodiments.

[0335] Visualization engine 330 may output received image data of one or more oral state capture modalities to a display of a user interface 322. Visualization engine 330 may additionally generate overlays associated with each detected instance of an oral condition and output the overlays over theAttorney Docket No.: 28510.973 (L0805PCT)image data in the display. In embodiments, each instance of an oral condition may be associated with a separate layer of the overlay, and may be turned on or off individually. Visualization engine 330 may additionally output a view of a dental chart populated with oral condition information as generated by segmentation engine 312. In embodiments, visualizations may include overlays having shapes of areas of interest for identified oral conditions. These areas of interest may be displayed using a visualization that is coded based on classes of the one or more oral conditions that the areas of interest are associated with.

[0336] In some embodiments, visualization engine 330 generates bone measure visualizations, which may show an amount of periodontal bone loss of a patient. Oral condition detection engines 320, oral condition mediation engines 322 and / or oral health diagnostics engines 321 may operate on data to perform bone measure analysis in embodiments. The result of such analysis may then be shown by the visualization engine 330. Such bone measure visualizations may show how a patients’ teeth retain or lose bone density overtime using analysis of data from radiographs and / or other oral state capture modalities. In embodiments, bone loss may be measured and shown on panoramic x-rays or periapical x-rays, and / or from current bite-wing x-rays combined with data from older panoramic or periapical x-rays or older intraoral scans.

[0337] In some embodiments, tooth portion generation engine 320 can be a software program hosted by a device (e.g., computing device 305) to generate units of data that can be combined to create the dynamic tooth chart. In some embodiments, tooth portion generation engine 320 can identify datasets of scan data 351 that include scan data of a dental arch of a patient. The scan data in each dataset can correspond to an imaging modality (e.g., intraoral scan, CBCT, photograph, video, radiograph, etc.). The scan data in each dataset can provide information about a patients dentition. In some embodiments, the tooth portion generation engine 320 can identify the segmentation data 353 corresponding to the dataset. The segmentation data 353 can identify segments (or portions) of the patients dental arch. For example, a segment can include one tooth or multiple teeth of the patients dental arch.

[0338] In some embodiments, tooth portion generation engine 320 can normalize each section, e.g., for size, scale, color balance, brightness, and / or orientation, for coordinated presentation on the dental chart That is, each section can be normalized to fit within the dental chart format. Tooth portion generation engine 320 can then generate a tooth portion unit for each normalized section, and can store the tooth portion units in tooth portion data 357. Each tooth portion unit of data can correspond to a section of the dental chart in a particular imaging modality. The tooth portion generation engine 320 can generate a tooth portion unit for each modality. In some embodiments, each tooth portion unit of tooth portion data 357 can include an image of one or more teeth of the patient, representing aAttorney Docket No.: 28510.973 (L0805PCT)particular imaging modality. Each tooth portion unit can automatically align with other tooth portion units within the dental chart format, e.g., in a snap-to-fit configuration. For example, each tooth portion unit representing a specific section of the dental chart in a particular modality can be automatically aligned and positioned within the overall chart layout (e.g., without manual adjustment by the user). After normalizing for parameters such as size, scale, color balance, brightness, and / or orientation, each tooth portion unit is configured to seamlessly “snap” into its designated location on the dental chart. The snap-to-fit configuration can enable images from different modalities, or from different time points, to be consistently and accurately displayed in relation to one another, preserving anatomical relationship and visual coherence across the dental chart. In some embodiments, the tooth portion generation engine 320 can assign spatial coordinates or grid positions to each tooth portion unit, e.g., based on anatomical landmarks or predefined chart templates. These spatial coordinates or grid positions can enable each tooth portion unit to be automatically positioned within the dental chart, in such a way that adjacent units abut seamlessly, preserving anatomical relationship and reducing (or eliminating) gaps or overlaps. This snap-to-fit configuration can allow for the dynamic assembly of the chart from heterogeneous data sources, enabling images from different modalities or time points to be displayed in a coherent, standardized manner.

[0339] In some embodiments, tooth portion generation can be done using 3D registration and / or image registration. In some embodiments, 3D registration can include capturing 3D data of various points in multiple images (e.g., in multiple scans of the same patient), and registering the images by computing transformations between the images / scans. Registering each tooth can offset any tooth movement that may have occurred between scans of the patients dentition. In some embodiments, image registration involves identifying multiple points, point clouds, edges, corners, surface vectors, etc., in each image / scan of an image / scan pair, surface fitting to the points of each image / scan, and using local searches around points to match points of the two images / scans.

[0340] In some embodiments, the dynamic chart system 315 can include a dynamic chart generator 329 and / or a III controller 331.

[0341] In some embodiments, dynamic chart generator 329 can be a software program hosted by a device (e.g., computing device 305) to identify tooth portion units of tooth portion data 357 for a particular patient, arrange the tooth portion units into a dental chart, and / or create a visualization of the dental chart of the patient. In some embodiments, dynamic chart generator 329 can identify a particular imaging modality and select the tooth portion units of tooth portion data 357 that correspond to the identified imaging modality. In some embodiments, dynamic chart generator 329 can identify the particular imaging modality based on the context of the patients visit to the doctor’s office. Examples of context include the chief complaint of the patient, a treatment plan, a treatment type, a scheduled dentalAttorney Docket No.: 28510.973 (L0805PCT)visit (e.g., a regular 6-month check-up, a tooth cleaning), an inputof a user (e.g., of the dental practitioner), or a detection of a condition (e.g., identified by Al). In some embodiments, the dynamic chart generator 329 can identify a correlation between the context of the visit and each of the imaging modalities, and can identify the particular imaging modality based on a ranking of the correlations.

[0342] As an illustrative example, a dental practitioner could inputthe context of the visit as identifying caries. The dynamic chart generator 329 can identify bite wing x-rays as having the highest correlation to the context for the buccal view, can identify NIR images as having the highest correlation to the context for the occlusal view, and can identify the panoramic x-ray has having the highest correlation to the context for the lingual view. That is, the bite-wing x-rays can be the best imaging modality for displaying caries in the buccal view, the NIR images can be the best imaging modality for displaying caries in the occlusal view, and the panoramic x-rays can be the best imaging modality for displaying caries in the lingual view. Thus, the dynamic chart generator 329 can identify the tooth portion units of tooth portion data 357 corresponding to the bite-wing x-rays of the buccal views of the patient, the tooth portion units of tooth portion data 357 corresponding to the NIR images of the occlusal view of the patient, and the tooth portion units of tooth portion data 357 corresponding to the panoramic x-rays of the lingual view of the patient when generating the visualization of the patients dental chart If any of the imaging modalities are not available for the particular patient (or are not available for the particular view for the patient), the dynamic chart generator 329 can select the imaging modality with next highest correlation. In some embodiments, the dynamic chart generator 329 can generate a visualization of the patients dental chart using multiple imaging modalities (e.g., two or more), or can generate a visualization of the patients dental chart using a single imaging modality.

[0343] In some embodiments, the visualization of the dental chart can include a buccal view, an occlusal view, and / or a lingual view of the dental arch of the patient, and can optionally include a 2D view, a 3D view, and / or a multi-dimensional view. Examples of the visualization of the dental chart generated by dynamic chart generator 329 are described with respect to FIGs.6-11.

[0344] In some embodiments, the dynamic chart generator 329 can modify the visualization of the patients dental chart, e.g., based on a user interaction received from the user device (e.g., via the Ul). In some embodiments, the dynamic chart generator 329 can identify a second imaging modality that corresponds to the user interaction. For example, the user can change the context of the visit, e.g., to inputthe patients secondary complaint. The dynamic chart generator 329 can identify imaging modality (or modalities) that correspond to the user input, and can generate an updated visualization using the tooth portion units of tooth portion data 357 in the newly identified imaging modality (or modalities).

[0345] In some embodiments, the tooth portion data 357 can include data from multiple image sources of the same imaging modality. The dynamic chart generator 329 can identify the image sourceAttorney Docket No.: 28510.973 (L0805PCT)that corresponds to the imaging modality that best corresponds to the context. In some embodiments, the dynamic chart generator 329 can include an Al model that can receive, as input, the image sources corresponding to particular imaging modalities, and can identify which image of the multiple images of each imaging modality best represents the context. For example, if the context is to identify caries, the Al model can identify which image of the multiple images of bite-wing x-rays of the buccal view of the patients dental arch best displays the caries. In some embodiments, the Al model can rank the images, e.g., from best to worst. In some embodiments, the Al model can rank the images for each tooth portion unit. Thus, as an illustrative example, the dynamic chart generator 329 can use the tooth portion unit of tooth portion data 357 from one image to display a first tooth of the patients dental arch, and can use the tooth portion unit of tooth portion data 357 from a second image to display the a second tooth of the patients dental arch.

[0346] In some embodiments, the dynamic chart generator 329 can process scan data 351 (or a subset thereof, e.g., corresponding to the patient) to detect oral condition(s) of the patient, such as, cavities, gum disease, tooth wear, cracked or fractured teeth, plaque or tartar build-up, bite issues, temporomandibular joint disorder, impacted teeth, orthodontic needs, etc. In some embodiments, the dynamic chart generator 329 can use an Al model that is trained to provide the detected conditions. In some embodiments, the dynamic chart generator 329 can update the tooth portion units of tooth portion data 357 to include a representation of the detected conditions in the visualization of the dental arch of the patient.

[0347] In some embodiments, the dynamic chart generator 329 can provide, as input to an Al model, the scan data 351 that corresponds to the patient. The Al model can be trained to provide an indication of a clinical finding corresponding to particular imaging modality. The dynamic chart generator 329 can receive, as output from the Al model, the indication of the clinical finding. In some embodiments, the clinical finding can be stored as clinical findings data 355 of data store 308. In some embodiments, the dynamic chart generator 329 can include the clinical finding in the visualization of the dental chart of the patient. In some embodiments, the dynamic chart generator 329 can include the clinical finding in a second imaging modality that best corresponds to the clinical finding.

[0348] In some embodiments, the Al model an provide multiple indications of a clinical finding. Each indication can correspond to a particular imaging modality. For example, the Al model can provide a first indication of a cavity in a first imaging modality (e.g., intraoral scan image), and a second indication of the cavity in a second imaging modality (e.g., NIR image). To determine which image data to include in the visualization to indicate the clinical finding, the dynamic chart generator 329 can identify the imaging modality that best corresponds to the clinical finding, and can identify the indication that corresponds to that imaging modality. The dynamic chart generator 329 can then identify the toothAttorney Docket No.: 28510.973 (L0805PCT)portion unit of tooth portion data 357 that corresponds to that imaging modality, and include an indication of the clinical finding in that tooth portion unit.

[0349] In some embodiments, the dynamic chart generator 329 can aggregate the multiple indications of the clinical finding to generate an overall indication, and include the overall indication of the clinical finding in the visualization of the patients dental chart.

[0350] In some embodiments, the dynamic chart generator 329 can provide image data of multiple image sources corresponding to scan data 351 to an Al model that is trained to provide a confidence score associated with an identified clinical finding (e.g., identified using an Al model, or otherwise identified) for each of the image source. The dynamic chart generator 329 can then identify an image source with the highest confidence score, and can include that tooth portion unit corresponding to that image source in that visualization of the dental chart.

[0351] In some embodiments, the tooth portion units of tooth portion data 357 can correspond to a particular point in time, and the dynamic chart generator 329 can generate a visualization of the patients dental chart that corresponds a particular point in time. For example, the visualization can show the patients dental chart at a past time (e.g., 6 months ago), or at the current time.

[0352] In some embodiments, user interface (III) controller 331 can provide the visualization of the patients dental chart (e.g., generated by dynamic chart generator 329) to a user device (e.g., computing device 160) for presentation in a user interface (e.g., Ill 332). In some embodiments, III controller 331 can enable a user to interact with the visualization, e.g., by focusing on a particular section of the dental arch, changing imaging modalities, changing the point in time, changing between a 2D, 3D or multi-dimensional view, incorporating Al findings, etc.

[0353] In some embodiments, the III controller 331 can enable a user to make modifications to particular aspects of the patients dentition or dental arch, and cause the dynamic chart generator 329 to generate an updated visualization that corresponds to the modifications. In some embodiments, the III can include a measurement tool thatenables a user to measure (e.g., in 3D) the size of each tooth. In some embodiments, the measurement tool can enable the user to modify the measurements or dimensions of a tooth. The modifications can then be used by the dynamic chart generator 329 to generate an updated visualization that reflects the modified measurements or dimensions, and the III controller 331 can provide the updated visualization to the user device.

[0354] As an illustrative example, an orthodontist may measure the height of central teeth, lateral teeth, and cuspid teeth, with the goal of achieving a specific ratio between the measurements. The III controller 331 can provide tools to display the effects of 3D movements from each angle (e.g., occlusal, lingual, and / or buccal) simultaneously.Attorney Docket No.: 28510.973 (L0805PCT)

[0355] In some embodiments, the Ul controller 331 can provide multiple views of the dynamic tooth chart, e.g., 2D, 3D, multi-dimensional view, views based on modalities, based on a particular condition, based on the context for the visit, and / or a combination thereof. In some embodiments, the Ul controller 130 can enable a user to create a custom view of the dynamic tooth chart. In some embodiments, the Ul controller 130 can provide templates to enable a user to create custom view(s).

[0356] In some embodiments, computing device(s) 360 can be or include a user device. In some embodiments, the user device 160 can be used by a dental professional (e.g., a doctor, a dentist, a hygienist, a clinician, and / or a technician, sometimes referred to herein as a dental practitioner) to educate a patient regarding the patients dental health. The user device 360 can include a user interface (Ul) 332 to display the generated dynamic chart, and optionally include tools to interact with and / or modify the chart.

[0357] The dynamic chart system 315 is further described with respect to FIGs.4-11.

[0358] In some embodiments, auto charting system 316 can be a software program hosted by a device (e.g., computing device 305) to automatically generate tooth annotations used to populate a dental chart. In some embodiments, auto charting system 316 include a material analysis engine 326, a teeth arrangement analysis engine 327, and / or a shape analysis engine 328. The material analysis engine 326 can perform a material analysis based on 2D color and / or NIRI images, by segmenting the teeth according to material. The result of the material analysis can apply to global treatment history for the patient, such as the presence of a crown and / or bridges, as well as local treatments such as partial restoration, veneer, inlay, onlay, overlay, and / or significant fillings. The teeth arrangement analysis engine 327 can perform a teeth arrangement analysis based on 3D model(s) of the patients dentition by comparing the teeth position to a jaw arc model and detecting missing teeth and / or irregular tooth position. The shape analysis engine 328 can perform a shape analysis based on the 3D dental model(s) (and optionally color and / or NIRI attributes) to identify tooth identifications, including, for example, primary teeth, analysis of reconstruction entities such as an abutment, scan-body, and / or prep, as well as partially hatched teeth and detection of dental accessories such as brackets, attachments, retainer, and / or braces.

[0359] In some embodiments, material analysis engine 326 can assess dental structures by analyzing the composition and / or material characteristics of each tooth. The material analysis engine 326 can receive (e.g., from segmentation engine 312), retrieve (e.g., from segmentation data 353), or otherwise identify segmentation data identifying individual teeth and their spatial context within a 3D model of the patients dentition. The material analysis engine 326 can received, retrieve (e.g., from scan data 351), or otherwise identify 2D color images and / or NIRI images of the patient. The material analysis engine 326 can geometrically map the 2D color images and / or NIRI images to the segmentedAttorney Docket No.: 28510.973 (L0805PCT)3D model of each tooth. In some embodiments, the material analysis engine 326 can perform a 2D color analysis that includes projected the segmented 3D tooth models onto corresponding 2D color intraoral images. In some embodiments, the color analysis can include using image processing and / or ML models (e.g., CNNs or U-Net architecture) to extract and analyze colorimetric features within each tooth region. The analysis can focus on differentiating the optical properties of various dental materials, including, for example, the hue, saturation, and / or brightness characteristics that distinguish natural enamel and dentin from restorative materials such as composite resin, amalgam, ceramic, and / or porcelain. The color analysis can enable the material analysis engine 326 to localize findings to specific dental surfaces (e.g., buccal, lingual, occlusal). The 2D color analysis can result in material detection, such as tooth, restorative, tartar, etc. The material analysis engine 326 can perform a material segmentation to identify (e.g., detect and segment) veneer, inlay, onlay, overlay, fillings, etc.

[0360] In some embodiments, the material analysis engine 326 can receive input from the segmentation engine 312, which can provide detailed segmentation data identifying individual teeth and their spatial context within the 3D model of the patients dentition. The material analysis engine 326 can process multi-modal scan data, including 2D color images and / or NIRI images, which can be geometrically mapped to the segmented 3D model using intrinsic and extrinsic calibration parameters or direct transformation matrices. The material analysis engine 326 can analyze the optical properties, such as colorimetric values, translucency, and / or reflectance patterns, captured in these images to distinguish between natural tooth material and a variety of restorative materials, including but not limited to composite fillings, metal or ceramic crowns, bridges, veneers, inlays, onlays, and / or overlays. The material analysis engine 326 can use image processing algorithms and / or ML models, such as convolutional neural networks or U-Net architectures, to segment and classify regions of each tooth according to their material composition. In some embodiments, the image processing algorithms and / or ML models can segment and classify regions of each tooth according ot their material composition even where restorations are subtle, partially blended with natural tissue, or present in complex multi-material configurations. The material analysis engine 326 can generate detailed material labels and / or segmentation masks for each tooth, e.g., indicating the presence, type, and / or spatial extend of restorations or artificial structures. In some embodiments, the material labels and / or segmentation masks can be stored in data store 308, e.g., as material data 358. These results can be integrated with outputs from the shape analysis engine 328 and / or the teeth arrangement analysis engine 327 to produce a comprehensive, multi-dimensional dental chart. The material analysis engine 326 can provide precise differentiation of materials, thereby enhancing accuracy of the automated charting process and supplying data for diagnostic algorithms and / or treatment planning modules within the oral health diagnostics system 215.Attorney Docket No.: 28510.973 (L0805PCT)

[0361] In some embodiments, teeth arrangement analysis engine 327 can perform spatial analysis of dental structures by evaluating the positional relationships of individual teeth relative to the anatomical curvature of the jaw. The material analysis engine 326 can receive (e.g., from segmentation engine 312), retrieve (e.g., from segmentation data 353), or otherwise identify segmentation data and tooth identification within a 3D model of the patients dentition. The teeth arrangement analysis engine 327 can generate a reference jawline curve. In some embodiments, the teeth arrangement analysis engine 327 can generate the jawline reference curve by first extracting the spatial coordinates of the segmented teeth and the relevant anatomical landmarks from the 3D model of the patients dentition. Using these data points, the teeth arrangement analysis engine 327 can apply a model, such as a piecewise polynomial, spline interpolation, or least-squares fitted curve, to approximate the natural curvature of the dental arch. The process may involved identifying the central points or centroids of each tooth, as well as the boundaries of the alveolar ridge, for anatomical accuracy. In some embodiments, the teeth arrangement analysis engine 327 can employ outlier detection and / or smoothing algorithms to minimize the influence of missing teeth, mal-positioned teeth, and / or artifacts, to produce a continuous, anatomically representative baseline.

[0362] In some embodiments, the teeth arrangement analysis engine 327 can compute the relative translation, rotation, and / or orientation of each tooth with respect to this baseline. For example, the teeth arrangement analysis engine 327 can project the centroid of each tooth onto the jawline reference cruve to determine its expected anatomical position along the dental arch. The teeth arrangement analysis engine 327 can quantify relative translation by calculating the vector displacement between the actual centroid of the tooth and its corresponding point on the reference curve, capturing deviations in mesiodistal, buccolingual, and / or occlusogingival directions. For rotation and orientation, the teeth arrangement analysis engine 327 can perform a comparative analysis between the principal axes of the tooth and the tangent or normal vectors of the jawline curve at the projected location, sing metrics such as Euler angles or rotation matrices to describe angular discrepancies. In some embodiments, the teeth arrangement analysis engine 327 can analyze intertooth spacing, angulation, and / or alignment to detect clinically relevant conditions, such as missing teeth, crowding, diastema, and / or irregular positioning. For example, the teeth arrangement analysis engine 327 can calculate inter-tooth spacing by measuring the Euclidean distances between the centroids or contact points of adjacent teeth along the dental arch, comparing these values to normative anatomical thresholds to identify deviations indicative of diastema (excessive spacing) or crowding (reduced spacing). For angulation analysis, the teeth arrangement analysis engine 327 can determine the orientation of each tooth’s principal axis relative to the tangent or normal vector of the jawline reference curve at the corresponding position, using angular metrics such as inclination or rotationAttorney Docket No.: 28510.973 (L0805PCT)angles to detect irregular tilting or malposition. In some embodiments, the teeth arrangement analysis engine 327 can assess alignment by evaluating the sequential arrangement of teeth along the arch, identifying discontinuities or gaps that may signal missing teeth, as well as detecting outliers whose spatial or angular parameters fall outside clinically accepted ranges.

[0363] In some embodiments, the teeth arrangement analysis engine 327 can integrate contextual information from the material analysis engine 326 and / or the shape analysis engine 328, allowing for more robust differentiation between true anatomical anomalies and artifacts resulting from restorations or dental accessories. In some embodiments, the teeth arrangement analysis engine 327 can generate spatial labels, arrangement metrics, and / or anomaly flags for each tooth. In some embodiments, the teeth arrangement analysis engine 327 can store the labels, metrics, and / or flags in arrangement data 352 of data store 308. In some embodiments, the labels, metrics, and / or flags can be incorporated into the comprehensive dental chart.

[0364] In some embodiments, the teeth arrangement analysis engine 327 can be or implement a an ML model (e.g., a convolutional neural network or a point cloud-based architecture) specifically trained for dental spatial analysis. The teeth arrangement analysis engine 327 can provide, as input ot the ML model, segmented 3D data of the dental arches, e.g., including the spatial coordinates and orientation vectors of individual teeth, and optionally contextual features such as the jawline reference curve and / or inter-tooth distances. In some embodiments, the input data may be further augmented with derived features, such as local curvature, tooth centroid positions, and / or principal axes, e.g., to enhance the model’s ability to capture spatial relationships and anatomical context. In some embodiments, the ML model can be trained on a training dataset that includes clinically labeled conditions such as missing teeth, crowding, diastema, and / or irregular positioning. The ML model can learn complex patterns of normal and abnormal tooth arrangement. The ML model can provide, as output, structured predictions for each tooth and inter-tooth region, e.g., including classification labels (e.g., normal, crowded, spaced, missing), quantitative metrics (e.g., deviation from expected position, angulation angles), and / or anomaly flags. In some embodiments, the output of the ML model can be directly integrated into the comprehensive dental chart.

[0365] In some embodiments, shape analysis engine 328 can perform morphological assessment of dental structures by analyzing the geometric features of each segmented tooth within the 3D model of the patients dentition. In some embodiments, the shape analysis engine 328 can receive (e.g., from segmentation engine 312), retrieve (e.g., from segmentation data 353), or otherwise identify segmentation data and tooth identification within a 3D model of the patients dentition. The segmentation data can include high-resolution 3D point cloud or mesh data corresponding to individual teeth and their spatial context. The shape analysis engine 328 can extract and process geometricAttorney Docket No.: 28510.973 (L0805PCT)descriptors, such as curvature, surface area, volume, and / or principal axes, from the 3D data to characterize the morphology of each tooth. In some embodiments, the shape analysis engine 328 can implement one or more ML models, such as point cloud neural networks or feature embedding architectures, trained to classify teeth according to type (e.g., incisor, canine, premolar, molar), identify primary versus permanent teeth, and / or detect non-natural and anomalous shapes indicative of dental restorations, abutments, scan bodies, preps, and / or partially erupted teeth. In some embodiments, the shape analysis engine 328 can identify and / or segment dental accessories, such as brackets, attachments, retainers, and wires, e.g., by recognizing their distinctive geometric patterns within the 3D data. The outcomes produced by the shape analysis engine 328 can include detailed shape-based classification labels, anomaly flags, and / or segmentation masks for each tooth and accessory. The shape analysis engine 328 can store the labels, flags, and / or masks in data store 308, e.g., as shape data 359. In some embodiments, the labels, flags, and / or masks can be integrated with outputs of the material analysis engine 326 and / or the teeth arrangement analysis engine 327.

[0366] In some embodiments, the cross validation module 329 can perform cross-validation based on symmetry and / or multiple scans of the same patient. In some embodiments, the cross validation module 329 can serve as a quality assurance component by systematically evaluating and reconciling the outputs generated by the shape analysis engine 328, the material analysis engine 326, and / or the teeth arrangement analysis engine 327. In some embodiments, the cross valuation module 329 can receive (e.g., from engines 326-328), retrieve (e.g., from data store 308), and / or otherwise identify detailed classification labels, segmentation masks, spatial arrangement metrics, and / or material composition data. In some embodiments, the cross validation module 329 can implement one or more validation algorithms, such as symmetry checks that compare the morphology and / or material properties of contralateral teeth, consistency checks that assess the alignment between shape-based and / or material-based classifications, and / or temporal comparisons that evaluate the stability of findings across multiple scans of the same patient. The cross validation module 328 can use geometric registration techniques, such as iterative closest point algorithms, to align and compare mirrored tooth models, and can apply statistical or machine learning-based anomaly detection methods to flag discrepancies or outlier. The cross validation module 329 can generate confidence scores, correction suggestions, and / or validation flags for each tooth and / or dental structure, which can be fed back into the system for automated correction and / or presented to dental practitioners for review.

[0367] The auto charting system 316 is further described with respect to FIGs. 12-20.

[0368] In some embodiments, the results of the auto charting system 316 can be used to improve other diagnostic systems, such as reducing false positives in caries detection by recognizing restorations, informing time lapse analysis by identifying when a tooth has been restored or replaced,Attorney Docket No.: 28510.973 (L0805PCT)adjusting tooth strength assessment algorithms based on implant detection, and / or detecting missing attachments by comparing charting results to treatment plans. For example, by accurately identifying the presence, type, and spatial extent of restorations (such as fillings, crowns, bridges, veneers, inlays, and onlays), the outcome of the auto charting system 316 can enable caries detection algorithms to distinguish between natural tooth structure and restorative materials. This differentiation can help reduce false positives, as caries-like features in imaging modalities (e.g., NIRI or radiographs) may arise from the optical or geometric properties of restorations, rather than true pathological lesions. Thus, by referencing auto charting annotations, the caries detection algorithm can suppress and / or reclassify suspicious regions that overlap with known restorations, thereby improving diagnostic specificity. As another example, the identification of teeth that have been restored or replaced (e.g., by crowns, bridges, or extractions) can provide context for a time lapse analysis that tracks morphological changes in dentition overtime. By correlating detected changes in tooth shape or position with auto charting records of restorative interventions, the time lapse algorithm can differentiate between clinically significant disease progression (such as wear or fracture) and expected alterations due to restorative procedures, thus reducing misinterpretation and supporting more accurate longitudinal assessments. As another example, the detection of dental implants through auto charting can allow tooth strength assessment algorithms (such as those evaluating vertical mobility or occlusal load response) to dynamically adjust their analytical thresholds and / or interpretive criteria. Since implants are expected to exhibit minimal physiological movement compared to natural teeth, the algorithm can flag any detected mobility as a potential clinical concern, while avoiding false alarms for natural teeth with normal physiological movement. As another example, by comparing auto charting results to planned or expected attachment locations from orthodontic treatment plans, the system can automatically detect missing or dislodged attachments (e.g., aligner attachments or brackets). This comparison enables timely identification of deviations from the prescribed treatment protocol, supporting clinical intervention and improving treatment outcomes. Thus, the auto charting system 316 can serve as a foundational data layerthat augments the accuracy, context-awareness, and clinical utility of a broad range of dental diagnostic algorithms.

[0369] In some embodiments, the auto charting system 316 can remove and / or inpaint detected dental accessories (e.g., attachments, orthodontic brackets, archwires, bonded retainers, etc.) in the visualization of the dental chart, e.g., to facilitate a cleaner analysis. For example, upon identifying a dental accessory (e.g., using feature-based object detection algorithms and / or trained ML models), the auto charting system 316 can segment the affected region form the surrounding dental and / or gingival structures. In some embodiments, the auto charting system 316 can remove the identified accessory by excising the accessory geometry or masking the corresponding pixels / voxels to isolate the area ofAttorney Docket No.: 28510.973 (L0805PCT)interest. In some embodiments, the auto charting system 316 can perform an inpainting process using, e.g., context-aware interpolation, patch-based synthesis, and / or deep learning-based image and surface completion models, to reconstruct the occluded regions by inferring the most probable underlying tooth surface or gingival tissue morphology and / or appearance. This restoration process can yield a natural, anatomically plausible representation that closely approximates the original unaltered oral anatomy. In some embodiments, the removal and / or inpainting of dental accessories can mitigate artifacts and confounding features that can adversely impact the performance of subsequent analysis modules, e.g., semantic segmentation, morphological shape analysis, and / or Al-driven diagnostic algorithms. For example, by presenting a normalized dataset free from accessory-induced distortions, the auto charting system 316 can enhance the accuracy and robustness of tooth identification, restorative status classification, and / or pathology detection.

[0370] The user interface 332 can be a graphical user interface and may include icons, buttons, graphics, menus, windows and so on for controlling and navigating the oral health diagnostics system 215. A user may interact with user interface 332 to select individual teeth, to modify instances of oral conditions (e.g., by redrawing their shape), to remove instances of oral conditions, to add instances of oral conditions, to turn on and off overlay layers, and so on. The user interface 332 may include tools that a doctor or other user can use to model, annotate, and / or otherwise interact with various oral structures and / or oral conditions that are imaged through various oral structure capture modalities, including radiographs.

[0371] User interface 332 may provide visualizations generated by visualization engine 330 about oral structures (e.g., teeth), or oral conditions, oral health problems, and so on. The visualizations may be associated with tools for manipulating oral structures and / or oral conditions, for selecting oral structures, oral conditions, actionable symptom recommendations, diagnoses, and so on. Via the user interface 332, doctors may provide input about oral structures, oral conditions, actionable recommendations, diagnoses, and so on.

[0372] User interface 332 enables users to interact with various forms of data that capture the state of a patients dentition. User interface 332 may additionally enable users to plan treatments for a patients dentition with various oral state capture modalities, including x-rays. User interface 332 may provide multiple visualization tools that a doctor or other user can use to model, annotate, and / or otherwise interact with various oral structures that are imaged through various oral structure capture modalities, including radiographs. User interface 332 may also provide treatment planning tools for planning of patient treatments. For example, user interface 332 may receive a selection of a treatment recommendation, and oral health diagnostics system 215 may initiate and / or perform automatedAttorney Docket No.: 28510.973 (L0805PCT)treatment planning based on the selected treatment recommendation (e.g., optionally including interfacing with a treatment planning system).

[0373] In an example, one or more treatment recommendations comprise at least one of one or more restorative treatment recommendations or one or more orthodontic treatment recommendations. Oral health diagnostics system 215 may receive a selection of at least one of a restorative treatment recommendation of the one or more restorative treatment recommendations or an orthodontic treatment recommendation of the one or more orthodontic treatment recommendations based on user interaction with user interface 332. Oral health diagnostics system 215 may then generate a treatment plan that is one of a restorative treatment plan, an orthodontic treatment plan, or an ortho-restorative treatment plan based on the selection. Generating the treatment plan may include determining staging for the treatment plan, optionally receiving modifications to one or more stages of the treatment plan, and outputting an updated treatment plan in an example.

[0374] In some embodiments, user interface 332 provides one or more interactive elements to facilitate interaction with a segmented radiographic representation of the oral cavity. User interface 332 may receive one or more interactions with the segmented radiographic representation through the one or more interactive elements, and oral health diagnostics system 215 may take one or more actions, implement one or more recommendations, take one or more treatment steps, etc. based on the one or more interactions.

[0375] Via the user interface 332, a user may additionally cause a report to be generated, cause data to be exported to one or more other systems, cause data to be stored, toggle between a standard sensitivity mode and a high sensitivity mode, and so on. The user interface 332 can provide a platform for a doctor or other user to model, annotate, and / or interact with various oral structures depicted through processing of the oral state capture modalities.

[0376] User interface 332 may provide multiple different types of interactions that users can have with the depictions of oral structures and oral conditions identified in image data. Such interactions may include rotations, movements of jaws, zooming in, zooming out, panning in one or more directions, and so on. In some embodiments, user interface 332 provides staging information, treatment planning information (e.g., for ortho-restorative treatment) and / or controls for treatment planning and / or treatment management based on integration with a treatment planning system and / or treatment management system. User interface 332 may output photo-realistic depictions of treatment and / or staging based on data generated by visualization engine 330 in embodiments.

[0377] In some embodiments, user interface 332 provides information about oral conditions and / or oral structures (e.g., teeth) responsive to a user causing a pointer to hover over the oral conditions and / or oral structures in a presented image. Controls for modifying oral conditions, sizing oralAttorney Docket No.: 28510.973 (L0805PCT)conditions, etc. may additionally or alternatively be presented responsive to a user hovering a pointer over an oral condition or tooth and / or responsive to a user selecting (e.g., via clicking, double clicking, etc.) an oral condition or tooth. User interface 332 may provide controls for sharing a state of a treatment (e.g., with a patient, another doctor, etc.). User interface 332 may provide controls for making changes or modifications to treatments. In an example, user interface 332 may provide controls for moving attachments, teeth, etc. In embodiments, user interface 332 may provide controls for designing restorations or other dental appliances. In embodiments, user interface 332 may provide controls for sending fabrication instructions to fabricate dental appliances, restorations, orthodontic aligners, palatal expanders, wires and brackets, and so on.

[0378] In some embodiments, user interface 332 presents one or more radiographs of a patients oral cavity, and provides controls for annotating the radiograph(s). In some embodiments, user interface 332 outputs one or more visual overlays over a radiograph or other image data based on visualizations generated by visualization engine 330. The visual overlays may convey information about oral conditions, severity of oral conditions, locations of oral conditions, types of oral conditions, and so on. The visual overlays may additionally be interactive, and may be manipulated in embodiments. In some embodiments, one or more visual overlays include controls for modifying represented oral conditions. In one embodiment, a 3D model of a patients upper and / or lower patients dental arches are output to a display by visualization engine 330, and user interface 332 may provide controls for interacting with and / or changing a view of the 3D model(s). As the 3D model(s) are rotated, for example, visualization engine 330 may scroll a panoramic x-ray, or update a highlighted or emphasized region of the panoramic x-ray currently shown in a view of the 3D model(s) to show those teeth that are aligned with current view of the 3D model(s). In some embodiments, visualization engine 330 may determine a bitewing and / or periapical x-ray that most closely aligns with a current view of the 3D model(s), and may display the determined x-ray(s) in the user interface 332. In some embodiments, multiple views of the patients dentition are shown together (e.g., in different regions of a display).

[0379] Report generation engine 333 may generate reports for patients based on the outputs of segmentation engine 312, oral health diagnostics engine 321 and / or treatment recommendation engine 325. In embodiments, reports can be generated upon a click of a button or other graphical user interface (GUI) element (e.g., via a selection from an elementof a menu), an entry from a command line, etc. Once a report generation request is received, report preference information (patient information, doctor preference information, etc.) may be gathered from various databases that store that information. Such preference information may include doctor preferences and / or dental practice preferences. Preference information may include treatment preferences, preferred treatment modalities, preferred views (e.g., panoramic, bitewing, periapical, occlusal, buccal, lingual, etc.), preferred imagingAttorney Docket No.: 28510.973 (L0805PCT)modalities (e.g., radiograph, CBCT, color image, etc.), preferred arrangements of data, and so on. Preference information can be learned based on prior reports generated by and / or for doctors and / or dental practices in embodiments. Doctors and / or dental practices may additionally inputtheir preferences. In some embodiments, requests to generate reports may include one or more parameters for report generation. Such report preference information and / or parameters may be used to configure the report in some embodiments. A request to run a report may trigger one or more report generation processes. Such processes may be independent processes and / or may be dependent on processes of other engines (e.g., visualization engine 330, segmentation engine 312, treatment recommendation engine 325, oral health diagnostics engine 321 , and so on).

[0380] In some embodiments, report generation engine 333 stores report templates in a data store, and may use such report templates to generate and / or manage reports. In some implementations, report templates include one or more sets of report fields that are to be populated, e.g., at runtime, to generate a report.

[0381] A report generation request may, but need not, include report parameters. An example of report parameters that may be specified include limits to the numbers and / or types of oral conditions, actionable recommendations, diagnoses, and / or treatment recommendations in a report. Another example of report parameters that may be specified include limits to report length, format parameters (e.g., colors, fonts, locations of various elements, etc.), locations and / or attributes of interactive elements, security and / or encryption parameters (e.g., anything related to access rights to a report and / or ability to share a report), etc.

[0382] Generated reports may include image data from one or more image modalities that were evaluated to generate the outputs. The report may include the image data along with an overlay of one or more identified oral conditions over the image data. Additionally, the report may include a dental chart with oral conditions indicated for teeth having those oral conditions. The report may additionally include a list of oral conditions (e.g., in text form). The reports may be diagnostic data reports that summarize oral conditions detected from relevant oral state capture modalities, actionable symptom recommendations, and / or diagnoses of oral health problems associated with the oral conditions. The report may include treatment recommendations, which may include one more actions to take to effectuate treatment of the oral conditions and / or oral health problems. In embodiments, reports can be generated and / or prioritized based on various factors, such as doctor preferences, issue importance, patient historical factors, etc.

[0383] Report generation engine 333 can operate to prioritize diagnostic report elements based on attributes of radiographs and / or other oral state capture modalities, user preferences, relevance of patient information, and / or other information. The report generation engine 333 can use trained modelsAttorney Docket No.: 28510.973 (L0805PCT)(e.g., ML models) to automatically generate reports in some embodiments. The trained models may be trained for a specific doctor and / or dental practice, and may generate reports in a format preferred by the doctor and / or dental practice. Accordingly, the report generation engine 333 can present issues, actionable recommendations, diagnoses, actions to effectuate treatment, proposed treatments, etc. in a manner preferred by the doctor and / or dental practice.

[0384] Generated reports can be presented as a document (e.g., a Word document or PDF document), as a webpage, as a page of an application, and / or in another format. Reports may or may not be interactive. Interactive reports may include interactive elements that a user may interact with to modify the report, provide additional information about aspects of the report, and so on. Reports may be formatted according to preferences of a doctor, dental practice, insurance company, and so on.Information related to report preferences may help to prioritize the data, organize the data, and / or present the data in a diagnostic data report.

[0385] The report generation engine 325 may use attributes of detected issues (e.g., oral conditions, actionable symptom recommendations, diagnoses of oral health problems, etc.) and / or report preference information to prioritize identified issues. This may involve AI / ML-based understanding of the types of issues that are likely to be relevant to users and / or specific oral conditions, actionable recommendations, diagnoses, actions to effectuate treatment, and so on. In some implementations, the report generation engine 333 uses one or more Al and / or ML models to intelligently prioritize and display oral conditions, actionable recommendations, diagnoses, and / or treatment recommendations.

[0386] The report generation engine 333 can operate to render reports in an interactive manner. Rendering techniques can involve interactive displays where users interact with reports. Alternatively, reports may be static diagnostic reports with text, images / views, treatment options presented to a user. The user interface 332 can operate to facilitate user interactions with diagnostic reports in embodiments.

[0387] Once a report is generated, in some embodiments, the report generation engine 333 may receive and / or process user interactions with the generated report based on a user interaction with user interface 332, and provide these user interactions to other systems to update issues related to oral conditions, actionable recommendations, diagnoses, actions to effectuate treatment, etc. In some embodiments, other engines and / or integrated systems may use the reports and / or interactions with them for treatment planning, etc.

[0388] One or more data stores 308 may store input data (e.g., data captured using one or more oral state capture modalities) and output data (e.g., reports, determined oral state conditions, diagnoses of oral health problems, actionable symptom recommendations, treatment recommendations, and soAttorney Docket No.: 28510.973 (L0805PCT)on). In some embodiments, treatment recommendations and / or actionable symptom recommendations are stored in a recommendation data store 340, and / or determined oral conditions are stored in oral condition data store 343. Alternatively, the varies types of detections, analysis results, etc. may be stored together in a single data store.

[0389] In some embodiments, data store 308 may store captured data from one or more oral state capture modalities, as indicated above, and may include pooled patient data, which may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, and / or virtual 3D models regarding a multitude of patients. Such a multitude of patients may or may not include the at-hand patient. The pooled patient data may be anonymized and / or employed in compliance with regional medical record privacy regulations (e.g., the Health Insurance Portability and Accountability Act (HIPAA)). The pooled patient data may include data corresponding to scanning of the sort discussed herein and / or other data.Reference data may additionally or alternatively include pedagogical patient data, which may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, virtual 3D models, and / or medical illustrations (e.g., medical illustration drawings and / or other images) employed in educational contexts.

[0390] FIG.4 illustrates a flow diagram of an example method 400 for generating and / or displaying a dynamic tooth chart, in accordance with some embodiments of the present disclosure. FIG.5 illustrates a flow diagram of an example method 500 for generating a tooth portion of a dynamic tooth chart, in accordance with some embodiments of the present disclosure. One or more of methods 400-500 may be performed by a processing device that may include hardware, software, or a combination of both. The processing device may include one or more central processing units (CPUs), graphics processing units (GPUs), field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), or the like, or any combination thereof. In one embodiment, one or more of methods 400-500 may be performed by the processing devices and the associated algorithms, e.g., as described in conjunction with FIG.3. In embodiments, one or more of methods 400-500 is performed by processing logic comprising hardware, software, firmware, or a combination thereof. In certain embodiments, one or more of methods 400-500 may be performed by a single processing thread. Alternatively, one or more of methods 400-500 may be performed by two or more processing threads, each thread executing one or more individual functions, routines, subroutines, or operations of the method. In an illustrative example, the processing threads implementing one or more of methods 400-500 may be synchronized (e.g., using semaphores, critical sections, and / or other thread synchronization mechanisms). Alternatively, the processing threads implementing one or more of methods 400-500 may be executed asynchronously with respect to each other. Therefore, while FIGs.4-5 and the associated descriptions list the operations of methods 400-500 in a certain order, in some embodiments, at least some of the described operations may be performed in parallel and / or in aAttorney Docket No.: 28510.973 (L0805PCT)different order. In some embodiments one or more operations of one or more of methods 400-500 is not performed.

[0391] Referring to FIG.4, at block 402, processing logic receives one or more datasets associated with a patient. Each dataset of the one or more datasets comprises data corresponding to an imaging modality of a plurality of imaging modalities and provides information on a dentition of the patient. The plurality of imaging modalities can include, for example, intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence imaging, OCT imaging, and / or any other type of imaging modality. In some embodiments, each dataset can include data from a particular point in time.

[0392] In some embodiments, processing logic determines the imaging modality of the plurality of imaging modalities by identifying a correlation between a context of the dental visit and each of the plurality of imaging modalities, ranking each of the imaging modalities according to the correlation, and then determining the imaging modality with the highest ranking. The context of the dental visit can correspond to a complaintof the patient, an input of a user of the user device, a treatment plan, a treatment type, a scheduled dental visit, and / or a detection of a condition. As an illustrative example, a patient may present with a chief complaint of sensitivity in the upper right molar region. Upon receiving this context, the processing logic can analyze the available imaging modalities (e.g., intraoral photographs, bitewing radiographs, panoramic x-rays, and / or NIRI images) and evaluate their respective diagnostic value for detecting caries or other pathology in the specified area that corresponds to the patients chief complaint. The processing logic can determine a higher correlation score to bitewing radiographs, as this modality is particularly effective for interproximal caries detection in posterior teeth. In contrast, intraoral photographs may receive a lower ranking due to their limited ability to visualize subsurface lesions. Based on this ranking, the processing logic can select the bitewing radiograph as the primary imaging modality for populating the relevant section of the dynamic tooth chart. The selected modality can then be used to generated and display the corresponding tooth portion units. In some embodiments, the processing logic can select the one or more tooth portions that correspond to the determined imaging modality.

[0393] In some embodiments, the processing logic can determine the diagnostic value of an imaging modality for a specified area based on a combination of predefined clinical rules, context-aware algorithms, and / or ML models trained on historical diagnostic outcomes. For example, when a clinical context is provided (e.g., a patients chief complaint, a selected tooth or region, or a specific diagnostic task), the processing logic can reference a knowledge base or decision matrix that encodes the relative effectiveness of each imaging modality for various diagnostic purposes and / or anatomical locations. As an illustrative example, the knowledge base may specify that bitewing radiographs have high diagnosticAttorney Docket No.: 28510.973 (L0805PCT)value for detecting interproximal caries in posterior teeth, while NIRI imaging may be more effective for early enamel lesions on occlusal surfaces.

[0394] In some embodiments, the processing logic may further analyze metadata associated with each available image, such as anatomical coverage, imaging quality, and / or recency, to determine whether the modality is relevant and / or suitable for the area of interest. In some embodiments, the processing logic can implement an Al model that is trained to evaluate the likelihood that a given modality will reveal clinically significant findings. In some embodiments, the processing logic can assign a diagnostic value score to each modality (e.g., to each available modality for that patient) by combining these factors (e.g., clinical guidelines, image metadata, and / or Al predictions) and then rank the modalities accordingly. The modality with the highest diagnostic value for the specified area can be selected for visualization and / or further analysis.

[0395] At block 404, processing logic processes the one or more datasets to generate, for each of the one or more datasets, one or more tooth portions, wherein each tooth portion comprises an image of one or more teeth of the patient.

[0396] In some embodiments, processing logic can normalize the one or more tooth portions. For example, in some embodiments, processing logic can normalize the one or more tooth portions for a size, a scale, a color balance, a brightness, and / or an orientation for coordinated presentation on the dental chart.

[0397] At block 406, processing logic arranges the one or more tooth portions into a dental chart.

[0398] At block 408, processing logic generates a visualization of the dental chart of the patient. In some embodiments, the visualization can include a first portion displaying a dental arch of the patient in a panoramic format and a second portion displaying the dental arch of the patient in an arch format. An example of such a visualization is described with respect to FIGs. 7A,B.

[0399] In some embodiments, the visualization of the dental chart can include a buccal view, an occlusal view, and / or a lingual view of a dental arch of the patient. An example of the visualization is described with respect to FIG. 6.

[0400] In some embodiments, the visualization of the dental chart displays a dental arch of the patient in a two-dimensional view, a three-dimensional view, and / or a multi-dimensional view.

[0401] In some embodiments, the visualization can include two or more imaging modalities.

[0402] In some embodiments, a first tooth portion of the one or more tooth portions has a first imaging modality and a second tooth portion of the one or more tooth portions has a second imaging modality.Attorney Docket No.: 28510.973 (L0805PCT)

[0403] At block 410, processing logic provide, to a user device (e.g., device 360 of FIG.3), the visualization of the dental chart for presentation in a user interface. In some embodiments, the visualization can correspond to a particular point in time.

[0404] In some embodiments, processing logic can receive, from the user device, a user interaction associated with the visualization of the dental chart. Processing logic can identify, based on the user interact, a second imaging modality of the plurality of imaging modalities. Processing logic can update the visualization of the dental chart of the patient by selecting the one or more tooth portions that each corresponds to the second imaging modality. As an illustrative example, after initially displaying the dental chart using bitewing radiographs as the primary imaging modality, a user (e.g., dental practitioner) may interact with the user interface to select a specific tooth and request an alternative view, such as a near-infrared (NIRI) image ora 3D intraoral scan. Upon receiving this user interaction, the processing logic can identify the corresponding tooth portion units available in the selected secondary modality. In some embodiments, the processing logic can dynamically update the chart visualization by replacing the relevant tooth portion or region with the normalized image data from the NIRI or 3D scan, while maintaining the overall chart layout and anatomical alignment

[0405] In some embodiments, processing logic can process the at least one of the one or more datasets using a trained Al model that outputs one or more detected oral conditions. Processing logic can update the one or more tooth portions to include a representation of the one or more detected oral conditions detected for one or more teeth represented in the one or more tooth portions. For example, processing logic can update a corresponding tooth portion to include indications of the findings. In some embodiments, processing logic can update the corresponding tooth unit visualization within the dental chart to visually indicate the findings, e.g., by overlaying color-coded markers or annotations directly onto the affected regions of the tooth images.

[0406] In some embodiments, the Ul enables a user of the user device to interact with the visualization by focusing in a particular section of a dental arch, changing imaging modalities, and / or changing a point in time. As an illustrative example, a user reviewing a patients dynamic tooth chart can utilize the Ul to zoom in on the lower left quadrant of the dental arch, e.g., where a recent restoration was performed. The Ul can provide interactive controls that allow the user to isolate this region, automaticallyenlarging the relevant tooth portion units and / or suppressing the display of unrelate areas for enhanced clarity. The user can switch the imaging modality, e.g., from a color intraoral scan to a bitewing radiograph, e.g., to assess the integrity of the restoration and / or adjacent interproximal surfaces. As another example, the user can select a previous time point (e.g., the prerestorative state), enabling side-by-side comparison of the affected teeth before and after treatment.Attorney Docket No.: 28510.973 (L0805PCT)

[0407] In some embodiments, processing logic can receive, from the user device, view one or more controls of the III, a modification to a measurement of a tooth of the one or more teeth of the patient. For example, a user can utilize a digital caliper tool within the III to adjust the recorded mesiodistal width of a maxillary central incisor, e.g., based on new clinical findings or updated scan data. Processing logic can generate one or more updated tooth portions to reflect the modification. For example, upon receiving the measurement modification, the processing logic can update the corresponding tooth portion unit to reflect the revised dimension, automatically recalibrating the spatial alignment and scaling of adjacent teeth within the dynamic chart. The processing logic can propagate the change to related clinical records, such as orthodontic treatment plans or prosthetic design files. Processing logic can generate an updated visualization of the dental chart to include the one or more updated tooth portions, and can provide, to the user device, the updated visualization of the dental chart.

[0408] For example, a user may use the III to increase the recorded incisal edge length of a maxillary lateral incisor, reflecting a planned restorative procedure or a correction based on new scan data. Upon receiving a measurement modification, the processing logic can recalculate the geometry of the affected tooth portion unit, and ca update the visualization to depict the new crown height, for example. The processing logic can regenerate the visualization of the dental chart, integrated the updated tooth portion into the overall chart layout while maintaining anatomical alignment and proportional relationships with adjacent teeth. The updated chart can be provided to the user, allowing the userto assess the esthetic ad / or functional impact of the modification from multiple perspectives, such as buccal, lingual, and / or occlusal views.

[0409] In some embodiments, in orthodontic treatment planning, precise measurement and visualization of the proportional relationships between the heights and widths of anterior teeth (e.g., central incisors, lateral incisors, and canines) affect esthetic and functional outcomes. For example, the height-to-width ratio of the maxillary central incisor can be targeted at approximately 80%. As another example, the lateral incisor width can be targeted to be approximately 78% of the central incisor width. The dynamic tooth charting system can enable users to visualize these ratios directly within the chart interface, with real-time overlays or measurement tools that display the current dimensions and proportional relationships of each tooth. Processing logic can provide synchronized, multi-angle visualizations (e.g., buccal, occlusal, and / or lingual views), allowing a userto assess the effects of tooth movements and dimensional changes for all relevant perspectives simultaneously. As the user modifies the position and / or size of a tooth, processing logic can automatically recalculate the ratios and display the updated ratios, highlight deviations from targeted proportions, and / or provide visual cues to guide further adjustments.Attorney Docket No.: 28510.973 (L0805PCT)

[0410] In some embodiments, processing logic can provide, as input, the one or more datasets to an Al model that is trained to provide an indication of a clinical finding corresponding to a particular imaging modality of the plurality of imaging modalities. Processing logic can receive, from the Al model, the indication of the clinical finding corresponding to the particular imaging modality. Processing logic can include the clinical finding in the visualization of the dental chart of the patient. In some embodiments, to include the clinical finding in the visualization of the dental chart, processing logic can determine a second imaging modality of the plurality of imaging modalities other than the particular imaging modality, and can select the one or more tooth portions corresponding to the second imaging modality. In some embodiments, to determine the second imaging modality, processing logic can identify a correlation between the clinical finding and each of the plurality of imaging modalities.Processing logic can rank each of the plurality of imaging modalities according to the correlation, and can determine the second imaging modality as the imaging modality with the highest ranking.

[0411] In some embodiments, processing logic can receive, from at least one Al model, a plurality of indications of a clinical finding. Each indication corresponds to a particular imaging modality of the plurality of imaging modalities. Processing logic can identify a primary imaging modality corresponding to the clinical finding. Processing logic can identify a primary indication of the plurality of indications. The primary indication corresponds to the primary imaging modality. Processing logic can include the primary indication in the visualization of the dental chart of the patient.

[0412] In some embodiments, processing logic can generate an overall indication of the clinical finding by aggregating the plurality of indications of the clinical finding. Processing logic can include the overall indication of the clinical finding in the visualization of the dental arch of the patient.

[0413] As an illustrative example, one indication of a clinical finding can correspond to a first imaging modality. For example, the first imaging modality can indicate a caries associated with a tooth. Another indication corresponding to a second imaging modality may notindicate the carries associated with that tooth (e.g., the tooth is hidden behind an overlapping tooth in a bite wing). To re...

Claims

Attorney Docket No.: 28510.973 (L0805PCT)CLAIMSWhat is claimed is:

1. A method comprising:receiving one or more datasets associated with a patient, wherein each dataset of the one or more datasets comprises data corresponding to an imaging modality of a plurality of imaging modalities and provides information on a dentition of the patient;processing the one or more datasets to generate, for each dataset of the one or more datasets, one or more tooth portions, wherein each tooth portion comprises an image of one or more teeth of the patient;arranging the one or more tooth portions into a dental chart;generating a visualization of the dental chart of the patient; andproviding, to a user device, the visualization of the dental chart for presentation in a user interface (Ul).

2. The method of claim 1 , further comprising:normalizing the one or more tooth portions.

3. The method of claim 2, wherein the one or more tooth portions are normalized for at least one of a size, a scale, a color balance, a brightness, or an orientation for coordinated presentation on the dental chart.

4. The method of claim 1 , further comprising:determining the imaging modality of the plurality of imaging modalities; andselecting the one or more tooth portions corresponding to the determined imaging modality.

5. The method of claim 4, wherein determining the imaging modality comprises:identifying a correlation between a context of a dental visit and each of the plurality of imaging modalities;ranking each of the plurality of imaging modalities according to the correlation; and determining the imaging modality with a highest ranking.Attorney Docket No.: 28510.973 (L0805PCT)6. The method of claim 5, wherein the context of the dental visit corresponds to at least one of a complaint of the patient, an inputof a user of the user device, a treatment plan, a treatment type, a scheduled dental visit, or a detection of a condition.

7. The method of claim 1 , wherein the plurality of imaging modalities comprise at least one of: intraoral scan, near-infrared, cone beam computed tomography (CBCT), photograph, video, radiograph, fluorescence, or optical coherence tomography (OCT).

8. The method of claim 1, wherein the visualization of the dental chart comprises at least one of a buccal view, an occlusal view, or a lingual view of a dental arch of the patient.

9. The method of claim 1 , wherein the visualization of the dental chart displays a dental arch of the patient in at least one of a two-dimensional view, a three-dimensional view, ora multi-dimensional view.

10. The method of claim 1 , wherein the visualization comprises two or more imaging modalities.

11. The method of claim 1 , wherein a first tooth portion of the one or more tooth portions has a first imaging modality and wherein a second tooth portion of the one or more tooth portions has a second imaging modality.

12. The method of claim 1 , further comprising:receiving, from the user device, a user interaction associated with the visualization of the dental chart;identifying, based on the user interaction, a second imaging modality of the plurality of imaging modalities; andupdating the visualization of the dental chart of the patient by selecting the one or more tooth portions that each corresponds to the second imaging modality.

13. The method of claim 1 , further comprising:processing the at least one of the one or more datasets using a trained artificial intelligence (Al) model that outputs one or more detected oral conditions; andupdating the one or more tooth portions to include a representation of the one or more detected oral conditions detected for one or more teeth represented in the one or more tooth portions.Attorney Docket No.: 28510.973 (L0805PCT)14. The method of claim 1, wherein each dataset comprises data from a particular point in time.

15. The method of claim 1 , wherein the visualization corresponds to a particular point in time.

16. The method of claim 1, wherein the III enables a user of the user device to interact with the visualization by at least one of focusing in a particular section of a dental arch, changing imaging modalities, or changing a point in time.

17. The method of claim 1 , further comprising:providing, as input, the one or more datasets to an artificial intelligence model trained to provide an indication of a clinical finding corresponding to a particular imaging modality of the plurality of imaging modalities;receiving, from the artificial intelligence model, the indication of the clinical finding corresponding to the particular imaging modality; andincluding the clinical finding in the visualization of the dental chart of the patient.

18. The method of claim 17, wherein including the clinical finding in the visualization of the dental chart comprises:determining a second imaging modality of the plurality of imaging modalities other than the particular imaging modality; andselecting the one or more tooth portions corresponding to the second imaging modality.

19. The method of claim 18, wherein determining the second imaging modality comprises:identifying a correlation between the clinical finding and each of the plurality of imaging modalities;ranking each of the plurality of imaging modalities according to the correlation; and determining the second imaging modality with a highest ranking.

20. The method of claim 1 , further comprising:receiving, from at least one artificial intelligence model, a plurality of indications of a clinical finding, wherein each indication corresponds to a particular imaging modality of the plurality of imaging modalities.Attorney Docket No.: 28510.973 (L0805PCT)21. The method of claim 20, further comprising:identifying a primary imaging modality corresponding to the clinical finding;identifying a primary indication of the plurality of indications, wherein the primary indication corresponds to the primary imaging modality; andincluding the primary indication in the visualization of the dental chart of the patient.

22. The method of claim 20, further comprising:generating an overall indication of the clinical finding by aggregating the plurality of indications of the clinical finding; andincluding the overall indication of the clinical finding in the visualization of the dental chart of the patient.

23. The method of claim 1 , wherein the data corresponding to the imaging modality comprises image data associated with a plurality of image sources.

24. The method of claim 23, further comprising:providing, as input, the image data associated with the plurality of image sources to an artificial intelligence model trained to provide a confidence score associated with an identified clinical finding for each of the plurality of image sources;receiving, as output from the artificial intelligence model, a plurality of confidence scores associated with a clinical finding for the plurality of image sources;identifying an image source of the plurality of image sources with a highest confidence score; andincluding, in the visualization of the dental chart, the image source with the highest confidence score.

25. The method of claim 1 , wherein the visualization comprises a first portion displaying a dental arch of the patient in a panoramic format and a second portion displaying the dental arch of the patient in an arch format.

26. The method of claim 1 , further comprising:receiving, from the user device, via one or more controls of the III, a modification to a measurement of a tooth of the one or more teeth of the patient;generating one or more updated tooth portions to reflect the modification;Attorney Docket No.: 28510.973 (L0805PCT)generating an updated visualization of the dental chart to include the one or more updated tooth portions; andproviding, to the user device, the updated visualization of the dental chart.

27. A system comprising:a memory; anda processing device to execute instructions from the memory to perform the method of claims 1-26:

28. A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform the method of claims 1-26.

29. A method comprising:receiving scan data comprising at leastone of a three-dimensional (3D) model of a jaw of a patient, one or more two-dimensional (2D) color intraoral images of the patient, or one or more nearinfrared imaging (NIRI) intraoral images of the patient;identifying a subset of the scan data for each tooth of the patient; anddetermining one or more chart annotations for a dental chart of the patient, wherein the one or more chart annotations are determined by at least one of:performing, for each subset of the scan data, a shape analysis to identify a status of the tooth of the patient;performing, for each subset of the scan data, a teeth arrangement analysis to identify a positioning of the tooth of the patient; orperforming, for each subset of the scan data, a material classification to identify a composition of the tooth of the patient.

30. The method of claim 29, wherein identifying the subset of the scan data for each tooth of the patient comprises at leastone of:segmenting the 3D model to generate a series of secondary 3D models, wherein each secondary 3D model in the series of secondary 3D models corresponds to a tooth of the patient;identifying a portion of the one or more 2D color intraoral images corresponding to the tooth of the patient; oridentifying a portion of the one or more NIRI intraoral images corresponding to the tooth of the patient.Attorney Docket No.: 28510.973 (L0805PCT)31. The method of claim 30, wherein performing the teeth arrangement analysis comprises: generating, based on the 3D model, a jaw line reference curve for the patient; identifying, based on segmentation data of the secondary 3D model, a location of the tooth; making a comparison of the location of the tooth to the jaw line reference curve; and determining, based on the comparison, the positioning of the tooth, wherein the positioning comprises one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

32. The method of claim 30, further comprising:comparing a first secondary 3D model corresponding to a first tooth of the patient to a second secondary 3D model corresponding to a second tooth of the patient, wherein the second tooth is symmetrically opposite the first tooth in the jaw of the patient;determining, based on the comparison, an asymmetry metric representing a dissimilarity between the first tooth and the second tooth; andadding the asymmetry metric to at least one of the subset of the scan data for the first tooth or the subset of the scan data for the second tooth.

33. The method of claim 32, further comprising:responsive to determining that the asymmetry metric satisfies a condition, performing an error recovery operation corresponding to the dissimilarity between the first tooth and the second tooth.

34. The method of claim 29, further comprising:providing, to a user device, the one or more chart annotations to include in the dental chart of the patient; andproviding the one or more chart annotations to a dental practice management system.

35. The method of claim 29, wherein performing the shape analysis comprises:providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.Attorney Docket No.: 28510.973 (L0805PCT)36. The method of claim 29, wherein performing the shape analysis comprises:providing the subset of the scan data as input to a machine learning model, wherein the machine learning model is trained to provide, as output, at least one of a tooth identification, an outlier shape, or one or more indicators of dental accessories; andreceiving, as output from the machine learning model, at least one of the tooth identifications, the outlier shape, or the one or more indicators of dental accessories.

37. The method of claim 36, further comprising:providing at least one of the tooth identification or the outlier shape to a classifier, wherein the classifier outputs one or more indicators of the status of the tooth, the one or more indicators comprising at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, or a partially hatched tooth indicator.

38. The method of claim 36, further comprising:providing the one or more indicators of dental accessories as input to a second machine learning model, wherein the second machine learning model outputs one or more additional indicators comprising at least one of a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

39. The method of claim 29, wherein performing the material classification comprises:providing the subset of the scan data as input to a machine learning model, wherein the machine learning model outputs a classification of at least one of a partial restoration, a veneer, an inlay, an only, an overlay, a filling, a full restoration crown, ora bridge.

40. The method of claim 39, further comprising:segmenting the classification of the at least one of the partial restoration, the veneer, the inlay, the only, the overlay, the filling, the full restoration crown, or the bridge from the corresponding tooth, wherein the segmentation provides at least one of a location or a size corresponding to the classification of the at least one of the partial restoration, the veneer, the inlay, the only, the overlay, the filling, the full restoration crown, or the bridge.

41. The method of claim 29, further comprising:providing the one or more chart annotations to a diagnostic system, wherein an outcome of the diagnostic system comprises the one or more chart annotations.Attorney Docket No.: 28510.973 (L0805PCT)42. The method of claim 29, further comprising:identifying, for the tooth of the patient, a caries indication identified by a caries diagnostic system; andresponsive to determining that the one or more chart annotations for the tooth of the patient satisfies a caries condition, providing an updated caries identification to the caries diagnostic system.

43. The method of claim 29, further comprising:responsive to identifying, based on the one or more chart annotations, that the tooth is a restoration, providing an indication of the restoration to a timelapse diagnostic system.

44. The method of claim 29, further comprising:responsive to identifying, based on the one or more chart annotations, that the patient is in active orthodontic treatment, providing an indication of the active orthodontic treatment to a timelapse diagnostic system.

45. The method of claim 29, further comprising:responsive to identifying, based on the one or more chart annotations, that the tooth is an implant, providing an indication of the implant to a tooth strength assessment system.

46. The method of claim 29, further comprising:determining an orthodontic treatment plan for the patient, wherein the orthodontic treatment plan comprises a first location of a dental attachment forthe tooth of the patient;identifying, based on the one or more chart annotations, a second location of the dental attachment for the tooth of the patient; andresponsive to determining that the first location and the second location differ, providing, to a user device, an indication of a displacement of the dental attachment.

47. The method of claim 29, further comprising:validating a first set of the one or more chart annotations corresponding to a first scan of the patient taken at a first point in time by comparing the first set of the one or more chart annotations to a second set of chart annotations corresponding to a second scan of the patient taken at a second point in time, wherein the second point in time predates the first point in time.Attorney Docket No.: 28510.973 (L0805PCT)48. The method of claim 29, further comprising:receiving second scan data comprising one or more geometrical connections between the 3D model and the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images;responsive to segmenting the 3D model, projecting segmentation results onto the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images;responsive to performing the shape analysis, mapping the status of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images;responsive to performing the teeth arrangement analysis, mapping the positioning of the tooth to the at least one of the one or more 2D color intraoral images or the one or more NIRI intraoral images; andresponsive to performing the material classification, mapping the composition of the tooth the 3D model.

49. The method of claim 29, wherein determining the one or more chart annotations for the dental chart of the patient comprises:providing atleastone of a secondary 3D model corresponding to the tooth of the patient, the one or more two-dimensional (2D) color intraoral images, or the one or more near-infrared imaging (NIRI) intraoral images as input to a machine learning model, wherein the machine learning model outputs one or more chart annotation indicators, wherein the one or more chart annotation indicators correspond to at least one of a status indicator, a positioning indicator, or a composition indicator.

50. The method of claim 49, wherein the status indicator represents at least one of a tooth number indicator, a primary tooth indicator, an abutment indicator, a scan-body indicator, a preparation tooth indicator, a partially hatched tooth indicator, a bracket indicator, an attachment indicator, a retainer indicator, or a braces indicator.

51. The method of claim 49, wherein the positioning indicator reflects one of a regular positioning, an irregular positioning, or an indication of a missing tooth.

52. The method of claim 49, wherein the composition indicator reflects at least one of a partial restoration, a veneer, an inlay, an only, an overlay, a filling, a full restoration crown, or a bridge.Attorney Docket No.: 28510.973 (L0805PCT)53. A system comprising:a memory; anda processing device to execute instructions from the memory to perform the method of claims 29-52.

54. A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform the method of claims 29-42.

Images