Method for comparing digital 3D dental models in mobile applications

Abstract

Disclosed is a computer-implemented method for comparing digital 3D dental models of a patient's oral condition in a user interface of a mobile application, the method comprising: receiving, in a user interface of a mobile application, a selection of a dental condition of at least two dental conditions, displaying buttons representing digital 3D dental models available for comparison, wherein the buttons comprise a first button and a second button, the first button being associated with a first digital 3D dental model representing a patient's oral condition at a first point in time, the second button being associated with a second digital 3D dental model representing a patient's oral condition at a second point in time. The method further comprises: receiving, in the user interface, a selection of the first button, and in response, displaying, in the user interface, the first digital 3D dental model such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first point in time.

Description

Technical Field

[0001] This invention relates to a computer-implemented method for comparing a digital 3D dental model of a patient's oral condition within a mobile application's user interface and a corresponding user interface. Furthermore, this invention relates to a computer-implemented method for comparing a digital 3D dental model of a patient's oral condition with the user's oral condition and a corresponding user interface within a mobile application's user interface. This invention also relates to a computer-implemented method and system for determining a patient's individual dental profile based on diagnostic intraoral scan data of the patient's oral condition. Specifically, the individual dental profile is generated by a mobile application that provides filtered, specific patient metadata based on the individual dental profile. Background Technology

[0002] The development of intraoral scanning technology has facilitated the transition to modern digital dentistry. Using an intraoral 3D scanner allows dentists to accurately and quickly capture scan data representing the condition of a patient's oral cavity. This scan data can then be visualized on a display device as a digital three-dimensional (3D) dental model. Therefore, the resulting digital 3D dental model can be used as a digital impression of the teeth, offering numerous advantages compared to classic physical impressions.

[0003] Various algorithms can be used to analyze the obtained scan data and / or corresponding digital 3D models to detect common dental conditions such as cavities, tooth wear, plaque, gingival recession, and similar issues. However, the results obtained from these powerful diagnostic tools are not currently available to patients. Therefore, patients with these conditions often lack in-depth knowledge of their diagnostic data and may only be aware of limited information conveyed by their dentist.

[0004] Therefore, the challenge is to create solutions that share patient-specific diagnostic information, educate patients about their dental health, provide care guidance, and enhance treatment acceptance and overall effectiveness to increase patient engagement with their dental health.

[0005] This disclosure relates to methods, systems, mobile applications, and graphical user interfaces (GUIs) for developing methods to provide patients with diagnostic overviews of various dental conditions and to track changes in dental conditions over time. Furthermore, this disclosure relates to developing and providing personalized oral care guidance for patients while promoting self-reporting of dental problems. Additionally, this invention relates to improving the overall interaction between dentists and patients, such as appointment scheduling, provision and selection of appropriate dental treatments, etc. Summary of the Invention

[0006] In one embodiment, a computer-implemented method is described, the method comprising:

[0007] - A mobile application receives diagnostic intraoral scan data of a patient's oral condition, wherein the diagnostic intraoral scan data includes a digital 3D dental model of the patient's oral condition, quantitative data associated with the patient's oral condition for at least two dental conditions, qualitative data for at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein, when the mesh overlay is applied to the digital 3D dental model, the mesh overlay is configured to visualize the quantitative data and the qualitative data on the digital 3D dental model.

[0008] - The mobile application generates an individual dental profile for the patient based on the quantitative and qualitative data.

[0009] - Metadata associated with the at least two dental conditions is obtained from the mobile application, wherein the metadata is filtered based on the individual dental profile.

[0010] - Displays a digital 3D tooth model with applied mesh overlay in the mobile app's user interface, and further displays metadata.

[0011] The mobile application can be a specially designed mobile application used to generate and present dental health status to the users of the mobile application.

[0012] Throughout this disclosure, the term "3D" refers to the term "three-dimensional". The term "digital 3D dental model" refers to a digital, three-dimensional, computer-generated representation of a patient's oral cavity.

[0013] This digital 3D dental model can accurately correspond to a patient's actual dental condition. This means that dental objects such as teeth, tooth surfaces, restorations, and / or gums in a digital 3D dental model can correspond to those dental objects that correspond to a patient's dental condition.

[0014] A digital 3D dental model can be constructed by a processor based on scan data collected during an intraoral scan (also known as intraoral scan data), during which an intraoral 3D scanner can be used to scan the patient's oral cavity, including teeth and gums. Throughout this invention, the intraoral 3D scanner is also referred to as an intraoral scanner. The digital 3D dental model can be stored in the memory of a computer system, for example in Standard Triangle Language (STL) format or any other format suitable for viewing and / or printing 3D objects.

[0015] The scan data can include different types of data acquired by an intraoral scanner, such as one or more of the following: 3D geometric data, color data, infrared (IR) data, and fluorescence data.

[0016] A digital 3D dental model can be received or accessed by a processor. The digital 3D dental model can typically be displayed on a screen as a 3D mesh, representing the surfaces of teeth and gingival tissue in an oral cavity. The 3D mesh can consist of individual facets, such as triangular facets, and each facet can include, for example, three interconnected vertices. Alternatively, the digital 3D dental model can be displayed as a point cloud including points, a graph including nodes and edges, a volumetric representation including voxels, or any other suitable 3D representation.

[0017] Diagnostic intraoral scan data of a patient's oral condition can be obtained by processing the scan data to identify the presence of dental diseases. For example, the scan data can be processed by a diagnostic algorithm capable of detecting dental diseases within the scan data. The diagnostic algorithm can be, for example, a trained machine learning (ML) algorithm comprising one or more neural networks trained for detecting dental diseases. Alternatively, the diagnostic algorithm can be a classical algorithm (non-ML algorithm) based on predefined rules.

[0018] The at least two dental conditions can be at least two of the following: dental caries, tooth wear, dental plaque, gingival recession, gingivitis, periodontitis, and cracked teeth. In some embodiments, the mobile application may provide information about only a single dental condition, rather than using at least two dental conditions.

[0019] Diagnostic intraoral scan data may include quantitative data on at least two dental conditions associated with the patient's oral condition. Quantitative data may include the number of teeth affected for each of the at least two dental conditions in the patient's oral condition. If the dental condition is plaque, the number of affected teeth may be a percentage of the total tooth surface area. On the other hand, qualitative data may include a severity value for each of the at least two dental conditions in the patient's oral condition. Severity values ​​may be defined for individual teeth and / or gingiva in a digital 3D dental model.

[0020] Therefore, quantitative data on dental conditions can indicate the number of teeth affected by that specific condition or the percentage of the total tooth surface affected. For example, quantitative data on caries could indicate that eight teeth are affected, but it doesn't provide information on how severe those caries will be. In another example, quantitative data on plaque could indicate that 35% of the total tooth surface is affected by plaque. Tooth surfaces can be occlusal surfaces, lingual surfaces, buccal surfaces, medial surfaces, and / or distal surfaces.

[0021] Diagnostic intraoral scan data can include qualitative data for at least two dental conditions. Qualitative data for a dental condition can indicate its severity level. For example, in eight teeth affected by caries, two teeth may be considered to have initial caries, five to have moderate caries, and one to have severe caries. Similar severity levels (“initial,” “moderate,” “severe”) can be applied to other dental conditions. For plaque, severity levels can be “thin plaque” and “thick plaque.” Overall, the severity level can correspond to the clinically used severity levels for various dental conditions.

[0022] Diagnostic intraoral scan data may additionally include mesh overlays for each of at least two dental conditions, wherein the mesh overlays are configured to visualize quantitative and qualitative data on the digital 3D dental model when applied. Therefore, the mesh overlay can be a 3D color overlay applicable to the surface of the digital 3D dental model. The color of the mesh overlay can indicate the portion of the digital 3D dental model affected by the dental condition and the severity level of that condition. For example, colors such as yellow, orange, and red can be used to highlight different severity levels of the dental condition. In addition to using color, the mesh overlay can use patterns or various textures to represent different severity levels.

[0023] The method according to the invention may include generating an individual dental profile for a patient using a mobile application based on quantitative and qualitative data. The individual dental profile generated in this manner reflects the patient's dental health at a specific time. The generation of the individual dental profile enables the subsequent creation of personalized care plans tailored to the patient's dental health.

[0024] Generating an individual dental profile may include determining a representative severity value for each of at least two dental conditions. Thus, representative severity values ​​can be determined for at least two of caries, tooth wear, plaque, gingival recession, gingivitis, periodontitis, and cracked teeth. An individual dental profile in this manner clearly defines the dental health status of a patient relative to at least two dental conditions. In one example, the representative severity value for each of the at least two dental conditions may be calculated as a weighted average of quantitative and qualitative data for each of the at least two dental conditions. The individual dental profile may then include, or may be determined as a function of the representative severity value for each of the at least two dental conditions.

[0025] This method may also include displaying an individual dental profile within the user interface of a mobile application. The individual dental profile can be displayed as a single tooth score, which may be numerical. The tooth score can be determined as a function of representative severity values ​​for at least two dental conditions, such as a weighted average, taking the maximum of the representative severity values, taking the majority of the representative severity values, etc. Displaying the individual dental profile as an individual tooth score is advantageous because it conveys the overall state of dental health to the user in the form of a single value.

[0026] In one embodiment, a dental score can be determined based on data collected from other users of the mobile application. This data may include individual dental profiles of those other users. In this way, the dental score can indicate to the patient's dental health relative to other patients, such as those in the same geographic area and / or of similar age, for example, an age difference of 2 or 3 years.

[0027] Throughout this disclosure, the term "user interface" may refer to the graphical user interface (GUI) of a mobile application.

[0028] The method may also include obtaining ranked dental conditions by ranking at least two dental conditions based on quantitative and / or qualitative data. Alternatively, ranked dental conditions can be obtained by ranking at least two dental conditions based on representative severity values ​​of the at least two dental conditions. Obtaining ranked dental conditions is advantageous because this information can then be displayed to users of the mobile application, for example, as an ordered list. This is particularly advantageous given the limited area available for displaying information on the screen of a mobile phone hosting the mobile application, where the ranking of dental conditions can be an efficient way to present the relative severity relationship of at least two dental conditions. Thus, a complete overview of the dental conditions can be provided, allowing users to easily identify and focus first on the most severe dental condition. The most severe dental condition is likely to have the highest representative severity value and may be ranked first in the list.

[0029] In one embodiment, the ranked dental conditions can be obtained by ranking at least two dental conditions over time based on changes in quantitative and / or qualitative data for each of the at least two dental conditions. Therefore, dental conditions with greater deterioration will be ranked higher compared to those with less change.

[0030] The ranked dental conditions can be displayed in the user interface of a mobile application. Typically, the mobile application can be hosted on a mobile device such as a smartphone or tablet. The highest-ranked dental condition in the ranked list can be the condition with the highest representative severity value. In addition to the ranked dental conditions, digital 3D dental models can be displayed.

[0031] For example, the displayed digital 3D dental model may include an applied mesh overlay highlighting the highest-ranked dental condition among the ranked dental conditions. Thus, the mesh overlay may correspond to qualitative and / or quantitative data associated with the highest-ranked dental condition. In this way, a visual representation of the most severe dental condition is presented to the user. The mesh overlay may be updated based on the user's selection of dental conditions rather than the highest-ranked condition to visualize the selected condition.

[0032] The displayed digital 3D dental model with applied mesh overlay can indicate portions of the digital 3D dental model affected by the highest-ranked dental condition or other selected dental conditions. This can be achieved by applying various colors, patterns, and / or textures within the mesh overlay to represent the location and / or severity level of the highest-ranked dental condition.

[0033] In one embodiment, the displayed metadata may correspond to the highest-ranked dental condition among the ranked dental conditions. In an example where the highest-ranked dental condition is plaque, the metadata may include information about the presence of plaque in the patient's oral condition. Generally, the metadata may include descriptive information for the at least two dental conditions and / or personalized care plans for each of the at least two dental conditions. Personalized care plans may include (depending on the individual dental profile) statements such as "Attention!", "Keep an eye on it!", "No worries!", or similar phrases. Additionally, personalized care plans may include actionable recommendations, such as, in the plaque example, changes in brushing technique, increased flossing frequency, visits to the dentist, etc. These are merely non-limiting examples. The metadata and personalized care plans may be specific to the dental condition and also specific to the individual dental profile.

[0034] The method may also include receiving a user's selection of dental conditions other than the highest-ranked condition, and updating the applied mesh overlay to visualize the selected dental condition in the digital 3D dental model. In addition to updating the mesh overlay, the displayed metadata may also be updated to reflect the selected dental condition. In this way, the user can receive metadata with a personalized care plan specific to the selected dental condition.

[0035] This method may also include updating metadata so that the displayed metadata corresponds to the selected dental condition. Metadata can be obtained from official clinical sources such as the World Health Organization (WHO), the American Dental Association (ADA), and the National Health Service (NHS). Therefore, official clinical sources can be local, regional, national, or global health organizations addressing human dental health issues.

[0036] To maximize the positive impact of mobile applications on users, it is particularly important to generate metadata tailored to individual dental profiles. Therefore, this method may also include filtering metadata obtained from official clinical sources by identifying correspondences between metadata and individual dental profiles. The term "curating" can refer to the purposeful selection and organization of metadata to present to the user. Correspondences in this paper can refer to the correspondence between a representative severity value for a dental condition and metadata associated with that representative severity value. As a result, only information relevant to the patient's actual dental health is obtained from official clinical sources. For example, if the representative severity value for dental plaque is "moderate," only information relevant to that specific condition is sought. Alternatively or additionally, metadata can be filtered based on qualitative and / or quantitative data from diagnostic intraoral scans.

[0037] The method may include receiving a user selection for a first dental condition among the at least two dental conditions in the user interface, and updating the user interface to display metadata associated with the first dental condition. Furthermore, the method may include receiving a user selection for a second dental condition among the at least two dental conditions, updating a displayed digital 3D dental model with a corresponding mesh overlay to visualize the second dental condition in the digital 3D dental model, and updating the user interface to display metadata associated with the second dental condition. The user selection may be registered as a swipe movement on the display screen of a mobile phone hosting the mobile application. In this way, dental conditions with associated metadata can be presented as cards in the user interface, which can be navigated by the user through swipe movements.

[0038] In one embodiment, the method may further include annotating diagnostic intraoral scan data with patient demographics. Demographics may include age, sex, ethnicity, education, and / or marital status. This data may be incorporated into an individual dental profile. Therefore, the method may further include updating the individual dental profile with patient demographics. This allows for characterizing patients within a group or subgroup of an individual based on demographic data, such as categorizing patients within a specific age group.

[0039] The method may also include benchmarking updated individual dental profiles based on at least a portion of demographic data. For example, representative severity levels of at least two dental conditions in a patient may be benchmarked against severity levels within the same or similar age group, country, sex, nationality, etc.

[0040] In this example, the benchmarking of an updated individual dental profile can be achieved as follows: The patient's diagnostic intraoral scan data can be stored in a diagnostic database along with diagnostic intraoral scan data from multiple other patients. This data may be anonymized and unavailable for benchmarking unless the patient consents to provide their corresponding demographic data. After user input, the mobile application can provide demographic data to the diagnostic database. The demographic data can be correlated with the patient's diagnostic intraoral scan data. Following this correlation, sufficient information is available to benchmark the patient's individual dental profile against individual dental profiles from multiple other patients.

[0041] The method according to the invention may further include receiving an external signal by a mobile application and, based on the received external signal, deleting quantitative and / or qualitative data for at least one of at least two dental conditions. The external signal may originate from a dentist, for example, when it is assessed that sending certain quantitative and / or qualitative data is unnecessary for the user. For example, if the same severity is constant over a defined time period and tooth wear does not worsen, it may be unnecessary to send information about the severity of tooth wear. The effect of this feature is that an external party (e.g., a dentist) may influence the metadata content presented to the user of the mobile application. Instead of deleting quantitative and / or qualitative data, this data can be removed from what is displayed to the user. The effect of this feature is that the dentist may influence what information is ultimately displayed to the user.

[0042] In one example, the method may further include updating the user interface using a request for user input on dental habits, receiving user input on dental habits, and generating a recommended dental care plan based on the user input on dental habits and / or an individual dental profile. The request for user input on dental habits may take the form of a questionnaire. Dental habits may relate to brushing frequency, flossing, toothbrush type, mouthwash product use, frequency of dental visits, etc. In one example, the recommended dental care plan may be generated based solely on user input on dental habits or solely on an individual dental profile. In a favorable example, the recommended dental care plan may be generated based on both user input on dental habits and an individual dental profile. By considering user input on dental habits, the root cause of at least two dental conditions can be revealed. Recommended dental care plans can be displayed in the user interface for each of the at least two dental conditions. The recommended dental care plan may also be referred to as a personalized care plan for the user. This plan may include feasible suggestions for treating or preventing dental conditions. Generating the recommended dental care plan may include access to official clinical sources. Actionable recommendations can be generated by accessing official clinical sources and retrieving information related to dental diseases.

[0043] In one embodiment, the method may further include updating the individual dental profile based on user input regarding dental habits. In this way, users can directly contribute to the development of their individual dental profiles.

[0044] In one example, a button could be used to display recommended dental care options, which, upon engagement, initiates a conversation with the dentist, such as opening a chat communication mode. In this way, the user gains direct communication access with their dentist.

[0045] This method may additionally or alternatively include receiving user input about dental symptoms and updating an individual's dental profile based on the received user input. Dental symptoms may include toothache, jaw pain, bleeding, etc. Based on the received user input about dental symptoms, metadata and / or recommended dental care plans may be updated.

[0046] The present invention also discloses a data processing apparatus, including means for performing a method, the method comprising:

[0047] - A mobile application receives diagnostic intraoral scan data of a patient's oral condition, wherein the diagnostic intraoral scan data includes a digital 3D dental model of the patient's oral condition, quantitative data associated with the patient's oral condition for at least two dental conditions, qualitative data for the at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein when the mesh overlay is applied to the digital 3D dental model, the mesh overlay is configured to visualize the quantitative data and the qualitative data on the digital 3D dental model;

[0048] - The mobile application generates an individual dental profile for the patient based on the quantitative and qualitative data;

[0049] - Obtain metadata associated with the at least two dental conditions from the mobile application, wherein the metadata is filtered based on the individual dental profile;

[0050] - The mobile application's user interface displays a digital 3D tooth model with applied mesh coverage, and further displays metadata.

[0051] A computer program product including instructions is also disclosed, which, when executed by a processor, cause the processor to perform a method, the method comprising:

[0052] - A mobile application receives diagnostic intraoral scan data of a patient's oral condition, wherein the diagnostic intraoral scan data includes a digital 3D dental model of the patient's oral condition, quantitative data associated with the patient's oral condition for at least two dental conditions, qualitative data for the at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein when the mesh overlay is applied to the digital 3D dental model, the mesh overlay is configured to visualize the quantitative data and the qualitative data on the digital 3D dental model;

[0053] - The mobile application generates an individual dental profile for the patient based on the quantitative and qualitative data;

[0054] - Obtain metadata associated with the at least two dental conditions from the mobile application, wherein the metadata is filtered based on the individual dental profile;

[0055] - The mobile application's user interface displays a digital 3D tooth model with applied mesh coverage, and further displays metadata.

[0056] A computer-readable medium comprising instructions, which, when executed by a processor, cause the processor to perform the method according to the invention. The computer-readable medium may be a non-transitory computer-readable medium. The method may include:

[0057] - A mobile application receives diagnostic intraoral scan data of a patient's oral condition, wherein the diagnostic intraoral scan data includes a digital 3D dental model of the patient's oral condition, quantitative data associated with the patient's oral condition for at least two dental conditions, qualitative data for the at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein when the mesh overlay is applied to the digital 3D dental model, the mesh overlay is configured to visualize the quantitative data and the qualitative data on the digital 3D dental model;

[0058] - The mobile application generates an individual dental profile for the patient based on the quantitative and qualitative data;

[0059] - Obtain metadata associated with the at least two dental conditions from the mobile application, wherein the metadata is filtered based on the individual dental profile;

[0060] - The mobile application's user interface displays a digital 3D tooth model with applied mesh coverage, and further displays metadata.

[0061] In one embodiment, a system is disclosed, the system comprising:

[0062] - Mobile applications;

[0063] - Content Management System;

[0064] - A diagnostic module configured to generate diagnostic intraoral scan data for the patient, wherein the mobile application is configured to:

[0065] - Receive diagnostic intraoral scan data of the patient, including a digital 3D dental model, from the diagnostic module;

[0066] - Generate an individual dental profile for the patient based on diagnostic intraoral scan data;

[0067] - Obtain metadata based on the individual dental profile from the content management system;

[0068] - The digital 3D tooth model and the metadata are displayed in the user interface of the mobile application.

[0069] A content management system can represent a system entity responsible for generating specific information content packages for mobile applications, as well as for delivering these content packages and updates to the mobile applications.

[0070] The content management system can be configured to provide time-delayed metadata to mobile applications. The time delay can be selected to correspond to a treatment plan that may be included in the metadata. Alternatively or additionally, this time delay can be determined based on an individual dental profile.

[0071] Content management systems can be configured to instruct mobile applications to request user input on dental habits and / or dental symptoms. Content management systems can also be configured to filter metadata before providing it to the mobile application. This filtering of metadata can be performed by accessing official clinical sources.

[0072] The diagnostic module may process a patient's intraoral scan data and generate diagnostic intraoral scan data indicating the presence and / or severity of at least two dental conditions. The diagnostic intraoral scan data may include a digital 3D dental model of the patient's oral condition, quantitative data of at least two dental conditions associated with the patient's oral condition, qualitative data of at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein the mesh overlay is configured to visualize the quantitative and qualitative data on the digital 3D dental model when applied.

[0073] The diagnostic module can be configured to compress the digital 3D dental model before sending it to the mobile application. In this way, the mobile application can process smaller 3D data files, thereby improving processing speed. Alternatively, the mobile application can be configured to compress the digital 3D dental model before storing it in the memory of the mobile device hosting the mobile application.

[0074] In one embodiment, a computer-implemented method is disclosed for comparing digital 3D dental models of a patient's oral condition in a user interface of a mobile application, the method comprising:

[0075] - Receive a selection of dental conditions from at least two dental conditions in the user interface of the mobile application;

[0076] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0077] - Receive the selection of the first button in the user interface, and in response, display the first digital 3D dental model in the user interface, so that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first time point;

[0078] - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, a transition from the first digital 3D dental model to the second digital 3D dental model is displayed, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

[0079] The proposed method for comparing digital 3D dental models of patients' oral conditions within the user interface of a mobile application is advantageous because it addresses the problem of arranging and presenting comparisons of digital 3D dental models on a mobile phone. Considering the limited touchscreen area of ​​a mobile phone hosting the application, the proposed solution effectively guides the user through the process of selecting and presenting the digital 3D dental models for comparison.

[0080] The mobile application and user interface involved in the method for comparing digital 3D dental models of patients’ oral conditions may be the same as those described throughout this disclosure and the same as those mentioned in relation to other methods herein.

[0081] For the purpose of comparing digital 3D dental models, the described embodiments of comparing digital 3D dental models of patients' oral conditions describe the use of drag commands on the touchscreen of a mobile device hosting a mobile application. Comparing various digital 3D dental models from users at different times is relevant for users to visualize dental conditions changing over time. The method of this disclosure economically and effectively utilizes the limited surface of a touchscreen and provides a time-efficient way to compare digital 3D dental models.

[0082] The conversion from a first digital 3D tooth model to a second digital 3D tooth model may include deforming the first digital 3D tooth model into the second digital 3D tooth model. Deformation can be understood as the transformation of 3D geometry from one shape to another, such as a geometric transformation describing the transformation from a vertex of the first digital 3D tooth model to a corresponding vertex of the second digital 3D tooth model. Alternatively, the conversion from the first digital 3D tooth model to the second digital 3D tooth model may include adjusting the transparency level of the first digital 3D tooth model to reduce its visibility, and adjusting the transparency level of the second digital 3D tooth model to increase its visibility. This transparency adjustment can be performed simultaneously, allowing the user to perceive a seamless change in the 3D geometry.

[0083] The conversion from the first digital 3D dental model to the second digital 3D dental model can highlight the differences between the first and second digital 3D dental models, where the differences correspond to variations in the selected dental condition.

[0084] The comparison mode can be active during user drag commands. Once the user releases the touchscreen, the drag command stops and can exit comparison mode. Once exiting comparison mode, the display can show a transition back to the first digital 3D tooth model. Therefore, the method can include detecting the cessation of the drag command and, in response, displaying a transition from the second digital 3D tooth model to the first digital 3D tooth model.

[0085] During comparison mode, a first and / or second digital 3D tooth model can be displayed with the jaw closed. Based on receiving user input (e.g., via a dedicated button in the user interface), the first and / or second digital 3D tooth model can be displayed in an occlusal view (i.e., the jaw of the digital 3D tooth model can be open).

[0086] During comparison mode and during the display of the second digital 3D tooth model, the second digital 3D tooth model can be rotated so that the differences between the first and second digital 3D tooth models are visible in the user's field of view. Because multiple differences may exist between the two digital 3D models, the difference specified for display can be the difference with the highest severity value and / or surface area.

[0087] The first and second digital 3D tooth models can be stored on the memory of the mobile device hosting the mobile application, or alternatively on remote memory outside the mobile device, in which case the mobile application is configured to access the digital 3D tooth models.

[0088] In addition, a user interface for a mobile application used to track a patient's dental health is disclosed, the user interface including:

[0089] - A button representing a digital 3D dental model that can be used for comparison, wherein the button representing the digital 3D dental model includes a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point, wherein the user interface is configured to display the first digital 3D dental model based on the user's selection of the first button;

[0090] - A comparison button, wherein the user interface is configured to initiate a comparison mode of the mobile application by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, displaying a conversion from the first digital 3D tooth model to the second digital 3D tooth model.

[0091] The user interface may also include buttons representing dental conditions, wherein the user interface is configured to visualize dental conditions on a first or second digital 3D dental model based on user selection of the buttons representing dental conditions. This feature provides users with the option to select the dental conditions they wish to visualize on the displayed digital 3D dental model.

[0092] Dental conditions can be visualized as surface color overlays, or as patterns or texture overlays.

[0093] The user interface can be configured to display the transformation from a first digital 3D tooth model to a second digital 3D tooth model, which can be a geometric deformation from the first digital 3D tooth model to the second digital 3D tooth model.

[0094] A data processing apparatus is also disclosed, including means for performing a method comprising:

[0095] - Receive selection of dental condition among the at least two dental conditions in the user interface of the mobile application;

[0096] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0097] - Receive the selection of the first button in the user interface, and in response, display the first digital 3D dental model in the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition at the first time point;

[0098] - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, a transition from the first digital 3D dental model to the second digital 3D dental model is displayed, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

[0099] A computer program product including instructions is also disclosed, which, when executed by a processor, causes the processor to perform a method comprising the following steps:

[0100] - Receive a selection of dental conditions from at least two dental conditions in the user interface of the mobile application;

[0101] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0102] - Receive the selection of the first button in the user interface, and in response, display the first digital 3D dental model in the user interface, so that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first time point;

[0103] - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, a transition from the first digital 3D dental model to the second digital 3D dental model is displayed, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

[0104] A computer-readable medium comprising instructions is also disclosed, which, when executed by a processor, causes the processor to perform a method comprising the following steps:

[0105] - Receive a selection of dental conditions from at least two dental conditions in the user interface of the mobile application;

[0106] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0107] - Receive the selection of the first button in the user interface, and in response, display the first digital 3D dental model in the user interface, so that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first time point;

[0108] - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, a transition from the first digital 3D dental model to the second digital 3D dental model is displayed, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

[0109] After a user receives and checks the status of a dental condition in a mobile application, the user may want to simultaneously observe their actual oral condition in order to attempt to detect the dental condition visualized in the mobile application. In one embodiment, the present invention provides a computer-implemented method for comparing a digital 3D dental model of a patient's oral condition with the user's oral condition in the user interface of a mobile application, the method comprising:

[0110] - Receive selection of dental conditions from at least two dental conditions in the user interface; and display buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0111] - Receive a selection of a first button in the user interface, and in response, display a first digital 3D dental model in a first area of ​​the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to a first time point;

[0112] - A camera button is arranged in the user interface, the camera button being configured to activate the front camera of the mobile device used to host the mobile application when engaged;

[0113] - The user detects engagement of the camera button, and in response, activates the front camera;

[0114] - A camera stream from the front camera is displayed in a second area of ​​the user interface, so that when the user is facing the front camera, the user's dental condition can be compared with a first digital 3D dental model.

[0115] Users can view their actual oral condition and a digital 3D model of the displayed related dental problems in this way. This presents a unique solution for users to simultaneously observe detected dental problems and their actual oral condition.

[0116] The mobile application and user interface involved in the method for comparing a digital 3D dental model of a patient's oral condition with the user's actual oral condition can be the same as those described throughout the invention and with respect to other methods mentioned herein. The terms "user" and "patient" are used interchangeably throughout the disclosure, as the user of the mobile application is also a patient presenting with their specific dental diagnostic data.

[0117] There are several ways to arrange the first and second regions in the user interface. The first region can be above the second region in the user interface. In another example, the first region can be below the second region in the user interface. In yet another example, the first and second regions can be arranged adjacent to each other in the user interface. The first and second regions can be arranged so that they do not overlap in the user interface. Generally, the first and second regions are used to represent different parts of the user interface. For example, within a specific graphical element of the user interface, these regions can be explicitly or implicitly distinguished.

[0118] The method may further include detecting, in a second region, a region of the user's oral condition corresponding to a portion of the first digital 3D dental model affected by a selected dental condition, and highlighting the region of the user's oral condition visualized in the second region. In this way, within the camera stream, the affected portion of the user's oral condition is clearly distinguished from the rest of the user's oral condition.

[0119] Highlighting the area may include applying color overlays and / or bounding boxes to the area of ​​the user's dental condition that is visualized in the second area.

[0120] The method in this embodiment may include identifying objects in a video stream that correspond to objects in a first digital 3D dental model. Identifiable objects may be individual teeth, gums, dental landmarks such as edges, cusps, grooves, and / or dental conditions.

[0121] The first and / or second digital 3D dental models can be segmented by the diagnostic module before being received by the mobile application. This means that objects such as teeth, gums, and dental conditions have already been identified when the mobile application executes the disclosed methods.

[0122] The regions within the second area of ​​the user interface can include an applied neural network trained to automatically label frames from the camera stream to dental conditions and / or other objects such as teeth or gums. In this case, the neural network could be a region-based convolutional neural network (R-CNN) capable of labeling frames from the video stream. This neural network could be trained, for example, by an expert dentist based on training data including images of dental objects with artificial labels. In one example, the training data could include more than 1000 labeled images. The artificial labels can be used as ground truth data to compare with the output of the neural network. The training process can be an iterative process in which a loss function is minimized to minimize the difference between the output of the neural network and the ground truth. During the training process, the weights of the neural network can be adjusted until the value of the loss function meets a stopping criterion. An example of a loss function could be a mean squared error function. Minimizing the loss function can be achieved, for example, by using a stochastic gradient descent algorithm. The stopping criterion can be a specific threshold of the loss function. The stopping criterion can be stopping multiple epochs (training cycles) after the performance metric increases.

[0123] The first and second digital 3D tooth models can be stored on the memory of the mobile device hosting the mobile application. Alternatively, the first and second digital 3D tooth models can be stored on remote memory and accessed by the mobile application based on user input.

[0124] A data processing apparatus is also disclosed, including means for performing the method, the method comprising:

[0125] - Receive selection of dental conditions from at least two dental conditions in the user interface; and display buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0126] - Receive a selection of a first button in the user interface, and in response, display a first digital 3D dental model in a first area of ​​the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to a first time point;

[0127] - A camera button is arranged in the user interface, the camera button being configured to activate the front camera of the mobile device used to host the mobile application when engaged;

[0128] - The user detects engagement of the camera button, and in response, activates the front camera;

[0129] - A camera stream from the front camera is displayed in a second area of ​​the user interface, so that when the user is facing the front camera, the user's dental condition can be compared with a first digital 3D dental model.

[0130] A computer program product including instructions is also disclosed, which, when executed by a processor, causes the computer to perform a method comprising the following steps:

[0131] - Receive selection of dental conditions from at least two dental conditions in the user interface; and display buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0132] - Receive a selection of a first button in the user interface, and in response, display a first digital 3D dental model in a first area of ​​the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to a first time point;

[0133] - A camera button is arranged in the user interface, the camera button being configured to activate the front camera of the mobile device used to host the mobile application when engaged;

[0134] - The user detects engagement of the camera button, and in response, activates the front camera;

[0135] - A camera stream from the front camera is displayed in a second area of ​​the user interface, so that when the user is facing the front camera, the user's dental condition can be compared with a first digital 3D dental model.

[0136] A computer-readable medium comprising instructions which, when executed by a processor, cause the processor to perform a method comprising the following steps:

[0137] - Receive selection of dental conditions from at least two dental conditions in the user interface; and display buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0138] - Receive a selection of a first button in the user interface, and in response, display a first digital 3D dental model in a first area of ​​the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to a first time point;

[0139] - A camera button is arranged in the user interface, the camera button being configured to activate the front camera of the mobile device used to host the mobile application when engaged;

[0140] - The user detects engagement of the camera button, and in response, activates the front camera;

[0141] - A camera stream from the front camera is displayed in a second area of ​​the user interface, so that when the user is facing the front camera, the user's dental condition can be compared with a first digital 3D dental model.

[0142] A user interface for a mobile application that compares a digital 3D dental model of a patient's oral condition with a user's oral condition is also disclosed, the user interface including:

[0143] - A button representing dental conditions;

[0144] - A button representing a digital 3D dental model that can be used for comparison, wherein the button representing the digital 3D dental model includes a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0145] - A first area, configured to display the first digital 3D dental model based on user selection of a first button, and further configured to visualize the dental condition of the displayed first digital 3D dental model based on user selection of the button representing the dental condition;

[0146] - A camera button, which, when engaged, is configured to activate the front camera of the mobile device used to host the mobile application;

[0147] - A second area is configured to display a camera stream from the front camera when the user engages the camera button, allowing the user to compare their dental condition with a first digital 3D dental model when facing the front camera. Attached Figure Description

[0148] Figure 1 A user interface for a mobile application for reporting dental health status according to the present invention is shown;

[0149] Figure 2 A method for generating individual dental profiles according to the present invention is shown;

[0150] Figure 3 An example of an individual dental profile is shown;

[0151] Figures 4A to 4E The user interface of the mobile application is shown, which has metadata displayed based on the individual dental profile;

[0152] Figures 5A to 5G The user interface of the mobile application is shown, which displays a dental care plan based on an individual dental profile.

[0153] Figures 6A to 6C An example of the user interface of a mobile application in scan comparison mode is shown;

[0154] Figure 7 A method for comparing digital 3D tooth models in the user interface of a mobile application is shown;

[0155] Figures 8A to 8B The illustration shows the user interface of the mobile application in dental endoscopy mode;

[0156] Figure 9 This illustrates a method for comparing digital 3D dental models with a user's oral condition;

[0157] Figure 10 A system including a mobile application according to the present invention is shown. Detailed Implementation

[0158] Figure 1 A user interface 100 for a mobile application used to report a patient's dental health status is shown. The mobile application may be hosted by a mobile device 103, shown as a mobile phone. Alternatively, the mobile device 103 may be a laptop computer or a tablet computer. Figure 1 The image shown is the homepage of the mobile application.

[0159] The homepage in user interface 100 may display a digital 3D dental model 101 of the patient's oral condition. The digital 3D dental model 101 may include an accurate representation of the patient's teeth and gums. The user of the mobile application (in this case, the patient) can interact with the digital 3D dental model 101 by rotating and / or zooming in or out of the model via the touchscreen display of the mobile device 103. When multiple digital 3D dental models 101 are available for the patient, the latest digital 3D dental model may be automatically displayed.

[0160] The user interface 100 may display a button 102, which, when activated, can begin to display further details related to the patient's dental health.

[0161] Figure 2 A method 200 for generating an individual dental profile according to the present invention is illustrated. Step 201 illustrates receiving diagnostic intraoral scan data of a patient's oral condition via a mobile application. The diagnostic intraoral scan data may include a digital 3D dental model 101 of the patient's oral condition, quantitative data for at least two dental conditions associated with the patient's oral condition, qualitative data for at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein the mesh overlay is configured to visualize the quantitative and / or qualitative data on the digital 3D dental model 101 when applied to the digital 3D dental model 101.

[0162] Diagnostic intraoral scan data can be stored at a remote location and can be received by mobile applications via a network (e.g., the Internet). Diagnostic intraoral scan data can be obtained by applying one or more algorithms to the intraoral scan data to identify the presence and / or severity of dental conditions. While these algorithms are not discussed in detail herein, machine learning (ML) classification algorithms may be included to classify the building blocks of the digital 3D dental model 101 included in the intraoral scan data into one of several dental condition categories.

[0163] Quantitative data for dental conditions can involve the number of teeth affected, the number of lesions present, the percentage of total tooth surface affected, or the percentage of gingiva affected. Qualitative data, on the other hand, can relate to the severity level of lesions present in a specific dental condition. Qualitative data can represent the damage to each tooth or individual in the oral condition. Severity levels can be one of the internationally recognized severity levels for dental conditions, such as the International Caries Detection and Assessment System (ICDAS) classification for dental caries.

[0164] Mesh overlays can be 3D color overlays that can be applied to a digital 3D dental model 101 to visually highlight portions of the digital 3D dental model 101 affected by dental conditions. The color of the mesh overlay can indicate qualitative data, i.e., the severity level of the dental condition. For example, red can indicate a severe level of dental condition, orange can indicate a moderate level, and green can indicate an initial level of severity. In addition to color, patterns or textures can also be used to visualize the damage and / or the severity level of the dental condition. Mesh overlays can be generated by a diagnostic module (discussed later) and can be the output of an algorithm used to process intraoral scan data to generate diagnostic intraoral scan data.

[0165] Step 202 illustrates the generation of an individual dental profile 300 for the patient by a mobile application based on quantitative and / or qualitative data. The individual dental profile 300 generated in this manner reflects the patient's dental health at a specific time. The generation of the individual dental profile 300 enables the subsequent creation of a personalized care plan tailored to the patient's dental health.

[0166] Generating an individual dental profile 300 may include determining a representative severity value for each of at least two dental conditions. Thus, a representative severity value may be determined for at least two of caries, tooth wear, plaque, gingival recession, gingivitis, periodontitis, cracked teeth, etc. In one example, the representative severity value for each of the at least two dental conditions may be calculated as a weighted average of quantitative and / or qualitative data for each of the at least two dental conditions. The individual dental profile 300 may then include a representative severity value for each of the at least two dental conditions, or a function that can be determined as a representative severity value.

[0167] Individual tooth profiles of 300 can be presented in the form of tooth fractions (which can be numerical values), or as follows: Figure 3 The two-dimensional plot shown may be displayed in the user interface 100 of the mobile application in the form of a chart such as a pie chart or in any other suitable manner. The tooth score can be determined as a function of representative severity values ​​of at least two dental conditions, such as a weighted average. In addition to a weighted average, the tooth score can be selected by the maximum of the representative severity values, taking the majority of the representative severity values, or by similar methods. Converting the individual dental profile 300 into a single tooth score would be advantageous because it can convey the overall state of dental health to the user as a single value.

[0168] Step 203 of method 200 illustrates obtaining metadata associated with at least two dental conditions via a mobile application. To provide patients with relevant and actionable advice and / or treatment plans, the metadata can be filtered based on an individual dental profile 300. Therefore, the metadata can be customized based on a specific individual dental profile 300. The metadata can be obtained from official clinical sources such as the World Health Organization (WHO), the American Dental Association (ADA), and the National Health Service (NHS). Thus, official clinical sources can be local, regional, national, or global health organizations with expertise in human dental health. The metadata can be filtered by identifying correspondences between the metadata and the individual dental profile. Correspondences in this document can involve the correspondence between a representative severity value for a dental condition and metadata associated with that representative severity value. As a result, only information relevant to the patient's actual dental health is obtained from official clinical sources. For example, if the representative severity value for dental plaque is "moderate," only information related to that specific condition and severity is sought. Alternatively, the metadata can be filtered based on qualitative and / or quantitative data.

[0169] Step 204 of method 200 shows displaying a digital 3D tooth model 101 with mesh overlay applied in the user interface 100 of a mobile application, and further displaying metadata. Additionally, the individual tooth profile 300 can be displayed in digital form or in the form of a diagram or chart.

[0170] Figure 3 An example of an individual dental profile 300 is shown in the form of a two-dimensional drawing. On the vertical axis 301, at least two dental conditions can be indicated, in this case showing tooth wear, gingival recession, caries, and plaque. On the horizontal axis 302, various severity levels associated with the at least two dental conditions can be shown. Figure 3 In this case, three severity levels are shown: initial, moderate, and severe; however, different names and numbers of severity levels may also be used. The severity levels on axis 302 can be representative severity values ​​303, 304, 305, and 306 for each of at least two dental conditions detected in the patient's oral cavity. For example, a representative severity value 305 for caries describes the overall severity of caries in the patient's oral condition, and as... Figure 3 As shown, this value is lower than the "initial" value. Figure 3As shown, representative severity values ​​can be determined individually for dental caries, tooth wear, dental plaque, and gingival recession. In one example, representative severity values ​​303, 304, 305, and 306 for each of at least two dental conditions can be calculated as a weighted average of quantitative and / or qualitative data for each of at least two dental conditions. The individual dental profile 300 can then include, or be determined as, representative severity values ​​303, 304, 305, and 306 for each of at least two dental conditions.

[0171] Figures 4A to 4E An example of a user interface 100 for a mobile application with displayed metadata 400 is shown, wherein the metadata 400 can be generated based on an individual dental profile 300. Figure 4A The most severe dental condition is shown, in this case, moderate-severity plaque. The displayed digital 3D tooth model 101 includes an applied mesh overlay that visualizes the areas affected by plaque. Metadata 400 may include a descriptor 401, which may be a general recommendation regarding the displayed dental condition. This general recommendation may be a function of the representative severity of the displayed dental condition. Metadata 400 may also include descriptive information 402 about the displayed dental condition. This descriptive information 400 may be generated for the user based on an individual dental profile 300. Metadata 400 may also include a dental condition identifier 403 in text and / or symbolic form and a severity value 404, which may be a representative severity value 306 for plaque.

[0172] Figure 4B The second most severe dental condition displayed in the user interface 100 is shown, in this case, gingival recession. The displayed digital 3D tooth model 101 includes an applied mesh overlay that visualizes the areas affected by gingival recession. Metadata 400 may include a descriptor 401, which may be a general recommendation regarding the displayed dental condition. This general recommendation may be a function of the representative severity of the displayed dental condition. Metadata 400 may also include descriptive information 402 about the displayed dental condition. This descriptive information may be generated for the user based on an individual dental profile 300. Metadata 400 may also include a dental condition identifier 403 in text and / or symbolic form and a severity value 404, which may be the number of teeth affected (quantitative data).

[0173] Figure 4CAnother dental condition with a lower severity level is shown in the user interface 100, in this case, dental caries. In this case, the displayed digital 3D tooth model 101 does not include applied mesh coverage because no carious lesions have been identified. Metadata 400 may include a corresponding descriptor 401, which may be a general suggestion regarding the displayed dental condition. This general suggestion may be a function of the representative severity of the displayed dental condition. Metadata 400 may also include descriptive information 402 of the displayed dental condition. This descriptive information may be generated for the user based on an individual dental profile 300. Metadata 400 may also include a dental condition identifier 403 in textual and / or symbolic form and a severity value 404, in which case the severity value 404 may have a "no indication" value due to the lack of identified carious lesions.

[0174] Figure 4D Another dental condition with lower severity is shown, in this case, tooth wear. In this case, the displayed digital 3D tooth model 101 does not include applied mesh coverage because no tooth wear has been identified. Metadata 400 may include a corresponding descriptor, which may be a general suggestion regarding the displayed dental condition. This general suggestion may be a function of the representative severity of the displayed dental condition. Metadata 400 may also include descriptive information 402 of the displayed dental condition. This descriptive information may be generated for the user based on an individual dental profile 300. Metadata 400 may also include a dental condition identifier 403 in text and / or symbolic form and a severity value 404, in which case the severity value 404 may have a "no indication" value due to the lack of identified tooth wear.

[0175] exist Figures 4A to 4D The metadata 400, displayed in card format, can be navigated by the user of the mobile application through swiping motions (the user can remove the displayed card by swiping) or by engaging the user interface 100 with a designated button (e.g., the "Next" button). In the illustrated example, only one card can be displayed at a time.

[0176] Descriptors 401 and / or descriptive information 402 can be generated and presented in order to effectively communicate the most important information about dental health to patients.

[0177] Figure 4E An overview of the ranked dental conditions and their corresponding severity levels is shown. The ranked dental conditions (e.g., ranked based on corresponding representative severity) can be displayed as part of the displayed metadata 400. Figure 4EIn this case, dental plaque is the most serious dental condition and is therefore placed at the top of the metadata 400 overview. Additionally, a digital 3D dental model 101 representing the patient's oral condition is displayed, which can automatically visualize the most serious dental conditions, or can visualize dental conditions only after corresponding user input (e.g., the user selects a dental condition from a sorted list of dental conditions).

[0178] Figures 5A to 5G The user interface 100 of the mobile application is shown during the process of registering user input about habits and the subsequent generation of recommended dental care plans based on user input. Figure 5A A window 500 is shown, which is part of the user interface 100 and can be the starting point for generating a dental care plan. User input regarding habits can be initiated by engaging button 501. Button 502 can indicate further dental care plans to be generated for the user. Habits may be related to dental habits, such as the number of times a day one brushes their teeth, uses dental floss, uses mouthwash, the type of toothbrush used, etc.

[0179] User input regarding habits can be presented in the form of a questionnaire, which includes questions 503 and several provided answers 504, where the user can choose their preferred answer 505. Figure 5B and Figure 5C As shown.

[0180] Figure 5D A summary of recommended dental care plans is visualized 506, indicating multiple dental care plan recommendations generated based on user input. The user can activate the display of dental care plans by clicking button 507.

[0181] Figure 5E A first dental care plan 508 is shown displayed in user interface 100, which may include a recommendation 509 and supplementary information 510 for the recommendation 509. The first dental care plan 508 can be generated based on an individual dental profile 300 and / or user input regarding habits. Therefore, the first dental care plan 508 can be associated with the highest-ranked dental condition, and the first dental care plan 508 can be selected such that it has the highest relevance or the highest impact on the highest-ranked dental condition. Relevance here should be understood as a potential recommended measure for reversing or curbing dental conditions.

[0182] Figure 5F A second dental care plan 511 is shown in the user interface 100, which may include a second recommendation 512 and second supplementary information 513 to the second recommendation 512. Compared with the first dental care plan 508, the second dental care plan 508 may be less significant in its impact on the highest-ranked dental conditions.

[0183] Figure 5GA user interface 100 is shown that simultaneously displays a first dental care plan 508, a second dental care plan 511, and a third dental care plan 514, all of which can be generated based on user input regarding the user's dental habits. The displayed care plans 508, 511, and 514 can be ranked based on their relevance to the highest-ranking dental condition (in this case, plaque), where relevance can be considered as potential recommendations for reversing or curbing the dental condition. Figure 5G From the perspective of the presented mobile application, users can press button 502 to activate the generation of further care plans.

[0184] Figures 6A to 6C The user interface 100 of a mobile application in scan comparison mode is shown. Generally, scan comparison mode serves the user to efficiently compare digital 3D dental models 101 from various points in time within the user interface 100 of the mobile application. This provides the user with a clearly visible overview of how oral conditions change over time. Several challenges arise when designing the user interface 100 of a mobile application for comparing digital 3D dental models. One challenge is providing the user with the option to quickly select which digital 3D dental models should be compared among the available models. It is generally desirable to design the user interface 100 to provide an efficient way to select from a variety of available digital 3D dental models, and to simultaneously display the changes in the digital 3D dental models once the user makes a selection. Another challenge is providing this content within a single user interface 100 on the limited surface area of ​​the touchscreen display of the mobile device hosting the mobile application.

[0185] Figure 6A A user interface 600 for scanning comparison is shown, displaying a first digital 3D dental model 601. The displayed digital 3D dental model 601 corresponds to a user's oral condition captured by an intraoral 3D scanner at a first time 605, which can be indicated in the user interface 600. The user interface 600 in this mode also includes a first button 602 associated with the first digital 3D dental model 601. When the user selects the first button 602, the corresponding first digital 3D dental model 601 can be displayed. This selection can define one of two digital 3D dental models for comparison.

[0186] In addition to the first button 602, the user interface 600 for scanning comparison may display a second button 603 associated with a second digital 3D dental model representing the patient's oral condition at a second time, which differs from the first time 605 corresponding to the first digital 3D dental model 601. The user interface 600 may also include a third button 604 associated with a third digital 3D dental model representing the patient's oral condition at a third time, which differs from the first time 605 and the second time. By selecting any of these buttons 602, 603, and 604, the user interface 600 changes to display the corresponding digital 3D model. While navigating back and forth by individually engaging buttons 602, 603, and 604 allows the user to observe the interchangeable displayed models, it is difficult to observe detailed changes between the digital 3D models in this way. Therefore, it is desirable to specify the particular digital 3D model to be compared with the first selected digital 3D dental model 601 via a single user gesture, and subsequently highlight the actual differences between the two digital 3D dental models. For this purpose, a comparison button 606 can be arranged in the user interface 600.

[0187] Users can further engage button 607, which specifies the dental condition to display the differences between the two digital 3D dental models.

[0188] A user can specify a second or third digital 3D dental model to be compared with a first digital 3D dental model 601 in the following manner: The user can engage (or press) a comparison button 606 in the user interface 600 and then perform a dragging motion to the desired target for comparison, which can be either the second button 603 or the third button 604. By pausing the dragging motion at one of the second button 603 or the third button 604, the user selects the desired digital 3D dental model to be compared with the first digital 3D dental model 601. This presents an efficient way to enable user input to select the desired digital 3D dental model to be compared with the first digital 3D dental model 601. The described user selection method is particularly advantageous because the selection occurs within the same user interface 600 and utilizes a single user gesture, thereby allowing for faster comparison of digital 3D dental models. Therefore, the present invention reduces the amount of user interaction compared to other methods that require opening a menu for further selection of digital 3D dental models for comparison. Furthermore, the described method helps the user focus on maintaining and simultaneously staying within the context of the information displayed in the user interface 600.

[0189] The arrangement of buttons 606 and 602, 603, and 604 places them close to each other, allowing users to execute drag commands efficiently. Furthermore, there are no other visual elements between these buttons that could potentially obstruct the user's dragging movement.

[0190] Subsequently, the user interface 600 updates, causing the display to transition from the initially displayed first digital 3D tooth model 601 to a second (or third) digital 3D tooth model. This transition could be a geometric deformation or an adjustment of the transparency level between the two digital 3D tooth models. Alternatively, once comparison mode is activated, a new digital 3D tooth model can be displayed, which could be a geometric overlay of the two digital 3D tooth models being compared, with their geometric differences highlighted. In this way, an efficient comparison method is provided that allows the user to preview, select digital 3D tooth models for comparison, and observe differences, all within the same user interface 600 and utilizing a single user gesture. The described comparison mode can be active while the user remains interacting with the desired target for comparison (i.e., while the user remains in contact with the second button 603 or the third button 604). Once the user releases the touchscreen, the user interface 600 can re-render the first digital 3D tooth model 601.

[0191] Figure 6B Another example of a user interface 600 for scan comparison is shown, which displays a first digital 3D tooth model 601 and a third digital 3D tooth model 608. The two digital 3D tooth models 601, 608 can be displayed in an overlay manner and can be separated by a movable graphical user interface element 609, wherein the movable graphical user interface element 609 is... Figure 6B The image shows straight lines dividing the overlay model. User interface element 609 can be moved by the user, allowing them to observe differences in dental conditions between the two digital 3D dental models 601 and 608. The user can select the dental condition for which differences between the two digital 3D dental models 601 and 608 are to be displayed via the engagement button 607. Figure 6B In this case, the user has selected the gingival recession to be highlighted on the overlaid digital 3D dental models 601 and 608. The advantage of this method of comparing digital 3D dental models is that local differences are easier to observe because the user has the ability to navigate back and forth between element 609, thereby highlighting specific differences that would be difficult to observe in other ways.

[0192] In some examples, the user interface 600 for scanning comparison can display a library 612 of available digital 3D tooth models for mutual comparison, such as... Figure 6C As shown. The user can indicate two target digital 3D tooth models 610 to be compared in library 612. By engaging button 611 to confirm the user's selection, the user can activate the comparison mode, for example, as... Figure 6B As shown, library 612 allows for efficient searching and selection among available digital 3D tooth models. However, a potential drawback is that the comparison process may be delayed overall, as users need to navigate library 612 and interact with multiple windows of the mobile application.

[0193] Figure 7 A method 700 for comparing a patient’s oral condition using a digital 3D dental model, based on an example, is shown.

[0194] Step 701 illustrates receiving a selection of dental conditions from at least two dental conditions in the user interface 600 of the mobile application. In this way, the user specifies the desired dental condition whose changes they want to track.

[0195] Step 702 shows buttons 602, 603, and 604 representing digital 3D dental models that can be used for comparison. Buttons 602, 603, and 604 include a first button 602 associated with a first digital 3D dental model 601 representing the patient's oral condition at a first time point, and a second button 603 associated with a second digital 3D dental model representing the patient's oral condition at a second time point. The second time point may differ from the first time point.

[0196] Step 703 illustrates receiving a selection of the first button 602 in the user interface 600, and in response, displaying a first digital 3D dental model 601 in the user interface 600, such that the displayed first digital 3D dental model 601 visualizes the selected dental condition corresponding to a first time point. By executing this command, the user can select the first of two digital 3D dental models for comparison.

[0197] Step 704 illustrates initiating the comparison mode of the mobile application by detecting a drag command executed by the user of the mobile application, the drag command comprising a dragging motion within the user interface 600 from the comparison button 606 to the second button 603 (or to the third button). This specific arrangement of buttons and visual elements in the user interface 600 effectively guides the user to select the target digital 3D dental model for comparison. By executing the command, the user can select the second of two digital 3D dental models for comparison.

[0198] Step 705 shows a display of a conversion from a first digital 3D dental model 601 to a second digital 3D dental model that can be performed in response to a drag command, wherein the second digital 3D dental model visualization corresponds to a selected dental condition at a second time point.

[0199] The described embodiments illustrate the use of drag commands on the touchscreen of a mobile device hosting a mobile application for the purpose of comparing digital 3D dental models. Comparison of various digital 3D dental models from users at different times is relevant for visualizing the progression of dental conditions over time. The disclosed method economically utilizes the limited surface area of ​​the touchscreen and provides a time-efficient way to compare digital 3D dental models and highlight the differences between those models. This described method also addresses the technical problem of how to easily identify the digital 3D dental models used for comparison and observe the differences between all those models within the same user interface 600.

[0200] The conversion from a first digital 3D tooth model 601 to a second digital 3D tooth model may include deforming the first digital 3D tooth model 601 into the second digital 3D tooth model. Alternatively, the conversion from the first digital 3D tooth model 601 to the second digital 3D tooth model may include adjusting the transparency level of the first digital 3D tooth model 601 to reduce its visibility, and adjusting the transparency level of the second digital 3D tooth model to increase its visibility, to simulate the change from the first digital 3D tooth model 601 to the second digital 3D tooth model.

[0201] The comparison mode can be activated while the user maintains interaction with the touchscreen, more precisely, during interaction with buttons 603 and 604 representing the target digital 3D dental model. Once the user releases the touchscreen, the drag command can be interrupted and the comparison mode can be turned off. When the comparison mode is turned off, the user interface 600 can display a transition back to the first digital 3D dental model 601. Therefore, the method can further include detecting the cessation of the drag command and responding by displaying a transition from the second digital 3D dental model to the first digital 3D dental model 601.

[0202] Therefore, Method 700 reliably assists users in performing comparison tasks of digital 3D dental models on mobile devices within the limited surface area of ​​a touchscreen.

[0203] Once the state of dental problems is presented to the user in a mobile application, such as Figures 4A to 4E As shown, users may want to identify diagnosed dental conditions in their actual oral health. Figures 8A to 8B The user interface 800 of the mobile application in dental endoscopy mode is shown. This mode of the mobile application allows users to simultaneously view diagnosed dental conditions and actual oral conditions on a corresponding digital 3D dental model, as presented herein. Users can advantageously use the mobile application as a digital dental endoscope using the user interface and methods presented herein.

[0204] Figure 8AA user interface 800 in digital dental endoscopy mode is shown, which is configured to simultaneously display a digital 3D dental model highlighting dental conditions and the user's actual oral condition captured by the camera of the mobile device hosting the mobile application.

[0205] Based on the user's engagement of the first button 602, the user interface 800 can display a first digital 3D dental model 601, which corresponds to the user's oral condition captured by an intraoral 3D scanner at a first time 605, which can be indicated in the user interface 800. The user interface 800 in this mode may also include a second button 603 associated with a second digital 3D dental model and a third button 604 associated with a third digital 3D dental model, wherein the second digital 3D dental model represents the patient's oral condition at a second time (different from the first time 605), and the third digital 3D dental model represents the patient's oral condition at a third time (different from both the first and second times). By selecting any of these buttons 602, 603, and 604, the user interface 800 changes to display the corresponding digital 3D model.

[0206] A first digital 3D tooth model (or any other available model) can be displayed in a first region 804 of the user interface 800. The first region may include explicit boundaries or may have invisible boundaries.

[0207] The user can further engage button 607, which is designated for displaying dental conditions on the first digital 3D dental model 601. Figure 8A In this situation, they chose to shrink.

[0208] The user interface may further include a camera button 802, which, when engaged by the user, activates a camera stream from the front camera 801, allowing the user's dental condition to be compared with a first digital 3D dental model 101 (or any other alternative available digital 3D dental model) when facing the front camera 801. Once the front camera 801 is activated, the camera stream from it can be displayed in a second region 803 of the user interface 800. The second region 803 may be explicitly defined by boundary lines or may have invisible boundaries. The second region 803 and the first region 804 may be arranged to not overlap in the user interface 800. The user interface 800, equipped with these functions, provides the user with the unique opportunity to simultaneously track the actual oral condition and the corresponding digital 3D dental model 601.

[0209] In this way, the user can identify a region 805 in the user's oral condition that corresponds to a portion 806 of the first digital 3D dental model 601 affected by a selected dental condition.

[0210] The user interface 800 and the mobile application as a whole can be further improved by automatically detecting and highlighting areas 805 in the user's oral condition that correspond to portions 806 of the first digital 3D dental model 601 affected by the selected dental condition. In this way, the user is automatically guided to the relevant portion of the oral condition suffering from the dental condition. A particular advantage of this feature is that it can clearly and explicitly point out conditions that are more difficult to observe and / or less severe cases of dental conditions that are difficult for the user to observe.

[0211] Automatic detection of region 805 in the second region 803 of the user interface 800 may include applying a neural network trained to automatically label frames in the camera stream to dental conditions and / or other objects such as teeth or gums. In this case, the neural network may be a region-based convolutional neural network (R-CNN) capable of labeling frames in the video stream. This neural network may be trained, for example, by an expert dentist based on training data including images of manually labeled dental objects. In one example, the training data may include more than 1,000, preferably more than 5,000 labeled images. Manual labels may be used as ground truth data to compare with the output of the neural network. The training process may be an iterative process in which a loss function is minimized to minimize the difference between the output of the neural network and the ground truth. During the training process, the weights of the neural network may be adjusted until the value of the loss function meets a stopping criterion. An example of a loss function may be a mean squared error function. The minimization of the loss function may be achieved, for example, by using a stochastic gradient descent algorithm. The stopping criterion may be a specific threshold of the loss function. In one example, the stopping criterion may be the number of epochs (training cycles) after which the performance metric stops increasing.

[0212] Region 805 can be highlighted by applying a bounding box around it or by applying a color overlay on it.

[0213] In one example, in addition to displaying the camera stream in the second region 803, the mobile application can be configured to automatically capture a 2D image of the user corresponding to the view of the first digital 3D dental model 601 displayed in the first region 804. The 2D image can be automatically captured by the front camera 801 based on a correspondence criterion. This correspondence criterion can represent the relationship between the first digital 3D model 601 and images from the video stream shown in the second region 803. When a correspondence is detected between the first digital 3D model 601 and a 2D image from the video stream, the 2D image can be automatically captured by the front camera 801. This correspondence detection can be based on object recognition within the video stream, thereby identifying the corresponding object relative to the object displayed in the first digital 3D model 601.

[0214] Figure 9A method 900 for comparing a digital 3D dental model with a user's oral condition is shown.

[0215] The computer-implemented method 900 illustrates steps for comparing a digital 3D dental model of a patient's oral condition with the user's oral condition in a user interface 800 of a mobile application.

[0216] Step 901 illustrates receiving a selection of dental conditions from at least two dental conditions in the user interface 800. By performing this action, the user specifies the target dental condition they wish to observe in their oral health.

[0217] Step 902 shows buttons 602, 603, 604 representing digital 3D dental models that can be used for comparison, wherein buttons 602, 603, 604 include a first button 602 associated with a first digital 3D dental model 601 representing the patient's oral condition at a first time point and a second button 603 associated with a second digital 3D dental model representing the patient's oral condition at a second time point.

[0218] Step 903 shows receiving a selection of the first button 602 in the user interface 800, and in response, displaying a first digital 3D dental model 601 in a first area 804 of the user interface 800, such that the displayed first digital 3D dental model 601 visualizes the selected dental condition corresponding to a first time point.

[0219] Step 904 illustrates activating the front camera 801 of the mobile device hosting the mobile application. The front camera 801 can be activated by engaging the camera button 802 arranged in the user interface 800.

[0220] Step 905 shows a camera stream from the front camera 801 displayed in a second area 803 of the user interface 800, such that when the user is facing the front camera 801, the user's dental condition can be compared with the first digital 3D dental model 101.

[0221] In this way, users can observe their oral health and visualize related dental conditions using a digital 3D model 601. Figure 8A and Figure 8B In this case, it is gum recession.

[0222] There are several ways to arrange the first area 804 and the second area 803 in the user interface 800. The first area 804 can be above the second area 803 in the user interface 800, such as... Figure 8BAs shown. In another example, the first region 804 may be below the second region 803 in the user interface 800. In yet another example, the first region 804 and the second region 803 may be arranged adjacent to each other in the user interface 800, for example, arranged horizontally adjacent to each other. The first region 804 and the second region 803 may be arranged so that they do not overlap in the user interface 800.

[0223] The method may further include detecting a region 805 in the second region 803 corresponding to a portion 806 of the first digital 3D dental model 601 affected by a selected dental condition 607 in the user's oral condition, and highlighting the region 805 in the user's oral condition visualized in the second region 803. This may include identifying objects in the video stream corresponding to objects in the first digital 3D dental model 601. Highlighting the region may include applying a color overlay or bounding box to the region in the user's dental condition visualized in the second region 803.

[0224] Figure 10 A system 1000 according to the present invention is illustrated. System 1000 may include a mobile application 1001 for transmitting patient diagnostic data and generating actionable recommendations for improving dental health. System 1000 may further include a content management system 1002, which is responsible for providing metadata for filtering at least two dental conditions associated with the patient. The task of the content management system 1002 may be to update the content of the mobile application 1001, thereby increasing user engagement. System 1000 may further include a diagnostic module 1003, which is configured to generate diagnostic intraoral scan data for the patient. Therefore, the diagnostic module 1003 may be configured to receive the patient's intraoral scan data (including a digital 3D dental model 101) and process the intraoral scan data to identify the presence and / or severity values ​​of at least two dental conditions. The intraoral scan data may be stored in a database 1004, which may be a cloud database or a local server. The diagnostic module 1003 may also be configured to provide the intraoral diagnostic data and / or the digital 3D dental model 101 to the mobile application 1001. The diagnostic module 1003 can be configured to compress the digital 3D dental model before sending it to the mobile application 1001.

[0225] Mobile application 1001 can be configured to receive diagnostic intraoral scan data of a patient, including a digital 3D dental model 101, and generate an individual dental profile 300 for the patient based on the received diagnostic intraoral scan data. Mobile application 1001 can also be configured to obtain metadata associated with at least two dental conditions from a content management system 1002, wherein the metadata can be filtered based on the individual dental profile 300. The metadata can be obtained by the content management system 1002 from official clinical sources 1005 (e.g., WHO, ADA, or others). Mobile application 1001 can also be configured to display the digital 3D dental model 101 and the metadata in a user interface 100.

[0226] The content management system 1002 and / or diagnostic module 1003 can be configured to generate and / or update content packages 1006 for mobile application 1001. Content package 1006 may include metadata 1007, 1010, which includes diagnostic information about at least one dental condition, a questionnaire 1008 about the user's dental habits and / or symptoms, and learning information 1009, which may include informative messages about dental conditions and other tips about dental health.

[0227] Content management system 1002 can be configured to provide time-delayed metadata to mobile application 1001. This may be particularly relevant when content management system 1002 updates the provided metadata with new content. The time delay can be selected to reflect the timing of initiation and / or execution of treatment protocols that may be included in the metadata. Certain recommended measures within a provided treatment protocol can provide maximum effectiveness only when the user follows a strict timeline of the treatment protocol. In these cases, it would be advantageous to set the provision of metadata according to the recommended treatment protocol. This time delay can be determined alternatively or additionally based on individual dental profile 300.

[0228] Information provided to mobile application 1001 may optionally be provided through classification module 1011. In one example, the classification module may link the provided metadata 1007, 1010 to the corresponding dental condition in mobile application 1001. Classification module 1011 may perform this linking by applying condition-specific tags to the metadata. Figure 10 Metadata 1007 and 1010 related to dental plaque are shown. The classification module 1011 can link metadata 1001 and 1010 to dental plaque in the mobile application 1001. Existing metadata describing dental plaque can be supplemented by new metadata 1001 and 1010, or can be partially or completely replaced. Alternatively or additionally, the classification module 1011 can link learning information 1009 included in content package 1006 to corresponding dental conditions in the mobile application 1001.

[0229] Content management system 1002 can be configured to instruct mobile application 1001 to request user input regarding dental habits and / or dental symptoms, for example, via questionnaire 1008. Content management system 1002 can also be configured to filter metadata before providing it to mobile application 1001. This filtering can be performed by accessing official clinical sources 1005. Based on individual dental profiles 300 and / or user input regarding dental habits and / or dental symptoms, relevant information can be obtained from official clinical sources 1005 and adjusted by content management system 1002 before being provided to mobile application 1001.

[0230] Mobile application 1001 can be configured to compress the digital 3D dental model 101 before storing it in the memory of the mobile device hosting mobile application 1001.

[0231] The disclosure provided describes only exemplary embodiments. As those skilled in the art will understand, this disclosure may be practiced in various forms without departing from the spirit or essential characteristics of this disclosure. This description is intended to be illustrative and not to limit the scope of this disclosure and the other claims. Throughout the disclosure, the term "comprising" does not exclude other elements or steps, and the terms "a" or "an" do not exclude multiple elements or steps. Certain features recited in mutually different dependent claims do not indicate that combinations of those features cannot be utilized. It should be understood that structural and functional modifications may be made to the invention in addition to implementing the embodiments mentioned without departing from the scope of the invention.

[0232] Project List:

[0233] 1. A computer-implemented method, comprising:

[0234] - A mobile application receives diagnostic intraoral scan data of a patient's oral condition, wherein the diagnostic intraoral scan data includes a digital 3D dental model of the patient's oral condition, quantitative data associated with the patient's oral condition for at least two dental conditions, qualitative data for the at least two dental conditions, and a mesh overlay for each of the at least two dental conditions, wherein when the mesh overlay is applied to the digital 3D dental model, the mesh overlay is configured to visualize the quantitative data and the qualitative data on the digital 3D dental model;

[0235] - The mobile application generates an individual dental profile for the patient based on the quantitative and qualitative data;

[0236] - Obtain metadata associated with the at least two dental conditions from the mobile application, wherein the metadata is filtered based on the individual dental profile;

[0237] - The mobile application's user interface displays a digital 3D tooth model with applied mesh coverage, and further displays metadata.

[0238] 2. The computer-implemented method according to Project 1, wherein the at least two dental conditions are at least two of the following: dental caries, tooth wear, dental plaque, gingival recession, gingivitis, periodontitis, and tooth cracks.

[0239] 3. A computer-implemented method according to any of the foregoing items, wherein the quantitative data includes the number of teeth affected in the patient's oral condition for each of the at least two dental conditions.

[0240] 4. The computer-implemented method according to item 3 above, wherein if the dental disease of the at least two dental diseases is dental plaque, the number of affected teeth is a percentage of the total tooth surface area.

[0241] 5. A computer-implemented method according to any of the foregoing items, wherein the qualitative data includes severity values ​​for each of at least two dental conditions in the patient's oral condition.

[0242] 6. The computer-implemented method according to item 5 above, wherein the severity value is defined for individual teeth and / or gums of a digital 3D dental model.

[0243] 7. A computer-implemented method according to any of the foregoing items, wherein generating the individual dental profile includes determining a representative severity value for each of the at least two dental conditions.

[0244] 8. The computer-implemented method according to item 7 above, wherein a representative severity value for each of the at least two dental conditions is calculated as a weighted average of quantitative and qualitative data for each of the at least two dental conditions.

[0245] 9. The computer-implemented method according to any of the foregoing items further includes: displaying the individual dental profile in the user interface of the mobile application.

[0246] 10. The computer-implemented method according to item 9 above, wherein the individual dental profile is displayed in the form of dental fractions.

[0247] 11. The computer-implemented method according to item 10 above, wherein the tooth score is determined as a function of representative severity values ​​of the at least two dental conditions.

[0248] 12. The computer-implemented method according to item 10 or 11 above, wherein the tooth score is determined based on data collected from other users of the mobile application.

[0249] 13. The computer-implemented method according to item 12 above, wherein the data collected from other users of the mobile application includes individual dental profiles of the other users.

[0250] 14. The computer-implemented method according to any of the foregoing items further includes: obtaining the ranked dental conditions by ranking the at least two dental conditions based on the quantitative data and / or the qualitative data.

[0251] 15. The computer-implemented method according to any of the foregoing items 7 to 14 further includes: obtaining the ranked dental diseases by ranking the at least two dental diseases based on representative severity values ​​of the at least two dental diseases.

[0252] 16. The computer-implemented method according to item 14 or 15 above further includes: displaying the sorted dental conditions in the user interface.

[0253] 17. A computer-implemented method according to any of the foregoing items 14 to 16, wherein the displayed digital 3D dental model with applied mesh coverage highlights the highest-ranked dental disease among the ranked dental diseases.

[0254] 18. The computer-implemented method according to item 17 above, wherein the displayed digital 3D dental model with applied mesh coverage indicates the portion of the digital 3D dental model affected by the highest-ranked dental condition.

[0255] 19. A computer-implemented method according to any of the foregoing items 14 to 18, wherein the displayed metadata corresponds to the highest-ranked dental disease among the ranked dental diseases.

[0256] 20. The computer-implemented method according to any of the preceding items 14 to 19 further includes: receiving a user selection of dental conditions other than the highest-ranked dental condition, and updating the applied mesh overlay so that the digital 3D dental model visualizes the selected dental condition.

[0257] 21. The computer-implemented method according to item 20 above further includes: updating the displayed metadata such that the displayed metadata corresponds to the selected dental condition.

[0258] 22. A computer-implemented method according to any of the foregoing items, wherein the metadata is obtained from an official clinical source.

[0259] 23. The computer-implemented method according to item 22 above further includes: filtering metadata obtained from the official clinical source by identifying correspondences with the individual dental profile.

[0260] 24. A computer-implemented method according to any of the foregoing items, wherein the metadata is filtered based on the qualitative and / or quantitative data.

[0261] 25. The computer-implemented method according to any of the foregoing items further includes: annotating the diagnostic intraoral scan data with the patient's demographic data.

[0262] 26. The computer-implemented method according to any of the foregoing items further includes: updating the individual dental profile with the patient's demographic data.

[0263] 27. The computer-implemented method according to item 26 above further includes: benchmarking an updated individual dental profile based on at least a portion of demographic data.

[0264] 28. The computer-implemented method according to any of the foregoing items 14 to 27, further comprising: receiving a user selection of a first dental condition among the at least two dental conditions in the user interface, and updating the user interface to display metadata associated with the first dental condition.

[0265] 29. The computer-implemented method according to item 28 above further receives a user selection of a second dental condition among the at least two dental conditions, updates the displayed digital 3D dental model with a corresponding mesh overlay so that the digital 3D dental model visualizes the second dental condition, and updates the user interface to display metadata associated with the second dental condition.

[0266] 30. The computer-implemented method of the aforementioned item 29, wherein the user selection is recorded as a swiping motion on the display screen of a mobile device used to host the mobile application.

[0267] 31. The computer-implemented method according to any of the foregoing items further includes: receiving an external signal by the mobile application and deleting quantitative and / or qualitative data for at least one of the at least two dental conditions based on the received external signal.

[0268] 32. The computer-implemented method according to any of the foregoing items further includes: updating the user interface based on a request for user input on dental habits, receiving user input on dental habits, and generating a recommended dental care plan based on the received user input on dental habits and / or individual dental profiles.

[0269] 33. The computer-implemented method according to item 32 above, wherein a recommended dental care plan is displayed in the user interface for at least two dental conditions.

[0270] 34. The computer-implemented method according to item 32 above further includes: updating the individual dental profile based on received user input regarding dental habits.

[0271] 35. The computer-implemented method according to any of the foregoing items 32 to 34, wherein generating the recommended dental care plan further includes accessing official clinical sources.

[0272] 36. The computer-implemented method according to any of the foregoing items 32 to 35, wherein the recommended dental care plan is displayed using a button, wherein engaging the button initiates a dialogue with a dentist.

[0273] 37. The computer-implemented method according to any of the foregoing items further includes: receiving user input about dental symptoms and updating the individual dental profile based on the received user input about dental symptoms.

[0274] 38. The computer-implemented method according to item 37 above further includes: updating the displayed metadata and / or the recommended dental care plan based on received user input about dental symptoms.

[0275] 39. A data processing apparatus comprising means for performing the method according to items 1 to 38 above.

[0276] 40. A computer program product comprising instructions that, when executed by a computer, cause the computer to perform the method according to any of the preceding items 1 to 38.

[0277] 41. A computer-readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method according to any of the preceding items 1 to 38.

[0278] 42. A system comprising:

[0279] - Mobile applications;

[0280] - Content Management System;

[0281] - A diagnostic module configured to generate diagnostic intraoral scan data for a patient, wherein the mobile application is configured to:

[0282] - Receive diagnostic intraoral scan data of the patient, including a digital 3D dental model, from the diagnostic module;

[0283] - Generate an individual dental profile for the patient based on diagnostic intraoral scan data;

[0284] - Obtain metadata based on the individual dental profile from the content management system; and

[0285] - The digital 3D tooth model and the metadata are displayed in the user interface of the mobile application.

[0286] 43. The system according to item 42, wherein the content management system is configured to provide the mobile application with time-delayed metadata.

[0287] 44. The system according to item 43 above, wherein the time delay is determined based on the individual dental profile.

[0288] 45. The system according to item 43 above, wherein the time delay is determined based on the recommended treatment plan.

[0289] 46. ​​The system according to any of the preceding items 42 to 45, wherein the content management system is configured to instruct the mobile application to request user input on dental habits and / or dental symptoms.

[0290] 47. A system according to any of the preceding items 42 to 46, wherein the content management system is configured to filter the metadata before providing the metadata to the mobile application.

[0291] 48. The system according to item 47 above, wherein the filtering of the metadata is performed by accessing official clinical sources.

[0292] 49. The system according to any of the preceding items 42 to 48, wherein the diagnostic module is configured to compress the digital 3D dental model before sending the digital 3D dental model to the mobile application.

[0293] 50. The system according to any of the preceding items 42 to 49, wherein the mobile application is configured to compress the digital 3D dental model before storing the digital 3D dental model into the memory of the mobile device used to host the mobile application.

[0294] 51. The system according to any of the foregoing items 42 to 50, wherein the content management system is configured to filter metadata associated with at least two dental conditions based on the individual dental profile.

[0295] 52. A computer-implemented method for comparing digital 3D dental models of a patient's oral condition in a user interface of a mobile application, the method comprising:

[0296] - Receive a selection of dental conditions from at least two dental conditions in the user interface of the mobile application;

[0297] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0298] - Receive the selection of the first button in the user interface, and in response, display the first digital 3D dental model in the user interface, so that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first time point;

[0299] - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, a transition from the first digital 3D dental model to the second digital 3D dental model is displayed, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

[0300] 53. The computer-implemented method according to item 52, wherein the conversion from the first digital 3D tooth model to the second digital 3D tooth model includes deforming the first digital 3D tooth model into the second digital 3D tooth model.

[0301] 54. The computer-implemented method of Item 52, wherein the conversion from the first digital 3D tooth model to the second digital 3D tooth model includes adjusting the transparency level of the first digital 3D tooth model to reduce its visibility, and adjusting the transparency level of the second digital 3D tooth model to increase its visibility.

[0302] 55. A computer-implemented method according to any of the foregoing items 52 to 54, wherein the conversion from a first digital 3D dental model to a second digital 3D dental model highlights the difference between the first digital 3D dental model and the second digital 3D dental model, wherein the difference corresponds to a variation in the selected dental condition.

[0303] 56. The computer-implemented method according to any of the foregoing items 52 to 55 further includes: detecting the cessation of the drag command, and in response, displaying a conversion from the second digital 3D tooth model to the first digital 3D tooth model.

[0304] 57. A computer-implemented method according to any of the foregoing items 52 to 56, wherein the first digital 3D tooth model is displayed with the jaw closed.

[0305] 58. The computer-implemented method according to any of the preceding items 52 to 57 further includes: receiving user input and displaying the first digital 3D tooth model in an occlusal view based on the received user input.

[0306] 59. The computer-implemented method according to item 55 above further includes: rotating the second digital 3D tooth model so that the difference is within the user's field of view.

[0307] 60. The computer-implemented method according to any of the foregoing items 52 to 59, wherein the first digital 3D tooth model and the second digital 3D tooth model are stored on the memory of the mobile device hosting the mobile application.

[0308] 61. The computer-implemented method according to any of the preceding items 52 to 59, wherein the first digital 3D tooth model and the second digital 3D tooth model are stored on a remote memory and accessed by a mobile device hosting a mobile application based on user input.

[0309] 62. A user interface for a mobile application for tracking a user's dental health, comprising:

[0310] - A button representing a digital 3D dental model that can be used for comparison, wherein the button representing the digital 3D dental model includes a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point, wherein the user interface is configured to display the first digital 3D dental model based on the user's selection of the first button;

[0311] - A comparison button, wherein the user interface is configured to initiate a comparison mode of the mobile application by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, displaying a conversion from the first digital 3D tooth model to the second digital 3D tooth model.

[0312] 63. The user interface according to item 62 further includes: a button representing a dental condition, wherein the user interface is configured to visualize the dental condition on a first digital 3D dental model or a second digital 3D dental model based on a user selection of the button representing the dental condition.

[0313] 64. According to the user interface of item 63, the dental condition is visualized as a surface color overlay.

[0314] 65. According to any of the aforementioned items 62 to 64, the conversion from the first digital 3D dental model to the second digital 3D dental model includes deforming the first digital 3D dental model into the second digital 3D dental model.

[0315] 66. According to any of the aforementioned items 62 to 64, the conversion from the first digital 3D tooth model to the second digital 3D tooth model includes adjusting the transparency level of the first digital 3D tooth model to reduce its visibility, and adjusting the transparency level of the second digital 3D tooth model to increase its visibility.

[0316] 67. According to any of the aforementioned items 62 to 64, the user interface, wherein the conversion from the first digital 3D dental model to the second digital 3D dental model highlights the differences between the first digital 3D dental model and the second digital 3D dental model.

[0317] 68. A data processing apparatus comprising means for performing the method according to any of the preceding items 52-61.

[0318] 69. A computer program product comprising instructions that, when executed by a processor, cause the processor to perform the method according to any of the preceding items 52 to 61.

[0319] 70. A computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform the method according to any of the preceding items 52 to 61.

[0320] 71. A computer-implemented method for comparing a digital 3D dental model of a patient's oral condition with a user's oral condition in a user interface of a mobile application, the method comprising:

[0321] - Receive selection of dental conditions from at least two dental conditions in the user interface;

[0322] - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0323] - Receive a selection of a first button in the user interface, and in response, display a first digital 3D dental model in a first area of ​​the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to a first time point;

[0324] - A camera button is arranged in the user interface, the camera button being configured to activate the front camera of the mobile device used to host the mobile application when engaged;

[0325] - Detects engagement of the camera button by the user, and in response, activates the front camera;

[0326] - A camera stream from the front camera is displayed in a second area of ​​the user interface, so that when the user is facing the front camera, the user's dental condition can be compared with a first digital 3D dental model.

[0327] 72. The computer-implemented method according to item 71, wherein the first region is above the second region in the user interface.

[0328] 73. The computer-implemented method according to item 71, wherein the first region is below the second region in the user interface.

[0329] 74. The computer-implemented method according to item 71, wherein the first region and the second region do not overlap in the user interface.

[0330] 75. The computer-implemented method according to item 71, wherein the first region and the second region are arranged adjacent to each other in the user interface.

[0331] 76. The computer-implemented method according to any of the foregoing items 71 to 75 further includes: detecting, in the second region, a region in the user's oral condition corresponding to a portion of the first digital 3D dental model affected by a selected dental condition, and highlighting the region in the user's oral condition visualized in the second region.

[0332] 77. The computer-implemented method according to item 76 above, wherein highlighting the region includes applying a color overlay or bounding box to the region of the user's dental condition visualized in the second region.

[0333] 78. A computer-implemented method according to any of the preceding items 76 or 77, wherein detecting regions in the user's oral condition includes applying a neural network trained to automatically label frames in a camera stream to dental conditions.

[0334] 79. The computer-implemented method according to the aforementioned item 78, wherein the neural network is a region-based convolutional neural network (R-CNN).

[0335] 80. The computer-implemented method according to any of the preceding items 71 to 79, wherein the first digital 3D tooth model and the second digital 3D tooth model are stored on the memory of a mobile device for hosting a mobile application.

[0336] 81. The computer-implemented method according to any of the preceding items 71 to 79, wherein the first digital 3D tooth model and the second digital 3D tooth model are stored on a remote memory and accessed by a mobile device for hosting a mobile application based on user input.

[0337] 82. A data processing apparatus comprising means for performing the method according to any of the preceding items 71 to 81.

[0338] 83. A computer program product comprising instructions that, when executed by a processor, cause the processor to perform the method according to any of the preceding items 71 to 81.

[0339] 84. A computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform the method according to any of the preceding items 71 to 81.

[0340] 85. A user interface for a mobile application that compares a digital 3D dental model of a patient's oral condition with a user's oral condition, comprising:

[0341] - A button representing dental conditions;

[0342] - A button representing a digital 3D dental model that can be used for comparison, wherein the button representing the digital 3D dental model includes a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point;

[0343] - A first area, configured to display the first digital 3D dental model based on user selection of a first button, and further configured to visualize dental conditions on the displayed first digital 3D dental model based on user selection of the button representing dental conditions;

[0344] - A camera button, which, when engaged, is configured to activate the front camera of the mobile device used to host the mobile application;

[0345] - A second area is configured to display a camera stream from the front camera when the user engages the camera button, allowing the user to compare their dental condition with a first digital 3D dental model when facing the front camera.

[0346] 86. According to the user interface of item 85, the first area is arranged above the second area.

[0347] 87. According to the user interface of item 85, the first area is arranged below the second area.

[0348] 88. The user interface according to any of the foregoing items 85 to 87, wherein the first area and the second area do not overlap in the user interface.

[0349] 89. The user interface according to any of the foregoing items 85 to 88, wherein the first area and the second area are arranged adjacent to each other in the user interface.

Claims

1. A computer-implemented method for comparing digital 3D dental models of a patient's oral condition in a user interface of a mobile application, the method comprising: - Receive a selection of dental conditions from at least two dental conditions in the user interface of the mobile application; - Displays buttons representing digital 3D dental models that can be used for comparison, wherein the buttons include a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point; - Receive a selection of a first button in the user interface, and in response, display the first digital 3D dental model in the user interface, such that the displayed first digital 3D dental model visualizes the selected dental condition corresponding to the first time point; - The comparison mode of the mobile application is initiated by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, displaying a transition from the first digital 3D dental model to the second digital 3D dental model, wherein the second digital 3D dental model visualizes the selected dental condition corresponding to the second time point.

2. The computer-implemented method according to claim 1, wherein, The conversion from the first digital 3D dental model to the second digital 3D dental model includes transforming the first digital 3D dental model into the second digital 3D dental model.

3. The computer-implemented method according to claim 1, wherein, The conversion from the first digital 3D dental model to the second digital 3D dental model includes adjusting the transparency level of the first digital 3D dental model to reduce its visibility, and adjusting the transparency level of the second digital 3D dental model to increase its visibility.

4. The computer-implemented method according to any one of claims 1 to 3, wherein, The conversion from the first digital 3D dental model to the second digital 3D dental model highlights the differences between the first digital 3D dental model and the second digital 3D dental model, wherein the differences correspond to variations in the selected dental condition.

5. The computer-implemented method according to any one of claims 1 to 4 further comprises: The system detects when the drag command stops and, in response, displays the transition from the second digital 3D tooth model to the first digital 3D tooth model.

6. The computer-implemented method according to any one of claims 1 to 5, wherein, The first digital 3D tooth model is displayed with the jaw closed.

7. The computer-implemented method according to any one of claims 1 to 6 further comprises: Receive user input and display the first digital 3D tooth model in an occlusal view based on the received user input.

8. The computer-implemented method according to any one of claims 4 to 7 further comprises: Rotate the second digital 3D tooth model so that the difference is within the user's field of view.

9. The computer-implemented method according to any one of claims 1 to 8, wherein, The first digital 3D tooth model and the second digital 3D tooth model are stored on the memory of the mobile device used to host the mobile application.

10. The computer-implemented method according to any one of claims 1 to 8, wherein, The first digital 3D tooth model and the second digital 3D tooth model are stored in a remote memory and accessed by a mobile device hosting the mobile application based on user input.

11. A user interface for a mobile application for tracking a user's dental health, comprising: - A button representing a digital 3D dental model that can be used for comparison, wherein the button representing the digital 3D dental model includes a first button and a second button, the first button being associated with a first digital 3D dental model representing the patient's oral condition at a first time point, and the second button being associated with a second digital 3D dental model representing the patient's oral condition at a second time point, wherein the user interface is configured to display the first digital 3D dental model based on the user's selection of the first button; - A comparison button, wherein the user interface is configured to initiate a comparison mode of the mobile application by detecting a drag command executed by a user of the mobile application, the drag command including a drag movement from the comparison button to the second button in the user interface, and in response to the drag command, displaying a conversion from the first digital 3D tooth model to the second digital 3D tooth model.

12. The user interface of claim 11, further comprising: A button representing a dental condition, wherein the user interface is configured to visualize a dental condition on a first digital 3D dental model or a second digital 3D dental model based on a user selection of the button representing the dental condition.

13. The user interface according to claim 12, wherein, The dental condition is visualized as a surface color overlay.

14. The user interface according to any one of claims 1 to 13, wherein, The conversion from the first digital 3D dental model to the second digital 3D dental model includes transforming the first digital 3D dental model into the second digital 3D dental model.

15. The user interface according to any one of claims 11 to 14, wherein, The conversion from the first digital 3D dental model to the second digital 3D dental model includes adjusting the transparency level of the first digital 3D dental model to reduce its visibility, and adjusting the transparency level of the second digital 3D dental model to increase its visibility.

Images