System and method for dental image acquisition and recognition of early tooth enamel erosion

Abstract

The system and method of the present invention uses a uniquely trained convolutional neural network (CNN) to process raw images of a person's teeth captured through a camera according to given specifications, and identifies early erosion and its location on the raw tooth images.

Description

[Technical Field]

[0001] The present invention relates to a recognition and classification system and method for early stage dental enamel erosion, and in particular to an image analysis based recognition and classification system and method for training and using a convolutional neural network (CNN). [Background technology]

[0002] Convolutional neural networks for image classification are described, for example, in P. Pinheiro and R. Collobert, “Recurrent convolutional neural networks for scene labeling. Proceedings of the 31st International Conference on Machine Learning, Beijing, China, 2014. JMLR: W&CP volume 32 (pp. 82-90); I-Saffar et al., “Review of Deep Convolution Neural Network in Image Classification,” 2017 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, University Malaysia Pahang Institutional Repository. For a discussion of deep regression techniques, see Lathuiliere et al., “A Comprehensive Analysis of Deep Regression,” at arXiv:1803.08450v3 [cs.CV] 24 Sep 2020. Summary of the Invention

[0003] Oral diseases affect more than 3.58 billion people worldwide. The most common are abrasions and erosion, cavities in permanent teeth, calculus, gingivitis, plaque, and stains. Early diagnosis of these dental conditions is important.

[0004] Dental erosion is defined as a chemical process involving the dissolution of dental hard tissues, such as enamel and dentin, by non-bacterial acids. Dissolution occurs when the surrounding aqueous phase becomes undersaturated with tooth minerals. Although the World Health Organization (WHO) lists dental erosion in its International Classification of Diseases, clinicians tend to ignore erosive tissue loss as a disease in itself. One reason is that erosion and physical wear also contribute to the physiological loss of dental hard tissue throughout a person's lifetime.

[0005] Attrition is the gradual loss of hard tooth substance caused by mechanical actions other than mastication or tooth-to-tooth contact.

[0006] Importantly, the dissolution or loss of dental hard tissue is irreversible. Furthermore, if allowed to progress, the dissolution or loss of dental hard tissue can lead to lesions and serious dental problems.

[0007] Early dental hard tissue erosion does not cause clinical discoloration or softening of the tooth surface.Therefore, early dental hard tissue erosion is difficult to detect visually or by tactile sensing.In addition, early dental hard tissue erosion may not show any symptoms, or the symptoms may be minimal, and therefore difficult to evaluate.

[0008] Over time, however, continued exposure to acidic chemicals, including those found in soft drinks, alters the tooth's morphology. Eventually, lesions form, and the erosion manifests as a dull appearance. Also, as the lesions erode or approach the dentin, their color worsens, changing from yellow to brown. At this stage, the teeth are also more sensitive to thermal changes. Erosive lesions also become rough and may form small depressions.

[0009] Early diagnosis of dental erosion is important. Dental erosion can be prevented by proper tooth cleaning or by avoiding acidic foods that cause such erosion.

[0010] Erosive wear is difficult to assess because surface loss generally progresses slowly and requires long-term observation to detect changes. Another challenge is identifying a stable standard by which tooth substance loss can be measured.

[0011] To ensure coordination among clinicians in grading erosion, the Basic Erosion Wear Examination (BEWE) and the Visual Erosion Dental Examination (VEDE) have been developed. Various clinical indices have been designed to detect and quantify tooth surface loss due to erosion from other causes. Most indices were designed with a focus on clinical diagnosis and recording and monitoring erosive wear lesions. These indices rely on subjective clinical descriptions and may not be as accurate as desired when morphological changes are minimal.

[0012] Currently, clinical appearance is the most important diagnostic feature. As mentioned above, dental professionals may not easily recognize the very early stages of dental erosion and may overlook minor tooth surface loss (TSL), considering it a normal and inevitable occurrence in everyday life, and therefore erroneously decide that no specific intervention is necessary. Treatment is initiated only at the later stages of the disease, when dental hard tissue erosion becomes apparent through routine examination, i.e., when dentin is exposed and the appearance and shape of the teeth are significantly changed.

[0013] Given that dental erosion is primarily identified using visual appearance, consumers must rely on the expertise of a dentist to determine whether dental erosion is present.

[0014] In addition to their expertise, dentists on whom consumers rely have access to sophisticated dental image capture systems. These systems are generally expensive but are intended for use by professionals in specialized settings. These systems often include several components in addition to the image capture device itself. One example includes sophisticated lighting equipment.

[0015] The output of these systems is for professionals and requires specialized training. These systems can require a lot of space and specific environmental adjustments. These systems are expensive and can be consumer-prohibitive. These systems require a substantial investment by the consumer simply to detect early stages of enamel erosion. Additionally, these systems require technical maintenance that is beyond the capabilities of a typical consumer.

[0016] The present invention provides a system and method for detecting dental erosion.

[0017] The present invention also provides a system and method that is an intelligent tool capable of identifying early enamel erosion.

[0018] The present invention further provides a system and method for routine dental practice to enable determination of the progression of dental erosion.

[0019] The present invention provides systems and methods that use convolutional neural networks (CNNs). CNNs are deep learning algorithms that can be trained on large data sets with millions of parameters. Deep learning algorithms are designed to mimic the function of the human cerebral cortex. These algorithms are representations of deep neural networks, i.e., neural networks with many hidden layers.

[0020] The present invention provides such a system and method that aims to model high-level abstractions in data by using deep graphs with multiple processing layers for automatic feature extraction. Such algorithms automatically grasp the relevant features needed to solve the problem, thereby reducing the work of dental professionals.

[0021] The present invention provides a system including an imaging device, a display device, and a processor.

[0022] The present invention also provides a neural network algorithm that takes metadata as input and processes the metadata through several layers of non-linear transformations to compute an output classification.

[0023] The present invention provides an effective, convenient and cost-effective method for acquiring dental images in the privacy of a consumer's own personal space or home.

[0024] The present invention provides a hands-free smart intraoral image acquisition and display system that can incorporate visible and near-infrared image capture mechanisms and illumination sources.

[0025] The present invention provides an image capture system that can be used by consumers in their own home environment without prior training.

[0026] The system can integrate with the consumer's own smartphone or smart display device to show captured images in real time and send the processed images to a cloud-based processing system before returning them to the consumer's display.

[0027] The system allows consumers to capture dental images in their own private space that can be used to process and identify dental pathology through a cloud-based imaging system, without the need for training or manually operating equipment.

[0028] The present invention further provides systems and methods that provide consumers with a self-care approach, which can include lifestyle adjustments that halt the progression of enamel erosion and other oral diseases. Advantageously, the systems and methods benefit consumers in that they will experience fewer oral symptoms throughout their lifetime, but also spend less time and money managing their oral health.

[0029] The above is not intended to describe each disclosed implementation, and features in the present disclosure may be incorporated into additional features as detailed herein below, unless expressly stated to the contrary. [Brief explanation of the drawings]

[0030] The accompanying drawings illustrate aspects of the present invention and, together with the general description herein, serve to explain the principles of the invention. As shown throughout the drawings, like reference numerals indicate like or corresponding parts. [Figure 1] 1 is a system according to the present invention. [Figure 2] 1 shows a CNN diagram according to the present invention. [Figure 3] It shows the convolution performed by a 3x3 kernel on the original image to produce a 6x6 matrix. [Figure 4] FIG. 1 is a diagram illustrating types of pooling in a CNN according to the present invention. [Figure 5] 1 illustrates a process according to the present invention for identifying early erosion and its location on a raw image of a tooth. [Figure 6] 1 is a perspective view showing an imaging device according to an embodiment of the present invention. [Figure 7] 1 illustrates an exemplary display device according to the present invention. [Figure 8] 2 illustrates another exemplary display device according to the present invention. [Figure 9] 1 illustrates an operating environment for the system and method of the present invention. [Figure 10]1 is a flowchart of a method for capturing dental images according to the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0031] The system and method of the present invention uses a uniquely trained convolutional neural network (CNN) to process images of a person's teeth captured through a camera, thus enabling the system and method to identify early erosion and the location of erosion on the teeth.

[0032] Referring to the drawings, and in particular to FIGS. 1 and 6, there is shown a system for training a CNN in accordance with the present invention, generally referenced 100, and a system for identifying early erosion, generally referenced 600.

[0033] Referring to FIG. 1, system 100 includes the following exemplary components electrically and / or communicatively connected: a computing unit 102, a digital image capture device 104, an image processor 106, and a trained neural network model 108.

[0034] The trained neural network model 108 may be local or may reside on a server 190 communicating over a network 192 such as the Internet.

[0035] The computing unit 102 may have a control unit 140 configured to include a controller 142, a processing unit 144, and / or a non-transitory memory 146. The computing unit 102 may also have an interface unit 148, which may be configured as an interface for an external power connection and / or an external data connection, a transceiver unit 152 for wireless communication, an antenna 154, and a display 156. The components of the computing unit 102 may be implemented in a distributed manner.

[0036] 1 and 2, image processor 106 of system 100 is operatively connected or coupled to network 192. Image processor 106 is configured to receive images, including one or more dental images 205 of a person, from digital image capture device 104. Image processor 106 is further configured to provide images 205 for training or to a trained neural network model 108, such as CNN 110 of FIG.

[0037] The CNN 110 is a deep learning algorithm that can receive an image as input and can classify the image 205 or identify and distinguish objects within the image 205.

[0038] The CNN 110 is configured to learn and determine the enamel erosion for each tooth based on the images received from the image processor. The CNN 110 or neural network model 108 also learns and determines the amount of grading associated with the enamel erosion so that the system 100 can provide feedback.

[0039] 2, the CNN 110 has four main components: an input layer 210, a convolutional layer 220, a pooling layer 230, and a fully connected layer 240. Each layer 210, 220, 230, and 240 has neurons.

[0040] The input layer 210 contains pixel values ​​of the image 205 .

[0041] The convolution layer 220 holds the main features extracted by the process of convolution. The main task of convolution is to reduce the image size and extract the main features. Convolution is achieved using a kernel / filter, which is an NxN matrix. The output of the convolution is the feature map 222.

[0042] The system 100 extracts salient features through the pooling layer 230 .

[0043] The fully connected layer 240 contains neurons that are directly connected to neurons in adjacent layers. The fully connected layer 240 performs classification tasks and makes predictions.

[0044] Figure 3 illustrates the convolution process and how it is performed by a 3x3 kernel on the original image to produce a 6x6 matrix (see, for example, AD Nishad, “Convolution Neural Network (Very Basic) / Data Science and Machine Learning / Kaggle, https: / / www.kaggle.com / general / 171197). Figure 4 is an illustrative example of the type of pooling in a CNN, showing how peaks and averages are calculated. In Figures 3 and 4, the numbers in the grid indicate how the image may be represented in the neural network as it is processed.

[0045] The convolution is shown in Figure 3 as a square 302 (a 3x3 matrix) to square 304 shifting from left to right on the input image. When the convolution reaches the rightmost edge of the image 205, a shift down by one row occurs, and the process repeats, scanning the entire image. With each shift to the right, a matrix multiplication is performed between the kernel and the image it overlies. The resulting sum is inserted into a new grid, the feature map 222.

[0046] The system 100 extracts salient features by pooling.

[0047] 4, pooling further reduces the size of the feature map 222, advantageously reducing the computational power required for the process. Common types of pooling are max pooling 402 and average pooling 404. Max pooling 402 returns the maximum value within the region covered by the kernel. Average pooling 404 returns the average value of all values ​​within the region covered by the kernel.

[0048] Next, with reference to FIG. 5, the process according to the present invention will be described.

[0049] In step 1, raw images are captured using a camera and submitted to a trained CNN.

[0050] In an embodiment, the raw image clearly shows two rows of teeth in a frontal view with proper lighting that does not distort the appearance of the teeth with shadows, discoloration, over- or under-exposure.

[0051] In an embodiment, the area of ​​the image occupied by teeth is at least 60%.

[0052] In this example, the image aspect ratio is 4:3 and the minimum resolution is 800x600 pixels.

[0053] In step 2, the CNN processes the submitted image to identify one or more regions where incipient enamel erosion is likely to be present.

[0054] The CNN is trained on images tagged by trained clinicians using their expertise and judgment. Two sets of dental images were acquired and tagged to train the CNN110. Images were obtained from approximately 700 patients.

[0055] Tagging can be performed according to the BEWE scoring system described by Bartlett et al., "Basic Erosive Wear Examination (BEWE): a new scoring system for scientific and clinical needs," Clin Oral Invest (2008) 12 (Suppl 1):S65-S68, which is incorporated herein by reference. The four-level score assesses the severity of tooth appearance or wear: no surface loss (0), early loss of enamel surface texture (1), obvious defects, hard tissue loss (dentin) in less than 50% of the area (2), and hard tissue loss in more than 50% of the area (3).

[0056] Dental erosive wear tagging can also be performed according to the Visual Erosion Dental Examination (VEDE) system, which has the following criteria: Grade 0 = no erosion; Grade 1 = early enamel loss, no dentin exposure; Grade 2 = significant enamel loss, no dentin exposure; Grade 3 = dentin exposure, less than one-third of the surface; Grade 4 = dentin exposure, one-third to two-thirds of the surface; Grade 5 = dentin exposure, more than two-thirds of the surface. See, e.g., Mulic et al., "Reliability of two clinical scoring systems for dental erosive wear," Caries Res 2010;44(3):294-9, which is incorporated herein by reference.

[0057] In this example, dentists tagged images using their own clinical judgment in agreement with BEWE or VEDE scoring regarding conditions observed in the images.

[0058] In the first set of dental images, the training focus was based on observing early erosion. In the first set of dental images, the training focus was also on erosion, but also included wear.

[0059] Thus, the tagging indicated the area or location, the extent or size, the color change within the area and any surface changes. In other words, the tagging was based on clinical evidence.

[0060] Conditions trained include early enamel erosion, gingivitis, abrasions and erosions, caries in permanent teeth, calculus, plaque, and stains.

[0061] Approximately 1000-1500 data points were used for training for each condition, with approximately 700 data points used for gingivitis training due to its rarity.

[0062] By way of non-limiting example, the tagging mechanism may indicate risk, sensitivity, classification, and degree.

[0063] In an embodiment, the algorithm on which the CNN 110 is based can resize the image to fit the optimal processing capabilities of the CNN. The algorithm can use a set of predetermined anchors specific to recognizing early enamel erosion at scales of 24, 46, and 64, and ratios of 1:1, 1:1.4, and 1.4:1 during object candidate region detection.

[0064] In such an example, the algorithm may have a unique overlap threshold and algorithm confidence threshold that is tailored to the need to identify incipient enamel erosion.

[0065] In step 3, the CNN 110 generates a processed image with tags, as shown in step 2. The generation of the processed image can be performed in real time. The processed image with tags is sent from the server 190 on which the CNN 110 is based to the display 156 shown in FIG. 1.

[0066] In an embodiment, the process described in steps 1-3 is managed by a software application written for a digital device, such as a smart device (e.g., ANDROID® or IOS® based) that has its own digital image capture device (camera). The software application facilitates image capture, image storage, image transmission to server 190 where CNN 110 is located, reception of processed images from server 190 over network 192, and display of the processed images for the consumer on display 156.

[0067] Referring to FIG. 6, a system 600 will be described.

[0068] The system 600 includes an image capture device 602 for capturing intraoral images and a display device 604 that provides the user with device functionality for previewing, photographing, storing, analyzing, and transmitting intraoral images. The image capture device 602 includes a camera 606 sensitive to visible and / or near-infrared light and a light source 608 disposed within or around a housing 610.

[0069] Image capture device 602 is configured to capture images of the front and interior surfaces of the teeth as the user opens their mouth and poses so that the teeth are visible and positioned at a predetermined distance. The process of using image capture device 602 is guided by display device 604. Display device 604 may include visual guidelines and instructions and provides functionality for automated, hands-free operation.

[0070] The image capture device 602 is communicatively coupled to the display device 604. In an embodiment, the image capture device 602 is communicatively coupled to the display device 604 by wireless communication. In another example, the image capture device 602 is communicatively coupled to the display device 604 by wired communication.

[0071] In an exemplary embodiment, image capture device 602 automatically captures and transmits images of the teeth in real time to display device 604, allowing the user to view and adjust positioning. Image capture may be triggered by, for example, a user sound, such as "eee" or "aahh," for a few seconds while the teeth are visible on display device 604. This function, the "tooth detection function," may be software or hardware.

[0072] The light source 608 can be a white LED and / or a near-infrared LED, which can be switched on and off to provide illumination of two different wavelengths to the system, allowing for the acquisition of visible and / or near-infrared images.

[0073] The light source 608 is controlled by an application on the display device 604. The data processing unit is further connected to a Bluetooth module via which the data processing unit 624 can connect with the display device 604 for transmitting data.

[0074] Preferably, the LEDs are in the visible and / or near infrared wavelengths of 940 nm, 1000 nm, and 1300 nm. The illumination is synchronized with the capture of images and is controllable by the display device 604.

[0075] Also within the housing 610 is a main control circuit board 620 that includes a battery 622, a data processing unit 624, and a Bluetooth module 626. The data processing unit 624 is communicatively connected to the camera 606 and controls the camera to capture images. The data processing unit 624 is also connected to the light source 608.

[0076] The housing 610 can optionally be mounted to an adjustable stand 612 supported on a platform 614. By mounting the device on a fixed, adjustable support, the system 600 avoids the need for the user to handle the image capture device 602. This allows the user to pose freely without having to adjust mechanical or manual controls, making it easy for the user to position their mouth relative to the camera. Thus, the system 600 facilitates obtaining high-quality dental images for processing.

[0077] The display device 604 may be a smartphone 700 as shown in FIG.

[0078] Smartphone 700 is comprised of logic and circuitry configured to perform one or more (preferably all) of the following functions: guide the user in taking optimal images of the teeth; receive captured images from the image capture device via Bluetooth; display the images; provide guidelines and instructions for the user to adjust tooth positioning; store the images; transmit the stored images via the Internet to image processor 106 or an equivalent cloud-based image processing system; receive processed images from the cloud-based image processing system via the Internet; and display the processed images with tags identifying dental pathology. Advantageously, the smartphone is a large-screen touch-sensitive mobile phone for ease of viewing.

[0079] The smartphone 700 may have software applications configured to facilitate the aforementioned functions, and preferably further includes one or more (preferably all) of the following functions: identifying the visible tooth surfaces / contours, appropriate distances and proportions of the visible teeth; transmitting images to a display device in real time; and storing images. The software is preferably configured to provide the device functions of previewing, taking, storing, analyzing, and transferring oral images to the user.

[0080] As mentioned above, the smartphone 700 is further configured with software to use audio, graphics, or both to guide the user in obtaining optimal images through the tooth detection feature.

[0081] The tooth detection function is a software feature that determines the appropriate ratio, distance, and clarity of the image to be captured prior to acquisition. The tooth detection function triggers the image capture device by identifying an open mouth and visible teeth, or by the user indicating teeth for a preset period of time, such as two, three, or more seconds, when making a specific sound, such as "eee." The tooth detection function allows the user to capture an image of the user's teeth without the need for manual operation.

[0082] Alternatively, as shown in FIG. 8, display device 604 may be a dedicated display device 800 having logic and circuitry configured to perform one or more (preferably all) of the following functions: guiding the user to take optimal images of the teeth; receiving captured images from an image capture device via Bluetooth; displaying the images; providing guidelines and instructions for the user to adjust the position of the teeth; storing the images; transmitting the stored images to image processor 106 or an equivalent cloud-based image processing system via the Internet; receiving processed images from image processor 106 or a cloud-based image processing system via the Internet; and displaying the processed images with tags identifying dental pathology.

[0083] The special purpose display device 800 may have software applications configured to facilitate the aforementioned functions, and further capable of: identifying visible tooth surfaces / contours, appropriate distances and proportions of visible teeth; transmitting images to and from the display device in real time; and managing image storage. The software is preferably configured to provide the device functionality of previewing, capturing, storing, analyzing, and transferring oral images to the user.

[0084] The dedicated display device can further include a "tooth detection function" as the smartphone 700.

[0085] 9, the image capture device 602 and the display device 604, such as a smartphone 700 or dedicated display device 800, can be connected to or attached to a mirror, such as a bathroom mirror 916. Thus, a user can easily incorporate the system 600 into their daily dental routine in the comfort of their own bathroom.

[0086] The apparatus 600 is in communication with a network 192 (FIG. 1), such as the Internet. Captured images can be transmitted by the display device 604 over the Internet to a cloud-based image processing system or image processor 106. The cloud-based image processing system or image processor can transmit processed images back over the Internet to the display device 604. The display device 604 can connect to the Internet via an integrated wireless connectivity module.

[0087] Referring now to FIG. 10, operation 1000 of system 600 will be described.

[0088] In step 1002, the user turns on the image capture device 602, thereby turning on the camera and the illumination source. Thus, in step 1002, the image capture device 602 is powered on.

[0089] In step 1004, the user connects the display device 604 to the image capture device 602 and positions the device. The image capture device 602 and the display device 604 may also automatically connect based on detected proximity. Thus, in step 1004, the display device 604 communicatively connects to the image capture device 602.

[0090] In step 1006, the user exposes their front / inner teeth to the camera 606. This allows the user to preview the image in real time on the display device 604. Thus, in step 1006, the display device 604 displays a preview image of the user's exposed teeth as captured by the camera 606.

[0091] In step 1008, if desired, the user adjusts the exposed teeth so that they appear within the guidelines shown on the display device 604, or by following voice commands from the same display device, so that the display device 604 provides audio and / or visual feedback or guidelines to the user.

[0092] In step 1010, the user holds the exposed teeth in place for a preset time to capture an image of the teeth, or makes a sound like "eee" for a few seconds while the teeth are visible to activate the camera. Thus, in step 1010, an image of the exposed teeth is captured.

[0093] In step 1012, the display device / smartphone stores and transmits the captured images to an image processor storage device and / or a cloud-based image processing system via the internet.

[0094] In step 1014, a trained convolutional neural network (CNN) analyzes the image, for example, CNN 110 of FIG.

[0095] In step 1016, the CNN detects and labels dental lesions.

[0096] In step 1018, the analyzed image is transmitted back to the display device 604 via the Internet.

[0097] In step 1020, the display device 604 displays and stores the analyzed images along with the assessment of dental pathology detected and labeled by the CNN during processing. The user can turn off the image capture device 602 to end the session.

[0098] Based on the processed images and classification, the system 600 can provide the consumer with specific instructions regarding the next course of action. Non-limiting examples include cleaning and flossing instructions, special treatment for dental recommendations, lifestyle adjustment advice, and dental checkup reminders.

[0099] In particular, the invention in various embodiments is described in the following numbered paragraphs:

[0100] (1) A system for training an image recognition algorithm for detecting early enamel erosion, the system comprising an image processor connected to a network, the image processor configured to: receive a set of images from a digital device; tag one or more regions on each image of the set where indicators of early enamel erosion are present; provide the tagged images to a neural network model to train the neural network model to recognize enamel erosion based on the tagged dental images; and detect enamel erosion from the trained neural network model.

[0101] (2) The system of (1), wherein the trained neural network model is a recurrent deep learning convolutional neural network model.

[0102] (3) The system of (2), wherein the recurrent deep learning convolutional neural network model is trained with dental images of a person associated with a corresponding initial enamel erosion image.

[0103] (4) The system described in (2), wherein the convolutional neural network receives input data to be recognized, performs object recognition, and outputs the object recognition result.

[0104] (5) The system described in (2), wherein the convolutional neural network receives input data for object recognition, and the object recognition outputs the processing target recognition result.

[0105] (6) The system described in (5), wherein the target recognition process includes each convolution in a convolution layer, and each neuron is based on each input channel signal, data of separately convolved signals of each channel, a channel selection section signal, and a signal of a selected channel result of convolution mapping features to obtain feature information.

[0106] Thus, following multiple convolutions, feature maps are generated, then regions of interest are extracted and fed to a fully connected layer, and finally classification is performed and bounding boxes are created.

[0107] (7) The system described in (6), wherein the characteristic information obtained as a result of the output of the neuron is the input and output of a convolutional next layer neuron.

[0108] (8) The system described in (1), further comprising a server and a network, wherein the trained neural network model is stored on the server.

[0109] (9) The system of (1), further comprising a digital device configured to capture the images, including dental images of the person, and the digital device electrically coupled to the network.

[0110] (10) The system of (1), wherein the image processor is further configured to evaluate the image to determine the extent of enamel erosion of the person.

[0111] (11) The system described in (1) further comprising an electronic device that receives the detected enamel erosion of the person and receives the input from the electronic device to a smartphone.

[0112] (12) An image acquisition system for detecting early stage enamel erosion, comprising: an image acquisition device; and a display device operatively connected to the image acquisition device; The image acquisition system is configured to: capture images of a user's exposed teeth; send the obtained images to a trained CNN, which analyzes the obtained images by detecting and labeling dental pathologies to generate an analyzed image; and receive the analyzed image and display it on a display device.

[0113] (13) The system according to (12), further comprising a light source.

[0114] (14) The system described in (13), wherein the light source is configured to emit visible light and near-infrared light.

[0115] (15) The system described in (12), wherein the image capture device is sensitive to visible and near-infrared light sources.

[0116] (16) The system of (12), wherein the image capture is based on a timer.

[0117] (17) The system described in (12), wherein the image capture is based on a voice command.

[0118] (18) The system of (1), wherein the enamel erosion detection uses a set of predetermined anchors specific to recognize early enamel erosion at ratios of 1:1, 1:1.4, and 1.4:1 at scales of 24, 46, and 64 during object candidate region detection.

[0119] (19) A method for training an image recognition algorithm for early enamel erosion detection using the system of (1).

[0120] It should be noted that terms such as "first," "second," etc. may be used herein to modify various elements. These modifiers do not imply a spatial, sequential, or hierarchical order to the modified elements unless otherwise specified.

[0121] As used herein, the terms "a" and "an" mean "one or more" unless otherwise specified.

[0122] As used herein, the term "substantially" refers to the complete or nearly complete degree or extent of an operation, feature, characteristic, state, structure, item, or result. For example, a "substantially" enclosed object means that the object is either completely enclosed or nearly completely enclosed. The exact degree of acceptable deviation from absolute completeness may depend on the particular situation. However, in general, the proximity of completion will have the same overall result as if absolute and complete completion had been achieved.

[0123] As used herein, the term "comprising" means, but is not limited to: the term "consisting essentially of" means The term "consisting of" means that a method, structure, or composition of matter includes only the specifically recited steps or components. It may also include other elements that do not materially affect the basic novel characteristics or features of the method, structure, or composition of matter. The term "consisting of" means that the method, structure, or composition of matter includes only the specifically recited steps or components.

[0124] As used herein, the term "about" is used to provide flexibility to the endpoints of numerical ranges by providing that a given value may be "slightly above" or "slightly below" the endpoints. Furthermore, when a range of numerical values ​​is provided, that range is intended to include any and all numbers within that numerical range, including the endpoints of the range.

[0125] Although the present invention has been described with reference to one or more exemplary embodiments, those skilled in the art will recognize that various changes can be made and equivalents substituted for elements thereof without departing from the scope of the invention. In addition, many modifications can be made to adapt a particular situation or material to the teachings of the invention without departing from its scope. Therefore, it is not intended that the invention be limited to the particular embodiments disclosed herein, but rather that the invention will include all aspects that come within a fair reading of the invention.

Claims

1. 1. A system for training an image recognition algorithm for early enamel erosion detection, comprising: an image processor connected to a network, the image processor comprising: receiving an image set from a digital device; tagging one or more regions on each image of said set where signs of incipient enamel erosion are present; providing the tagged images to a neural network model to train the neural network model to recognize enamel erosion based on the tagged dental images; Detecting enamel erosion from the trained neural network model; It is structured as follows: The trained neural network model is a deep learning convolutional neural network model, and the recognition target is enamel erosion; The enamel erosion detection uses a set of predetermined anchors specific to recognizing incipient enamel erosion at ratios of 1:1, 1:1.4, and 1.4:1 at scales of 24, 46, and 64 during object candidate region detection. system.

2. 10. The system of claim 1, wherein the deep learning convolutional neural network model is trained with dental images of a person associated with a corresponding initial enamel erosion image.

3. The system of claim 1 , wherein the deep learning convolutional neural network model is capable of receiving input data of the recognition target, performing object recognition, and outputting the object recognition result.

4. The system of claim 1 , wherein the system further comprises a server and a network, and the trained neural network model is stored on the server.

5. The system of claim 1 , further comprising a digital device configured to capture the image, the digital device being electronically coupled to the network.

6. The system of claim 1 , wherein the image processor is further configured to evaluate the image to determine the extent of the enamel erosion.

7. The system of claim 1 , further comprising an electronic device for receiving the detected enamel erosion and transmitting an input indicative of the received enamel erosion to a smartphone.

8. 10. A method of training an image recognition algorithm for early enamel erosion detection using the system of claim 1.

Images