Method and apparatus for training an automated dental charting system - Patents.com
An automated dental charting system using AI and neural networks analyzes various dental images to improve the accuracy and efficiency of dental records by generating and updating electronic charts with precise tooth information, addressing the need for enhanced relevance and construction methods.
Patent Information
- Application Number
- JP2021546700
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-02-07
- Filing Date
- 2020-02-07
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2040-02-07
AI Technical Summary
Existing dental records, although efficient, require improvements in relevance and construction methods to enhance their accuracy and efficiency.
A computer method for training an automated dental charting system using a neural network to analyze multiple types of digital images, including visible light, ultraviolet, infrared, OCT, X-ray, and CBCT images, to generate and update electronic dental charts by extracting relevant information and training an AI engine to identify and characterize teeth and their conditions.
The system enhances the accuracy and reliability of dental records by automatically generating and updating electronic dental charts with precise tooth information, improving the diagnostic and treatment tracking capabilities of dental professionals.
Smart Images

Figure 0007586826000001 
Figure 0007586826000002 
Figure 0007586826000003
Abstract
Description
[Technical field]
[0001] The present invention relates to the technical field of dental charting, and more particularly to a method and apparatus for training an automatic dental charting system, e.g. a method and apparatus for training an automatic dental charting system based on artificial intelligence, such as a dental charting system based on neural networks. [Background technology]
[0002] Dental charts assist dentists in the systematic diagnosis, tracking, and treatment of teeth and supporting structures. The common use of electronic devices for storing and displaying images by dentists has led to the widespread use of digital dental charts that can be viewed and updated as needed.
[0003] Methods exist for automatically generating an electronic dental chart for a patient using information obtained from the analysis of any of several types of digital images acquired from the patient, such as the method described in U.S. Patent No. 8,416,984, which allows for the generation of a template dental chart for the patient in accordance with the acquired image data, where the position of each imaged tooth is represented by a symbol characterizing the condition (e.g., restorations and treatments) of the tooth.
[0004] 1a is a depiction of a patient's dental chart 100, where each tooth is represented by a symbol, such as symbol 105. The dental chart 100 may be generated from images of the patient's teeth using analysis of the images. The dental chart 100 may show patient-specific features such as the number of teeth, relative tooth sizes, detected tooth contours and angles, as well as overall tooth condition, tooth color, restorations and other treatments of teeth or specific surfaces of teeth.
[0005] As shown, different types of images may be associated with the tooth depiction. The images acquired may be of one or more image types or modalities including visible light images (VL), ultraviolet images (UV), infrared images (IR), fluorescent images (F), OCT (optical coherence tomography) images, X-ray images (X), image projections used to form volumetric images in CBCT (dental cone beam computed tomography) processing, contour images, 3D mesh images, and ultrasound images.
[0006] The tooth symbols may be suitably highlighted or otherwise marked to indicate whether an image has been acquired and is associated with a corresponding tooth, and to give specific information about the corresponding tooth, such as information about previous restorations and treatments or information about the surrounding gums or bone.
[0007] Images can be added to the dental chart at any time, typically each time a patient makes an appointment with a dentist. Similarly, tooth information can be updated at any time.
[0008] As shown in Figure lb, the dentist can use a pointing device to access images or information items related to the teeth, link new images to the teeth, and enter new information items related to the teeth. For example, the dentist can use a mouse-controlled pointer 110 to open window 115 to edit or modify notes related to tooth 2, which is referenced in text field 120. [Prior art documents] [Patent documents]
[0009] [Patent Document 1] U.S. Pat. No. 8,416,984 Summary of the Invention [Problem to be solved by the invention]
[0010] Although such dental charts have proven to be very efficient, there is a continuing need to improve them, to improve their relevance and to improve the way in which they are constructed.
[0011] The present invention has been devised to address one or more of the above-mentioned concerns. [Means for solving the problem]
[0012] According to a first aspect of the present invention there is provided a computer method for training an automated dental chart generation system connected via a communications network to a plurality of dental information systems, each of the dental information systems being configured to generate an electronic dental chart, each of the generated electronic dental charts including a digital image and an associated item of information characterizing at least a portion of the corresponding digital image, The information items are: The area below the root and crown, whether the tooth is present, periapical lesions, whether there are root canals, intra-root posts, bone loss, ankylosis, sinus infection, and swelling of the sinus floor; Also, for the crown level area, whether to restore, 3D medial-distal restoration extent, crown and material type, restorative liner, restorative collapse, and interproximal collapse. Also, features not detectable on radiographs include buccal-lingual restoration coverage, fractures, peri-restorative leakage, and peri-restorative enamel fractures. At least one of the following items is included: The computer method comprises: Through a communication network, multiple Dental Information System acquiring a plurality of electronic dental charts generated by the method of claim 1, the plurality of electronic dental charts relating to a plurality of patients; For each electronic dental record obtained, - extracting at least a portion of the image depicting the tooth or the region of interest and obtaining at least a corresponding item of information characterizing the depicted tooth or the depicted region of interest; storing at least a portion of the extracted images and corresponding information items in a training dataset; training an automated dental charting system using the training data set; A computer method is provided, comprising:
[0013] According to the methods of the present invention, an automated dental charting system can be trained to generate and / or update a reliable electronic dental chart.
[0014] According to an embodiment, the method further comprises a step of filtering the image from which at least a portion of the image is extracted.
[0015] According to an embodiment, the extracted at least part of the image depicting the tooth or region of interest is extracted automatically based on the acquired information items characterizing the tooth or region of interest.
[0016] According to an embodiment, the method further comprises a step of obtaining a type of image from which at least a portion of the image is extracted, the obtained type of image being stored in the training data set in association with the corresponding at least a portion of the image.
[0017] According to an embodiment, the method further comprises a step of identifying at least a portion of the extracted image, the at least a portion of the image being identified depending on an item of information associated with the image from which the at least a portion of the image is identified.
[0018] According to an embodiment, at least one of the electronic dental charts includes several types of images depicting at least the same teeth or the same region of interest, and the steps of extracting and storing are repeated such that the training data set includes at least a portion of each of the several types of images, which may include an ultraviolet image type, a visible light image type, an infrared image type, an OCT image type, an X-ray image type, a CBCT image type, an ultrasound image type, a fluorescence image type, and / or a 3D mesh image type.
[0019] According to an embodiment, the automated dental charting system includes an artificial intelligence engine, which may include at least one artificial neural network.
[0020] According to an embodiment, each of the plurality of electronic dental charts is obtained from a server via a communications network, the server being different from the dental information system that generated the electronic dental chart of the plurality of electronic dental charts.
[0021] According to a second aspect of the invention there is provided a computer method for automatically assigning medical chart data to at least a portion of an image depicting a tooth or an area of interest, comprising the steps of: obtaining at least a portion of an image depicting a tooth or an area of interest; and using an automated dental charting system trained according to the above-described method to assign items of information characterizing the depicted teeth or regions of interest to at least a portion of the image.
[0022] At least some of the methods according to the invention may be computer-implemented. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects (all of which may be referred to generally herein as a "circuit," "module," or "system"). Furthermore, the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer-usable program code embodied in the medium.
[0023] Since the present invention can be implemented in software, the present invention can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium. Tangible carrier media can include storage media such as floppy disks, CD-ROMs, hard disk drives, magnetic tape devices, or solid state memory devices. Transient carrier media can include signals such as electrical signals, electronic signals, optical signals, acoustic signals, magnetic signals, or electromagnetic signals, e.g., microwave or RF signals.
[0024] Other features and advantages of the invention will become apparent from the following description of non-limiting exemplary embodiments, with reference to the accompanying drawings, in which: [Brief description of the drawings]
[0025] [Figure 1a] FIG. 1 is a diagram showing a patient's dental chart. [Figure 1b] FIG. 1 is a diagram showing a patient's dental chart. [Diagram 2] FIG. 1 illustrates a computing device for training an automated dental charting system connected to multiple dental information systems via a communications network, in which an embodiment of the present invention can be implemented. [Diagram 3] 3 is a schematic block diagram of the computing device shown in FIG. 2 for implementing one or more embodiments of the present invention. [Figure 4] 3 is a schematic diagram illustrating a dental information system, such as one of the dental information systems of FIG. 2, from which an electronic dental chart and / or a portion of an electronic dental chart is generated. [Diagram 5] FIG. 1 shows the steps of an automated dental charting system. [Figure 6a] FIG. 6 illustrates an example of steps performed by an AI engine such as that shown in FIG. 5 to generate an electronic dental chart. [Figure 6b] FIG. 1 illustrates an example of steps for training such an AI engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] The following is a detailed description of a specific embodiment of the present invention, with reference to the drawings in which like reference numerals identify like elements of structure in each of the several views.
[0027] In the following drawings and text, similar components are indicated by similar reference numerals, and similar descriptions regarding the arrangement or interaction of components and components already described are omitted. Terms such as "first", "second", etc., when used, do not necessarily indicate an ordinal or priority relationship, but may simply be used to more clearly distinguish one element from another element.
[0028] 2 illustrates a computing device 200 for training an automated dental charting system 205, capable of implementing embodiments of the present invention, connected to a number of dental information systems 210-1 to 210-3 via a communications network 215. According to the illustrated example, computing device 200 is further connected to a storage device 220.
[0029] The computing device 200 and the automated dental charting system 205 may be two different devices that are directly connected to each other or connected via the communication network 215 or another communication network, e.g., a private network. The computing device 200 and the automated dental charting system 205 may also be integrated into the same device.
[0030] Note that for purposes of illustration, only three dental information systems and one storage device are shown, however, it should be understood that computing device 200 may be connected to hundreds or thousands of dental information systems and / or hundreds or thousands of storage devices.
[0031] According to an embodiment, each dental information system is configured to acquire dental images of a patient and generate an electronic dental chart. The acquired images can be images of different types or modalities, including visible light images (VL), ultraviolet images (UV), infrared images (IR), OCT images, fluorescence images (F), X-ray images (X), image projections used to form volume images in CBCT (dental cone beam computed tomography) processing, contour images, 3D mesh images, and ultrasound images. The generated electronic dental chart includes images and related information items related to the patient's teeth, providing information about the patient's teeth. Both the images and the related information are synchronized.
[0032] The electronic dental chart, or portions of the electronic dental chart, may be obtained directly from the dental information system or from one or more storage devices, such as storage device 220, in which they were previously stored.
[0033] According to an embodiment, the dental information systems generate the electronic dental charts based on the same template or compatible templates, and the same symbols have the same meaning, so that they can be automatically decoded by a piece of software. For illustration purposes, the electronic dental charts are generated by the same software application installed within or accessed by each dental information system (e.g., if the software application is provided as a service).
[0034] According to further particular embodiments, each of the dental information systems can transfer the generated electronic dental chart or a part of the generated electronic dental chart to a remote device, such as a remote storage or information system. Preferably, the generated electronic dental chart (or a part of the generated electronic dental chart) is transferred after being anonymized, in which case it is not possible to identify the patient with whom the generated electronic dental chart (or a part of the generated electronic dental chart) is associated.
[0035] FIG. 3 is a schematic block diagram of a computing device 200 shown in FIG. 2 for implementing one or more embodiments of the present invention, and in particular for performing the steps or portions of the steps described with reference to FIGS. 5, 6a, and 6b.
[0036] The computing device 200 includes: - a central processing unit 305, such as a microprocessor, denoted as CPU; a random access memory 310, denoted RAM, for storing the executable code of the method of an embodiment of the invention, and registers arranged to record variables and parameters necessary for the implementation of the method for training an automatic dental charting system according to an embodiment of the invention, the memory capacity of which can be expanded, for example by any RAM connected to an expansion port; a read-only memory 315, denoted ROM, for storing a computer program for implementing an embodiment of the invention; - a user interface and / or input / output interface 330 that can be used to receive input from a user, display information to a user, and / or receive / transmit data from / to an external device; - a network interface 320, which is typically connected to a communication network capable of transmitting and receiving digital data to and from remote devices, in particular from the dental information systems 210-1 to 210-3 and / or the storage device 220, and to and from the automated dental charting system 205, and a communication bus connected to the network interface 320. The network interface 320 may be a single network interface or may be composed of a series of different network interfaces (e.g., wired and wireless interfaces, or different types of wired or wireless interfaces). Data packets are written to the network interface for transmission or read from the network interface for reception under the control of a software application running on the CPU 305.
[0037] Computing Device 200 The communication bus may optionally be connected to a hard disk 325, denoted HD, used as mass storage device.
[0038] The executable code may be stored either in the read-only memory 315, in the hard disk 325 or on a removable digital medium, such as a disk. According to a variant, the executable code of the program may be received by a communications network, via the network interface 320, to be stored in one of the storage means of the computing device 200, such as the hard disk 325, before being executed.
[0039] The central processing unit 305 is configured to control and direct the execution of instructions of one or more programs or parts of software code according to embodiments of the present invention, the instructions being stored in one of the aforementioned storage means. After power-on, the CPU 305 may execute instructions from the main RAM memory 310 related to a software application, after loading it, for example, from the ROM 315 or the hard disk 325. Such software application, when executed by the CPU 305, causes the steps of the algorithms disclosed herein to be performed.
[0040] Any step of an algorithm disclosed herein may be implemented in software by execution of a sequence of instructions or a program by a programmable computing machine such as a PC ("personal computer"), a DSP ("digital signal processor") or a microcontroller, or other machine such as an FPGA ("field programmable gate array") or ASIC ("application specific integrated circuit") or implemented in hardware by dedicated components.
[0041] According to an embodiment, a schematic block diagram of the automated dental charting system 205 is similar to the schematic block diagram of the computing device 200 .
[0042] FIG. 4 is a schematic diagram illustrating a dental information system, such as one of dental information systems 210-1-210-3 of FIG. 2, that generates an electronic dental chart and / or a portion of an electronic dental chart.
[0043] As shown, the dental information system 210 includes at least one imaging device, which may be an x-ray imager 400, a digital camera 405, such as an intraoral camera, or a dental cone beam computed tomography (CBCT) system 410 for generating volumetric images of the tooth structure. Other types of imaging devices may also be used to obtain images of the teeth and supporting structures, gums, and associated tissues, such as devices using ultrasound or other imaging types. Additionally, various types of diagnostic measurement equipment may also be provided to operate the dental information system 210.
[0044] 4, a host processor 415, such as a computer or other type of dedicated logic processor for acquiring, processing, and storing image data from the imaging devices, is also part of the dental information system 210, along with one or more displays 425 for displaying the imaging results. The host processor 415 is in data communication with one or more image capture devices, and optionally with any number of automated measurement devices. Additionally, the host processor 415 may also be in data communication with a database of patient records stored internally or on a networked host or server, and computer-accessible memory 420 is also provided, which may be a non-volatile memory storage device used for long-term storage, such as devices using magnetic, optical, or other data storage media.
[0045] Additionally, host processor 415 includes a network interface 430 that is typically connected to communications network 215 capable of transmitting and receiving digital data to and from remote devices, particularly to and from computing device 200, automated dental charting system 205, and / or storage device 220. Network interface 430 may be a single network interface or may be comprised of a series of different network interfaces (e.g., wired and wireless interfaces, or different types of wired or wireless interfaces).
[0046] It should be noted that while different dental information systems may use similar imaging devices, such as similar x-ray imaging devices or similar intraoral cameras, these devices may be from different manufacturers or may be configured according to different settings. As a result, the images generated by these devices may look different, even if they depict the same object (e.g., the same tooth). Thus, some of the electronic dental records generated by different dental information systems, while supposed to be similar, may in fact be slightly different.
[0047] FIG. 5 shows the steps of the automated dental charting system.
[0048] As shown, the first step (step 500) is aimed at acquiring images of the patient's teeth, e.g., one extraoral panoramic image and several images of one or more teeth, e.g., x-ray images, visible light images, ultraviolet images, infrared images, OCT images, fluorescence images, and CBCT images.
[0049] These images are then processed (step 505) to generate an electronic dental chart using dental chart information (symbol 510). The processing of the acquired images can be based on an artificial intelligence (AI) engine, for example including one or more artificial neural networks. The artificial neural network can be a supervised neural network based on supervised learning. In supervised learning, a training set of input samples and associated labels must be presented to the neural network (each label describing an object of output). The set of corresponding labels can be determined according to a prior classification performed separately from the neural network by an expert. The dental chart information can be coded into the AI engine as a set of parameter values (e.g. number of layers and nodes, weight values, etc.).
[0050] According to an embodiment, the extraoral panoramic images are used to generate a basic electronic dental chart that is supplemented by other images of different types and by items of information characterizing the teeth represented on the images.
[0051] As suggested by the dotted arrows, the electronic dental record can be automatically updated at any time by processing new images and / or by further processing previously processed images into new learning steps (i.e., taking into account new information).
[0052] FIG. 6a shows example steps performed in an AI engine such as that shown in FIG. 5 to generate an electronic dental chart, and FIG. 6b shows example steps for training such an AI engine.
[0053] The steps shown in FIG. 6 a may be performed in an automated dental charting system, such as automated dental charting system 205 of FIG. 2, and the steps shown in FIG. 6 b may be performed in the same system or a different system, such as computing device 200 of FIG. 2.
[0054] The AI engine may be based on a particular AI technique, such as fuzzy logic or artificial neural networks, a combination of AI techniques, or a combination of AI techniques and traditional techniques, such as a combination of neural networks and predefined rules.
[0055] After an image to be processed to generate or update an electronic dental chart is acquired (step 600), the image is preferably filtered (step 605). Such a filtering step may include, for example, normalizing the acquired image so that pixel values are coded according to a predefined format (e.g., YUV), according to a predefined resolution, and with a predefined number of bytes (e.g., 3 bytes, 1 byte per component). Furthermore, the normalization step may include adjusting parameters such as brightness and range expansion. The filtering step may also include image processing such as image enhancement and image smoothing.
[0056] Next, the type of image acquired is determined, step 610. The type of image acquired is preferably determined automatically, for example, by identifying its source or parameters associated with the acquired image, or by analyzing the latter according to well-known methods.
[0057] According to a particular embodiment, the step of filtering the acquired image is carried out after determining the type of image, so that the filtering is adapted to that type.
[0058] Teeth are then identified in the acquired image (step 615) and the number of teeth depicted in the image, their location in the image, their size, and their shape are determined. Such steps can be performed with or without a pre-processing step, such as a segmentation step, using the AI engine after training. According to an embodiment, the teeth are indexed or numbered using a global index, so that a link can be established between a tooth represented in an image and the same tooth represented in another image. Such a global index can be the same as that used in known electronic dental charts.
[0059] According to one embodiment, tooth identification and numbering is performed by using bounding boxes (e.g. rectangular boxes or boxes with more precise contours). The bounding boxes may involve a rough image segmentation by identifying rectangular boxes on the panoramic image to identify the number of teeth contained in each.
[0060] Such bounding boxes can be determined by using implicit rules of an AI engine, for example by using parts of the acquired images as input to an artificial neural network, which, after appropriate training, is able to identify tooth depictions and thus determine bounding boxes around the identified teeth.
[0061] Additionally, segmentation may (where necessary) implement explicit rules to clarify ambiguous situations, such as: - "Rectangular boxes may have overlaps that must not exceed a given distance (e.g. 1mm)", and - "The center of the rectangular box corresponding to one arc should represent a curve with small spatial variation (i.e., the teeth mostly align along a line or a curve with little curvature)."
[0062] Similarly, a tooth numbering algorithm may implement implicit or explicit rules such as: - "In panoramic images during occlusion, the number of teeth follows a predetermined natural order", - "The teeth of the lower jaw do not appear in the upper jaw", and - "The upper jaw is made up of a subset of boxes and is positioned above the lower jaw, which is made up of a complementary group of boxes."
[0063] It should be noted that information regarding tooth position may be provided by means other than image analysis, particularly if the acquired image contains a subset of the patient's teeth from which it is difficult, if not impossible, to derive the positions of the teeth in the patient's mouth. For example, information regarding tooth position may be obtained from the user or from instructions given to the user when taking the image (step 620).
[0064] The identified teeth are then classified or characterized (step 625).
[0065] Such classification / characterization step is preferably performed by using information obtained from the electronic dental record obtained during the learning phase, for example by using the isolated tooth representation as input of a previously trained artificial neural network that is used to classify the tooth representation, the output of which is one or more items of information characterizing the isolated tooth representation.
[0066] Again, such steps can be supplemented with a set of rules and thresholds such as: - "The strong saturation signal is probably characteristic of metals", - "The ability to detect metals increases the likelihood of including amalgams, implants, metal crowns, metal brackets, root canals, etc."; and - "The depth of the bone root determines whether there is bone loss that may lead to tooth loss."
[0067] The purpose of the classification / characterization step is to associate one or more items of information with the identified tooth. Such items of information may be, for example: - The area below the root and crown -Whether teeth are present Periapical lesions, · Whether root canal, -Intra-root supports, ·Bone loss, ·Ankylosis, · Sinus infections, and Swelling of the sinus floor, - About the crown level part Whether to restore or not 3D medial-distal restoration extent (difficult to determine buccal-lingual extent), · Type of crown and material (porcelain, porcelain-fused-to-metal, all-metal), Liners in restorations (appearing as different greyscales on X-rays from amalgam or composite), Collapse during repairs, and -Interproximal decay, - Features that cannot be detected by X-rays Restoration range from buccal to lingual side, ·fracture, Leaks around restorations, and -Fracture of enamel around the restoration.
[0068] Of course, other items of information may be associated with teeth and / or groups of teeth.
[0069] It should also be noted that the classification / characterization step may include some pre-processing, for example to scale and align the signal contained in each bounding box to the normalized average tooth representation. This may help to define placement information such as mesial / distal, occlusal / buccal, etc., compared to the average tooth representation.
[0070] Once the tooth has been classified / characterized, a corresponding electronic dental chart is generated (if the current tooth is the first of the first images associated with a new patient) or updated depending on the classification / characterization (step 630). According to an embodiment, the image is stored (if it is not already stored) and the information items related to the current tooth are stored in association with this tooth, for example using its global index.
[0071] These steps are repeated for every image being processed and for every tooth identified in the acquired images (steps 635 and 640).
[0072] As mentioned above, the AI engine used may use artificial neural networks such as convolutional neural networks and deep learning techniques for localization tasks and / or classification and characterization tasks.
[0073] The process described with reference to Figure 6a may be performed when an electronic dental record is created, typically from a set of images of the patient's teeth, as well as whenever new images of the patient's teeth are taken or a dentist intervenes in and / or monitors the patient's teeth.
[0074] According to an embodiment, training of an AI engine such as that described with reference to Figures 5 and 6a, used for tooth identification and / or classification, is performed using a large number of electronic dental charts that contain low levels of errors (these errors are typically directed towards image interpretation), which are preferably anonymized before or after being sent for use in training the automated dental charting system.
[0075] For reliability, the electronic medical records used to train the automated dental charting system are preferably practitioner-generated, practitioner-controlled, or automatically generated by a trusted system, at different locations, and using different dental information systems, that share a common format and allow the information systems to automatically retrieve images and items of information related to the teeth represented in those images.
[0076] The electronic dental chart may be obtained from a dental information system and / or from a server on which the electronic dental chart generated by the dental information system is stored.
[0077] After at least one electronic dental chart is obtained (step 650), the electronic dental chart is analyzed to obtain images depicting the patient's teeth (step 655), to obtain the type of image obtained (step 660), and to obtain information items regarding the teeth depicted in the obtained images (step 665).
[0078] The steps of obtaining the image, the type of image, and the information items regarding the depicted teeth are advantageously performed according to a predetermined electronic format of the electronic dental chart so that the data can be collected appropriately.
[0079] It should be noted that several images of the same tooth or the same region of interest can be used, provided that the corresponding information items characterize the tooth or region of interest represented in the images considered. In other words, the information items and the images are synchronized (i.e. the state of the tooth or region of interest remains unchanged between the time the image depicting the tooth or region of interest is acquired and the time the corresponding information item is defined).
[0080] According to a particular embodiment, the acquired image is filtered (step 670). Similar to the filtering step described with reference to Fig. 6a, which may be performed when generating or updating an electronic dental chart, this filtering step may include, for example, normalizing the acquired image according to a predefined format (e.g. YUV) and according to a predefined resolution, such that pixel values are coded in a predefined number of bytes (e.g. 3 bytes, 1 byte per component). Furthermore, the normalization step may include adjusting parameters such as brightness and range expansion.
[0081] Again, according to certain embodiments, filtering the acquired image may depend on the image type.
[0082] Next, according to the illustrated example, a first learning phase is performed (step 675) to teach the AI engine how to identify tooth depictions. To that end, acquired items of information related to the tooth are acquired in order to identify the part of the acquired image that corresponds to this tooth. Such items of information can be combined with the segmentation information in order to identify the part of the image that corresponds to this tooth.
[0083] This portion of the image is added to the training dataset referenced 680-1 that is used to train the AI engine. According to an embodiment, the type of image may also be stored in the training dataset in association with the corresponding image portion.
[0084] Next, the teeth depicted in the captured image are identified using the AI engine (once it has been trained) (step 685).
[0085] A second learning phase is then performed (step 690) to teach the AI engine how to classify or characterize the identified teeth, i.e., enable the AI engine to associate items of information representative of tooth classes and / or characteristics with tooth depictions.
[0086] To that end, retrieved information items related to the identified teeth are retrieved. The portions of the images corresponding to the identified teeth and the related information items are added to a training data set referenced 680-2 used to train the AI engine. According to an embodiment, the type of image may also be stored in the training data set in association with the corresponding image portion.
[0087] These steps are preferably repeated for every image in every electronic dental chart for every tooth identified in the acquired image (step 695).
[0088] According to certain embodiments, some of the electronic dental charts may be removed from the set of electronic dental charts used to train the AI engine, so that they are used to test the AI engine after the learning phase has been performed. In such a case, the efficiency of the automated charting system may be determined by comparing the output of the automated charting system with the expected response (i.e., the information items of the electronic dental charts). Such an evaluation may also be performed during the learning phase, so that it can be stopped as soon as an efficient level is reached.
[0089] It should be noted that the training data set may be updated periodically, for example weekly or monthly, with new or updated electronic dental charts obtained from the dental information system. According to an embodiment, the automated dental chart generation system is trained after the training data set is updated.
[0090] While the invention has been illustrated and described in detail in the drawings and the foregoing description, such illustration and description is to be considered as illustrative or exemplary and not restrictive, and the invention is not limited to the disclosed embodiments. Other variations of the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure and the appended claims.
[0091] Such variations may result in particular from combining the embodiments described in the summary of the invention and / or in the appended claims.
[0092] In particular, although the image analysis is for purposes of illustration directed to the identification of a tooth with which an item of information is associated, the image analysis may be directed to the identification of any region of interest (ROI) with which an item of information is associated, for example allowing a cyst type pathology to be associated with a depiction of a portion of a jaw. In such cases, the region of interest may be identified and / or extracted at least in part according to the item of information, for example according to a depiction of a cyst and / or according to features characterizing the cyst.
[0093] In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite articles "a" or "an" do not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that different features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be used to advantage. Any reference signs in the claims should not be interpreted as limiting the scope of the invention.
Claims
1. 1. A computer method for training an automated dental charting system connected to a plurality of dental information systems via a communications network, each of the dental information systems configured to generate an electronic dental chart, each of the generated electronic dental charts including a digital image and an associated item of information characterizing at least a portion of the corresponding digital image; The information items are: The area below the root and crown, whether the tooth is present, periapical lesions, whether there are root canals, intra-root posts, bone loss, ankylosis, sinus infection, and swelling of the sinus floor; and for the crown level area, whether to restore, 3D medial to distal restoration extent, type of crown and material, liner during restoration, decay during restoration, and interproximal decay. and features not detectable on radiographs, such as buccal-lingual coverage of restorations, fractures, peri-restorative leakage, and peri-restorative enamel fractures. and The computer method comprises: obtaining, via the communications network, a plurality of electronic dental charts generated by a plurality of the dental information systems, the plurality of electronic dental charts relating to a plurality of patients; For each of the electronic dental charts obtained, - extracting at least a portion of an image depicting a tooth or an area of interest and obtaining at least a corresponding item of information characterizing said depicted tooth or said depicted area of interest; storing at least a portion of the extracted images and the corresponding information items in a training dataset; training the automated dental charting system using the training data set; 23. A computer method comprising:
2. 2. The method of claim 1, further comprising the step of filtering the image from which at least a portion of the image is extracted.
3. 3. The method of claim 1 or 2, characterized in that the extracted at least part of the image depicting a tooth or an area of interest is extracted automatically based on the corresponding item of information characterizing the depicted tooth or the depicted area of interest.
4. 4. The method of claim 1, further comprising the step of obtaining a type of the image from which at least a portion of the image is extracted, the obtained type of image being stored in the training data set in association with the corresponding at least a portion of the image.
5. 5. A method according to claim 1, further comprising the step of identifying at least a portion of the extracted image, wherein the at least a portion of the image is identified depending on an item of information associated with the image for which the at least a portion of the image is identified.
6. 6. The method of claim 1, wherein at least one of the electronic dental records includes several types of images depicting at least the same teeth, and the steps of extracting and storing are repeated such that the training data set includes at least a portion of each of the several types of images.
7. 7. The method of claim 6, wherein the several image types include an ultraviolet image type, a visible light image type, an infrared image type, an OCT image type, an X-ray image type, a CBCT image type, an ultrasound image type, a fluorescence image type, and / or a 3D mesh image type.
8. 8. The method of any one of claims 1 to 7, wherein the automated dental charting system includes an artificial intelligence engine.
9. 9. The method of claim 8, wherein the artificial intelligence engine includes at least one artificial neural network.
10. 10. The method of claim 1, wherein each of the plurality of electronic dental charts is obtained from a server via the communications network, the server being different from the dental information system that generated the electronic dental chart of the plurality of electronic dental charts.
11. 1. A method for automatically assigning medical chart data to at least a portion of an image depicting a tooth or region of interest, comprising: obtaining at least a portion of an image depicting a tooth or an area of interest; and using an automated dental charting system trained according to the method of any one of claims 1 to 9 to assign items of information characterizing the depicted teeth or areas of interest to at least a portion of the image.
12. A computer program product for a programmable device, characterized in that the computer program product contains instructions for carrying out each of the steps of the method according to any one of claims 1 to 11 when the program is loaded and executed by the programmable device.
13. Apparatus comprising means for a computer to carry out the steps of the method according to any one of claims 1 to 10.
14. 10. An automated dental charting system trained according to the method of any one of claims 1 to 9.
Citation Information
Patent Citations
Device and method for disease detection
JP2017527399A
Dental CAD automation using deep learning
US20180028294A1
Automatic tooth charting using digital images
US8416984B2
Crown information acquisition program, information processing device, and crown information acquisition method
WO2016143022A1
