Mouthpiece-type intraoral imaging device using a lensless camera and dental diagnosis and management system using the same
The mouthpiece-type intraoral imaging device with lensless cameras and AI-driven diagnostics addresses image quality variations and safety issues, improving efficiency and accuracy by standardizing imaging conditions and reducing device thickness and heat generation.
Patent Information
- Application Number
- JP2025513225
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-23
- Filing Date
- 2023-11-23
- Publication Date
- 2026-01-07
AI Technical Summary
Existing intraoral imaging devices suffer from variations in image quality due to photographer skill, increased thickness and volume causing discomfort, heat generation, and inadequate consideration of individual tooth characteristics, leading to inefficiencies and safety concerns.
A mouthpiece-type intraoral imaging device using lensless cameras and a diagnostic system that includes a body with sensor and light source grooves, a medical terminal for digital filtering, and an integrated monitoring server for image analysis and AI-based diagnostics, ensuring consistent imaging conditions and minimizing device thickness and heat generation.
The solution enables accurate, efficient, and safe dental diagnosis by standardizing imaging conditions, reducing manpower and time, and enhancing diagnostic precision through AI analysis, while minimizing patient discomfort and safety risks.
Smart Images

Figure 2026500452000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a mouthpiece-type intraoral imaging device using a lensless camera and a dental diagnosis and management system using the same. More specifically, the present invention relates to a mouthpiece-type intraoral imaging device using a lensless camera and a mouthpiece with a light source that acquires images of the front, back, and occlusal surfaces of each tooth, and a pre-trained AI algorithm that tracks and analyzes successive images over time to detect diagnostic, management, and predictive information. This not only improves the precision, reliability, and efficiency of dental diagnosis, treatment, and management, but also makes it possible to acquire images under the same conditions (photography direction, magnification, position, etc.) for each tooth regardless of the photographer's level of skill, thereby further improving the precision and efficiency of diagnosis and treatment and significantly reducing the time and manpower required for photographing teeth. [Background technology]
[0002] In general, oral diseases, including dental diseases such as cavities, tooth loss, tartar, and plaque, as well as periodontal disease, are among the most widespread diseases worldwide. Due to their high prevalence, the severe pain caused by the diseases, and the large economic burden caused by delayed treatment, regular diagnosis and management are necessary.
[0003] Therefore, if treatment and management are carried out through regular monitoring at dental and other treatment institutions, various oral diseases can be prevented at an early stage.
[0004] In particular, with the recent development of oral treatment techniques and devices and dramatic advances in image analysis and processing technology, methods for diagnosing a patient's oral condition and preventing and treating oral diseases by analyzing dental images acquired with an intraoral camera have become widespread. Images acquired through such intraoral imaging devices can be used not only to grasp and diagnose the condition of teeth and periodontal tissues, but also to explain the condition of teeth to patients, to create a database of the condition of teeth and periodontal tissues, and to use the database to check the treatment status before and after treatment and the progression of deterioration of dental conditions.
[0005] However, in the past, the photographer (therapist) would move the intraoral photography device adjacent to the desired tooth or periodontal tissue and take the photograph directly. This not only wasted time and manpower in photographing the entire tooth, but also increased patient fatigue and resulted in variations in the quality of the tooth images obtained depending on the photographer's level of skill.
[0006] In particular, comprehensive oral examination requires images of the front, back, and occlusal (chewing) surfaces of each tooth, which requires detailed photography, further increasing the above-mentioned problems.
[0007] To solve this problem, various studies have been conducted on technology that uses multiple cameras attached to a mouthpiece to photograph multiple teeth in a single shot.
[0008] FIG. 1 is a perspective view showing an intraoral scanner disclosed in Korean Patent Registration No. 10-1942641 (title of invention: mouthpiece-type intraoral scanner).
[0009] The intraoral scanner 100 of Figure 1 (hereinafter referred to as the first prior art) is formed in the shape of a curved rod and includes a body 110 having grooves 111 and 112 formed on the upper and lower surfaces, respectively, with upper teeth inserted into the upper groove 111 and lower teeth inserted into the lower groove 112; an upper scanner 120 coupled to the upper groove 111 of the body 110 and scanning the upper teeth inserted into the upper groove 111; a lower scanner 130 coupled to the lower groove 112 of the body 110 and scanning the lower teeth inserted into the lower groove 112; a control unit 140 that receives a scan signal from the upper scanner 120 or the lower scanner 130 and converts it into data; and a connection unit 15 that transmits the data of the control unit 140 to the outside.
[0010] In this case, the upper scanner 120 and the lower scanner 130 each include a sensor 101, which may be a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor.
[0011] The conventional technology 100 configured in this manner is formed in the shape of a mouthpiece, and therefore has the advantage that the position of the teeth can be easily confirmed by scanning the shape of the patient's oral cavity while the patient is chewing in their mouth without opening their mouth, thereby speeding up the process of converting the shape of the teeth into data.
[0012] However, in the prior art, two sensors 101, an illumination source, a circuit board, cables, etc. are attached to the partition between the upper groove 111 and the lower groove 112, and in particular, a lens of a certain thickness must be attached to the camera sensor 101 such as a CCD or CMOS, which creates the problem of increasing the thickness and volume of the partition.
[0013] Furthermore, such an increase in the thickness and volume of the partition not only reduces convenience of use because a gap is formed between the patient's upper and lower teeth when the patient's teeth are inserted, and the patient's mouth is not closed when the image is taken, but also causes external noise to interfere with the light source, resulting in a decrease in the clarity of the captured image.
[0014] Furthermore, in order to photograph a narrow area such as the upper groove 111 and the lower groove 112 of the body 110 as in the prior art 100, it is necessary to attach an illumination source with a sufficient amount of light, and such an illumination source has the characteristic of generating a large amount of heat when irradiated with light. However, the prior art 100 does not disclose any technology or method for dissipating the heat generated from such an illumination source, and therefore has the drawback of causing safety accidents such as burns when applied to an actual patient.
[0015] Generally, oral characteristics (tooth size, tooth structure, etc.) vary from person to person, but conventional technology 100 does not take such tooth characteristics into consideration at all, and the curvature, size, and shape of the upper groove 111 and the lower groove 112 into which the patient's teeth are inserted are fixed. Therefore, when used by a patient with different oral characteristics, it not only causes damage to the teeth but also increases the patient's sense of rejection and anxiety. In order to solve this problem, if conventional technology 100 is newly manufactured according to the patient's oral characteristics, there is a problem that manufacturing costs will increase excessively.
[0016] Meanwhile, in recent years, there has been active research into video analysis technology using deep learning to detect objects, recognize types, and track them. Deep learning-based video analysis technology has the advantage of being able to reduce error rates through learning itself while improving the accuracy and precision of output values, leading to a dramatic expansion in its application fields.
[0017] In particular, deep learning has shown great potential in the field of computer vision, such as classification, object detection, instance segmentation, and image captioning. With advances in CPUs, GPUs, and datasets, deep learning-based methodologies are being actively applied to the medical field.
[0018] FIG. 2 is a configuration diagram showing a system for remotely monitoring an oral cavity condition disclosed in Korean Patent Registration No. 10-2074887 (title of the invention: System and method for remotely monitoring an oral cavity condition using video analysis).
[0019] The oral condition remote monitoring system 200 in Figure 2 (hereinafter referred to as the second conventional technology) is composed of an intraoral imaging device 210 capable of capturing images inside the oral cavity, a user terminal 220 that is wirelessly paired with the intraoral imaging device 210 and transmits images captured from the intraoral imaging device 210, an oral condition management server 230 that stores the images captured for each subject and data on the analysis results of the subject's oral condition, and an oral condition determination device 250 that receives the captured images from the oral condition management server 230, detects tartar and plaque using a pre-trained oral condition determination algorithm, displays the detected tartar and plaque areas on the captured images, and transmits the analysis results to the user terminal 220.
[0020] The oral cavity condition determination device 250 inputs multiple intraoral images showing tartar and plaque into the oral cavity condition determination algorithm, and trains the oral cavity condition determination algorithm to determine the presence or absence of tartar and plaque based on the color of the teeth, their location, and the size of the area where they occur.
[0021] The second prior art 200 configured in this manner has the advantage of being able to accurately determine in real time whether tartar and plaque have been properly removed, and by diagnosing or monitoring tartar and plaque adhering to the teeth and gums in the oral cavity, it is possible to prevent periodontal disease in the oral cavity and manage teeth over the long term.
[0022] However, in the second prior art 200, the oral cavity condition assessment device 250 is configured to analyze only a single image captured in real time and determine the presence or absence of tartar or plaque based on the color, location, and size of the tooth. This means that the change in the condition of each tooth over time is not taken into consideration at all, resulting in a decrease in the accuracy and precision of the diagnosis.
[0023] Furthermore, in the second conventional technology 200, the oral condition assessment device 250 analyzes a single captured image and diagnoses only the current oral condition and provides it to the user, which limits the information provided to the user and has a structural limitation in that it is not possible to provide various information about the teeth, such as problems with the subject's current dental care, improvement measures, and predictions of the oral condition of each tooth. Summary of the Invention [Problem to be solved by the invention]
[0024] The present invention is intended to solve these problems, and the problem to be solved by the present invention is to provide a mouthpiece-type intraoral photography device that uses a lensless camera, and a dental diagnosis and management system that uses the same, which makes it possible to acquire images for each tooth under the same conditions (photographing direction, magnification, position, etc.) regardless of the photographer's level of skill by making the intraoral photography device a mouthpiece-type device to which multiple cameras can be attached, thereby further improving the accuracy and efficiency of diagnosis and treatment and significantly reducing the wasted time and manpower spent photographing teeth. [Means for solving the problem]
[0025] The solution of the present invention for solving the above problem includes a mouthpiece-type intraoral photography device including a body to be inserted into the oral cavity of a subject, lensless cameras attached to the body at intervals and taking images of at least one of the front, back, and occlusal surfaces of all teeth, and light sources attached adjacent to each of the lensless cameras and emitting light rays; a medical staff terminal carried by a medical staff member and installed with a diagnostic service application that digitally filters pattern data sent from the mouthpiece-type intraoral photography device with a preset wavelength pass band and then performs an inverse operation to obtain an image; and an integrated monitoring / diagnostic server that analyzes the images sent from the medical staff terminal, detects diagnostic results including at least one of the condition of each of the subject's teeth, whether or not treatment has been performed, and the details of treatment, generates diagnostic analysis information including the detected diagnostic results, and sends the generated diagnostic analysis information to the medical staff terminal; and the diagnostic service application installed on the medical staff terminal displays the diagnostic analysis information sent from the integrated monitoring / diagnostic server on a monitor.
[0026] In addition, in the present invention, the lensless camera includes a mask through which light reflected from the imaging surface of the tooth passes; an image sensor into which the light passing through the mask is incident; and a controller that integrates the patterns projected onto the image sensor to generate pattern data and then transmits the data to the outside; the body is made of a long plate material and is curved backward toward both ends, and is positioned parallel to the imaging surface (front, back, or occlusal surface) of the subject's tooth, and it is preferable that the film-like mask replaces the lens in the lensless camera, thereby slimming the thickness of the mouthpiece-type intraoral imaging device.
[0027] Furthermore, in the present invention, it is preferable that the diagnostic service application installed on the medical staff terminal includes an image processing unit, which includes: a network construction module that checks whether the medical staff terminal is connected to the mouthpiece-type intraoral photography device via a wired or wireless connection; a subject setting module that receives input of identification information of the subject to be photographed from the medical staff (user); a pattern data input module that receives input of pattern data transmitted from the mouthpiece-type intraoral photography device; a digital filtering module that filters reflected signals outside the wavelength passband of the pattern data input via the pattern data input module; an inverse calculation and image acquisition module that performs inverse calculation on the pattern data filtered by the digital filtering module to convert it into a lens-based image; a matching data generation module that generates matching data by matching the subject identification information, medical staff identification information, tooth photography direction information (occlusal surface, front or back), lensless camera identification information, and the image; and a control unit that transmits the matching data generated by the matching data generation module to the integrated monitoring / diagnosis server.
[0028] Furthermore, in the present invention, the integrated monitoring / diagnosis server preferably includes: a DB server; a tooth image generation unit that analyzes, corrects, and merges images included in the matching data sent from the medical staff terminal to generate tooth images that are images of each tooth; and an AI-based diagnostic analysis unit that analyzes the tooth images of the subject generated by the tooth image generation unit to generate the diagnostic analysis results. The tooth image generation unit preferably includes: an image alignment module that aligns images included in the matching data input via the matching data input module in order along the dentition by referring to identification information of the lensless camera; an image merging module that merges the images aligned by the image alignment module; a tooth object recognition module that analyzes the images merged by the image merging module using a preset object recognition algorithm to recognize each tooth object; an image segmentation module that segments the merged image into images representing each tooth object recognized by the tooth object recognition module; and a tooth image generation module that determines each of the images segmented by the image segmentation module as a tooth image.
[0029] In addition, in the present invention, it is preferable that the integrated monitoring / diagnostic server further includes a tooth data generation / update unit that, if the subject is being photographed for the first time, assigns an identification number to the tooth corresponding to the tooth image generated by the tooth image generation unit, matches at least one of the subject identification information, tooth photography direction (occlusal surface, front or back), tooth identification number and tooth image, and photography date to generate tooth data, and then stores the tooth data in the DB server; and, if the subject is not being photographed for the first time, extracts the subject's tooth data from the DB server, refers to the tooth identification number of the previous tooth data, matches the identification number to the tooth corresponding to the tooth image generated by the tooth image generation unit, and then generates tooth data and stores it in the DB server.
[0030] In addition, in the present invention, it is preferable that the DB server stores a category detection algorithm that analyzes input tooth images and detects a numerical value M for each category (including at least one of caries lesions, cracks, fluorosis, tartar, and plaque), and the integrated monitoring / diagnosis server further includes a category-specific numerical value calculation unit that uses the category detection algorithm to analyze the tooth images generated by the tooth image generation unit, calculates a category-specific numerical value M for each tooth, matches the subject identification information with the category-specific numerical value M for each tooth, generates category information for each tooth, and then stores it in the DB server.
[0031] Furthermore, in the present invention, it is preferable that the DB server stores a first AI algorithm that uses the current numerical value M and previous numerical value M' for each tooth by category as input data and outputs a diagnostic result including at least one of the tooth condition, whether treatment has been performed, and the treatment content, and the AI-based diagnostic analysis unit includes: a tooth category information collection module that collects the category information for each tooth calculated by the category numerical value calculation unit and the previous category information for each tooth stored in the DB server; a first AI analysis module that uses the first AI algorithm to analyze the current numerical value M and previous numerical value M' for each tooth by category collected by the tooth category information collection module and outputs the diagnostic result; and a diagnostic analysis information generation module that uses the output data output by the first AI analysis module to generate diagnostic analysis information including the diagnostic result and store it in the DB server.
[0032] In addition, in the present invention, the integrated monitoring / diagnosis server further includes an AI-based management analysis unit; and an AI-based predictive analysis unit. The DB server stores a second AI algorithm that takes as input data the current numerical value M and previous numerical value M' for each tooth category and outputs a management result including at least one of the management status, management method, and management improvement points, and a third AI algorithm that takes as input data the current numerical value M and previous numerical value M' for each tooth category and outputs a prediction result indicating the tooth condition after a preset elapsed time when no treatment is being performed on each tooth. It is preferable that the AI-based management analysis unit uses the second AI algorithm to analyze the current numerical value M and previous numerical value M' for each tooth category collected by the tooth category information collection module and output the management result, and then generate management analysis information including the output management result, and the AI-based predictive analysis unit uses the third AI algorithm to analyze the current numerical value M and previous numerical value M' for each tooth category collected by the tooth category information collection module and output the prediction result, and then generate predictive analysis information including the output prediction result.
[0033] Furthermore, in the present invention, the mouthpiece-type intraoral photography device has sensor mounting grooves, into which each of the lensless cameras is attached, formed at intervals along the longitudinal direction on the inside of a mounting surface, which is one side of the body facing the imaging surface of the subject's teeth, and it is preferable that a pair of light source mounting grooves are formed adjacent to each sensor mounting groove on the mounting surface.
[0034] Furthermore, in the present invention, the mouthpiece-type intraoral photographing device is operated in a fluorescent photographing mode, a general photographing mode, and a mixed photographing mode, and the light source preferably irradiates blue visible light with a wavelength of 405 nm in the fluorescent photographing mode, irradiates white visible light in the general photographing mode, and irradiates blue visible light with a wavelength of 405 nm from half of the total number of light sources and irradiates white visible light from the remaining light sources in the mixed photographing mode.
[0035] Furthermore, in the present invention, when a mouthpiece-type intraoral photography device for photographing the occlusal surfaces of a subject's upper teeth and lower teeth is referred to as an intraoral photography device for occlusal surfaces, it is preferable that the body of the intraoral photography device for occlusal surfaces be positioned horizontally, the upper surface of the body be in contact with the occlusal surfaces of the subject's upper teeth, the lower surface of the body be in contact with the occlusal surfaces of the subject's lower teeth, and the sensor mounting grooves be formed at intervals in the longitudinal direction on the upper and lower surfaces of the body.
[0036] In addition, in the present invention, it is preferable that the body is made of plate material, is connected by at least one hinge axis, and includes at least two sub-bodies that form the body when hinged, the sensor mounting groove and the light source mounting groove are formed on the upper and lower surfaces of the sub-bodies, the hinge axis is respectively connected to the opposing side walls of adjacent sub-bodies and is installed vertically, and the body is configured to rotate inward when the sub-bodies are assembled.
[0037] In addition, in the present invention, it is preferable that the sub-bodies are formed in the same number as the lensless cameras along the longitudinal direction, and that a single sensor mounting groove is formed on each of the upper and lower surfaces of the sub-body.
[0038] Furthermore, in the present invention, when a mouthpiece-type intraoral photography device for photographing the front of a subject's upper and lower teeth is referred to as a front-side intraoral photography device, it is preferable that the body of the front-side intraoral photography device be positioned vertically, with the back surface of the body facing the front of the subject's teeth, and that the sensor mounting grooves be arranged in two rows spaced apart in the longitudinal direction on the back surface of the body.
[0039] In addition, in the present invention, it is preferable that the body is made of plate material, is connected by at least one hinge axis, and includes at least two sub-bodies that form the body when hinged, the sensor mounting groove and the light source mounting groove are formed on the back of the sub-body, the hinge axis is respectively connected to the opposing side walls of adjacent sub-bodies and is installed vertically, and the body is configured to rotate inward when the sub-bodies are assembled.
[0040] In addition, in the present invention, it is preferable that the sub-bodies are formed in the same number as the lensless cameras in the longitudinal direction, and that a pair of lensless cameras are attached to the back of each of the sub-bodies with a gap in the vertical direction.
[0041] Furthermore, in the present invention, when a mouthpiece-type intraoral photography device for photographing the back of a subject's upper and lower teeth is referred to as a back-side intraoral photography device, it is preferable that the body of the back-side intraoral photography device be positioned vertically, with the front surface of the body facing the back of the subject's teeth, and that the sensor mounting grooves be arranged in two rows spaced apart in the longitudinal direction on the front surface of the body.
[0042] In addition, in the present invention, it is preferable that the body is made of plate material, is connected by at least one hinge shaft, and includes at least two sub-bodies that form the body when hinged, the sensor mounting groove and the light source mounting groove are formed on the front surface of the sub-body, the hinge shafts are respectively connected to the opposing side walls of adjacent sub-bodies and are installed vertically, and the body is configured to rotate inward when the sub-bodies are assembled.
[0043] In addition, in the present invention, it is preferable that the sub-body is formed in the same number as the lensless cameras along the longitudinal direction, and that a pair of lensless cameras are attached to the front of the sub-body with a gap in the vertical direction. [Effects of the Invention]
[0044] According to the present invention, which has the above-mentioned problems and solutions, by making the intraoral photography device a mouthpiece type to which multiple cameras can be attached, it becomes possible to obtain images for each tooth under the same conditions (photography direction, magnification, position, etc.) regardless of the photographer's level of skill, which further improves the accuracy and efficiency of diagnosis and treatment and significantly reduces the wasted time and manpower spent photographing teeth.
[0045] Furthermore, according to the present invention, by replacing the camera of a mouthpiece-type intraoral photography device with a lensless camera and replacing the conventional physical optical filter so that the diagnostic service application performs digital filtering, the thickness and volume of the intraoral photography device can be minimized to make it slimmer, thereby minimizing the subject's foreign body sensation and discomfort when inserted into the oral cavity and efficiently preventing damage and strain to the teeth.
[0046] Furthermore, according to the present invention, by converting the conventional physical optical filter with a transmittance of approximately 20% into a digital filter, it is possible to take sufficient photographs with a small amount of light, which in turn minimizes the heat generated by the LED, effectively preventing safety accidents such as burns, and improving the reliability and safety of the product.
[0047] Furthermore, according to the present invention, when the integrated monitoring / diagnostic server receives images from each lensless camera from the diagnostic service application, it aligns and merges the images in order along the tooth row, recognizes each tooth object, separates the images to represent each recognized tooth object, generates tooth images, and then analyzes the generated tooth images to detect diagnostic analysis information, thereby improving the accuracy of tooth diagnosis and treatment.
[0048] In addition, according to the present invention, the integrated monitoring / diagnosis server analyzes images of each tooth to calculate a preset category-specific value M, and uses a pre-trained first AI algorithm to analyze the current category-specific value M and previous value M' of each tooth to detect diagnostic analysis information, thereby enabling accurate and precise diagnosis and significantly improving treatment effectiveness and efficiency. [Brief explanation of the drawings]
[0049] [Figure 1] FIG. 1 is a perspective view showing an intraoral scanner disclosed in Korean Patent Registration No. 10-1942641 (title of the invention: mouthpiece-type intraoral scanner). [Figure 2] 1 is a block diagram showing the configuration of a remote oral cavity condition monitoring system disclosed in Korean Patent Registration No. 10-2074887 (title of the invention: System and method for remote oral cavity condition monitoring using video analysis). [Figure 3] 1 is a configuration diagram showing a dental diagnosis and management system according to an embodiment of the present invention. [Figure 4] FIG. 4 is a conceptual diagram for explaining FIG. 3. [Figure 5] 4 is a perspective view showing an intraoral imaging device for occlusal surfaces, which is one embodiment of the mouthpiece type intraoral imaging device of FIG. 3. FIG. [Figure 6] FIG. 6 is a conceptual diagram for explaining FIG. 5. [Figure 7] (a) is a normal photograph of teeth, and (b) is a photograph of teeth after irradiating them with blue visible light and then filtering out the blue light. [Figure 8] FIG. 6 is a conceptual diagram showing the lensless camera of FIG. 5. [Figure 9] FIG. 1A is an exemplary diagram for explaining a phase mask-based lensless imaging method of the present invention, and FIG. 1B is an exemplary diagram for explaining a lens-based imaging method. [Figure 10] FIG. 1 is a perspective view showing a rear-view intraoral imaging device, which is a second embodiment of the mouthpiece-type intraoral imaging device of the present invention. [Figure 11]FIG. 10 is a perspective view showing a front-side intraoral imaging device, which is a third embodiment of the mouthpiece-type intraoral imaging device of the present invention. [Figure 12] FIG. 6 is a perspective view showing a second embodiment of the intraoral photographing device for occlusal surface of FIG. 5. [Figure 13] FIG. 11 is a perspective view showing a second embodiment of the intraoral photographing device for the back side of FIG. [Figure 14] FIG. 12 is a perspective view showing a second embodiment of the front intraoral photographing device of FIG. [Figure 15] FIG. 6 is a perspective view showing a third embodiment of the intraoral photographing device for occlusal surface of FIG. 5. [Figure 16] FIG. 11 is a perspective view showing a third embodiment of the intraoral photographing device for the back side of FIG. [Figure 17] FIG. 12 is a perspective view showing a third embodiment of the front intraoral photographing device of FIG. [Figure 18] FIG. 4 is a block diagram illustrating the diagnostic service application of FIG. 3. [Figure 19] 19 is an exemplary diagram showing a selection interface provided by the operation mode selection unit of FIG. 18. [Figure 20] FIG. 18 is a block diagram showing an image processing unit in FIG. [Figure 21] FIG. 19 is a block diagram showing the medical staff mode operation section of FIG. 18. [Figure 22] FIG. 4 is a block diagram illustrating the integrated monitoring / diagnostic server of FIG. 3. [Figure 23] FIG. 23 is a block diagram showing the tooth image generating unit of FIG. 22. [Figure 24] FIG. 23 is a block diagram illustrating the AI-based diagnostic analyzer of FIG. [Figure 25] FIG. 23 is a block diagram illustrating the AI-based management and analysis unit of FIG. [Figure 26] FIG. 23 is a block diagram illustrating the AI-based predictive analysis unit of FIG. DETAILED DESCRIPTION OF THE INVENTION
[0050] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
[0051] FIG. 3 is a configuration diagram showing a dental diagnosis and management system according to one embodiment of the present invention, and FIG. 4 is a conceptual diagram for explaining FIG.
[0052] The dental diagnosis and management system 1, which is one embodiment of the present invention shown in Figures 3 and 4, is configured to use a lensless camera and a mouthpiece with a light source to acquire images of the front, back, and occlusal surfaces of each tooth, and to use a pre-trained AI algorithm to track and analyze consecutive images in chronological order to detect diagnostic, management, and predictive information. This not only improves the precision, reliability, and efficiency of dental diagnosis, treatment, and management, but also makes it possible to acquire images under the same conditions (photographing direction, magnification, photographing position, etc.) for each tooth regardless of the photographer's level of skill, thereby further improving the precision and efficiency of diagnosis and treatment and significantly reducing the time and manpower wasted by photographing teeth.
[0053] Furthermore, as shown in Figures 3 and 4, the dental diagnosis and management system 1 of the present invention is composed of an integrated monitoring / diagnosis server 3, a mouthpiece-type intraoral photography device 5, a medical staff terminal 7, a user terminal 8, a diagnostic service application 9, and a communication network 10.
[0054] In this case, for the sake of convenience, the present invention has been described with an example in which the diagnostic service application 9 performs inverse calculations on the pattern data sent from the lensless camera to acquire an image, and the integrated monitoring / diagnostic server 3 analyzes the acquired image and then generates meaningful information (tooth diagnosis, management, prediction, etc.). However, the diagnostic service application 9 may be configured to perform the calculations for image analysis and meaningful information generation independently.
[0055] Furthermore, for the sake of convenience, the present invention has been described using an example in which the diagnostic service application 9 is installed on the medical staff terminal 7 and the subject terminal 8, but it is also possible to configure the medical staff terminal 7 and the subject terminal 8 to have different dedicated applications installed.
[0056] The communication network 10 provides a data transfer path between the integrated monitoring / diagnostic server 3, the medical staff terminal 7, and the subject terminal 8, and specifically can be composed of a wired network such as a wide area network (WAN) or a local area network (LAN), or a mobile communication network such as 3G, LTE, or 4G.
[0057] The medical staff terminal 7 is a digital terminal carried by medical staff (doctors, nurses, therapists, etc.), and the subject terminal 8 is a digital terminal carried by the subject (user), and the medical staff terminal 7 and the subject terminal 8 can be configured as a desktop PC, notebook computer, smartphone, tablet PC, etc.
[0058] In addition, the medical staff terminal 7 and the subject terminal 8 are connected to the mouthpiece-type intraoral photography device 5 via a wired or wireless communication network 20, and receive pattern data obtained by photography using the mouthpiece-type intraoral photography device 5 from the mouthpiece-type intraoral photography device 5.
[0059] In addition, a diagnostic service application 9 shown in FIG. 18, which will be described later, is installed in the medical staff terminal 7 and the subject terminal 8.
[0060] FIG. 5 is a perspective view showing an intraoral imaging device for occlusal surfaces, which is one embodiment of the mouthpiece type intraoral imaging device of FIG. 3, and FIG. 6 is a conceptual diagram for explaining FIG.
[0061] Figures 5 and 6 show an intraoral imaging device 51 for occlusal surfaces, which is one embodiment of the mouthpiece-type intraoral imaging device 5. When the intraoral imaging device 51 for occlusal surfaces is inserted into the oral cavity of a subject and bitten by the subject's teeth, lensless cameras 513 arranged in a row along the subject's dentition photograph the upper and lower occlusal surfaces (chewing surfaces) of each tooth and obtain pattern data for each occlusal surface.
[0062] As shown in FIG. 6, the intraoral photography device 51 for occlusal surfaces is formed in the shape of a mouthpiece, is inserted into the oral cavity of the subject, and has an upper surface 5111 and a lower surface 5113 formed as flat surfaces against which the body 511 is pressed by the upper and lower occlusal surfaces 211 of the subject; lensless cameras 513 attached to the upper surface 5111 and the lower surface 5113 of the body 511 at intervals in the longitudinal direction; light sources 515 attached opposite each lensless camera 513 in the width direction at intervals in the longitudinal direction; and a controller (not shown) that supplies power to the lensless cameras 513 and the light sources 515 and transmits pattern data obtained by photographing with the lensless cameras 513 to the connected terminal 7 or terminal 8.
[0063] The body 511 is formed in the shape of a mouthpiece, and has flat upper and lower surfaces 5111, 5113, so that when inserted into the subject's oral cavity, the occlusal surfaces 211 of the subject's upper teeth 21 come into contact with the upper surface 5111, and the occlusal surfaces of the subject's lower teeth 22 come into contact with the lower surface 5113.
[0064] In this case, the body 511 is preferably made of a synthetic resin material that is harmless to the human body, yet has high elasticity and flexibility so as not to put strain on the teeth, in order to minimize the subject's foreign body sensation or discomfort when biting.
[0065] The body 511 is formed in a shape corresponding to the shape of the teeth, dentition and oral cavity of the human body.
[0066] Furthermore, sensor mounting grooves 5114 are formed in the upper surface 5111 and the lower surface 5113 of the body 511, spaced apart in the longitudinal direction from the upper surface 5111 and the lower surface 5113 inward.
[0067] At this time, lensless cameras 513 are attached to the sensor mounting grooves 5114 of the body 511 and are arranged in a row longitudinally along the occlusal surfaces of the upper and lower teeth, so that the upper and lower occlusal surfaces of each tooth can be photographed.
[0068] The light source mounting groove 5115 is formed symmetrically in the width direction with the sensor mounting groove 5114 of the body 511 as the reference.
[0069] At this time, the light sources 515 are attached to the light source attachment grooves 5115, respectively.
[0070] Furthermore, a handle 517 is protruded from the front of the body 511 to be held by the hand of a medical staff member or a user.
[0071] Furthermore, although not shown in the figure, a heating means and a cooling means may be attached inside the body 511 of the occlusal surface intraoral photography device 51 adjacent to the light source mounting groove 5115, and in this case, when the controller receives a control signal for the heating means or cooling means of a specific area from an external computing device, it can operate the heating means or cooling means of that area to test the sensitivity and degree of reaction of a specific tooth to heat or cold on the subject.
[0072] The light sources 515 are attached to light source mounting grooves 5115 formed on the upper surface 5111 and the lower surface 5113 of the body 511, respectively, and emit LED light beams toward the occlusal surfaces of the corresponding teeth, providing the illumination necessary for the lensless camera 513 to take photographs.
[0073] That is, among the light sources 515, a pair of light sources 515 attached symmetrically in the width direction with respect to the lensless camera 513 irradiates LEDs toward the occlusal surfaces of the corresponding teeth.
[0074] Furthermore, the light source 515 emits blue visible light, that is, visible light with a wavelength of 405 nm.
[0075] On the other hand, the mouthpiece-type intraoral photography device 5 of the present invention is designed to support all of the fluorescent (blue light) photography mode, general photography mode, and mixed photography mode, and when the photographer selects either the fluorescent photography mode, general photography mode, or mixed photography mode, light corresponding to the selected mode is irradiated from the light source 515.
[0076] For example, when the photographer selects the fluorescence photography mode of the mouthpiece-type intraoral photography device 5, blue visible light with a wavelength of 405 nm is emitted from the light source 515, and when the photographer selects the general photography mode, white visible light is emitted from the light source 515.
[0077] FIG. 7(a) is a photograph of teeth taken in a normal manner, and FIG. 7(b) is a photograph of teeth after irradiating them with blue visible light and then filtering out the wavelength band of blue visible light.
[0078] Generally, blue visible light not only does not penetrate teeth, but also induces fluorescence when reflected. On the other hand, teeth that have lost their mineral content exhibit darker fluorescence than normal teeth, specifically, caries lesions, cracks, fluorosis, tartar, plaque, etc. on the tooth surface appear dark. On the other hand, porphyrin, which forms biofilms, induces red fluorescence.
[0079] That is, when blue visible light is irradiated and then the reflected blue visible light irradiated from an external computing device is digitally filtered, the porphyrin component that generates oral biofilm is significantly emphasized in red due to color contrast, as shown in Figure 4 (a) and (b), and caries lesions, cracks, fluorosis, tartar, plaque, etc. on the tooth surface can be easily identified based on the difference in brightness of the reflected light.
[0080] On the other hand, conventional physical light filters have a transmittance of approximately 20%, so in order to emit a sufficient amount of light for photography, the amount of light emitted from the light source is unnecessarily increased, and this increase in the light intensity of the light source also increases the amount of heat generated.However, this increase in the amount of heat generated by mouthpiece-type products can cause safety hazards such as burns, so special care is required.
[0081] Therefore, the mouthpiece-type intraoral photography device 5 of the present invention does not have a conventional optical filter, so it can take sufficient photos with a small amount of light, and as a result, the amount of heat generated by the LED is reduced, thereby improving the reliability and safety of the product.In addition, by minimizing the thickness and volume of the product itself and making it slimmer, it is possible to improve the fit for the subject.
[0082] FIG. 8 is a conceptual diagram showing the lensless camera of FIG. 5, FIG. 9(a) is an illustrative diagram for explaining the phase mask-based lensless imaging method of the present invention, and FIG. 9(b) is an illustrative diagram for explaining the lens-based imaging method.
[0083] The lensless cameras 513 are attached to the sensor mounting grooves 5114 formed on the upper surface 5111 and the lower surface 5113 of the body 511, respectively, so that when inserted into the oral cavity, they are spaced apart in the width direction along the subject's dentition.
[0084] At this time, the lensless camera 513 attached to the upper part of the body 511 photographs the occlusal surfaces 211 of the subject's upper teeth 21, and the lensless camera 513 attached to the lower part of the body 511 photographs the occlusal surfaces 211 of the subject's lower teeth 22.
[0085] As shown in FIG. 8, the lensless camera 513 includes a phase mask 5131 through which light rays emitted from the light source 515 and reflected pass, and an image sensor 5133 onto which light that has passed through the phase mask 5131 is incident.
[0086] In this case, for the sake of convenience, the present invention has been described using an example in which the mask of the lensless camera 513 is a phase mask. However, the mask of the lensless camera 513 is not limited to this, and it goes without saying that various known types and techniques of masks, such as an amplitude mask, can be applied.
[0087] That is, in the lensless camera 513, instead of a lens that condenses a point light source, a phase mask 5131 that changes the phase of a light beam by a fine bending pattern is used.
[0088] The phase mask 5131 is made of a transparent material that transmits light, such as a transparent film.
[0089] In addition, the phase mask 5131 has a minute curved pattern formed on its outer surface facing the image sensor 515, the pattern having irregular sizes, heights, shapes, etc. at different positions.
[0090] At this time, the phase mask 5131 delays the transmitted light differently depending on the position, and changes and diffuses the phase, in a pattern according to a point spread function (PSF) that represents a unique pattern determined by the shape structure.
[0091] That is, the point light source that passes through the phase mask 5131 has its phase converted and diffused by the phase conversion pattern, and is incident on the entire area of the image sensor 5133.
[0092] The image sensor 5133 receives a pattern that has been transmitted through the phase mask 5131 and has its phase changed.
[0093] At this time, the patterns projected onto the image sensor 5133 and appearing are merged and called pattern data.
[0094] In addition, the pattern data acquired by the image sensor 5133 is transmitted to the medical staff terminal 7 or the subject terminal 8 under the control of a controller (not shown), and when the pattern data is transmitted, the diagnostic service application 9 installed on the terminal digitally filters the transmitted pattern data and then performs an inverse operation to obtain an image.
[0095] Referring to (b) of Figure 9, comparing the lensless camera 513 of the present invention with a conventional lensless camera, as shown in (a) of Figure 9, in the lensless camera 513 of the present invention, when light rays emitted from a light source 515 and reflected by a tooth pass through a phase mask 5131, the phase of the point light rays is converted and diffused by the fine bending pattern of the phase mask 5131, and the point light rays are projected onto an image sensor 5133 located a focal length f away.
[0096] In addition, as shown in (a) of Figure 9, a conventional lens camera 513 has at least one lens 1011 arranged in front of an image sensor 1012, and is able to capture an image by having a point light source pass through the lens 1011 and then be incident on the image sensor 1012 in a point-like manner.
[0097] Generally, for a mouthpiece-type product inserted into the oral cavity of a subject, such as the mouthpiece-type intraoral imaging device 5 of the present invention, the most sensitive issue for the subject is whether or not they feel a foreign body sensation, a sense of fit, or discomfort when biting the mouthpiece-type product with their teeth. In particular, because the mouthpiece is bitten by the subject's upper and lower teeth, the thicker the area where the upper and lower teeth bite, the greater the foreign body sensation and discomfort felt by the subject, and the significantly reduced sense of fit.
[0098] In the present invention, taking into consideration the characteristics of such mouthpiece-type products, by installing a lensless camera instead of a conventional lens camera, the overall volume and thickness can be minimized, and as a result, even when multiple lensless cameras are installed, the thickness can be minimized.
[0099] Meanwhile, in the past, to achieve quantitative light-induced fluorescence (QLF (registered trademark)), an optical filter that filters out light of a specific wavelength was placed at a distance outside the lens camera. However, the physical attachment of such an optical filter increases the thickness of the mouthpiece-type product, and since the light transmittance is approximately 20%, it is necessary to increase the amount of light. This also increases the amount of heat generated, and when applied to a mouthpiece-type product as in the present invention, there is a problem of safety hazards such as burns occurring.
[0100] Therefore, in the present invention, instead of the conventional physical optical filter, digital filtering is performed in the diagnostic service application 9, thereby making it possible to slim down and miniaturize the mouthpiece-type intraoral photography device 5 and effectively prevent safety accidents.
[0101] FIG. 10 is a perspective view showing a back-side intraoral photographing device which is a second embodiment of the mouthpiece-type intraoral photographing device of the present invention.
[0102] The rear-view intraoral photography device 52 in Figure 10 is a second embodiment of the mouthpiece-type intraoral photography device 5 of the present invention.When inserted into the subject's oral cavity and bitten by the subject's teeth, lensless cameras 523 arranged in a row along the subject's dentition photograph the rear surfaces of each tooth and obtain pattern data for the rear surfaces of each tooth.
[0103] As shown in FIG. 10, the rear intraoral photography device 52 is made of a long plate material and is attached perpendicular to the direction of insertion into the oral cavity, but is rounded toward the rear from the middle of the longitudinal direction toward both ends, a mounting portion 522 that protrudes from the middle of the height direction of the front surface 5211 of the second body 521 but extends along the longitudinal direction, lensless cameras 523 that are attached to the front surface 5211 of the second body 522 at intervals in the height direction but are attached at intervals in the longitudinal direction, light sources 525 that are attached opposite each other in the height direction based on each lensless camera 523, and a controller (not shown) that supplies power to the lensless cameras 523 and the light sources 525 and transmits pattern data obtained by photography by the lensless cameras 523 to the connected terminal 7 or terminal 8.
[0104] Second body 521 is made of a long plate material, is placed in a direction perpendicular to the insertion direction into the oral cavity, and is rounded backward from the middle part toward both ends in the longitudinal direction.
[0105] In this case, the second body 521 is preferably shaped to correspond to the shape of the subject's dentition.
[0106] Furthermore, when the second body 521 is inserted into the oral cavity of the subject, the front surface is positioned at a predetermined distance from the back surfaces of the subject's teeth, so that the lensless camera 523 attached to the front surface of the second body 521 can photograph the back surfaces of each of the subject's teeth.
[0107] Further, at the intermediate portion in the height direction of the front surface 5211 of the second body 521, a mounting portion 522 is formed so as to protrude outward from the front surface 5211 and extend in the longitudinal direction.
[0108] In addition, second sensor mounting grooves 5214 are formed on the inside of the front surface 5211 of the second body 521, facing each other in the height direction but spaced apart in the longitudinal direction, and lensless cameras 523 are respectively attached to the second sensor mounting grooves 5214.
[0109] Furthermore, light source mounting grooves 5215 for mounting light sources 525 are formed above and below each second sensor mounting groove 5214 on the front surface 5211 of the second body 521.
[0110] Further, a handle 527 to be gripped by a medical staff member or a user is provided on the front surface of the second body 521 so as to protrude therefrom.
[0111] Furthermore, a guide protrusion 528 is provided on the upper surface of the handle 527 adjacent to the second body 521 to come into contact with the upper front teeth of the subject and guide the reference position.
[0112] The thus configured rear intraoral photography device 52 is configured so that when inserted into the oral cavity of the subject, the second body 521 is positioned at a predetermined distance behind the tooth row, and lensless cameras 523 are attached to the front of the second body 521 at intervals in the longitudinal and vertical directions, so that by photographing with each lensless camera 523, the rear of each of the subject's teeth (including upper and lower teeth) can be photographed and pattern data can be obtained, thereby enabling detailed analysis, diagnosis and treatment of the rear of the subject's teeth.
[0113] FIG. 11 is a perspective view showing a front-side intraoral imaging device, which is a third embodiment of the mouthpiece-type intraoral imaging device of the present invention.
[0114] The rear-view intraoral photography device 53 in Figure 11 is a third embodiment of the mouthpiece-type intraoral photography device 5 of the present invention.When inserted into the subject's oral cavity and bitten by the subject's teeth, lensless cameras 533 arranged in a row along the subject's dentition photograph the front of each tooth and obtain pattern data for the front of each tooth.
[0115] 11, the front intraoral photography device 53 is made of a long plate material and is attached perpendicular to the direction of insertion into the oral cavity, but is rounded backward from the middle of the longitudinal direction toward both ends, a third body 531 protruding from the middle of the height direction of the back (rear) 5311 of the second body 531, but extending along the longitudinal direction so that the subject's upper and lower teeth are bitten by the third attachment portion 532, lensless cameras 533 attached to the back 5311 of the third body 531 at intervals in the height and longitudinal directions, light sources 535 attached opposite each lensless camera 533 in the height direction, and a controller (not shown) that supplies power to the lensless cameras 533 and the light sources 535 and transmits pattern data obtained by photography by the lensless cameras 533 to the connected terminal 7 or terminal 8.
[0116] The third body 531 is made of a long plate material, is disposed in a direction perpendicular to the insertion direction into the oral cavity, and is rounded backward from the middle part toward both ends in the longitudinal direction.
[0117] In this case, the third body 531 preferably has a shape corresponding to the shape of the dentition of the subject.
[0118] Furthermore, when the third body 531 is inserted into the oral cavity of the subject, the rear surface 5311 is positioned at a predetermined distance from the front surfaces of the subject's teeth, so that the lensless camera 533 attached to the rear surface of the third body 531 can photograph the front surfaces of each of the subject's teeth.
[0119] Furthermore, a third mounting portion 532 is formed at the middle in the height direction of the rear surface 5311 of the third body 531 so as to protrude outward from the rear surface 5311 and extend in the longitudinal direction.
[0120] At this time, when the third body 531 is inserted into the oral cavity of the subject, the upper and lower surfaces of the third attachment portion 532 come into contact with the upper and lower teeth of the subject.
[0121] In addition, third sensor mounting grooves 5314 are formed on the inside of the back surface 5311 of the third body 531, facing each other in the height direction but spaced apart in the longitudinal direction, and lensless cameras 533 are respectively attached to the third sensor mounting grooves 5314.
[0122] Furthermore, light source mounting grooves 5315 for mounting light sources 535 are formed above and below each of the third sensor mounting grooves 5314 on the rear surface 5311 of the third body 531 .
[0123] Furthermore, a handle 537 is protruded from the front surface of the third body 521 to be gripped by the hand of a medical staff member or a user.
[0124] The front intraoral photography device 53 configured in this manner is configured so that when inserted into the subject's oral cavity, the third body 531 is positioned at a predetermined distance in front of the subject's dentition, and lensless cameras 533 are attached to the back of the third body 531 at intervals in the longitudinal and vertical directions, so that by photographing with each lensless camera 533, the front of each of the subject's teeth (including upper and lower teeth) can be photographed and pattern data can be obtained, thereby enabling detailed analysis, diagnosis and treatment of the back of the subject's teeth.
[0125] FIG. 12 is a perspective view showing a second embodiment of the intraoral photographing device for occlusal surface of FIG.
[0126] The second intraoral imaging device 54 for the occlusal surface in Figure 12 is a second embodiment of the intraoral imaging device 52 for the occlusal surface in Figure 5 described above, and taking into account that oral characteristics such as the number of teeth, shape of the dentition, and structure of the oral cavity vary from person to person, the sub-bodies 541-1, ..., 541-N are configured to be connected by hinges 549, so that the sub-bodies can rotate in accordance with the various characteristics of the subject's oral cavity, and can be linked and adapted to suit the various characteristics of the oral cavity.
[0127] As shown in FIG. 12, the second intraoral photography device 54 for the occlusal surface includes a fourth body 541 formed into a mouthpiece shape by connecting multiple sub-bodies 541-1, ..., 541-N with hinges 549, lensless cameras 543 attached to the top and back of each of the sub-bodies 541-1, ..., 541-N, and light sources 545 attached to the front and back of each of the sub-bodies 541-1, ..., 541-N.
[0128] The sub-bodies 541,...,541-N are made of flat plate material, and adjacent sub-bodies and their sides are connected by hinges 549 to form a mouthpiece shape. Each sub-body 541,...,541-N can be rotated according to the characteristics of the subject's oral cavity (number of teeth, shape of the dentition, structure of the oral cavity, etc.), thereby improving the subject's foreign body sensation and discomfort, and further effectively preventing damage to the subject's teeth.
[0129] That is, the sub-bodies 541, . . . , 541-N are connected in a joint manner.
[0130] Further, a fourth sensor mounting groove 5414 is formed on each of the front and rear surfaces of the sub-bodies 541, . . . , 541-N, and a light source mounting groove 5415 is formed above and below each sensor mounting groove 5414, respectively.
[0131] FIG. 13 is a perspective view showing a second embodiment of the intraoral photographing device for the back side of FIG.
[0132] The second intraoral rear photographing device 55 in FIG. 13 is a second embodiment of the intraoral rear photographing device 51 in FIG. 10 described above.
[0133] As shown in FIG. 13, the second rear-facing intraoral photography device 55 includes a fifth body 551 formed into a mouthpiece shape by connecting multiple second sub-bodies 551-1, ..., 551-N with hinges 559, lensless cameras 553 attached to the front of each second sub-body 551-1, ..., 551-N at intervals in the vertical direction, and light sources 555 attached to the front of each second sub-body 551-1, ..., 551-N.
[0134] The second sub-bodies 551, . . . , 551-N are made of flat plates, and are arranged vertically when inserted into the oral cavity, and adjacent sub-bodies are joined at their sides by hinges 559 to form a mouthpiece shape.
[0135] In other words, the second sub-bodies 551,...,551-N are configured to be rotatable by a predetermined angle by connecting the sides of adjacent second sub-bodies with hinges 559, thereby allowing them to flexibly respond to the characteristics of the subject's oral cavity.
[0136] That is, the second sub-bodies 551, . . . , 551-N are connected in a joint manner.
[0137] Further, mounting grooves 5514 are formed on the front and rear surfaces of the second sub-bodies 551, . . . , 551-N, and light source mounting grooves 5415 are formed above and below each sensor mounting groove 5514, respectively.
[0138] FIG. 14 is a perspective view showing a second embodiment of the front intraoral photographing device of FIG.
[0139] The second front intraoral imaging device 56 in FIG. 14 is a second embodiment of the front intraoral imaging device 53 in FIG. 11 described above.
[0140] As shown in FIG. 14, the second rear-facing intraoral photography device 56 includes a sixth body 561 formed into a mouthpiece shape by connecting multiple third sub-bodies 561-1, ..., 561-N with hinges 569, lensless cameras 563 attached to the rear of each of the third sub-bodies 561-1, ..., 561-N at intervals in the vertical direction, and light sources 565 attached to the front of each of the third sub-bodies 561-1, ..., 561-N.
[0141] The third sub-body 561, ..., 561-N is made of a flat plate material, and is positioned vertically when inserted into the oral cavity, and adjacent sub-bodies are joined at their sides by hinges 569 to form a mouthpiece shape.
[0142] That is, the third sub-bodies 561,...,561-N are configured to be rotatable by a predetermined angle by connecting the sides of adjacent third sub-bodies with hinges 569, thereby enabling them to fluidly respond to the characteristics of the subject's oral cavity.
[0143] That is, the third sub-bodies 561, . . . , 561-N are connected in a joint manner.
[0144] Further, mounting grooves 5614 are formed on the front and rear surfaces of the third sub-bodies 561, . . . , 561-N, and light source mounting grooves 5615 are formed above and below each sensor mounting groove 5614, respectively.
[0145] Figure 15 is an oblique view showing a third embodiment of the intraoral photography device for the occlusal surface of Figure 5, Figure 16 is an oblique view showing a third embodiment of the intraoral photography device for the rear surface of Figure 10, and Figure 17 is an oblique view showing a third embodiment of the intraoral photography device for the front surface of Figure 11.
[0146] As shown in Figure 15, the third intraoral photography device 57 for occlusal surfaces of the present invention comprises a fourth body 571 connected by two hinges 579 and consisting of fourth sub-bodies 571-1, 571-2, 571-3 which, when assembled, form the body 511 of Figure 5 described above.
[0147] In this case, the hinge 579 is formed at the rearmost position of the side wall of the adjacent sub-body and is positioned perpendicular to the insertion direction of the intraoral imaging device, allowing both ends of the fourth body 571 to rotate inward.
[0148] On the other hand, the third rear-view intraoral imaging device 580, as shown in Figure 16, has a fifth body 581 connected by two hinges 589, and consists of fifth sub-bodies 581-1, 581-2, and 581-3 which, when assembled, form the second body 521 of Figure 10 described above.
[0149] At this time, hinges 589 are formed vertically along the side walls of the adjacent sub-bodies, which allow both ends of the fifth body 581 to rotate inward.
[0150] On the other hand, the third front intraoral imaging device 590, as shown in Figure 14, has a sixth body 591 connected by two hinges 599, and consists of sixth sub-bodies 591-1, 591-2, and 591-3 which, when assembled, form the third body 531 of Figure 11 described above.
[0151] At this time, hinges 599 are formed vertically along the side walls of the adjacent sub-bodies, which allow both ends of the sixth body 591 to rotate inward.
[0152] In other words, the mouthpiece-type intraoral photography device of the present invention is configured to be selectively usable for the occlusal surface, back surface, and front surface depending on the area of the teeth to be photographed, and can be configured as a sub-body to which the body is rotatably connected by at least one hinge.
[0153] FIG. 18 is a block diagram illustrating the diagnostic service application of FIG.
[0154] The diagnostic service application 9 in Figure 18 is installed on the medical staff terminal 7 or the subject terminal 8, and is an application program, software, or application that works in conjunction with the integrated monitoring / diagnostic server 3 to provide dental diagnosis and treatment services to users.
[0155] As shown in FIG. 18, the diagnostic service application 9 includes a control unit 90, a data transmission / reception unit 91, a data storage unit 92, an operation mode selection unit 93, an image processing unit 94, a medical staff mode operation unit 95, and a subject mode operation unit 97.
[0156] The control unit 90 manages and controls the operation of the diagnostic service application 9, and more specifically, manages and controls the operation of the control targets 91, 92, 93, 94, 95, and 97.
[0157] Furthermore, during execution, the control unit 90 executes an operation mode selection unit 93, and when image processing is selected by the user via the operation mode selection unit 93, executes an image processing unit 95, executes a medical staff mode operation unit 97 when the medical staff mode is selected, and executes a subject mode operation unit 99 when the subject mode is selected.
[0158] The data transmission / reception unit 91 transmits and receives data to and from the integrated monitoring / diagnosis server 3 and the mouthpiece-type intraoral imaging device 5 via a communication module (not shown) of the terminal 7 or 8 .
[0159] Furthermore, the data transmitter / receiver 91 requests data from the integrated monitoring / diagnostic server 3, and then receives result data in response to the requested data.
[0160] The data storage unit 92 stores data in the memory of the terminal under the control of the control unit 90.
[0161] FIG. 19 is an exemplary diagram showing a selection interface provided by the operation mode selection unit of FIG.
[0162] The operation mode selection unit 93 in FIG. 19 operates when the diagnostic service application 9 is executed by the user for the first time.
[0163] In addition, the operation mode selection unit 93 displays a selection interface 710, which is a graphic user interface (GUI) for allowing the user to select one of image processing, medical staff mode, and subject mode, on the monitor of terminal 7 or 8, as shown in Figure 19.
[0164] At this time, the selection interface 710 displays a button 711 for selecting image processing, a button 712 for selecting the medical staff mode, and a button 713 for selecting the subject mode.
[0165] In addition, the operation mode selection unit 93 executes the image processing unit 95 when the image processing button 711 is touched (clicked) by the user, executes the medical staff mode operation unit 97 when the medical staff mode button 712 is touched (clicked), and executes the subject mode operation unit 99 when the subject mode button 713 is touched (clicked).
[0166] FIG. 20 is a block diagram showing the image processing unit of FIG.
[0167] The image processing unit 95 in FIG. 20 is executed under the control of the control unit 90 when the image processing button 711 is touched (clicked) by the user via the selection interface 710 in FIG.
[0168] As shown in FIG. 20, the image processing unit 95 includes a network construction module 951, a subject setting module 952, a pattern data input module 953, a digital filtering module 954, an inverse calculation and image acquisition module 955, and a matching data generation module 956.
[0169] The network construction module 951 checks whether the mouthpiece-type intraoral imaging device 5 that captures images of the subject's teeth is connected to the wired or wireless communication network 20.
[0170] The subject setting module 952 receives input of identification information of the subject to be imaged from the medical staff.
[0171] The pattern data input module 953 receives the pattern data transmitted from the mouthpiece-type intraoral photographing device 5 via the data transmitting / receiving unit 92.
[0172] At this time, each pattern data includes identification information of the lensless camera.
[0173] The digital filtering module 954 filters out reflected signals outside the wavelength passband of the pattern data input via the pattern data input module 953 .
[0174] Conventionally, quantitative light-induced fluorescence (QLF, registered trademark) has been achieved by attaching optical filters that filter out light of specific wavelengths at intervals to the outside of a lens camera. However, the physical attachment of such optical filters increases the thickness of the mouthpiece-type product, and since the light transmittance is 20%, the amount of light must be increased. As the amount of light increases, the amount of heat generated also increases in proportion to the increase in light amount, and therefore, when applied to a mouthpiece-type product as in the present invention, there is a problem of safety hazards such as burns occurring.
[0175] The present invention dramatically solves the problems of the prior art by having the digital filtering module 954 of the diagnostic service application 9 convert the pattern data acquired by photographing with the lensless camera 953 into color values of the wavelength pass band, and by using quantitative light-induced fluorescence, the porphyrin component that generates oral biofilm is displayed in red, making it possible to easily identify carious lesions, cracks, fluorosis, tartar, plaque, etc. on the tooth surface based on differences in the brightness (luminance) of the reflected light.
[0176] The inversion and image acquisition module 955 uses the point spread function (PSF) of the phase mask 5131 to invert the wavelength passband pattern data in the digital filtering module 954 and convert it into a lens-based image.
[0177] In this case, the phase mask is formed as a three-dimensional structure whose height varies depending on the position according to the phase conversion pattern, and the phase conversion pattern of the phase mask having a three-dimensional structure corresponds to a point spread function (PSF) having a two-dimensional pattern.
[0178] Additionally, the inverse calculation function applied to the inverse calculation and image acquisition module 955 may be preset and stored as a value corresponding to the point spread function (PSF) of the phase mask.
[0179] The matching data generation module 956 uses the identification information of the mouthpiece-type intraoral photography device 5 and the identification information of each lensless camera 515 to match the subject identification information, medical staff identification information, photography direction (occlusal surface, front or back, etc.) information, lensless camera identification information, and image to generate matching data.
[0180] At this time, when the matching data is generated in the matching data generation module 956, the control unit 90 controls the data transmission / reception unit 92 so that the generated matching data is transmitted to the integrated monitoring / diagnosis server 3.
[0181] FIG. 21 is a block diagram showing the medical staff mode operation section of FIG.
[0182] The medical staff mode operation unit 97 in Figure 21 is executed under the control of the control unit 90 when the medical staff mode button 712 is touched (clicked) by the user via the selection interface 710 in Figure 19 described above, authenticates the connected medical staff through login authentication, and performs operation if the authentication is successful.
[0183] In addition, as shown in Figure 21, the medical staff mode operation unit 97 is composed of a GUI display and processing module 971, a list display module 972, an integrated treatment information provision module 973, a diagnosis / management / prediction analysis information provision module 974, a recent image display module 975, and a three-way time series image display module 976.
[0184] The GUI display and processing module 971 displays a ready-made GUI on the monitor of terminal 7 or terminal 8, and when a command is requested from the medical staff (user) via the displayed GUI, it executes the corresponding processor to perform calculation processing, and then provides the medical staff with a GUI with exposed response data via the GUI corresponding to the response data.
[0185] The list display module 972 displays a GUI exposing the subject list transmitted from the integrated monitoring / diagnosis server 3 on the monitor of the terminal 7 or 8 in response to a request from the medical staff.
[0186] When medical staff request integrated treatment information for a specific subject, the integrated treatment information providing module 973 references and utilizes the integrated treatment information for all subjects sent from the integrated monitoring / diagnosis server 3 to extract the integrated treatment information for the selected subject, and then displays this on the monitor of terminal 7 or terminal 8 via the GUI.
[0187] In this case, the integrated treatment information includes the subject's personal information, diagnosis date and history, treatment date and history, diagnostic analysis information, management analysis information, predictive analysis information, etc., where diagnostic analysis information means the diagnostic content of the current dental condition detected by the integrated monitoring / diagnostic server 3 through AI analysis of the subject's dental images, management analysis information means the management status and completion points, etc. detected by the integrated monitoring / diagnostic server 3 through AI analysis of the subject's dental images, and predictive analysis information means the predicted content of the future dental condition detected by the integrated monitoring / diagnostic server 3 through AI analysis of the subject's dental images.
[0188] When medical staff request diagnostic analysis information, management analysis information, or predictive analysis information for a specific subject, the diagnostic / management / predictive analysis information providing module 974 extracts the diagnostic analysis information, management analysis information, or predictive analysis information from the integrated treatment information for that subject, and then displays it on the monitor of terminal 7 or terminal 8 via a GUI.
[0189] That is, medical staff can view and understand the AI analysis results for each subject's dental images via the GUI provided by the diagnosis / management / predictive analysis information provision module 974.
[0190] When medical staff request the most recent dental images of a specific subject, the recent image display module 975 references and utilizes the dental image data of all subjects sent from the integrated monitoring / diagnostic server 3 to extract three-angle images of each tooth recently taken by the selected subject, then generates a GUI that displays the extracted three-angle images of each tooth, and displays the generated GUI on the monitor of terminal 7 or terminal 8.
[0191] When medical staff request time-series images of a specific tooth, the three-direction time-series image display module 976 generates a GUI that displays images of the tooth in each direction (front, back, occlusal surface, etc.) in chronological order, and displays the generated GUI on the monitor of terminal 7 or terminal 8.
[0192] Returning to Figure 18 and looking at the subject mode operation unit 99, when the user touches (clicks) the subject mode button 713 via the selection interface 710 in Figure 19 described above, the subject mode operation unit 99 is executed under the control of the control unit 90, authenticates the connected subject through login authentication, and performs operation if the authentication is successful.
[0193] The subject mode operation unit 99 also includes the GUI display and processing module 971 of FIG. 21 described above, an integrated treatment information provision module 973, a diagnosis / management / predictive analysis information provision module 974, a recent image display module 975, and a three-way time series image display module 976, but only allows access to the subject's own data.
[0194] That is, the subject mode operation unit 99 of the diagnostic service application 9 provides the subject with integrated treatment information, dental images, and diagnostic / management / predictive analysis information about the subject, allowing the subject to quickly and accurately view their own diagnosis and treatment status.
[0195] FIG. 22 is a block diagram illustrating the integrated monitoring / diagnostic server of FIG.
[0196] As shown in Figure 22, the integrated monitoring / diagnostic server 3 is composed of a control unit 30, a DB server 31, a communication interface unit 32, an application management unit 33, a matching data input unit 34, a tooth image generation unit 35, a tooth data generation / update unit 36, a tooth image preprocessing unit 37, a category-specific numerical calculation unit 38, an AI-based diagnostic analysis unit 39, an AI-based management analysis unit 40, an AI-based predictive analysis unit 41, an integrated treatment information generation / update unit 42, and a list generation / update unit 43.
[0197] The control unit 30 is an OS (Operating System) of the integrated monitoring / diagnostic server 3, and manages and controls the operations of the control targets 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, and 43.
[0198] Furthermore, when the control unit 30 receives matching data from the diagnostic service application 9 via the communication interface unit 32, the control unit 30 stores the received matching data in the DB server 31 and outputs the matching data to the matching data input unit .
[0199] Furthermore, when the integrated treatment information generating / updating unit 42 generates / updates the integrated treatment information, the control unit 30 stores the generated / updated integrated treatment information in the DB server 31.
[0200] Furthermore, when list information is generated / updated in list generating / updating section 43, control section 30 stores the generated / updated list information in DB server 31 and transmits it to connected diagnostic service application 9.
[0201] The DB server 31 stores personal information and login information of registered medical staff members, and personal information and login information of registered subjects.
[0202] Furthermore, the DB server 31 stores the matching data sent from the diagnostic service application 9.
[0203] Furthermore, the DB server 31 stores tooth images generated by the tooth image generating unit 35 and tooth data generated / updated by the tooth data generating / updating unit 36.
[0204] Here, a tooth image refers to an image of a single tooth, and tooth data refers to data in which a tooth image, subject identification information, and tooth identification number are matched.
[0205] The DB server 31 also stores the category-specific numerical value M of each tooth calculated by the category-specific numerical value calculation unit .
[0206] In this case, the categories may be composed of carious lesions, cracks, fluorosis, tartar, plaque, etc., and the categorical numerical value M means a numerical value indicating the degree of the category.
[0207] In addition, the DB server 31 stores diagnostic analysis information generated by the AI-based diagnostic analysis unit 39, management analysis information generated by the AI-based management analysis unit 40, and predictive analysis information generated by the AI-based predictive analysis unit 41.
[0208] Furthermore, the DB server 31 stores the integrated treatment information generated / updated by the integrated treatment information generating / updating unit 42 and the list information generated / updated by the list generating / updating unit 43.
[0209] The communication interface unit 32 transmits and receives data to and from the diagnostic service application 9 .
[0210] The application management unit 33 manages the overall operation of the diagnostic service application 9, such as firmware updates, GUI updates, failures and errors of the diagnostic service application 9, etc.
[0211] The matching data input unit 34 receives the matching data transmitted from the diagnostic service application 9 as input.
[0212] At this time, the matching data includes subject identification information, medical staff identification information, imaging direction (occlusal surface, front or back, etc.) information, lensless camera identification information, and the image.
[0213] FIG. 23 is a block diagram showing the tooth image generating unit of FIG.
[0214] The tooth image generation unit 35 in Figure 23 is a processor that analyzes, corrects, and merges images contained in the matching data input via the matching data input unit 34 to generate tooth images, which are images of each tooth.
[0215] In this case, in the mouthpiece-type intraoral photography device 5 of Figures 5 to 17 described above, the lensless camera 513 is attached taking into consideration the average number, size, position, spacing, etc. of teeth. However, due to the characteristics of the subject's oral cavity, it is common for a single tooth to be split into adjacent images, or for two or more teeth to be photographed in a single image.
[0216] That is, the tooth image generating unit 35 of the present invention converts each image taken by the lensless camera 513 into a tooth image of each tooth, thereby enabling accurate analysis of tooth diagnosis and treatment.
[0217] As shown in FIG. 23, the tooth image generation unit 35 includes an image input module 351, an image alignment module 352, an image merge module 353, a tooth object recognition module 354, an image segmentation module 355, and a tooth image generation module 356.
[0218] The image input module 351 receives an input of an image included in the matching data input via the matching data input module 34 .
[0219] The image alignment module 352 references the identification information of the lensless camera 513 to align the images in order along the tooth row.
[0220] The image merging module 353 merges the images that have been registered by the image registration module 352 .
[0221] The tooth object recognition module 354 uses a preset object recognition algorithm to analyze the images merged by the image merging module 353 and recognize each tooth object.
[0222] At this time, the technology and method for recognizing a preset object from an image is widely known in the technical field of image analysis, and therefore a detailed description thereof will be omitted.
[0223] The image segmentation module 355 segments the merged image into images representing each of the tooth objects recognized by the tooth object recognition module 354 .
[0224] The tooth image generation module 356 determines each image segmented by the image segmentation module 355 as a tooth image.
[0225] If this is the first time the subject is being photographed, the tooth data generation / update unit 36 assigns an identification number to the tooth corresponding to the tooth image generated by the tooth image generation unit 35, and generates tooth data by matching the subject identification information, photographing direction (occlusal surface, front or back, etc.), tooth identification number and tooth image, photographing date, etc., and then stores the tooth data in the DB server 31.
[0226] Furthermore, if the subject is not being photographed for the first time, the tooth data generation / update unit 36 extracts the tooth data of the subject from the DB server 31, then refers to the tooth identification number of the previous tooth data, matches the identification number to the tooth corresponding to the tooth image generated by the tooth image generation unit 35, and then updates the tooth data by adding the photographing direction (occlusal surface, front or back, etc.), tooth identification number and tooth image, photographing date, etc., and stores the updated tooth data in the DB server 31.
[0227] The tooth image preprocessing unit 37 preprocesses the image of each tooth generated by the tooth image generating unit 35 so that the numerical values for each category can be accurately detected from the image of each tooth.
[0228] The category-specific value calculation unit 38 uses a preset category detection algorithm to analyze the images of each tooth preprocessed by the tooth image preprocessing unit 37, and calculates the category-specific value M of each tooth.
[0229] In this case, the categories may be composed of carious lesions, cracks, fluorosis, tartar, plaque, etc., and the categorical value M means a value indicating the degree of the category.
[0230] For example, if the category is "tartar," the category-specific numerical value calculation unit 38 can calculate a tartar numerical value M, which is the degree of tartar on each tooth, and if the category is "caries lesion," the category-specific numerical value calculation unit 38 can calculate a caries lesion numerical value M, which is the degree of caries lesion on each tooth.
[0231] In addition, when the category-specific numerical value calculation unit 38 calculates the category-specific numerical value M for each tooth, it matches the subject identification information with the category-specific numerical value M for each tooth to generate category information for each tooth, and then stores it in the DB server 31.
[0232] FIG. 24 is a block diagram illustrating the AI-based diagnostic analyzer of FIG.
[0233] The AI-based diagnostic analysis unit 39 in Figure 24 uses a first AI algorithm that has been trained in advance to analyze category information (including categorical numerical values M) for each tooth, and generates diagnostic analysis information including the condition of each tooth, whether or not treatment has been performed, the details of treatment, etc.
[0234] 24, the AI-based diagnostic analysis unit 39 includes an individual tooth category information collection module 391, a first AI analysis module 392, and a diagnostic analysis information generation module 393.
[0235] The tooth category information collection module 391 collects the category information of each tooth calculated by the category-specific value calculation unit 38 and the previous category information of each tooth stored in the DB server 31.
[0236] The first AI analysis module 392 analyzes the category information of each tooth collected by the category information collection module 391 of each tooth using a first AI algorithm that has been trained in advance.
[0237] In this case, the first AI algorithm generates learning data that can learn the correlation between the current numerical value M and previous numerical value M' for each tooth category and the diagnosis result, and uses the generated learning data to derive an extraction model, which is a set of parameter values for the correlation between the current numerical value M and previous numerical value M' for each tooth category and the diagnosis result.
[0238] That is, the first AI algorithm is a deep learning algorithm that takes the current value M and the previous value M' for each tooth category as input data and outputs diagnostic results such as the condition of the teeth, whether or not treatment has been performed, and the details of the treatment.
[0239] The diagnostic analysis information generation module 393 uses the output data output by the first AI analysis module 392 to generate diagnostic analysis information including the condition of each tooth, whether or not treatment has been performed, the details of treatment, etc.
[0240] At this time, the diagnostic analysis information generated by the diagnostic analysis information generation module 393 is stored in the DB server 31 and is also output to the integrated treatment information generation / update unit .
[0241] FIG. 25 is a block diagram illustrating the AI-based management and analysis unit of FIG.
[0242] The AI-based management analysis unit 40 in Figure 25 uses a second AI algorithm that has been trained in advance to analyze the category information of each tooth (including the categorical numerical value M) and generate management analysis information including the management status, management method, management improvement points, etc. of each tooth.
[0243] 25, the AI-based management and analysis unit 40 includes an individual tooth category information collection module 401, a second AI analysis module 402, and a management and analysis information generation module 403.
[0244] The tooth category information collection module 401 collects the current value M and the previous value M' for each tooth category, as described above.
[0245] The second AI analysis module 402 analyzes the category information of each tooth collected by the category information collection module 401 of each tooth using a second AI algorithm that has been trained in advance.
[0246] At this time, the second AI algorithm generates learning data that can learn the correlation between the current numerical value M and previous numerical value M' for each tooth category and the management results (management status, management method, management improvements, etc.), and uses the generated learning data to learn by deriving an extraction model, which is a set of parameter values for the correlation between the current numerical value M and previous numerical value M' for each tooth category and the management results.
[0247] That is, the second AI algorithm is a deep learning algorithm that takes the current numerical value M and the previous numerical value M' for each tooth category as input data and outputs management results such as the management status, management method, and areas for improvement in management.
[0248] The management analysis information generation module 403 uses the output data output by the second AI analysis module 402 to generate management analysis information including the management status, management method, management improvements, etc. of each tooth.
[0249] At this time, the management analysis information generated by the management analysis information generation module 403 is stored in the DB server 31 and is also output to the integrated treatment information generation / update unit 42.
[0250] FIG. 26 is a block diagram illustrating the AI-based predictive analysis unit of FIG.
[0251] The AI-based predictive analysis unit 41 in Figure 26 uses a third AI algorithm that has been trained in advance to analyze the category information (including the categorical numerical value M) of each tooth and generate predictive analysis information including the state of each tooth after a predetermined elapsed time when no treatment has been performed on the tooth.
[0252] 26, the AI-based prediction analysis unit 41 includes an individual tooth category information collection module 411, a third AI analysis module 412, and a prediction analysis information generation module 413.
[0253] The tooth category information collection module 411 collects the current value M and the previous value M' for each tooth category, as described above.
[0254] The third AI analysis module 412 analyzes the category information of each tooth collected by the category information collection module 411 of each tooth using a third AI algorithm that has been trained in advance.
[0255] At this time, the third AI algorithm generates learning data that can learn the correlation between the current numerical value M and previous numerical value M' for each tooth category and the predicted result (the state of the tooth after a preset elapsed time when no treatment has been performed on each tooth), and uses the generated learning data to learn in a way that derives an extraction model, which is a set of parameter values for the correlation between the current numerical value M and previous numerical value M' for each tooth category and the predicted result.
[0256] That is, the third AI algorithm is a deep learning algorithm that takes the current value M and the previous value M' for each tooth category as input data and outputs the state of each tooth after a preset elapsed time when no treatment has been performed on that tooth.
[0257] The predictive analysis information generation module 413 uses the output data output by the third AI analysis module 412 to generate predictive analysis information indicating the condition of each tooth after a predetermined elapsed time when no treatment has been performed on the tooth.
[0258] At this time, the management analysis information generated by the prediction analysis information generation module 413 is stored in the DB server 31 and is also output to the integrated treatment information generation / update unit 42.
[0259] If the subject is being diagnosed for the first time, the integrated treatment information generation unit 42 generates integrated treatment information by matching the subject identification information, the identification number of each tooth, tooth images by direction of each tooth, numerical values M by category of each tooth, diagnostic analysis information, management analysis information, and predictive analysis information.
[0260] In addition, if the subject is not being diagnosed for the first time, the integrated treatment information generation unit 42 extracts the previous integrated treatment information of the subject, and then updates the integrated treatment information by adding to the extracted integrated treatment information tooth images by direction of each tooth, numerical values M by category of each tooth, diagnostic analysis information, management analysis information, and predictive analysis information.
[0261] The list generating / updating unit 43 generates and updates list information indicating a list of patients who have been imaged and diagnosed.
Claims
1. a mouthpiece-type intraoral photography device including a body to be inserted into the oral cavity of a subject, lensless cameras attached to the body at intervals and taking images of at least one of the front, back, and occlusal surfaces of all teeth, and light sources attached adjacent to each of the lensless cameras and irradiating light rays; a terminal carried by a medical staff member, on which a diagnostic service application is installed that digitally filters the pattern data transmitted from the mouthpiece-type intraoral photography device with a preset wavelength passband, and then performs inverse calculation to acquire an image; and an integrated monitoring / diagnostic server that analyzes the images sent from the medical staff terminal, detects diagnostic results including at least one of the state of each tooth of the subject, whether or not treatment has been performed, and the details of treatment, and then generates diagnostic analysis information including the detected diagnostic results and transmits it to the medical staff terminal; Including, The diagnostic service application installed on the medical staff terminal includes: A dental diagnostic and management system that displays the diagnostic analysis information sent from the integrated monitoring / diagnostic server on a monitor.
2. The lensless camera includes: A mask that transmits light reflected from the photographed surface of the tooth; an image sensor onto which the light beam that has passed through the mask is incident; a controller that integrates the patterns projected onto the image sensor to generate pattern data and then transmits the pattern data to an external device; The body is It is made of a long plate material, curved toward the rear at both ends, and is placed parallel to the imaging surface of the subject's teeth (front, back, or occlusal surface). The lensless camera includes:
2. The dental diagnosis and management system according to claim 1, wherein the thickness of the mouthpiece-type intraoral imaging device is slimmed down by the film-like mask replacing a lens.
3. the diagnostic service application installed on the medical staff terminal includes an image processing unit; The image processing unit a network construction module that checks whether the mouthpiece-type intraoral photography device is connected by wire or wirelessly; a subject setting module that receives input of identification information of a subject to be imaged from a medical staff member (user); a pattern data input module that receives input of pattern data transmitted from the mouthpiece-type intraoral photography device; a digital filtering module for filtering out reflected signals outside a wavelength passband of the pattern data input via the pattern data input module; an inversion and image acquisition module that inversely operates the pattern data filtered by the digital filtering module to convert it into a lens-based image; a matching data generation module that generates matching data by matching subject identification information, medical staff identification information, tooth imaging direction (occlusal surface, front surface, or rear surface) information, lensless camera identification information, and the image; 3. The dental diagnosis and management system of claim 2, further comprising: a control unit that transmits the matching data generated by the matching data generation module to the integrated monitoring / diagnosis server.
4. The integrated monitoring / diagnosis server includes: A database server; a tooth image generating unit that analyzes, corrects, and merges images included in the matching data transmitted from the medical staff terminal to generate tooth images that are images of each tooth; an AI-based diagnostic analysis unit that analyzes the dental image of the subject generated by the dental image generation unit to generate a diagnostic analysis result; The tooth image generating unit an image alignment module that refers to identification information of the lensless camera and aligns images included in the matching data input via the matching data input module in order along the tooth row; an image merging module that merges the images registered by the image registration module; a tooth object recognition module that analyzes the images merged by the image merging module and recognizes each tooth object using a preset object recognition algorithm; an image segmentation module that segments the merged image into images representing each of the tooth objects recognized by the tooth object recognition module; 4. The dental diagnosis and management system according to claim 3, further comprising: a tooth image generation module that determines each of the images segmented by the image segmentation module as a tooth image.
5. The integrated monitoring / diagnosis server includes:
5. The dental diagnosis and management system of claim 4, further comprising a tooth data generation / update unit that, if the subject is being photographed for the first time, assigns identification numbers to the teeth corresponding to the tooth images generated by the tooth image generation unit, matches at least one of the subject identification information, the tooth photography direction (occlusal surface, front or back), the tooth identification numbers and tooth images, and the photography date to generate tooth data, and stores the tooth data in the DB server; and if the subject is not being photographed for the first time, extracts the subject's tooth data from the DB server, refers to the tooth identification numbers of the previous tooth data, and matches the identification numbers to the teeth corresponding to the tooth images generated by the tooth image generation unit, and then generates tooth data and stores it in the DB server.
6. The DB server includes: A category detection algorithm is stored that analyzes the input tooth image and detects a numerical value (M) for each category (including at least one of caries lesions, cracks, fluorosis, tartar, and plaque). The integrated monitoring / diagnosis server 6. The dental diagnosis and management system of claim 5, further comprising a category-specific value calculation unit that uses the category detection algorithm to analyze the tooth images generated by the tooth image generation unit, calculates a category-specific value (M) for each tooth, matches the subject identification information with the category-specific value (M) for each tooth, generates category information for each tooth, and then stores the generated category information in the DB server.
7. The DB server A first AI algorithm is stored, which receives the current value (M) and the previous value (M') by category of each tooth as input data and outputs a diagnosis result including at least one of the tooth condition, whether or not treatment has been performed, and the treatment content; The AI-based diagnostic analysis unit a tooth category information collection module that collects the tooth category information calculated by the category value calculation unit and the previous tooth category information stored in the DB server; a first AI analysis module that analyzes the current value (M) and the previous value (M') for each tooth category collected by the each tooth category information collection module using the first AI algorithm and outputs the diagnosis result; 7. The dental diagnosis and management system of claim 6, further comprising: a diagnostic analysis information generation module that uses output data output by the first AI analysis module to generate diagnostic analysis information including the diagnosis result, and then stores the information in the DB server.
8. The integrated monitoring / diagnosis server includes: AI-based management and analysis department; and an AI-based predictive analysis unit. The DB server includes: A second AI algorithm is stored that takes as input data the current numerical value (M) and previous numerical value (M') for each tooth by category, and outputs a management result including at least one of the management status, management method, and management improvement points, and a third AI algorithm is stored that takes as input data the current numerical value (M) and previous numerical value (M') for each tooth by category, and outputs a prediction result showing the tooth condition after a preset elapsed time when no treatment is being performed on each tooth, The AI-based management and analysis unit using the second AI algorithm to analyze the current value (M) and the previous value (M') for each tooth category collected by the tooth category information collection module, output the management results, and then generate management analysis information including the output management results; The AI-based predictive analysis unit 7. The dental diagnosis and management system of claim 6, wherein the third AI algorithm is used to analyze the current values (M) and previous values (M') for each tooth category collected by the tooth category information collection module, output the prediction results, and then generate prediction analysis information including the output prediction results.
9. The mouthpiece type intraoral photography device is sensor mounting grooves, into which the lensless cameras are attached, are formed at intervals in the longitudinal direction on the inner side of a mounting surface, which is one surface of the body, facing the photographing surface of the subject's teeth; 3. The dental diagnosis and management system of claim 2, wherein a pair of light source mounting grooves are formed adjacent to each sensor mounting groove on the mounting surface.
10. The mouthpiece type intraoral photography device is It can be operated in fluorescent photography mode, general photography mode and mixed photography mode. The light source is 10. The dental diagnosis and management system of claim 9, wherein in the fluorescent photography mode, blue visible light with a wavelength of 405 nm is irradiated, in the general photography mode, white visible light is irradiated, and in the mixed photography mode, half of the light sources irradiate blue visible light with a wavelength of 405 nm, and the remaining light sources irradiate white visible light.
11. When a mouthpiece-type intraoral photography device for photographing the occlusal surfaces of the upper teeth and the lower teeth of a subject is referred to as an intraoral photography device for occlusal surfaces, the intraoral photography device for occlusal surfaces is:
11. The dental diagnosis and management system of claim 10, wherein the body is positioned horizontally, an upper surface of the body contacts the occlusal surfaces of the subject's upper teeth, a lower surface of the body contacts the occlusal surfaces of the subject's lower teeth, and the sensor mounting grooves are formed on the upper and lower surfaces of the body at intervals in the longitudinal direction.
12. The body is the at least two sub-bodies are made of plates and are connected by at least one hinge axis to form the body when hinged together; The sensor mounting groove and the light source mounting groove are formed on the upper and lower surfaces of the sub-body, The hinge shaft is The dental diagnosis and management system according to claim 11, wherein the bodies are respectively connected to opposing side walls of adjacent sub-bodies, are provided vertically, and are configured to rotate inward when the sub-bodies are assembled.
13. The subbody is The number of the lensless cameras is the same as the number of the lensless cameras along the longitudinal direction. The dental diagnosis and management system of claim 12, wherein a single sensor mounting groove is formed on each of the upper and lower surfaces of the sub-body.
14. When a mouthpiece-type intraoral photography device for photographing the front of the upper and lower teeth of a subject is referred to as a front intraoral photography device, the front intraoral photography device is:
11. The dental diagnosis and management system of claim 10, wherein the body is arranged vertically with a back surface of the body facing the front surfaces of the subject's teeth, and the sensor mounting grooves are provided in two rows spaced apart in the longitudinal direction on the back surface of the body.
15. The body is the at least two sub-bodies are made of plates and are connected by at least one hinge axis to form the body when hinged together; The sensor mounting groove and the light source mounting groove are formed on the rear surface of the sub-body, The hinge shaft is 15. The dental diagnosis and management system of claim 14, wherein the bodies are respectively connected to opposing side walls of adjacent sub-bodies, are provided vertically, and are configured to rotate inward when the sub-bodies are assembled.
16. The subbody is The number of the lensless cameras is the same as the number of the lensless cameras along the longitudinal direction. The dental diagnosis and management system according to claim 15, wherein a pair of lensless cameras are attached to the rear surface of each of the sub-bodies at a distance in the vertical direction.
17. When a mouthpiece-type intraoral photography device for photographing the back of the upper and lower teeth of a subject is referred to as a back-view intraoral photography device, the back-view intraoral photography device is:
17. The dental diagnosis and management system of claim 10, wherein the body is arranged vertically with a front surface of the body facing the back surface of the subject's teeth, and the sensor mounting grooves are provided in two rows spaced apart in the longitudinal direction on the front surface of the body.
18. The body is the at least two sub-bodies are made of plates and are connected by at least one hinge axis to form the body when hinged together; The sensor mounting groove and the light source mounting groove are formed on the front surface of the sub-body, The hinge shaft is 18. The dental diagnosis and management system of claim 17, wherein the bodies are respectively connected to opposing side walls of adjacent sub-bodies, are provided vertically, and are configured to rotate inward when the sub-bodies are assembled.
19. The subbody is The number of the lensless cameras is the same as the number of the lensless cameras along the longitudinal direction. The dental diagnosis and management system according to claim 18, wherein a pair of lensless cameras are attached to the front surface of the sub-body at a distance in the vertical direction.
Citation Information
Patent Citations
Tray for taking image inside oral cavity, and apparatus and system for taking image inside oral cavity comprising tray for taking image inside oral cavity
KR1020150021310A
Tunnel oxide layer silicon solar cell comprising silicon quantum wells and method of manufacturing the same
KR1020220141399A
Tag unit and vibration detecting apparatus having thereof
KR102230681B1
Method and system for processing an image of the teeth and gums
US20190167115A1
Intra oral dental irradiation device for material curing and dental imaging
US6976841B1