Mouth-type oral camera using lensless camera, and dental diagnosis and management system using same

Abstract

The present invention relates to a method for obtaining front, rear, and occlusal surface images of each tooth using a Lens-less camera and a mouthpart provided with a light source, tracking and analyzing consecutive images in a time series using a learned AI algorithm, detecting, diagnosing, managing, and predicting information, and determining whether or not the tooth is a tooth or not. Therefore, not only can the fineness, reliability and effectiveness of tooth diagnosis, treatment and management be improved, but also images of different teeth under the same conditions (imaging direction, magnification, position and the like) can be obtained regardless of the skill of a photographer, and the accuracy and effectiveness of diagnosis and treatment can be further improved. The present invention relates to a mouthpart-type oral cavity camera using a lens-free camera and a dental diagnosis and management system using the same, and can significantly reduce unnecessary time and manpower consumption caused by imaging teeth.

Description

Technical Field

[0001] The present invention relates to an oral cavity camera of a mouthpiece type using a lens-less camera and a dental diagnosis and management system using the same. Specifically, the present invention relates to an oral cavity camera of a mouthpiece type using a lens-less camera and a light source setting unit, which obtains front, rear, and occlusal surface images of each tooth, and uses a learned AI algorithm to track and analyze continuous images in time series, detect diagnosis, management, and prediction information. Thus, not only can the precision, reliability, and effectiveness of dental diagnosis, treatment, and management be improved, but also images of the same conditions (shooting direction, magnification, position, etc.) of different teeth can be obtained regardless of the proficiency of the photographer, which can further improve the accuracy and effectiveness of diagnosis and treatment, and can significantly reduce unnecessary time and labor consumption caused by shooting teeth. The present invention also relates to a dental diagnosis and management system using the above-mentioned oral cavity camera of a mouthpiece type. Background Art

[0002] Generally, oral diseases including dental caries, edentulism, dental plaque, and dental calculus are one of the most widespread diseases globally. These diseases not only cause great pain but also have a high incidence rate. As the treatment opportunity is delayed, the economic burden increases. Therefore, regular diagnosis and management are required.

[0003] Thus, if treatment and management are received through regular monitoring by dental treatment institutions, various oral diseases can be prevented at an early stage.

[0004] In particular, recently, as oral treatment technologies and equipment have developed and image analysis and processing technologies have improved geometrically, a method of diagnosing a patient's oral condition by analyzing dental images obtained by an oral camera to prevent and treat oral diseases is widely popular. Images obtained by such an oral camera are not only used to grasp and diagnose the state of teeth and periodontium but also used as materials to explain the dental state to patients. After databaseizing the dental and periodontal states, they can be used as useful materials for confirming the treatment status before and after treatment or confirming the deterioration status of the dental state.

[0005] However, since the conventional photographer (therapist) operates by directly moving an oral camera adjacent to the required teeth and periodontium and then taking a direct shot, there are problems such as an increase in unnecessary time and labor consumption when shooting the entire teeth, an increase in the fatigue of the patient, and different qualities of dental images obtained depending on the proficiency of the photographer.

[0006] In particular, in order to achieve overall oral diagnosis, images of the front, rear, and occlusal (chewing) surfaces of each tooth are required. Therefore, fine shooting is needed, which exacerbates the above-mentioned problems.

[0007] To solve these problems, multiple cameras are set on the oral appliance, and multiple studies on technologies for taking pictures of multiple teeth in a single shot are underway.

[0008] Figure 1 To show a perspective view of an oral scanner disclosed in Korean Patent No. 10-1942641 (invention title: Oral Scanner with Oral Appliance Shape).

[0009] Figure 1 The oral scanner (hereinafter referred to as the first prior art) 100 includes: a main body 110 formed in a curved rod shape, with grooves 111 and 112 formed on the upper and lower surfaces respectively. The upper teeth are inserted into the upper groove 111, and the lower teeth can be inserted into the lower groove 112; an upper scanner 120 coupled to the upper groove 111 of the main body 110 for scanning the upper teeth inserted into the upper groove 111; a lower scanner 130 coupled to the lower groove 112 of the main body 110 for scanning the lower teeth inserted into the lower groove 112; a control unit (not shown) that receives the information scanned by the upper scanner 120 or the lower scanner 130 and converts it into data; and a connection unit 150 that transmits the data of the control unit to the outside.

[0010] At this time, sensors 101 are built into the upper scanner 120 and the lower scanner 130, and the sensors 101 can be CCD sensors or Cmos sensors.

[0011] The prior art 100 configured as described above is made in the shape of an oral appliance, and scans the shape of the patient's oral cavity in a state where the patient bites it without opening the mouth. Thus, it has the advantages of facilitating the confirmation of the position of the teeth and accelerating the speed of converting the shape of the teeth into data.

[0012] However, in the prior art, two sensors 101, a light source, a circuit board, cables, etc. are provided in the partition wall between the upper groove 111 and the lower groove 112. In particular, for camera sensors 101 such as CCD or Cmos, lenses of a specified thickness must be provided, so there is a problem of an increase in the thickness and volume of the partition wall.

[0013] Moreover, the increase in the thickness and volume of such a partition wall causes the following problems: when the patient's teeth are inserted, a gap is formed between the patient's upper teeth and lower teeth, and the patient takes pictures with the mouth unable to close. Therefore, not only is the usability reduced, but also the image clarity obtained due to light source interference caused by external noise is reduced.

[0014] Also, as described in the prior art 100, in order to take pictures in narrow areas such as the upper slot 111 and the lower slot 112 of the main body 110, it is necessary to set up an illumination source with sufficient light quantity. Although this kind of illumination source has the characteristic of generating a large amount of heat when irradiating light, there is no technology or method for discharging the heat generated in this kind of illumination source described in the prior art 100 at all. Therefore, when actually applied to patients, it has the disadvantage of safety accidents such as burns.

[0015] Generally, the oral characteristics of people (tooth size, dentition structure, etc.) are different for each person. However, the prior art 100 does not consider these tooth characteristics at all. The curvature, size and shape of the upper slot 111 and the lower slot 112 into which the patient's teeth are inserted are fixed. Therefore, when a patient with different oral characteristics uses it, it will instead induce tooth damage, and there is also a problem of increased disgust and uneasiness of the patient. To solve this problem, remanufacturing the prior art 100 according to the patient's oral characteristics will result in an excessive increase in manufacturing costs.

[0016] On the other hand, recently, related research on image analysis technologies that use deep learning technology to perform object detection, category recognition, tracking, etc. is actively underway. The image analysis technology applying deep learning reduces the error rate through self-learning, and because of the advantages of improving the accuracy and precision of the output value, its application fields are increasing in geometric progression.

[0017] In particular, in the field of computer vision such as classification, object detection, instance segmentation, image captioning, etc., deep learning shows great potential. With the development of CPUs, GPUs, and datasets (Datasets), deep learning-based methodologies are also actively applied in the medical field.

[0018] Figure 2 To show the structural diagram of the oral state remote monitoring system disclosed in Korean Patent No. 10-2074887 (invention title: Oral State Remote Monitoring System and Method Using Image Analysis).

[0019] Figure 2A remote oral condition monitoring system (hereinafter referred to as the second prior art) 200 includes: an oral cavity photographing device 210 capable of photographing the interior of the oral cavity; a user terminal 220 wirelessly paired with the oral cavity photographing device 210 to transmit the images photographed by the oral cavity photographing device 210; an oral condition management server 230 storing the images photographed for different examinees and the data of the analysis results of the oral conditions of the examinees; an oral condition judging device 250 receiving the photographed images from the oral condition management server 230, detecting dental calculus or dental plaque through a learned oral condition judging algorithm, displaying the detected dental calculus or dental plaque part on the photographed images, and transmitting the analysis results to the user terminal 220.

[0020] The oral condition judging device 250 inputs multiple internal oral cavity images showing dental calculus or dental plaque into the oral condition judging algorithm, and learns the oral condition judging algorithm in such a way as to judge whether dental calculus or dental plaque appears according to the tooth color, occurrence position and size of the occurrence part.

[0021] The second prior art 200 configured as described above can accurately judge in real time whether dental calculus and dental plaque are normally removed, and diagnose and monitor the dental calculus and dental plaque of the teeth or gums in the oral cavity. Therefore, it has the advantages of being able to prevent oral and periodontal diseases in advance and manage teeth in the long term.

[0022] However, in the second prior art 200, the oral condition judging device 250 only analyzes a single photographed image taken in real time, and judges whether dental calculus or dental plaque appears according to the tooth color, occurrence position and size of the occurrence part, completely ignoring the state changes of each tooth based on time series. Therefore, it has the disadvantage of reduced diagnostic accuracy and fineness.

[0023] Moreover, in the second prior art 200, the oral condition judging device 250 analyzes a single photographed image, only diagnoses the current oral condition and provides it to the user. Therefore, the information provided to the user is limited, and there are structural limitations such as the problem of not being able to provide various tooth-related information such as the tooth management problems and improvement plans of the current examinee and the prediction of the oral conditions of each tooth. Summary of the Invention

[0024] Technical Problem

[0025] The present invention is used to solve such problems. The problem to be solved by the present invention is to provide an oral camera made in the form of a mouthpiece type with multiple cameras, which can obtain images of the same conditions (shooting direction, magnification, position, etc.) of different teeth regardless of the proficiency of the photographer, can further improve the accuracy and effectiveness of diagnosis and treatment, and can significantly reduce the unnecessary time and labor consumption caused by shooting teeth. The mouthpiece type oral camera using a lensless camera and the tooth diagnosis and management system using the same.

[0026] Solution to the problem

[0027] The solution of the present invention for solving the above problems includes: an oral appliance type oral camera, which includes a main body inserted into the oral cavity of the subject, a lens-less camera spaced apart from the main body and photographing at least one of the front, rear, and occlusal surfaces of the entire teeth, and a light source disposed at a position adjacent to the lens-less camera and irradiating light; a medical staff terminal, which is a terminal carried by medical staff, and is provided with a diagnostic service application program that performs digital filtering on the graphic data transmitted from the oral appliance type oral camera with a preset wavelength passband and then performs inverse operation to obtain an image; a comprehensive monitoring / diagnosis server, which analyzes the image transmitted from the medical staff terminal, detects a diagnostic result including at least one of the states of each tooth of the relevant subject, whether treatment is required, and the treatment content, generates diagnostic analysis information including the detected diagnostic result, transmits it to the medical staff terminal, and the diagnostic service application program provided in the medical staff terminal displays the diagnostic analysis information transmitted from the comprehensive monitoring / diagnosis server on the display.

[0028] Moreover, in the present invention, preferably, the lens-less camera includes: a mask that allows light reflected onto the photographing surface of the teeth to pass through; an image sensor that allows the light passing through the mask to be incident; a controller that synthesizes the graphics projected onto the image sensor, generates graphic data, and then transmits it to the outside. The main body is formed of a plate material having a length and is formed of a curved surface so that it is more oriented backward toward both ends and is arranged parallel to the photographing surface (front, rear, or occlusal surface) of the subject's teeth. In the lens-less camera, the mask in the form of a thin film replaces the lens, making the oral appliance type oral camera thinner.

[0029] Also, in the present invention, preferably, the diagnostic service application program provided in the above-mentioned medical staff terminal includes an image processing unit, and the image processing unit includes: a network construction module for confirming whether there is a wired or wireless connection with the above-mentioned oral cavity camera of the mouthpiece type; a subject setting module for receiving, from a medical staff (user), identification information of a subject to be photographed; a graphic data input module for inputting graphic data transmitted from the above-mentioned oral cavity camera of the mouthpiece type; a digital filtering module for filtering reflection signals outside the wavelength passband of the graphic data input through the above-mentioned graphic data input module; an inverse operation and image acquisition module for performing an inverse operation on the graphic data filtered by the above-mentioned digital filtering module and transforming it into an image based on the lens; a matching data generation module for matching subject identification information, medical staff identification information, tooth photographing direction (occlusal surface, front or rear) information, lensless camera identification information, and an image to generate matching data; and a control unit for transmitting the matching data generated in the above-mentioned matching data generation module to the above-mentioned integrated monitoring / diagnosis server.

[0030] Also, in the present invention, preferably, the above-mentioned integrated monitoring / diagnosis server includes: a database (DB, database) server; a tooth image generation unit for analyzing, correcting, and merging the images included in the matching data transmitted from the above-mentioned medical staff terminal to generate tooth images that are images of each tooth; an artificial intelligence (AI, Artificial Intelligence) diagnosis and analysis unit for analyzing the tooth images of the relevant subject generated in the above-mentioned tooth image generation unit to generate the above-mentioned diagnosis and analysis results. The tooth image generation unit includes: an image alignment module for aligning, in sequence according to the dental arch, the images included in the matching data input through the above-mentioned matching data input module with reference to the identification information of the lensless camera; an image merging module for merging the images aligned in the above-mentioned image alignment module; a tooth object recognition module for analyzing the images merged in the above-mentioned image merging module using a preset object recognition algorithm to respectively recognize tooth objects; an image segmentation module for segmenting the merged image into images representing each of the tooth objects recognized in the above-mentioned tooth object recognition module; and a tooth image generation module for determining each of the images segmented in the above-mentioned image segmentation module as a tooth image.

[0031] Also, in the present invention, preferably, the above-mentioned comprehensive monitoring / diagnosis server further includes a dental data generation / updating unit. In the dental data generation / updating unit, if the relevant subject is being photographed for the first time, after assigning an identification code to the teeth corresponding to the dental images generated in the dental image generation unit, at least one of the subject identification information, dental photographing direction (occlusal surface, front or back), dental identification code, dental image, and photographing date is matched to generate dental data, which is then stored in the above-mentioned DB server. If the relevant subject is not being photographed for the first time, after extracting the dental data of the relevant subject from the above-mentioned DB server, referring to the dental identification code of the previous dental data, after matching the identification code to the teeth corresponding to the dental images generated in the dental image generation unit, dental data is generated and then stored in the above-mentioned DB server.

[0032] Also, in the present invention, preferably, a category detection algorithm is stored in the above-mentioned DB server. The category detection algorithm analyzes the input dental images and detects a value (M) for each different category (including at least one of carious lesions, cracks, dental fluorosis, dental calculus, and dental plaque). The above-mentioned comprehensive monitoring / diagnosis server further includes a different category value calculation unit. The different category value calculation unit uses the category detection algorithm to analyze the dental images generated in the dental image generation unit, calculates the different category values (M) of each tooth, matches the relevant subject identification information and the different category values (M) of each tooth, generates information on each different tooth category, and then stores it in the above-mentioned DB server.

[0033] Also, in the present invention, preferably, a first AI algorithm is stored in the above-mentioned DB server. The first AI algorithm takes the current different category values (M) and previous values (M') of each tooth as input data and outputs a diagnosis result including at least one of the tooth status, whether treatment is required, and the treatment content. The AI diagnosis analysis unit includes: a collection module for each different tooth category information, which collects the information on each different tooth category calculated in the different category value calculation unit and the information on the previous categories of each different tooth stored in the above-mentioned DB server; a first AI analysis module, which uses the first AI algorithm to analyze the current different category values (M) and previous values (M') of each tooth collected in the collection module for each different tooth category information and outputs the above-mentioned diagnosis result; a diagnosis analysis information generation module, which applies the output data output from the first AI analysis module, generates diagnosis analysis information including the above-mentioned diagnosis result, and then stores it in the above-mentioned DB server.

[0034] Also, in the present invention, preferably, the above comprehensive monitoring / diagnosis server further includes: an AI management and analysis unit; an AI prediction and analysis unit. The second AI algorithm and the third AI algorithm are stored in the above DB server. The second AI algorithm takes the current values (M) and previous values (M') of different categories of each tooth as input data and outputs a management result including at least one of a management status, a management method, and a management improvement point. The third AI algorithm takes the current values (M) and previous values (M') of different categories of each tooth as input data and, when each tooth is untreated, outputs a prediction result indicating the tooth state after a preset time. The above AI management and analysis unit uses the second AI algorithm to analyze the current values (M) and previous values (M') of different categories of each tooth collected in the above different tooth category information collection modules, and after outputting the above management result, generates management analysis information including the output management result. The above AI prediction and analysis unit uses the third AI algorithm to analyze the current values (M) and previous values (M') of different categories of each tooth collected in the above different tooth category information collection modules, and after outputting the above prediction result, generates prediction analysis information including the output prediction result.

[0035] Also, in the present invention, preferably, in the above oral cavity camera of the mouthpiece type, on one surface of the above body facing the imaging surface of the subject's teeth, that is, on the setting surface, sensor placement grooves for each of the above lensless cameras are formed inward and spaced apart in the length direction, and a pair of light source placement grooves are formed at positions adjacent to each sensor placement groove on the above setting surface.

[0036] Also, in the present invention, preferably, the above oral cavity camera of the mouthpiece type operates in a fluorescence imaging mode, a general imaging mode, and a mixed imaging mode. For the above light source, when in the above fluorescence imaging mode, it irradiates visible light in the blue series with a wavelength of 405 nm. When in the above general imaging mode, it irradiates white light visible light. When in the above mixed imaging mode, it irradiates visible light in the blue series with a wavelength of 405 nm in half of the total number of light sources, and white light visible light in the remaining light sources.

[0037] Also, in the present invention, preferably, when the oral cavity camera of the mouthpiece type used for imaging the occlusal surfaces of the upper teeth and the lower teeth of the subject is referred to as an occlusal surface oral cavity camera, in the above occlusal surface oral cavity camera, the above body is horizontally arranged, the upper surface of the above body is in contact with the occlusal surface of the subject's upper teeth, the lower surface of the above body is in contact with the occlusal surface of the subject's lower teeth, and the above sensor placement grooves are formed at intervals in the length direction on the upper and lower surfaces of the above body.

[0038] Also, in the present invention, preferably, the above-mentioned main body includes at least two sub-bodies, the above-mentioned sub-bodies are formed of a plate material, and are joined by at least one hinge shaft. When hinge-joined, the above-mentioned main body is formed. The above-mentioned sensor placement grooves and the above-mentioned light source setting grooves are formed on the upper and lower surfaces of the above-mentioned sub-bodies. The above-mentioned hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When assembling the above-mentioned sub-bodies, the above-mentioned main body rotates inward.

[0039] Also, in the present invention, preferably, the above-mentioned sub-bodies are formed in a number equal to the number of the above-mentioned lensless cameras along the length direction, and a single sensor placement groove is formed on the upper and lower surfaces of the above-mentioned sub-bodies respectively.

[0040] Also, in the present invention, preferably, when an oral appliance type oral camera for photographing the front of the upper and lower teeth of a subject is referred to as a front-use oral camera, in the above-mentioned front-use oral camera, the above-mentioned main body is vertically arranged, the rear surface of the above-mentioned main body faces the front surface of the teeth of the subject, and the above-mentioned sensor placement grooves are formed at intervals along the length direction on the rear surface of the above-mentioned main body and are formed in two rows.

[0041] Also, in the present invention, preferably, the above-mentioned main body includes at least two sub-bodies, the above-mentioned sub-bodies are formed of a plate material, and are joined by at least one hinge shaft. When hinge-joined, the above-mentioned main body is formed. The above-mentioned sensor placement grooves and the above-mentioned light source setting grooves are formed on the rear surface of the above-mentioned sub-bodies. The above-mentioned hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When assembling the above-mentioned sub-bodies, the above-mentioned main body rotates inward.

[0042] Also, in the present invention, preferably, the above-mentioned sub-bodies are formed in a number equal to the number of the above-mentioned lensless cameras along the length direction, and a pair of lensless cameras are arranged at intervals in the height direction on each rear surface of the above-mentioned sub-bodies.

[0043] Also, in the present invention, preferably, when an oral appliance type oral camera for photographing the rear of the upper and lower teeth of a subject is referred to as a rear-use oral camera, in the above-mentioned rear-use oral camera, the above-mentioned main body is vertically arranged, the front surface of the above-mentioned main body faces the rear surface of the teeth of the subject, and the above-mentioned sensor placement grooves are formed at intervals along the length direction on the front surface of the above-mentioned main body and are formed in two rows.

[0044] Also, in the present invention, preferably, the above-mentioned main body includes at least two sub-bodies, the above-mentioned sub-bodies are formed of a plate material, and are joined by at least one hinge shaft. When hinge-joined, the above-mentioned main body is formed. The above-mentioned sensor placement grooves and the above-mentioned light source setting grooves are formed on the front surface of the above-mentioned sub-bodies. The above-mentioned hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When assembling the above-mentioned sub-bodies, the above-mentioned main body rotates inward.

[0045] Further, in the present invention, preferably, the above-mentioned sub-bodies are formed in the same number as the number of the above-mentioned lensless cameras along the length direction, and a pair of lensless cameras are arranged at intervals in the height direction in front of the above-mentioned sub-bodies.

[0046] Effects of the Invention

[0047] According to the present invention having the above technical problems and solutions, it is made in the form of a mouthpiece type with multiple cameras, and images of the same conditions (shooting direction, magnification, position, etc.) of different teeth can be obtained regardless of the proficiency of the photographer, which can further improve the accuracy and effectiveness of diagnosis and treatment, and can significantly reduce unnecessary time and labor consumption caused by shooting teeth.

[0048] Moreover, according to the present invention, while replacing the cameras of the mouthpiece type oral camera with lensless cameras and replacing the conventional physical optical filter, the diagnostic service application performs digital filtering, thereby minimizing and thinning the thickness and volume of the oral camera. When inserted into the oral cavity, it not only minimizes the foreign body sensation and discomfort of the examinee, but also can effectively prevent tooth damage and burden.

[0049] Furthermore, according to the present invention, by performing digital filtering on the conventional physical optical filter with a transmittance of about 20%, it is possible to sufficiently shoot with a low amount of light, thereby minimizing the heat generation of the LED, effectively preventing safety accidents such as burns, and improving the reliability and safety of the product.

[0050] In addition, according to the present invention, the integrated monitoring / diagnosis server transmits the images of each lensless camera from the diagnostic service application, aligns and combines these images in sequence according to the dental arch, then separately identifies the tooth objects, separates the images in a manner of displaying the identified tooth objects, generates tooth images, and analyzes the generated tooth images to detect diagnostic analysis information, thereby improving the accuracy of tooth diagnosis and treatment.

[0051] Also, according to the present invention, the integrated monitoring / diagnosis server analyzes each tooth image, calculates the preset different category values (M), and at the same time uses the learned first AI algorithm to analyze the current different category values (M) and previous values (M') of each tooth, and detects diagnostic analysis information, thereby enabling accurate and detailed diagnosis and significantly improving the treatment effect and effectiveness. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a perspective view showing an oral scanner disclosed in Korean Patent No. 10-1942641 (invention title: Oral Scanner in the Shape of a Mouthpiece).

[0053] Figure 2To represent the structural diagram of a remote oral condition monitoring system disclosed in Korean Patent No. 10-2074887 (invention title: Remote Oral Condition Monitoring System and Method Using Image Analysis).

[0054] Figure 3 To represent the structural diagram of a tooth diagnosis and management system according to the first embodiment of the present invention.

[0055] Figure 4 For explaining Figure 3 conceptual diagram.

[0056] Figure 5 To represent Figure 3 a perspective view of an occlusal surface oral camera as an embodiment of a mouthpiece-type oral camera.

[0057] Figure 6 For explaining Figure 5 conceptual diagram.

[0058] Figure 7 Part (a) of is a photograph of a conventional tooth, and part (b) is a photograph when blue visible light is irradiated onto the tooth and blue-series light is filtered.

[0059] Figure 8 To represent Figure 5 conceptual diagram of a lensless camera.

[0060] Figure 9 Part (a) of is an example diagram for explaining the phase-mask-based lensless imaging method of the present invention, and part (b) is an example diagram for explaining the lens-based imaging method.

[0061] Figure 10 To represent a perspective view of a rear oral camera as the second embodiment of the mouthpiece-type oral camera of the present invention.

[0062] Figure 11 To represent a perspective view of a front oral camera as the third embodiment of the mouthpiece-type oral camera of the present invention.

[0063] Figure 12 To represent Figure 5 a perspective view of the second embodiment of the occlusal surface oral camera.

[0064] Figure 13 To represent Figure 10 a perspective view of the second embodiment of the rear oral camera.

[0065] Figure 14 To represent Figure 11 a perspective view of the second embodiment of the front oral camera.

[0066] Figure 15 Stereogram of the third embodiment of the oral camera for representing the Figure 5 occlusal surface.

[0067] Figure 16 Stereogram of the third embodiment of the oral camera for representing the Figure 10 rear surface.

[0068] Figure 17 Stereogram of the third embodiment of the oral camera for representing the Figure 11 front surface.

[0069] Figure 18 Block diagram of the diagnostic service application for representing the Figure 3 ...

[0070] Figure 19 Example diagram of the selection interface provided in the operation mode selection unit for Figure 18 ...

[0071] Figure 20 Block diagram of the image processing unit for representing the Figure 17 ...

[0072] Figure 21 Block diagram of the medical staff mode operation unit for representing the Figure 18 ...

[0073] Figure 22 Block diagram of the integrated monitoring / diagnosis server for representing the Figure 3 ...

[0074] Figure 23 Block diagram of the tooth image generation unit for representing the Figure 22 ...

[0075] Figure 24 Block diagram of the AI diagnosis analysis unit for representing the Figure 22 ...

[0076] Figure 25 Block diagram of the AI management analysis unit for representing the Figure 22 ...

[0077] Figure 26 Block diagram of the AI prediction analysis unit for representing the Figure 22 ... DETAILED DESCRIPTION

[0078] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0079] Figure 3 Structural diagram of the tooth diagnosis and management system according to an embodiment of the present invention, Figure 4 Conceptual diagram for explaining Figure 3 ...

[0080] Figure 3 and Figure 4 In one embodiment of the tooth diagnosis and management system 1 of the present invention, by using a lens-less camera and an oral appliance provided with a light source, while obtaining the front, rear, and occlusal surface images of each tooth, and by using a learned AI algorithm, continuously tracking and analyzing the images in time series to detect diagnostic, management, and prediction information. Thereby, not only can the precision, reliability, and effectiveness of tooth diagnosis, treatment, and management be improved, but also images of the same conditions (shooting direction, magnification, position, etc.) of different teeth can be obtained regardless of the proficiency of the photographer, which can further improve the accuracy and effectiveness of diagnosis and treatment, and significantly reduce unnecessary time and labor consumption caused by shooting teeth.

[0081] Moreover, the tooth diagnosis and management system 1 of the present invention, as Figure 3 and Figure 4 shown, is composed of an integrated monitoring / diagnosis server 3, an oral appliance type oral camera 5, a medical staff terminal 7, a user terminal 8, a diagnostic service application 9, and a communication network 10.

[0082] At this time, for the convenience of explanation in the present invention, although an example is given in which the diagnostic service application 9 performs inverse operation on the graphic data transmitted from the lens-less camera to obtain an image, and after analyzing the image obtained by the integrated monitoring / diagnosis server 3, generates meaningful information (tooth diagnosis, management, prediction, etc.), the operation processing of image analysis and generation of meaningful information can be performed by the diagnostic service application 9 itself.

[0083] Moreover, for the convenience of explanation in the present invention, although an example is given in which the diagnostic service application 9 is respectively set on the medical staff terminal 7 and the examinee terminal 8, different dedicated applications can be set on the medical staff terminal 7 and the examinee terminal 8.

[0084] The communication network 10 provides a data movement path between the integrated monitoring / diagnosis server 3, the medical staff terminal 7, and the examinee terminal 8. Specifically, it can be composed of wired and wireless networks (such as WAN, LAN, etc.) and mobile communication networks such as 3G, LTE, and 4G.

[0085] The medical staff terminal 7 is a digital terminal carried by medical staff (doctors, nurses, therapists, etc.), and the examinee terminal 8 is a digital terminal carried by an examinee (User). The medical staff terminal 7 and the examinee terminal 8 can be composed of a desktop computer (DesktopPC), a notebook computer (Notebook), a smart phone (Smart phone), a tablet PC (Tablet PC), etc.

[0086] Moreover, the medical staff terminal 7 and the examinee terminal 8 are connected to the mouthpiece type oral camera 5 via the wired / wireless communication network 20, and receive the graphic data obtained by the shooting of the mouthpiece type oral camera 5 from the mouthpiece type oral camera 5.

[0087] Moreover, the following Figure 18 diagnostic service application program 9 is set in the medical staff terminal 7 and the examinee terminal 8.

[0088] Figure 5 To show Figure 3 a perspective view of the occlusal surface oral camera which is an embodiment of the mouthpiece type oral camera, Figure 6 is a conceptual diagram for explaining Figure 5 the concept.

[0089] Regarding Figure 5 and Figure 6 the occlusal surface oral camera 51 which is an embodiment of the mouthpiece type oral camera 5, when the occlusal surface oral camera 51 is inserted into the oral cavity of the examinee and bitten by the examinee's teeth, the lensless cameras 513 arranged in a row according to the examinee's dentition photograph the upper and lower occlusal surfaces (chewing surfaces) of each tooth to obtain the graphic data of each occlusal surface.

[0090] Moreover, as shown in Figure 6 , the occlusal surface oral camera 51 includes: a main body 511 formed in the shape of a mouthpiece, inserted into the oral cavity of the examinee, the upper surface 5111 and the lower surface 5113 are formed as flat surfaces, and are pressed by the upper and lower occlusal surfaces 211 of the examinee; lensless cameras 513 are arranged on the upper surface 5111 and the lower surface 5113 of the main body 511, and are spaced apart along the length direction; light sources 515 are arranged opposite to each other along the width direction with each lensless camera 513 as a reference, and are spaced apart along the length direction; a controller (not shown), supplies power to the lensless cameras 513 and the light sources 515, and transmits the graphic data obtained by the shooting of the lensless cameras 513 to the connected terminal 7 or 8.

[0091] The main body 511 is formed in the shape of a mouthpiece, the upper surface 5111 and the lower surface 5113 are formed flatly, when inserted into the oral cavity of the examinee, the occlusal surface 211 of the upper teeth 21 of the examinee contacts the upper surface 5111, and the occlusal surface of the lower teeth 22 of the examinee contacts the lower surface 5113.

[0092] At this time, when the examinee bites the main body 511, in order to minimize the foreign body sensation, discomfort, etc. of the examinee, preferably, it is made of a material harmless to the human body and at the same time made of a synthetic resin material with high stretchability and flexibility that does not cause harm to the teeth.

[0093] Further, the main body 511 is made in a shape corresponding to the teeth, dentition, and oral cavity shape of the human body.

[0094] Further, on the upper surface 5111 and the lower surface 5113 of the main body 511, sensor placement grooves 5114 are formed at intervals along the length direction, facing inward from the upper surface 5111 and the lower surface 5113.

[0095] At this time, lensless cameras 513 are provided in the sensor placement grooves 5114 of the main body 511. The lensless cameras 513 face the occlusal surfaces of the upper and lower teeth and are arranged in a row along the length direction, so that the upper and lower occlusal surfaces of each tooth can be photographed.

[0096] Further, with the sensor placement grooves 5114 of the main body 511 as a reference, light source placement grooves 5115 are symmetrically formed in the width direction.

[0097] At this time, light sources 515 are respectively provided in the light source placement grooves 5115.

[0098] Further, a handle 517 for being held by the hand of a medical staff or a user is formed to protrude forward from the main body 511.

[0099] Further, although not shown in the figure, a heating unit and a cooling unit can be provided inside the position adjacent to the light source placement grooves 5115 of the main body 511 of the occlusal surface oral camera 51. At this time, if the controller receives a control signal of the heating unit or the cooling unit of a specific area input from an external computer device, the controller causes the heating unit or the cooling unit of the relevant area to operate, and the sensitivity or reaction degree of the specific tooth of the subject to heat or cold can be tested.

[0100] The light sources 515 are respectively provided in the light source placement grooves 5115 formed on the upper surface 5111 and the lower surface 5113 of the main body 511, and irradiate LED light toward the occlusal surfaces of the corresponding teeth to provide the illumination required for photographing by the lensless cameras 513.

[0101] That is, among the light sources 515, a pair of light sources 515 symmetrically arranged in the width direction with the lensless cameras 513 as a reference irradiate LEDs toward the occlusal surfaces of the relevant teeth.

[0102] Further, the light sources 515 irradiate visible light in the blue series, that is, visible light with a wavelength of 405 nm.

[0103] On the other hand, the oral cavity camera 5 of the present invention is designed to support a fluorescence (blue light) shooting mode, a general shooting mode, and a hybrid shooting mode. If a photographer selects any one of the fluorescence shooting mode, the general shooting mode, and the hybrid shooting mode, light is irradiated from the light sources 515 according to the selected mode.

[0104] As an example, for the oral cavity camera 5 of the oral appliance type, if the fluorescence shooting mode is selected by the photographer, blue visible light with a wavelength of 405 nm is irradiated from the light source 515. If the general shooting mode is selected, white visible light is irradiated from the light source 515.

[0105] Figure 7 Part (a) of is a photo of a tooth taken by conventional shooting, and part (b) is a photo of the tooth when filtering the wavelength band of blue visible light after irradiating the blue visible light.

[0106] Generally, visible light in the blue series has the property of not only not passing through teeth but also inducing fluorescence when reflected. On the other hand, when the inorganic matter of the tooth disappears, the fluorescence appears dimmer compared to normal teeth. Specifically, carious lesions, cracks, dental fluorosis, dental calculus, dental plaque, etc. on the tooth surface have the property of appearing dimmer. On the other hand, porphyrin that forms a biofilm exhibits the property of inducing red fluorescence.

[0107] That is, after irradiating visible light in the blue series, digital filtering is performed on the reflected light of the visible light in the blue series irradiated from an external computer device. Figure 4 As shown in parts (a) and (b) of Figure 4 , through color contrast, the porphyrin component that forms the biofilm in the oral cavity appears red and conspicuous. According to the brightness difference of the reflected light, it is possible to easily distinguish carious lesions, cracks, dental fluorosis, dental calculus, dental plaque, etc. on the tooth surface.

[0108] On the other hand, conventional physical optical filters have a transmittance of about 20%. Therefore, in order to irradiate a sufficient amount of light during shooting, the irradiation amount of the light source is unnecessarily increased. Although this increase in the light amount of the light source also increases the calorific value, this increase in the calorific value of this oral appliance type product induces safety accidents such as burns, so special attention is required.

[0109] Thus, the oral cavity camera 5 of the present invention does not provide a conventional optical filter, can sufficiently shoot with a small amount of light, thereby saving the calorific value of the LED, improving the reliability and safety of the product, minimizing and thinning the thickness and volume of the product itself, and thus improving the wearing feeling of the subject.

[0110] Figure 8 To show Figure 5 the conceptual diagram of the lensless camera of Figure 5 , Figure 9 Part (a) of Figure 9 is an example diagram for explaining the lensless imaging method based on a phase mask of the present invention, and part (b) is an example diagram for explaining the imaging method based on a lens.

[0111] The lensless cameras 513 are respectively disposed in the sensor mounting grooves 5114 formed on the upper surface 5111 and the lower surface 5113 of the aforementioned main body 511, so that when inserted into the oral cavity, they are arranged at intervals in the width direction according to the dentition of the subject.

[0112] At this time, the lensless cameras 513 disposed on the upper part of the main body 511 respectively photograph the occlusal surfaces 211 of the upper teeth 21 of the subject, and the lensless cameras 513 disposed on the lower part of the main body 511 respectively photograph the occlusal surfaces of the lower teeth 22 of the subject.

[0113] And, the lensless camera 513 is as Figure 8 shown, and includes: a phase mask 5131 that allows the light irradiated from the light source 515 and reflected to pass through; an image sensor 5133 that allows the light passing through the phase mask 5131 to enter.

[0114] At this time, for the convenience of explanation in the present invention, although the mask of the lensless camera 513 is described by taking the phase mask as an example, the mask of the lensless camera 513 is not limited thereto, and of course, known various types and technical masks such as an amplitude mask can be applied.

[0115] That is, the lensless camera 513 applies a phase mask 5131 that changes the phase of light through a minute bending pattern instead of a lens that focuses a point light source.

[0116] The phase mask 5131 is made of a transparent material that is light-transmissive like a transparent film or the like.

[0117] And, the phase mask 5131 forms minute bending patterns with irregular shapes such as size, height, and shape at different positions on the outer surface in the direction facing the image sensor 515.

[0118] At this time, the phase mask 5131 delays, changes, and diffuses the phase of the light passing through the pattern based on the point spread function (PSF) representing the inherent pattern determined according to the shape structure differently at different positions.

[0119] That is, the point light source passing through the phase mask 5131 changes and diffuses the phase according to the phase transformation pattern and is incident on the entire area of the image sensor 5133.

[0120] The image sensor 5133 allows the pattern that passes through the phase mask 5131 and changes the phase to enter.

[0121] At this time, the patterns projected on the image sensor 5133 and appearing are combined, and this is called pattern data.

[0122] Further, the graphic data obtained by the image sensor 5133 is transmitted to the medical staff terminal 7 or the subject terminal 8 under the control of a controller (not shown). When the graphic data is transmitted, the diagnostic service application 9 provided in the terminal performs digital filtering on the transmitted graphic data and then performs inverse operation to obtain an image.

[0123] Refer to Figure 9 Part (b) of Figure 9 to compare the lensless camera 513 of the present invention with a conventional lens camera. As shown in part (a) of

[0124] When the light irradiated from the light source 515 and reflected by the teeth passes through the phase mask 5131, as shown in part (a) of Figure 9 the phase of the point light is transformed and diffused through the minute bending pattern of the phase mask 5131 and projected onto the image sensor 5133 separated by the focal distance (f).

[0125] Generally speaking, as in the case of the oral cavity camera 5 of the present invention, which is an oral appliance type product inserted into the oral cavity of a subject, the most sensitive problem for the subject is that when biting the oral appliance type product, there will be a sense of foreign body, wearing feeling, and discomfort. In particular, since the oral appliance is bitten by the upper and lower teeth of the subject, the thicker the thickness of the area where the upper and lower teeth bite, the higher the sense of foreign body and discomfort of the subject, and the wearing feeling is significantly reduced.

[0126] In view of the characteristics of such an oral appliance type product, the present invention sets a lensless camera instead of a conventional lens camera in order to minimize the overall volume and thickness. Thus, even if multiple lensless cameras are set, the thickness can be minimized.

[0127] On the other hand, in the past, an optical filter for filtering light of a specific wavelength was separately arranged outside the lens camera to implement the Quantitative Light-induced Fluorescence (QLF - registered trademark) technology. However, the physical setting of such an optical filter not only increases the thickness of the oral appliance type product, but also requires an increase in the amount of light due to a light transmittance of about 20%, thereby increasing the calorific value. When applied to an oral appliance type product as in the present invention, there is a problem of safety accidents such as burns.

[0128] Accordingly, in the present invention, instead of the conventional physical optical filter, digital filtering is performed in the diagnostic service application program 9, thereby manufacturing the oral appliance type oral camera 5 in a thinner and smaller size while effectively preventing safety accidents.

[0129] Figure 10 A perspective view of the rear oral camera of the second embodiment of the oral appliance type oral camera of the present invention is shown.

[0130] Figure 10 The rear oral camera 52 is the second embodiment of the oral appliance type oral camera 5 of the present invention. When it is inserted into the oral cavity of the subject and bitten by the subject's teeth, the lensless camera 523 arranged in a row according to the subject's dentition takes pictures of the rear of each tooth to obtain graphic data of the rear of each tooth.

[0131] Moreover, as shown in Figure 10 , the rear oral camera 52 includes: a second main body 521 formed of a plate material having a length, arranged perpendicular to the oral insertion direction, and formed in an arc shape with the middle position in the length direction facing more backward toward both ends; a mounting portion 522 protruding from the middle position in the height direction of the front surface 5211 of the second main body 521 and extending along the length; lensless cameras 523 arranged at intervals in the height direction on the front surface 5211 of the second main body 522 and arranged at intervals in the length direction; light sources 525 arranged opposite to each other in the height direction with each lensless camera 523 as a reference; and a controller (not shown) that supplies power to the lensless cameras 523 and the light sources 525 and transmits the graphic data obtained by photographing with the lensless cameras 523 to the connected terminals 7 or 8.

[0132] The second main body 521 is formed of a plate material having a length and is arranged in a direction perpendicular to the oral insertion direction, and is formed in an arc shape with the middle position in the length direction facing more backward toward both ends.

[0133] At this time, preferably, the second main body 521 is manufactured in a shape corresponding to the shape of the subject's dentition.

[0134] Moreover, when the second main body 521 is inserted into the oral cavity of the subject, the front surface is arranged at a fixed interval away from the rear of the subject's teeth, and the lensless camera 523 provided on the front surface of the second main body 521 can photograph the rear of each tooth of the subject.

[0135] Moreover, at the middle position in the height direction of the front surface 5211 of the second main body 521, a mounting portion 522 protruding outward from the front surface 5211 is formed and extends along the length direction.

[0136] Further, inside the front surface 5211 of the second body 521, second sensor placement grooves 5214 are formed to face each other in the height direction and are spaced apart in the length direction. Lensless cameras 523 are respectively disposed in the second sensor placement grooves 5214.

[0137] Further, at the upper and lower portions of each second sensor placement groove 5214 on the front surface 5211 of the second body 521, light source placement grooves 5215 for setting light sources 525 are formed.

[0138] Further, a handle 527 for being held by the hand of a medical staff or a user is formed to protrude at the foremost front of the second body 521.

[0139] Further, a guiding protrusion 528 that contacts the upper front teeth of the subject and is used to guide the reference position is formed to protrude on the upper surface adjacent to the second body 521 of the handle 527.

[0140] When the rear oral camera 52 configured as described above is inserted into the oral cavity of the subject, the second body 521 is disposed at a predetermined interval behind the dental arch, and lensless cameras 523 are disposed at intervals in the length and height directions on the front surface of the second body 521. Thus, by photographing with each lensless camera 523, the rear surfaces of the respective teeth (including upper teeth and lower teeth) of the subject can be photographed to obtain graphic data, and thus a detailed analysis, diagnosis, and treatment of the rear surfaces of the subject's teeth can be performed.

[0141] Figure 11 FIG. is a perspective view of the front oral camera showing the third embodiment of the oral appliance type oral camera of the present invention.

[0142] Figure 11 The rear oral camera 53 is the third embodiment of the oral appliance type oral camera 5 of the present invention. When it is inserted into the oral cavity of the subject and bitten by the subject's teeth, lensless cameras 533 arranged in a row according to the subject's dental arch photograph the front surfaces of the respective teeth to obtain graphic data of the front surfaces of the respective teeth.

[0143] Further, the front oral camera 53 is as Figure 11As shown in the figure, it includes: a third body 531, formed of a plate material having a length, disposed perpendicular to the oral insertion direction, and being arc-shaped with the middle position in the length direction facing more backward toward both ends; a third placement portion 532, protruding and formed at the middle position in the height direction of the rear surface 5311 of the second body 531, extending along the length, and enabling the upper teeth and the lower teeth of the subject to bite; a lensless camera 533, disposed at intervals in the height direction on the rear surface 5311 of the third body 531 and at intervals in the length direction; a light source 535, disposed opposite in the height direction with respect to each lensless camera 533; a controller (not shown), supplying power to the lensless camera 533 and the light source 535 and transmitting the graphic data obtained by photographing with the lensless camera 533 to the connected terminal 7 or 8.

[0144] The third body 531 is formed of a plate material having a length, configured in a direction perpendicular to the oral insertion direction, and being arc-shaped with the middle position in the length direction facing more backward toward both ends.

[0145] At this time, preferably, the third body 531 is made in a shape corresponding to the dentition shape of the subject.

[0146] Moreover, when the third body 531 is inserted into the oral cavity of the subject, the rear surface 5311 is disposed at a fixed interval from the front surface of the teeth of the subject, and the lensless camera 533 disposed on the rear surface of the third body 531 can photograph the front surfaces of the respective teeth of the subject.

[0147] And, at the middle position in the height direction of the rear surface 5311 of the third body 531, a third placement portion 532 protruding outward from the rear surface 5311 is formed and extends along the length direction.

[0148] At this time, when the third body 531 is inserted into the oral cavity of the subject, the upper teeth and the lower teeth of the subject come into contact with the upper surface and the lower surface of the third placement portion 532.

[0149] And, on the inner side of the rear surface 5311 of the third body 531, third sensor placement grooves 5314 are formed opposite to each other in the height direction, formed at intervals in the length direction, and lensless cameras 533 are respectively disposed in the third sensor placement grooves 5314.

[0150] And, on the upper and lower portions of each third sensor placement groove 5314 on the rear surface 5311 of the third body 531, light source placement grooves 5315 for setting the light source 535 are formed.

[0151] And, a handle 537 for being held by the hand of a medical staff or a user is protrudingly formed at the foremost part of the third body 521.

[0152] When the front oral camera 53 configured as described above is inserted into the oral cavity of the subject, the third body 531 is disposed in front of the dentition of the subject at a predetermined interval, and the lensless cameras 533 are provided behind the third body 531 at intervals in the length and height directions. Thus, by photographing with each lensless camera 533, the front surfaces of the respective teeth (including upper teeth and lower teeth) of the subject can be photographed to obtain graphic data, and thus, the back surfaces of the teeth of the subject can be finely analyzed, diagnosed, and treated.

[0153] Figure 12 To show Figure 5 A perspective view of a second embodiment of the oral camera for the occlusal surface.

[0154] Figure 12 The second oral camera 54 for the occlusal surface is a second embodiment of the oral camera 52 for the occlusal surface of the foregoing Figure 5 Since oral characteristics such as the number of teeth, the shape of the dentition, and the oral structure of each person are different, the sub-bodies 541-1,..., 541-N are combined with the hinge 549, and the sub-bodies are rotated corresponding to the various oral characteristics of the subject, so that they can be linked and applied to various oral characteristics.

[0155] Moreover, as shown in Figure 12 the second oral camera 54 for the occlusal surface includes: a fourth body 541, a plurality of sub-bodies 541-1,..., 541-N are combined with the hinge 549 to form the shape of a mouthpiece; lensless cameras 543 are respectively provided on the upper and lower surfaces of each of the sub-bodies 541-1,..., 541-N; and light sources 545 are provided on the upper and lower surfaces of each of the sub-bodies 541-1,..., 541-N.

[0156] The sub-bodies 541,..., 541-N are formed of flat plates, and the adjacent sub-bodies and sides are combined with the hinge 549 and assembled into the shape of a mouthpiece. Each of the sub-bodies 541,..., 541-N is rotated corresponding to the oral characteristics (number of teeth, shape of the dentition, oral structure, etc.) of the subject, which can not only improve the foreign body sensation and discomfort of the subject, but also effectively prevent damage to the teeth of the subject.

[0157] That is, the sub-bodies 541,..., 541-N are combined in a joint manner.

[0158] Moreover, fourth sensor mounting grooves 5414 are respectively formed on the front and rear surfaces of the sub-bodies 541,..., 541-N, and light source setting grooves 5415 are respectively formed on the upper and lower portions of each of the sensor mounting grooves 5414.

[0159] Figure 13 To show Figure 10 A perspective view of a second embodiment of the oral camera for the back surface.

[0160] Figure 13 The second posterior oral camera 55 is the aforementioned Figure 10 second embodiment of the posterior oral camera 51.

[0161] And, the second posterior oral camera 55 is as Figure 13 shown, including: a fifth body 551, a plurality of second sub-bodies 551-1, ..., 551-N combined with a hinge 559, formed in the shape of a mouthpiece; a lensless camera 553, disposed at intervals in the height direction in front of each of the second sub-bodies 551-1, ..., 551-N; a light source 555, disposed in front of each of the second sub-bodies 551-1, ..., 551-N.

[0162] The second sub-bodies 551, ..., 551-N are formed of flat plates, are vertically arranged when inserted into the oral cavity, and adjacent sub-bodies and sides are combined with the hinge 559 and assembled in the shape of a mouthpiece.

[0163] That is, among the second sub-bodies 551, ..., 551-N, the sides of adjacent second sub-bodies are combined with the hinge 559 and are rotatably formed at a specified angle, whereby it is possible to flexibly correspond to the oral characteristics of the subject.

[0164] That is, the second sub-bodies 551, ..., 551-N are combined in a joint manner.

[0165] And, mounting grooves 5514 are respectively formed in the front and rear of the second sub-bodies 551, ..., 551-N, and light source setting grooves 5415 are respectively formed in the upper and lower parts of each sensor mounting groove 5514.

[0166] Figure 14 To show Figure 11 a perspective view of the second embodiment of the anterior oral camera.

[0167] Figure 14 The second anterior oral camera 56 is the aforementioned Figure 11 second embodiment of the anterior oral camera 53.

[0168] And, the second posterior oral camera 56 is as Figure 14 shown, including: a sixth body 561, a plurality of third sub-bodies 561-1, ..., 561-N combined with a hinge 569, formed in the shape of a mouthpiece; a lensless camera 563, disposed at intervals in the height direction behind each of the third sub-bodies 561-1, ..., 561-N; a light source 565, disposed in front of each of the third sub-bodies 561-1, ..., 561-N.

[0169] The third sub-bodies 561, ..., 561-N are formed of flat plates, are vertically arranged when inserted into the oral cavity, and the adjacent sub-bodies and sides are combined with the hinge 569 and assembled in the shape of the oral appliance.

[0170] That is, among the third sub-bodies 561, ..., 561-N, the sides of the adjacent third sub-bodies are combined with the hinge 569 and are rotatably formed at a specified angle, whereby the oral cavity characteristics of the subject can be flexibly corresponded to.

[0171] That is, the third sub-bodies 561, ..., 561-N are combined in a joint manner.

[0172] Moreover, mounting grooves 5614 are respectively formed in the front and rear of the third sub-bodies 561, ..., 561-N, and light source setting grooves 5615 are respectively formed in the upper and lower parts of each sensor mounting groove 5614.

[0173] Figure 15 For showing Figure 5 the perspective view of the third embodiment of the oral cavity camera for the occlusal surface, Figure 16 For showing Figure 10 the perspective view of the third embodiment of the oral cavity camera for the rear surface, Figure 17 For showing Figure 11 the perspective view of the third embodiment of the oral cavity camera for the front surface.

[0174] The third occlusal surface oral cavity camera 57 of the present invention is as Figure 15 shown, and includes fourth sub-bodies 571-1, 571-2, 571-3. The fourth body 571 is combined with two hinges 579. When assembled, the body 511 of the aforementioned Figure 5 is formed.

[0175] At this time, the hinge 579 is formed at the rearmost position of the side walls of the adjacent sub-bodies and is arranged in a state perpendicular to the insertion direction of the oral cavity camera. The two end portions of the fourth body 571 can be rotated inward.

[0176] On the other hand, the third rear surface oral cavity camera 580 is as Figure 16 shown, and includes fifth sub-bodies 581-1, 581-2, 581-3. The fifth body 581 is combined with two hinges 589. When assembled, the second body 521 of the aforementioned Figure 10 is formed.

[0177] At this time, the hinge 589 is formed along the side walls of the adjacent sub-bodies in a vertical state, whereby the two end portions of the fifth body 581 can be rotated inward.

[0178] On the other hand, the third front surface oral cavity camera 590 is as Figure 14As shown, it includes: a sixth sub-body 591-1, 591-2, 591-3, the sixth body 591 is combined with two hinges 599, and when assembled, the aforementioned Figure 11 The third body 531.

[0179] At this time, the hinge 599 is formed in a vertical state along the side walls of the adjacent sub-bodies, so that both ends of the sixth body 591 can rotate inwardly.

[0180] That is, the mouthpiece type oral camera of the present invention can be selectively used for the occlusal surface, the rear surface and the front surface according to the tooth area to be photographed, and the main body can be composed of sub-bodies rotatably connected by at least one hinge.

[0181] Figure 18 To express Figure 3 Block diagram of the diagnostic service application.

[0182] Figure 18 The diagnostic service application 9 is an application, software or application software set on the medical staff terminal 7 or the subject terminal 8, which is linked with the comprehensive monitoring / diagnosis server 3 to provide users with dental diagnosis and treatment services.

[0183] Furthermore, the diagnostic service application 9 is as follows Figure 18 As shown, it includes a control unit 90, a data transceiver unit 91, a data storage unit 92, an operation mode selection unit 93, an image processing unit 94, a medical staff mode operation unit 95, and a subject mode operation unit 97.

[0184] The control unit 90 manages and controls the operation of the diagnostic service application 9 , and specifically manages and controls the operation of the control objects 91 , 92 , 93 , 94 , 95 , and 97 .

[0185] Furthermore, when the control unit 90 is operated, the operation mode selection unit 93 is operated. Through the operation mode selection unit 93, if the user (User) selects image processing, the image processing unit 95 is operated. If the medical staff mode is selected, the medical staff mode operation unit 97 is operated. If the subject mode is selected, the subject mode operation unit 99 is operated.

[0186] The data transceiver 91 transmits and receives data with the integrated monitoring / diagnostic server 3 and the mouthpiece-type oral camera 5 via a communication module (not shown) of the terminal 7 or 8 .

[0187] Then, the data transceiver 91 requests data from the integrated monitoring / diagnostic server 3 and receives result data in response to the request data.

[0188] The data storage unit 92 stores data in the memory of the terminal according to the control of the control unit 90 .

[0189] Figure 19 To show an example diagram of the selection interface provided in the operation mode selection unit of Figure 18 When the user first runs the diagnostic service application 9,

[0190] When the user first runs the diagnostic service application 9, Figure 19 the operation mode selection unit 93 of

[0191] And, as shown in Figure 19 the operation mode selection unit 93 displays the graphical user interface (GUI) for the user to select any one of image processing, medical staff mode, and subject mode, that is, the selection interface 710, on the display of the terminal 7 or 8.

[0192] At this time, the selection interface 710 displays a button 711 for selecting image processing, a button 712 for selecting the medical staff mode, and a button 713 for selecting the subject mode.

[0193] And, if the user touches (clicks) the image processing button 711, the operation mode selection unit 93 runs the image processing unit 95. If the user touches (clicks) the medical staff mode button 712, it runs the medical staff mode operation unit 97. If the user touches (clicks) the subject mode button 713, it runs the subject mode operation unit 99.

[0194] Figure 20 To show Figure 17 a block diagram of the image processing unit of

[0195] When the user touches (clicks) the image processing button 711, Figure 20 the image processing unit 95 of Figure 19 runs according to the control of the control unit 90 through the aforementioned

[0196] And, as shown in Figure 20 the image processing unit 95 includes a network construction module 951, a subject setting module 952, a graphic data input module 953, a digital filtering module 954, an inverse operation and image acquisition module 955, and a matching data generation module 956.

[0197] The network construction module 951 confirms whether the intraoral camera 5 for photographing the teeth of the subject is connected to the wired / wireless communication network 20.

[0198] The subject setting module 952 inputs the identification information of the subject to be photographed from the medical staff.

[0199] The graphic data input module 953 inputs the graphic data transmitted from the intraoral camera 5 through the data transceiver 92.

[0200] At this time, each graphic data includes lensless camera identification information.

[0201] The digital filtering module 954 filters the reflection signals outside the wavelength passband of the graphic data input through the graphic data input module 953.

[0202] Generally, in the past, an optical filter for filtering light of a specific wavelength was separately provided outside the lens camera to implement the Quantitative Light-induced Fluorescence (QLF - registered trademark) technology. However, this physical setting of the optical filter not only increases the thickness of the oral appliance type product, but also requires an increase in the amount of light due to a light transmittance of about 20%, and the heat generation increases in proportion to the increased amount of light. Therefore, when applied to the oral appliance type product as described in the present invention, there is a problem of safety accidents such as burns occurring.

[0203] The digital filtering module 954 of the diagnostic service application program 9 of the present invention transforms the graphic data obtained by photographing with the lensless camera 953 into color values within the wavelength passband. Thus, not only can the problems of the past be epoch - makingly solved, but also through the Quantitative Light-induced Fluorescence technology, the porphyrin component of the biofilm in the oral cavity is displayed in red, and according to the brightness difference of the reflected light, it is possible to easily distinguish carious lesions, cracks, dental fluorosis, dental calculus, dental plaque, etc. on the tooth surface.

[0204] The inverse operation and image acquisition module 955 uses the point spread function (PSF) of the phase mask 5131 to perform an inverse operation on the graphic data within the wavelength passband in the digital filtering module 954 and transforms it into an image based on the lens.

[0205] At this time, the phase mask is formed of a three - dimensional shape structure having different heights at different positions according to the phase transformation pattern, and the phase transformation pattern of the phase mask having the three - dimensional shape structure corresponds to the point spread function (PSF) having a two - dimensional pattern.

[0206] Moreover, the inverse operation function applicable to the inverse operation and image acquisition module 955 can be stored in advance by setting values corresponding to the point spread function (PSF) of the phase mask.

[0207] The matching data generation module 956 uses the identification information of the oral appliance type oral camera 5 and the identification information of each lensless camera 515 to match the subject identification information, medical staff identification information, shooting direction (occlusal surface, front or back, etc.) information, lensless camera identification information, and the image, and generates matching data.

[0208] At this time, if the matching data generation module 956 generates matching data, the control unit 90 controls the data transceiver unit 92 to transmit the generated matching data to the integrated monitoring / diagnosis server 3.

[0209] Figure 21 To represent Figure 18 The block diagram of the medical staff mode operation unit.

[0210] Figure 21 For the medical staff mode operation unit 97 of Figure 19 When the user touches (clicks) the medical staff mode button 712 through the selection interface 710 of

[0211] And, when the medical staff mode operation unit 97 is as Figure 21 shown, it includes a GUI display and processing module 971, a list display module 972, a comprehensive treatment information providing module 973, a diagnosis / management / prediction analysis information providing module 974, a recent image display module 975, and a three-direction time series image display module 976.

[0212] The GUI display and processing module 971 displays the produced GUI on the display of the terminal 7 or 8 and at the same time receives a request command from the medical staff (User) through the displayed GUI, runs the corresponding processor, performs arithmetic processing, and then provides the response data to the medical staff through the corresponding GUI that exposes the response data.

[0213] The list display module 972 displays, on the display of the terminal 7 or 8, the GUI on which the list of examinees transmitted from the integrated monitoring / diagnosis server 3 is exposed according to the request of the medical staff.

[0214] The comprehensive treatment information providing module 973, if it receives a request for comprehensive treatment information about a specific examinee from the medical staff, refers to and applies the comprehensive treatment information of the overall examinees transmitted from the integrated monitoring / diagnosis server 3, extracts the comprehensive treatment information of the selected examinee, and then displays it on the display of the terminal 7 or 8 through the GUI.

[0215] At this time, the comprehensive treatment information includes the personal information of the subject, the diagnosis date and history, the treatment date and history, the diagnostic analysis information, the management analysis information, the predictive analysis information, etc. The diagnostic analysis information means the diagnostic content of the current dental status detected by the comprehensive monitoring / diagnosis server 3 through the AI analysis of the dental images of the subject. The management analysis information means the management status and supplementary points detected by the comprehensive monitoring / diagnosis server 3 through the AI analysis of the dental images of the subject. The predictive analysis information means the predictive content of the subsequent dental status detected by the comprehensive monitoring / diagnosis server 3 through the AI analysis of the dental images of the subject.

[0216] The diagnosis / management / predictive analysis information providing module 974, if it receives a request for diagnostic analysis information, management analysis information, or predictive analysis information regarding a specific subject from a medical staff member, extracts the diagnostic analysis information, management analysis information, or predictive analysis information from the comprehensive treatment information of the subject and then displays it on the display of the terminal 7 or 8 through the GUI.

[0217] That is, through the GUI provided by the diagnosis / management / predictive analysis information providing module 974, the medical staff can view and identify the AI analysis results of the dental images of each subject.

[0218] The recent image display module 975, if it receives a request for the recent dental images of a specific subject from a medical staff member, refers to and applies the dental image data of the overall subject transmitted from the comprehensive monitoring / diagnosis server 3, extracts the three-direction images of each different tooth that were recently taken by the selected subject, and then generates a GUI that displays the extracted three-direction images of each different tooth and displays the generated GUI on the display of the terminal 7 or 8.

[0219] The three-direction time-series image display module 976, if it receives a request for the time-series images of a specific tooth from a medical staff member, generates a GUI that displays the images of each direction (front, back, occlusal surface, etc.) of the tooth arranged in time series and then displays the generated GUI on the display of the terminal 7 or 8.

[0220] Returning again to Figure 18 The subject mode operation unit 99. The subject mode operation unit 99 passes through the aforementioned Figure 19 selection interface 710. When the user touches (clicks) the subject mode button 713, according to the control of the control unit 90, it verifies the connected subject through login verification. When the verification is successful, it executes the work.

[0221] And, the subject mode operation unit 99 includes the aforementioned Figure 21The GUI display and processing module 971, the comprehensive treatment information providing module 973, the diagnosis / management / prediction analysis information providing module 974, the recent image display module 975, and the 3-direction time series image display module 976 only allow the examinee himself / herself to access the data.

[0222] That is, the examinee mode operation unit 99 of the diagnosis service application 9 provides the examinee with comprehensive treatment information, dental images, and diagnosis / management / prediction analysis information about himself / herself, so that the examinee can quickly and accurately view his / her diagnosis and treatment status.

[0223] Figure 22 To represent Figure 3 The block diagram of the comprehensive monitoring / diagnosis server.

[0224] The comprehensive monitoring / diagnosis server 3, as Figure 22 shown, includes a control unit 30, a DB server 31, a communication interface unit 32, an application management unit 33, a matching data input unit 34, a dental image generation unit 35, a dental data generation / updating unit 36, a dental image preprocessing unit 37, a different category numerical calculation unit 38, an AI diagnosis analysis unit 39, an AI management analysis unit 40, an AI prediction analysis unit 41, a comprehensive treatment information generation / updating unit 42, and a list generation / updating unit 43.

[0225] The control unit 30 is the operating system (O.S) of the comprehensive monitoring / diagnosis server 3, and manages and controls the operations of the controlled objects 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43.

[0226] Moreover, if matching data is transmitted from the diagnosis service application 9 through the communication interface unit 32, the control unit 30 stores the transmitted matching data in the DB server 31 and outputs it through the matching data input unit 34.

[0227] Moreover, if comprehensive treatment information is generated / updated in the comprehensive treatment information generation / updating unit 42, the control unit 30 stores the generated / updated comprehensive treatment information in the DB server 31.

[0228] Moreover, if list information is generated / updated in the list generation / updating unit 43, the control unit 30 stores the generated / updated list information in the DB server 31 and transmits it to the connected diagnosis service application 9.

[0229] The DB server 31 stores the personal information and login information of the registered medical staff, and the personal information and login information of the registered examinees.

[0230] Further, the DB server 31 stores the matching data transmitted from the diagnostic service application 9.

[0231] Further, the DB server 31 stores the tooth images generated by the tooth image generation unit 35 and the tooth data generated / updated by the tooth data generation / updating unit 36.

[0232] At this time, the tooth image means an image of a single tooth, and the tooth data means data in which the tooth image, the subject identification information, and the tooth identification code are matched.

[0233] Further, the DB server 31 stores the different category values (M) of each tooth calculated by the different category value calculation unit 38.

[0234] At this time, the categories can be composed of carious lesions, cracks, dental fluorosis, dental calculus, dental plaque, etc., and the different category values (M) mean values representing the degree of that category.

[0235] Further, the DB server 31 stores the diagnostic analysis information generated by the AI diagnosis analysis unit 39, the management analysis information generated by the AI management analysis unit 40, and the prediction analysis information generated by the AI prediction analysis unit 41.

[0236] Further, the DB server 31 stores the comprehensive treatment information generated / updated by the comprehensive treatment information generation / updating unit 42 and the list information generated / updated by the list generation / updating unit 43.

[0237] The communication interface unit 32 exchanges data with the diagnostic service application 9.

[0238] The application management unit 33 manages the overall operation of the diagnostic service application 9 such as firmware upgrade, GUI upgrade, obstacles, and errors of the diagnostic service application 9.

[0239] The matching data input unit 34 inputs the matching data transmitted from the diagnostic service application 9.

[0240] At this time, the matching data includes subject identification information, medical staff identification information, shooting direction (occlusal surface, front, or back, etc.) information, lensless camera identification information, and images.

[0241] Figure 23 To represent Figure 22 The block diagram of the tooth image generation unit.

[0242] Figure 23 The tooth image generation unit 35 is a processor that analyzes, corrects, and merges the images included in the matching data input through the matching data input unit 34 to generate an image of each tooth, that is, a tooth image.

[0243] At this time, the aforementionedFigures 5 to 17 For the oral camera 5 with a mouthpiece type, considering the average number, size, position, spacing, etc. of teeth, a lensless camera 513 is set. However, due to the oral characteristics of the subject, it frequently occurs that a single tooth is segmented by adjacent images or two or more teeth are photographed in a single image.

[0244] That is, the tooth image generation unit 35 of the present invention transforms the image captured by the lensless camera 513 into tooth images of different teeth, and accurately analyzes tooth diagnosis and treatment.

[0245] And, as shown in Figure 23 , the tooth image generation unit 35 includes an image input module 351, an image alignment module 352, an image merging module 353, a tooth object recognition module 354, an image segmentation module 355, and a tooth image generation module 356.

[0246] The image input module 351 inputs the images included in the matching data input through the matching data input module 34.

[0247] The image alignment module 352 aligns the images in sequence according to the dental arch with reference to the recognition information of the lensless camera 513.

[0248] The image merging module 353 merges the images aligned by the image alignment module 352.

[0249] The tooth object recognition module 354 analyzes the images merged by the image merging module 353 by using a preset object recognition algorithm, and respectively recognizes tooth objects.

[0250] At this time, the technologies and methods for presetting objects by image recognition are widely known technologies and methods in image analysis, so detailed descriptions are omitted.

[0251] The image segmentation module 355 segments the merged image into images respectively representing the tooth objects recognized by the tooth object recognition module 354.

[0252] The tooth image generation module 356 determines each of the images segmented by the image segmentation module 355 as a tooth image.

[0253] In the tooth data generation / updating unit 36, if it is the first time the relevant subject is photographed, after assigning an identification code to the teeth corresponding to the tooth images generated by the tooth image generation unit 35, the subject identification information, the shooting direction (occlusal surface, front or back, etc.), the tooth identification code and the tooth image, the shooting date, etc. are matched, and after generating tooth data, it is stored in the DB server 31.

[0254] Further, in the tooth data generation / update unit 36, if the relevant examinee is not being photographed for the first time, after extracting the tooth data of the relevant examinee from the DB server 31, referring to the tooth identification code of the previous tooth data, after the tooth matching identification code corresponding to the tooth image generated in the tooth image generation unit 35, the shooting direction (occlusal surface, front or back, etc.), tooth identification code, tooth image, shooting date, etc. are added to update the tooth data, and the updated tooth data is stored in the DB server 31.

[0255] The tooth image preprocessing unit 37 preprocesses each tooth image so that different category values can be accurately detected from each tooth image generated in the tooth image generation unit 35.

[0256] The different category value calculation unit 38 analyzes each tooth image preprocessed in the tooth image preprocessing unit 37 using a preset category detection algorithm to calculate different category values (M) for each tooth.

[0257] At this time, the category can consist of dental caries lesions, cracks, dental fluorosis, dental calculus, dental plaque, etc., and the different category value (M) means a value representing the degree of the relevant category.

[0258] For example, when the category is "dental calculus", the different category value calculation unit 38 can calculate the degree of dental calculus, i.e., the dental calculus value (M), for each tooth, and when the category is "dental caries lesion", the different category value calculation unit 38 can calculate the degree of dental caries lesion, i.e., the dental caries lesion value (M), for each tooth.

[0259] And if the different category value calculation unit 38 calculates different category values (M) for each tooth, after matching the relevant examinee identification information and the different category values (M) of each tooth, different tooth category information is generated and stored in the DB server 31.

[0260] Figure 24 To represent Figure 22 The block diagram of the AI diagnosis and analysis unit.

[0261] Figure 24 The AI diagnosis and analysis unit 39 of

[0262] And the AI diagnosis and analysis unit 39, as Figure 24 shown, includes a different tooth category information collection module 391, a first AI analysis module 392, and a diagnosis and analysis information generation module 393.

[0263] The different tooth category information collection module 391 collects the category information of different teeth calculated by the different category value calculation unit 38 and the previous category information of different teeth stored in the DB server 31.

[0264] The first AI analysis module 392 analyzes the category information of different teeth collected by the different tooth category information collection module 391 using the learned first AI algorithm.

[0265] At this time, the first AI algorithm generates learning data that can learn the correlation between the current value (M) and the previous value (M’) of different categories of each tooth and the diagnosis result, and applies the generated learning data to execute learning in the form of extracting a set of parameter values, that is, an extraction model, of the correlation between the current value (M) and the previous value (M’) of different categories of each tooth and the diagnosis result.

[0266] That is, the first AI algorithm is a deep learning algorithm that takes the current value (M) and the previous value (M’) of different categories of each tooth as input data and outputs diagnosis results such as tooth status, treatment or not, treatment content, etc.

[0267] The diagnosis analysis information generation module 393 applies the output data output from the first AI analysis module 392 to generate diagnosis analysis information including the tooth status, treatment or not, treatment content, etc. of each tooth.

[0268] At this time, the diagnosis analysis information generated by the diagnosis analysis information generation module 393 is stored in the DB server 31 and output to the comprehensive treatment information generation / updating unit 42 at the same time.

[0269] Figure 25 To represent Figure 22 The block diagram of the AI management and analysis unit.

[0270] Figure 25 The AI management and analysis unit 40 uses the learned second AI algorithm to analyze the category information of each tooth (including different category values (M)) and generates management analysis information including the management status, management method, management improvement points, etc. of each tooth.

[0271] And, as shown in Figure 25 The AI management and analysis unit 40 includes a different tooth category information collection module 401, a second AI analysis module 402, and a management analysis information generation module 403.

[0272] The different tooth category information collection module 401 collects the current value (M) and the previous value (M’) of different categories of each tooth as described above.

[0273] The second AI analysis module 402 analyzes the category information of each different tooth collected by each different tooth category information collection module 401 by using the learned second AI algorithm.

[0274] At this time, the second AI algorithm generates learning data that can learn the correlation between the current value (M) and the previous value (M’) of each different category of teeth and the management results (management status, management methods, management improvement points, etc.). The generated learning data is applied to perform learning in the form of an extraction model that is a set of parameter values of the correlation between the current value (M) and the previous value (M’) of each different category of teeth and the management results.

[0275] That is, the second AI algorithm is a deep learning algorithm that takes the current value (M) and the previous value (M’) of each different category of teeth as input data and outputs management results such as management status, management methods, and management improvement points.

[0276] The management analysis information generation module 403 applies the output data output from the second AI analysis module 402 to generate management analysis information including the management status, management methods, management improvement points, etc. of each tooth.

[0277] At this time, the management analysis information generated by the management analysis information generation module 403 is stored in the DB server 31 and output to the comprehensive treatment information generation / updating unit 42 at the same time.

[0278] Figure 26 To represent Figure 22 The block diagram of the AI prediction analysis unit.

[0279] Figure 26 The AI prediction analysis unit 41 of

[0280] utilizes the learned third AI algorithm to analyze the category information of each tooth (including different category values (M)), and generates prediction analysis information including the tooth status after a preset time when each tooth is untreated. Figure 26 And, as shown in

[0281] The AI prediction analysis unit 41 includes each different tooth category information collection module 411, a third AI analysis module 412, and a prediction analysis information generation module 413.

[0282] Each different tooth category information collection module 411 collects the current value (M) and the previous value (M’) of each different category of teeth as described above.

[0283] At this time, the third AI algorithm generates learning data that can learn the correlation between the current values (M) and previous values (M’) of different categories of each tooth and the prediction results (the tooth states of each tooth after a preset time when untreated), and applies the generated learning data to perform learning in a way of extracting a model, which is a set of parameter values representing the correlation between the current values (M) and previous values (M’) of different categories of each tooth and the prediction results.

[0284] That is, the third AI algorithm takes the current values (M) and previous values (M’) of different categories of each tooth as input data and outputs a deep learning algorithm that outputs the tooth states of each tooth after a preset time when untreated.

[0285] The prediction analysis information generation module 413 applies the output data output from the third AI analysis module 412 to generate prediction analysis information representing the tooth states of each tooth after a preset time when untreated.

[0286] At this time, the management analysis information generated in the prediction analysis information generation module 413 is stored in the DB server 31 and output to the comprehensive treatment information generation / updating unit 42 at the same time.

[0287] When the relevant examinee is diagnosed for the first time, the comprehensive treatment information generation unit 42 matches the examinee identification information, the identification codes of each tooth, the tooth images in different directions of each tooth, the numerical values (M) of different categories of each tooth, the diagnostic analysis information, the management analysis information, and the prediction analysis information to generate comprehensive treatment information.

[0288] Moreover, when the relevant examinee is not diagnosed for the first time, the comprehensive treatment information generation unit 42 extracts the previous comprehensive treatment information of the relevant examinee, and then appends the tooth images in different directions of each tooth, the numerical values (M) of different categories of each tooth, the diagnostic analysis information, the management analysis information, and the prediction analysis information to the extracted comprehensive treatment information to update the comprehensive treatment information.

[0289] The list generation / updating unit 43 generates and updates a list directory of patients who have undergone imaging and diagnosis.

Claims

1. A tooth diagnosis and management system, characterized in that, Comprising: An oral appliance type oral camera, which includes a main body inserted into the oral cavity of the subject, a lensless camera spaced apart from the main body and photographing at least one of the front, rear, and occlusal surfaces of the entire tooth, and a light source disposed at a position adjacent to the lensless camera respectively and irradiating light; A medical staff terminal, which is a terminal carried by medical staff, and is provided with a diagnostic service application program that performs digital filtering on the graphic data transmitted from the oral appliance type oral camera with a preset wavelength passband and then performs inverse operation to obtain an image; A comprehensive monitoring / diagnosis server, analyzes the image transmitted from the medical staff terminal, detects a diagnosis result including at least one of the state of each tooth of the relevant subject, whether it has been treated and the treatment content, and then generates diagnostic analysis information including the detected diagnosis result and transmits it to the medical staff terminal, The diagnostic service application program provided in the medical staff terminal displays the diagnostic analysis information transmitted from the comprehensive monitoring / diagnosis server on the display.

2. The tooth diagnosis and management system according to claim 1, characterized in that, The lensless camera includes: A mask that allows light reflected onto the photographic surface of the tooth to pass through; An image sensor that allows the light passing through the mask to be incident; A controller that combines the graphics projected onto the image sensor, generates graphic data, and then transmits it to the outside, The main body is formed of a plate material having a length, is formed of a curved surface, is configured to be more rearward toward both ends, and is parallel to the front, rear, or occlusal surface of the subject's tooth as the photographic surface, In the lensless camera, the mask in the form of a thin film replaces the lens, making the thickness of the oral appliance type oral camera thinner.

3. The tooth diagnosis and management system according to claim 2, characterized in that, The diagnostic service application program provided in the medical staff terminal includes an image processing unit, The image processing unit includes: A network construction module that confirms whether there is a wired or wireless connection with the oral appliance type oral camera; A subject setting module that receives the identification information of the subject to be photographed from a user who is a medical staff; A graphic data input module that inputs the graphic data transmitted from the oral appliance type oral camera; A digital filtering module that filters the reflection signals outside the wavelength passband of the graphic data input through the graphic data input module; An inverse operation and image acquisition module that performs an inverse operation on the graphic data filtered by the digital filtering module and transforms it into a lens-based image; A matching data generation module that matches the subject identification information, medical staff identification information, the occlusal surface, front, or rear information as the tooth photographing direction, lensless camera identification information, and the image, and generates matching data, The diagnostic service application program includes: A control unit that transmits the matching data generated in the matching data generation module to the comprehensive monitoring / diagnosis server.

4. The tooth diagnosis and management system according to claim 3, characterized in that, The comprehensive monitoring / diagnosis server includes: DB server; A tooth image generation unit that analyzes, corrects, and merges the images included in the matching data transmitted from the medical staff terminal to generate tooth images that are images of each tooth; An AI diagnosis and analysis unit that analyzes the tooth images of the relevant examinee generated in the tooth image generation unit to generate a diagnosis analysis result, The tooth image generation unit includes: An image alignment module that aligns the images included in the matching data input through the matching data input module in sequence according to the dental arch with reference to the identification information of the lensless camera; An image merging module that merges the images aligned in the image alignment module; A tooth object recognition module that analyzes the images merged in the image merging module using a preset object recognition algorithm to respectively recognize tooth objects; An image segmentation module that segments the merged image into images representing each tooth object recognized in the tooth object recognition module; A tooth image generation module that determines the images segmented in the image segmentation module as tooth images.

5. The tooth diagnosis and management system according to claim 4, wherein, The integrated monitoring / diagnosis server further includes a tooth data generation / updating unit. In the tooth data generation / updating unit, if the relevant examinee is photographed for the first time, after assigning an identification code to the tooth corresponding to the tooth image generated in the tooth image generation unit, at least one of the examinee identification information, the occlusal surface, the front or the back as the tooth shooting direction, the tooth identification code, the tooth image, and the shooting date is matched to generate tooth data, and then stored in the DB server. If the relevant examinee is not photographed for the first time, after extracting the tooth data of the relevant examinee from the DB server, with reference to the tooth identification code of the previous tooth data, after matching the identification code of the tooth corresponding to the tooth image generated in the tooth image generation unit, tooth data is generated and then stored in the DB server.

6. The tooth diagnosis and management system according to claim 5, wherein, A category detection algorithm is stored in the DB server. The category detection algorithm detects values (M) for each different category including at least one of carious lesions, cracks, dental fluorosis, dental calculus, and dental plaque by analyzing the input tooth images, The integrated monitoring / diagnosis server further includes a different category value calculation unit. The different category value calculation unit uses the category detection algorithm to analyze the tooth images generated in the tooth image generation unit, calculates the different category values (M) of each tooth, matches the relevant examinee identification information with the different category values (M) of each tooth, generates information on each different tooth category, and then stores it in the DB server.

7. The tooth diagnosis and management system according to claim 6, wherein, A first AI algorithm is stored in the DB server. The first AI algorithm takes the current different category values (M) and previous values (M') of each tooth as input data and outputs a diagnosis result including at least one of the tooth state, whether treatment is required, and the treatment content, The AI diagnosis and analysis unit includes: Each different tooth category information collection module, which collects each different tooth category information calculated in the different category numerical calculation unit and each different tooth previous category information stored in the DB server; The first AI analysis module, which uses the first AI algorithm to analyze the current different category values (M) and previous values (M') of each tooth collected in the each different tooth category information collection module, and outputs the diagnosis result; The diagnosis analysis information generation module, which applies the output data output from the first AI analysis module, generates diagnosis analysis information including the diagnosis result, and then stores it in the DB server.

8. The tooth diagnosis and management system according to claim 6, wherein The integrated monitoring / diagnosis server further includes: The AI management analysis unit; The AI prediction analysis unit, The second AI algorithm and the third AI algorithm are stored in the DB server. The second AI algorithm uses the current different category values (M) and previous values (M') of each tooth as input data and outputs a management result including at least one of a management status, a management method, and a management improvement point. The third AI algorithm uses the current different category values (M) and previous values (M') of each tooth as input data, and when each tooth is untreated, outputs a prediction result indicating the tooth state after a preset time. The AI management analysis unit uses the second AI algorithm to analyze the current different category values (M) and previous values (M') of each tooth collected in the each different tooth category information collection module, outputs the management result, and then generates management analysis information including the output management result. The AI prediction analysis unit uses the third AI algorithm to analyze the current different category values (M) and previous values (M') of each tooth collected in the each different tooth category information collection module, outputs the prediction result, and then generates prediction analysis information including the output prediction result.

9. The dental diagnosis and management system according to claim 2, characterized in that, In the oral appliance type oral camera, on one surface of the main body, i.e., the setting surface, facing the photographing surface of the subject's teeth, sensor placement grooves for each of the lensless cameras are formed inward and spaced apart along the length direction. A pair of light source setting grooves are formed at positions adjacent to each sensor placement groove of the setting surface.

10. The tooth diagnosis and management system according to claim 9, wherein The oral appliance type oral camera operates in a fluorescence shooting mode, a general shooting mode, and a mixed shooting mode. For the light source, when in the fluorescence shooting mode, it irradiates blue series visible light with a wavelength of 405 nm. When in the general shooting mode, it irradiates white light visible light. When in the mixed shooting mode, it irradiates blue series visible light with a wavelength of 405 nm in half of the total number of light sources, and white light visible light in the remaining light sources.

11. The tooth diagnosis and management system according to claim 10, wherein When an oral cavity camera of the mouthpiece type for photographing the occlusal surfaces of the upper teeth and the occlusal surfaces of the lower teeth of a subject is referred to as an oral cavity camera for occlusal surfaces, in the oral cavity camera for occlusal surfaces, the main body is horizontally arranged, the upper surface of the main body is in contact with the occlusal surface of the upper teeth of the subject, the lower surface of the main body is in contact with the occlusal surface of the lower teeth of the subject, and sensor placement grooves are formed at intervals in the length direction on the upper surface and the lower surface of the main body.

12. The tooth diagnosis and management system according to claim 11, wherein the main body includes at least two sub-bodies, the sub-bodies are formed of a plate material, and are combined by means of at least one hinge shaft, and when hinge-combined, the main body is formed. The sensor placement grooves and the light source setting grooves are formed on the upper surface and the lower surface of the sub-bodies. The hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When the sub-bodies are assembled, the main body rotates inward.

13. The tooth diagnosis and management system according to claim 12, wherein the sub-bodies are formed in the same number as the number of the lensless cameras along the length direction. Single sensor placement grooves are respectively formed on the upper surface and the lower surface of the sub-bodies.

14. The tooth diagnosis and management system according to claim 10, wherein When an oral cavity camera of the mouthpiece type for photographing the front surfaces of the upper and lower teeth of a subject is referred to as an oral cavity camera for the front surface, in the oral cavity camera for the front surface, the main body is vertically arranged, the rear surface of the main body faces the front surfaces of the teeth of the subject, and sensor placement grooves are formed at intervals in the length direction on the rear surface of the main body and are formed in two columns.

15. The tooth diagnosis and management system according to claim 14, wherein the main body includes at least two sub-bodies, the sub-bodies are formed of a plate material, and are combined by means of at least one hinge shaft, and when hinge-combined, the main body is formed. The sensor placement grooves and the light source setting grooves are formed on the rear surface of the sub-bodies. The hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When the sub-bodies are assembled, the main body rotates inward.

16. The tooth diagnosis and management system according to claim 15, wherein the sub-bodies are formed in the same number as the number of the lensless cameras along the length direction. A pair of lensless cameras are arranged at intervals in the height direction on the respective rear surfaces of the sub-bodies.

17. The tooth diagnosis and management system according to claim 10, wherein When an oral cavity camera of the mouthpiece type for photographing the rear surfaces of the upper and lower teeth of a subject is referred to as an oral cavity camera for the rear surface, in the oral cavity camera for the rear surface, the main body is vertically arranged, the front surface of the main body faces the rear surfaces of the teeth of the subject, and sensor placement grooves are formed at intervals in the length direction on the front surface of the main body and are formed in two columns.

18. The tooth diagnosis and management system according to claim 17, wherein The main body includes at least two sub-bodies, the sub-bodies are formed of a plate material, and are combined by means of at least one hinge shaft. When the hinges are combined, the main body is formed. The sensor placement groove and the light source setting groove are formed in front of the sub-body. The hinge shafts are respectively connected to the opposing side surfaces of adjacent sub-bodies and are arranged in a vertical state. When the sub-bodies are assembled, the main body rotates inward.

19. The tooth diagnosis and management system according to claim 18, wherein The sub-bodies are formed in a number equal to the number of the lensless cameras along the length direction. A pair of lensless cameras are arranged at intervals in the height direction in front of the sub-body.

Images