Intraoral imaging device, medical device, and program

Abstract

To provide an auxiliary material for determination on a disease in which there occur differences in intraoral findings.SOLUTION: There are provided an intraoral imaging device, a medical device, and a program for providing an auxiliary material for determination on a disease in which there occur differences in intraoral findings. The intraoral imaging device includes: an imaging device for acquiring an intraoral image; a light source for emitting light onto a subject of the imaging device; a storage device for storing an algorithm for determining a predetermined disease; and an arithmetic device. The arithmetic device executes determination processing for determining the possibility of the predetermined disease and output processing for outputting a result of the determination processing on the basis of the image and the algorithm.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an intraoral photography device for photographing the inside of a mouth, the intraoral photography device, an intraoral photography auxiliary tool, and and a program for determining a predetermined disease based on an intraoral image taken. Regarding Ram. [Background technology]

[0002] Non-patent document 1 states that lymph follicles that appear in the deepest part of the pharynx have a pattern specific to influenza. They reported that lymphoid follicles with this pattern were classified as influenza filtrates. Influenza follicles are a characteristic sign of influenza. It is said to appear about two hours after the onset of symptoms. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Miyamoto and Watanabe, "Consideration of the meaning and value of pharyngeal examination findings (influenza follicles)," Nihon University Journal of Medicine 72(1):11-18(2013) Summary of the Invention [Problem to be solved by the invention]

[0004] Accurate identification of influenza follicles is expected to lead to a dramatic improvement in diagnostic accuracy. However, proper identification of influenza follicular disease requires intensive observation of many cases. It requires training and is not easy for general physicians. However, it is only used by a limited number of doctors. There are many diseases other than influenza that cause differences in pharyngeal findings. The same points as above may also be applied to the diagnosis of the disease. Furthermore, imaging diagnosis is useful for diseases that result in differences in oral findings.

[0005] Therefore, the present invention aims to provide an aid for determining diseases that cause differences in oral findings. The present invention aims to provide an intraoral photography device, medical device, and program that can perform the above-mentioned operations. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the present invention provides an imaging device for acquiring an image of an intraoral cavity, It stores a light source that illuminates the subject of the imaging device and an algorithm for determining the presence of a specific disease. a storage device for storing the image and a calculation device, and a determination process for determining the possibility of the predetermined disease based on the algorithm; and an output process for outputting the processing result. . Here, "inside the mouth" includes the oral cavity and pharynx of humans as well as animals in general. The term "pharynx" also includes the "Waldeyer's ring" which contains lymphoid follicles in the posterior wall of the pharynx. Therefore, the term "patient" in the present invention includes not only humans but also animals in general. In addition, the light source broadly includes anything that can achieve the purpose of photography, and irradiates visible light. Alternatively, invisible light such as near-infrared light or infrared light may be irradiated.

[0007] In the intraoral photography apparatus of the present invention having the above-described configuration, the imaging device a moving image is acquired by the calculation device, and the calculation device selects a still image from among a plurality of still images included in the moving image. further performing an extraction process of extracting at least one still image that satisfies a predetermined condition, The determination process may be performed based on the result of the extraction process. It means taking a photograph using an imaging device, and may involve recording the photographed image on a recording medium. The predetermined condition may be a condition related to the content of the image, or The condition may be related to the timing of image extraction.

[0008] The intraoral photography device of the present invention having the above-described configuration accepts input of patient information. The computing device further includes an input device for performing the determination process based on the patient information. It may be executed.

[0009] Furthermore, the intraoral photography apparatus of the present invention having the above-described configuration is provided by the imaging device. a display device for displaying at least one of the acquired image and the result of the extraction process; It may also be provided.

[0010] In the intraoral photography apparatus of the present invention having the above-described configuration, the imaging device The image of the inside of the mouth is acquired in a cylindrical intraoral photography auxiliary device that is attached to the mouth, and the storage device The identification information of the used intraoral photography auxiliary tool is stored, and the calculation device stores the identification information of the used intraoral photography auxiliary tool for use in a new determination. an acquisition process for acquiring identification information of the intraoral photography auxiliary tool to be used for the new determination; a search process for checking whether or not there is a record in the storage device that matches the identification information of the photography auxiliary tool; A limiting process may be further performed to limit the new determination depending on the result of the search process.

[0011] The present invention relates to a method for imaging an intraoral image using the above-mentioned intraoral imaging device and a cylindrical intraoral imaging assistant that is detachably attached to the oral cavity. the intraoral photography aid includes a first end having an opening and a second end opposite the first end. and positioned on the side of the intraoral photography aid, and providing a field of view from the inside of the intraoral photography aid to the outside of the intraoral photography aid. and a second end having a window portion.

[0012] The present invention also provides a method for detecting a disease, comprising: a storage device storing an algorithm for determining a disease; and a computer including the imaging device. and a determination process for determining the possibility of the predetermined disease based on the algorithm; An output process for outputting the processing results and a program for executing the process are also provided. [Effects of the Invention]

[0013] According to the present invention, it is possible to provide supporting materials for determining diseases that cause differences in oral findings. can. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a schematic diagram of a medical device 1 including an intraoral photography device 5 and an intraoral photography aid 3 according to a representative embodiment of the present invention. [Figure 2] FIG. 2 is a perspective view showing the intraoral photography aid 3 of FIG. 1. [Figure 3] FIG. 3 is a longitudinal sectional view of the intraoral photography aid 3 of FIG. 2. [Figure 4] 3 is a diagram showing an example of a state in which the intraoral photography aid 3 of FIG. 2 is inserted into an oral cavity 71. FIG. [Figure 5] FIG. 10 is a perspective view showing an intraoral photography aid 13 according to a first modified example. [Figure 6] FIG. 6 is a longitudinal sectional view showing the intraoral photography aid 13 of FIG. 5. [Figure 7] 6 is a diagram showing an example of a state in which the intraoral photographing aid 13 of FIG. 5 is inserted into an oral cavity 71. FIG. [Figure 8] FIG. 10 is a perspective view showing an intraoral photography aid 23 according to a second modification. [Figure 9]FIG. 11 is a perspective view of an intraoral photography aid 43 according to a third modified example. [Figure 10] FIG. 10 is a cross-sectional view of the intraoral photography aid 43 of FIG. 9. [Figure 11] FIG. 2 is a schematic diagram showing a packaged intraoral photography aid 3. [Figure 12] FIG. 2 is a diagram showing an example of the appearance of the intraoral photographing device 5 of FIG. [Figure 13] FIG. 10 is a block diagram showing an example of a hardware configuration of the intraoral photographing device 5 of FIG. 9. [Figure 14] 10 is a block diagram showing an example of a functional configuration of the intraoral photographing device 5 of FIG. 9. FIG. [Figure 15] 10 is a flowchart showing a first example of the operation of the intraoral photographing device 5 of FIG. 9. [Figure 16] 10 is a flowchart showing a second example of the operation of the intraoral photographing device 5 of FIG. 9. [Figure 17] 10 is a flowchart showing a procedure for generating a determination algorithm. [Figure 18] 10 is a flowchart illustrating an example of an image extraction procedure. [Figure 19] 10 is a flowchart showing a third example of operation of the intraoral photographing device 5 of FIG. 9. [Figure 20] 10 is a flowchart showing an example of the photographing operation of the intraoral photographing device 5. [Figure 21] 1 is a schematic diagram of a cross-sectional shape of the head of a person 7. FIG. [Figure 22] FIG. 2 is a schematic view of the inside of an oral cavity 71. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, a medical device including an intraoral photography device and an intraoral photography auxiliary tool according to a representative embodiment of the present invention will be described. The present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the embodiments and drawings. Furthermore, the drawings are merely for explaining the concept of the present invention. , When dimensions, ratios or numbers are exaggerated or simplified as necessary for ease of understanding. There are also.

[0016] The following disclosure also assumes that the medical device is used for determining influenza. However, the present invention is not limited to this. For example, the present invention can be used to treat streptococcal infections, adenovirus infections, There are many diseases that cause differences in pharyngeal findings, such as EB virus infection and mycoplasma infection. These diseases may also cause important findings in the oral cavity. Other diseases may also cause oral cavity findings. The medical device may be used to determine any disease that manifests itself in the oral cavity. The photography aids are used in combination with other devices such as smartphones and tablet terminals. may be used.

[0017] 1. Overview of medical devices An overview of a medical device 1 according to this embodiment will be described with reference to FIG. 1. As shown in the figure, the medical device The intraoral photographing device 5 includes an intraoral photographing device 3. The intraoral photographing device 5 is It is best to use it in combination with the photography aid 3, but it can also be used alone or in combination with other aids. They may also be used in combination.

[0018] The intraoral photography device 5 includes an imaging device 57 for capturing an image of a subject. The user (e.g., a doctor) can use the A subject 7 (e.g., a patient) suspected of having influenza is asked to hold an intraoral photography aid 3 in his / her mouth. After that, the user attaches the imaging device 57 to the intraoral imaging aid. 3 and takes an image of the pharynx 72 of the subject 7. By adjusting the insertion depth and insertion angle, it is also possible to photograph the oral cavity 71 of the subject 7. Alternatively, the user may use the intraoral photography assistant unit 3, which houses the imaging device 57, as the object of judgment. The intraoral photography assistant unit 3 may be inserted into the mouth of the subject 7, or the subject 7 may be made to insert the intraoral photography assistant unit 3 into the mouth. good.

[0019] The captured image is processed by a pre-generated decision algorithm. The process is assumed to be performed by the intraoral photography device 5, but it may also be performed by other computers. For example, if the diagnosis is related to the possibility of influenza, The algorithm detects pharyngeal symptoms (patterns) specific to influenza and identifies influenza, etc. This allows even inexperienced doctors and trainees to provide accurate and early treatment. This will enable influenza diagnosis. It will also provide valuable information for experienced doctors to make decisions. Furthermore, by increasing the accuracy of influenza diagnosis, patients can receive treatment in one visit. This allows patients to complete outpatient visits and receive appropriate treatment earlier.

[0020] 2-1 Intraoral photography aids The intraoral photography aid 3 of this embodiment will be described in detail with reference to FIGS. The intraoral photography aid 3 is used to photograph the inside of a person's mouth (intraoral cavity 71 and pharynx 72). More specifically, the intraoral photography auxiliary tool 3 is an auxiliary tool for capturing images of the oral cavity 7 during intraoral photography. 1 to obtain a good view of the imaging area including the oral cavity 71 or pharynx 72. From the viewpoint of obtaining a better field of view, the intraoral photography aid 3 is preferably translucent. In this embodiment, a mouthpiece is assumed as an example of the intraoral photography aid 3. However, it is not limited to this.

[0021] As shown in FIG. 2, the intraoral photography aid 3 includes a main body 31, a flange 34, and a restricting portion 35. However, it is sufficient that the intraoral photography aid 3 has the main body 31, and the flange 34 and the restricting portion In this embodiment, the intraoral photography aid 3 may include both or either of the two. The intraoral photography aid 3 is intended to be an integrally molded resin product, but it can be made of paper, cloth, metal, etc. It may be made of other materials or may be made of multiple materials. The assisting tool 3 is assumed to be a disposable type, but may also be a reusable type.

[0022] The main body 31 has a cylindrical shape as a whole. The main body 31 is inserted deeply into the oral cavity 71. 1 and 21, the tongue 73 is pushed downward, This pushes the soft palate 74 upward, as can be seen, for example, by comparing Figs. In addition, a good view of the pharynx 72 can be secured from inside the intraoral photography aid 3 (main body 31).

[0023] In this embodiment, the main body 31 extends substantially linearly. The inner and outer diameters are substantially constant along the length. As long as it does not prevent the imaging device 57 from sliding on the surface, it may be partially or entirely curved. Alternatively, the inner or outer diameter of the body 31 may vary.

[0024] The cross-sectional shape of the main body 31 is assumed to be a perfect circle. The cross section may be elliptical, or may be polygonal such as a square, or may be, for example, approximately D-shaped. If the body 31 has an elliptical, polygonal or asymmetric cross-sectional shape, The imaging device 57, which corresponds to the shape of the main body 31, slides in the main body 31. Since the circumferential movement (i.e., rotation) around the axial direction is restricted or suppressed, it is suitable for judgment. This allows for the acquisition of intraoral images with uniform orientation.

[0025] When the main body 31 has a circular cross section, as will be described later with reference to FIG. By providing rails and protrusions that engage with each other on the outer surface of the imaging device and the inner circumferential surface of the main body 31, The rotation of the vise 57 within the body 31 may be restricted.

[0026] As shown in Figure 3, the body 31 includes opposed ends 32 and 33. When the photographing aid 3 is attached to the oral cavity 71, the end 32 is exposed to the outside, and the end 33 is inserted into the oral cavity 71. Therefore, end 32 is located at the first end and end 33 is located at the second end. Equivalent.

[0027] The outer peripheral surface of the main body 31 is smooth, and the main body 31 and the end portion 33 are also smoothly connected via the connecting surface 36. In other words, the outer surface of the main body 31 is connected to the oral cavity 71 so as not to injure the oral cavity 71. It has been smoothed to prevent scratches.

[0028] The main body 31 has a scale 37. The scale 37 is arranged along the longitudinal direction of the main body 31. This serves as a measure of how deeply the main body 31 is inserted into the oral cavity 71. The scale 37 may be provided on either the outer circumferential surface or the inner circumferential surface of the main body 31. When provided on the outer peripheral surface, as shown in FIG. The scale 37 is arranged at predetermined intervals (for example, every 1 cm). 2 is approximately halfway around the circumference of the main body 31. However, it is not limited to this and may be short or long.

[0029] In this embodiment, an example of the scale 37 is a plurality of marks aligned along the longitudinal direction of the main body 31. The surface of this raised part is designed to avoid injuring the oral cavity of the subject 7. However, the scale 37 may be formed on the outer circumferential surface of the main body 31, for example. It may be a substantially linear convex portion extending in the longitudinal direction, or may be formed on the outer or inner peripheral surface of the main body 31. may be printed or displayed on the

[0030] As shown in FIG. 3, the end portion 32 has an opening 32A, and an imaging device 57 is placed in the opening 32A. Therefore, the imaging device 57 can be inserted into the main body 31 through the opening 32A. The nozzle 32 is inserted into the main body 31 and is taken out of the main body 31 through the opening 32A.

[0031] The end portion 32 is provided with a flange portion 34. The flange portion 34 extends from the end portion 32 in the radial direction of the main body 31. The flange 34 extends outward when the body 31 is inserted deep into the oral cavity 71. The intraoral photography aid 3 comes into contact with the lips or front teeth of the subject 7, and the subject 7 accidentally swallows the intraoral photography aid 3. In other words, the flange portion 34 functions as a stopper. The portion 34 is provided around the entire circumference of the end portion 32. For example, the portion 34 is provided at the end portion 32 so as to contact the upper lip. The flange 34 may be partially formed at a location corresponding to the lower lip. The shape may be a perfect circle, an ellipse, or even a polygon such as a square.

[0032] The flange 34 is provided with a nozzle for detecting droplets from the mouth of the subject 7 when the subject 7 coughs, for example. In other words, the flange 34 also helps the doctor to avoid droplets from the subject 7. In order to provide this splash prevention function, the collar 3 can be adjusted depending on the age and physique of the user, for example. The shape and dimensions of 4 may be selected appropriately.

[0033] The end 33 is also open, forming a window 33A. The purpose of this is to provide a field of view from the side to the outside of the main body 31. The lens of the vise 57 is exposed to the outside. However, the window portion 33A is made of, for example, a transparent material. It may be covered with

[0034] The end 33 protrudes toward the inside of the main body 31 and forms a restricting portion 35. is to prevent the imaging device 57 in the main body 31 from coming into contact with and passing through the end 33. However, the restricting portion 35 does not necessarily have to be provided at the end portion 33. For example, The guide portion 141 (recess or groove), which will be described later in relation to FIG. 6, has an end portion where the image is captured. The engagement projection 57A of the imaging device 57 is brought into contact with the engagement projection 57A, and the movement of the imaging device 57 toward the rear side is restricted. It also serves as a restricting section 35.

[0035] When photographing the pharynx 72 using the intraoral photography aid 3 described above, the user In this manner, the intraoral photography support tool 3 is inserted into the oral cavity 71 of the subject 7. This forces the tongue 73 downward and the soft palate 74 upward. The imaging device 57 is inserted into the main body 31. At this time, as shown in FIG. The tongue 73 and soft palate 74 do not fit into the field of view of 7, or even if they do, they only occupy a small area. Therefore, a good view of the pharynx 72 can be obtained.

[0036] In addition, the flange 34 can prevent the subject 7 from accidentally swallowing the intraoral photography aid 3. In addition, the flange 34 prevents droplets from flying from the mouth of the person to be judged 7 to the user, This can reduce the risk of secondary infection of users with infectious diseases such as influenza.

[0037] Furthermore, the scale 37 allows the intraoral photography aid 3 to be adjusted appropriately according to the physique of the subject 7 and the part to be photographed. This allows for placement at the appropriate depth in the oral cavity, allowing for clear imaging of the intended area. In addition to contributing to shadows, the subject 7 may be inconvenienced by inserting the main body 31 deeper than necessary. It is possible to suppress pleasure and choking.

[0038] 2-2 Variation 1 of intraoral photography aid An intraoral photography aid 13 according to a first modified example of this embodiment will be described with reference to FIGS. The intraoral photography aid 13 has the same components as the intraoral photography aid 3 described above, and further has a substantially straight The imaging device 57 includes a linear guide portion 141. On the other hand, the imaging device 57 has an engagement protrusion that engages with the guide portion 141. Therefore, the guide unit 141 guides the imaging device 57 to the main body 131. It is possible to slide inside the main body 131 without rotating.

[0039] In the first modification, as shown in FIG. 6, an example of the guide portion 141 is a guide portion provided on the outer circumferential surface of the imaging device 57. The upper engaging projection 57A extends in a substantially straight line from the end 132 to the end 133. Alternatively, the guide portion 141 may be a pair of rails protruding from the inner circumferential surface of the main body. good.

[0040] Optionally, the cross-sectional shape of the body 131 may be elliptical, polygonal, or generally D-shaped. The imaging device 57 has an asymmetric shape and an outer shape corresponding to the cross-sectional shape of the main body 131. In this case, the imaging device 57 moves within the main body 131 without rotating relative to the main body 131. Since the main body 131 can be ridden, the inner peripheral surface of the main body 131 in this case also functions as a guide portion. become.

[0041] As shown in FIG. 5, the main body 131 and the flange 134 are provided on the outer surfaces thereof with a surface that faces the lips of the subject 7. An indicator 142 is provided to facilitate positioning of the main body 131. As shown in the figure, the instruction display 142 is, for example, directed to the center of the upper lip or the upper front teeth 75 of the person to be evaluated. The instruction display 142 may be positioned at a position corresponding to the user's preference, i.e., at the center of the upper part. By attaching the intraoral photography assisting tool 3 to the oral cavity 71 while aligning it with the center of the upper lip of the subject 7, Therefore, the images captured by the imaging device 57 will be oriented in approximately the same direction. This will enable machine learning using images and the detection of specific diseases (e.g., influenza). It becomes easier.

[0042] 2-3 Variation 2 of intraoral photography aid An intraoral photography auxiliary tool 23 according to a second modification of this embodiment will be described with reference to FIG. The intraoral photography aid 23 has the same components as the intraoral photography aid 3 described above, and further has the following features: The body 231 has at least one hole 243. The hole 243 is formed on the inside and outside of the body 231. The hole 243 allows the subject 7 to see through the hole 243. This makes it easier for the subject 7 to breathe, which may give the subject 7 a sense of security. The size, number and arrangement of 43 should be appropriately set so that saliva from the subject 7 does not easily get in. stomach. The components of the above-described modified example 2, such as the guide portion, can be applied to the above-described embodiment and modified example 1. It is also possible.

[0043] 2-4 Variation 3 of intraoral photography aid An intraoral photography assisting tool 43 according to a third modified example of this embodiment will be described with reference to FIGS. 9 and 10. The intraoral photography aid 43 has the same components as the intraoral photography aid 3 described above.

[0044] The main body 431 of the intraoral photography aid 43 is a transparent or semi-transparent resin molded product. The photographing area of the intraoral photographing device 5 is wider than the range visible through the window 433A. The inner diameter of the main body 431 is 432 to 433. This makes it easier to mold the intraoral photography aid 43 from resin. do.

[0045] As shown in FIG. 10, the scale 437 is formed on the inner circumferential surface of the main body 431. The outer peripheral surface of the main body 431 can be made smooth. It may be a protruding projection or a mark displayed or painted on the inner peripheral surface.

[0046] As shown in FIG. 9, the outer edge of the flange 434 is elliptical in the vertical direction. The photographing aid 43 can be easily positioned relative to the lips of the subject 7. The outer edge of the flange 434 protrudes toward the end 433 or is formed thicker than other parts. This ensures the necessary strength while reducing the amount and cost of material for the flange 434. are.

[0047] 2-5 Other variations of intraoral photography aids Body 31 need not have substantially the same inner diameter from end 32 to end 33. For example, the body 31 may be configured such that the inner diameter increases toward the end 32. The trumpet-shaped main body 31 allows multiple intraoral photography aids 3 to be stacked. This reduces the space required for transportation and storage.

[0048] In addition, as the imaging device 57, a camera mounted on a smartphone or a tablet terminal The positional relationship between such a camera and the intraoral photography aid 3 (opening 32A) may be To fix the engagement, a frame or clip may be provided on the main body 31 or the flange 34. The internal photography support tool 3 is a clip for holding the smartphone from the upper edge or side edge, or a It may also have an L-shaped frame that can be pressed against the corner of the smartphone.

[0049] 2-6 Packaging example of intraoral photography aid The intraoral photography aid 3 is sterilized and individually packed in a bag 9 with an identifier 91 as shown in FIG. 11. This allows for hygienic management of the intraoral photography aid 3. The identifier 91 may be displayed on the intraoral photography aid 3.

[0050] The identifier 91 includes identification information including, for example, the product ID of the intraoral photography aid 3. The element 91 may be, for example, a barcode or an RF tag. Considering the use of the medical device 1 in medical institutions, a bar code is preferable. Either one-dimensional or two-dimensional barcodes can be used as the code.

[0051] For example, before taking a photograph of the inside of the mouth, the photograph of the identifier 91 is taken by the photographing device 57, and the photograph of the inside of the mouth of the bag 9 is taken. By reading the identification information of the auxiliary tool 3 into the intraoral photography device 5, the corresponding intraoral photography auxiliary tool 3 can be identified. This allows the patient to check the information on the oral cavity to prevent any harmful effects on the patient. Even if an abnormality occurs, traceability can be ensured. It is also possible to detect reuse, which prevents contamination and secondary infection and improves hygiene. This ensures safety.

[0052] 3-1 Intraoral photography device The intraoral photographing device 5 will be described in detail with reference to FIGS. The intraoral photography device 5 is a computer including an imaging device, a computing device, and a storage device. Here, it is assumed that the intraoral photography device 5 is configured with one computer. For example, in remote image diagnosis, The function of the intraoral photography device 5 may be executed by separate computers. As shown in FIG. 1, an image pickup device 57, a central processing unit (CPU) 51 as an example of a computing device, , a random access memory (RAM) 52 as an example of a storage device, and a read-only memory (ROM) 53 as an example of a storage device. ROM 53, communication interface 54, input device 55, output device 56, and and a light source 58.

[0053] The communication interface 54 is a wired or wireless communication module, for example, Acquisition and updating of application programs and judgment algorithms, and the recovery of captured images The wireless communication interface is used for receiving (transmitting) data. Wireless LAN standards such as WiFi, and short-range wireless communication standards such as BLUETOOTH (trademark) It is assumed that devices will meet either the third or fourth generation mobile communication standards. Not limited to.

[0054] The input device 55 is an example of an input device that accepts user input, and is shown in FIG. Alternatively, the input device 55 may be a touch panel or a keyboard. Other input means such as a touch panel, microphone, operation dial, or stylus may also be used. The force device 55 may be disposed in the main body (housing) of the intraoral photography device 5, or may be disposed in the imaging device, for example. It may be placed on chair 57. The output device 56 is an example of an output device that outputs the determination result, and is, for example, a display. , speakers, and printers.

[0055] The imaging device 57 acquires an image. The image to be acquired is assumed to be a moving image. The image size to be acquired is, for example, 640x480. For example, a frame rate of 30 fps is sufficient. The format is not limited to this. Alternatively or additionally, the imaging device 57 may be capable of capturing still images. When taking still images, it is desirable that the imaging device 57 has a continuous shooting function. Not limited to.

[0056] In this embodiment, as shown in FIG. 12, the imaging device 57 is a body ( It is assumed that the device is separated from the housing and inserted into the intraoral photography aid 3 by itself. The device 57 also has an outer shape (for example, a cylindrical shape) that corresponds to the inner circumferential surface of the main body 31 of the intraoral photography aid 3. It is preferable that the shape of the sintered body is the same as that of the sintered body. However, the imaging device 57 may be a device that can be used in a variety of ways, such as a smartphone or tablet terminal. It may be incorporated into the main body of the internal photography device 5.

[0057] The imaging device 57 has an autofocus mechanism (not shown), for example, a lens The imaging device 57 may also be set to focus on a specific area in front of the Even if it has the function to automatically recognize a specific area (e.g., the posterior pharyngeal wall) and focus on it, The imaging device 57 further has a zoom function, and can be used to capture images of the posterior pharyngeal wall or follicles, for example. The image may be captured at an appropriate magnification depending on the size.

[0058] During operation of the imaging device 57, light may be emitted from a light source 58 toward the subject. This ensures a high quality image. The light emitted by the light source 58 is visible light. Alternatively, invisible light such as near-infrared or infrared light may be used. For example, one light source may emit visible light and another may emit near-infrared or infrared light. Each of the light sources 58 may be responsible for emitting light of a particular range of wavelengths.

[0059] In contrast, the imaging device 57 is of a type that can appropriately receive light emitted by the light source 58 and For example, if the light source 58 emits visible light, the imaging device The device 57 has a light receiving element suitable for receiving visible light, and the light source 58 emits invisible light. In this case, the imaging device 57 has a light receiving element suitable for receiving invisible light. The light source 58 may be, for example, a light emitting diode (LED) or an organic electroluminescent device. OEL is fine.

[0060] Optionally, during operation of the imaging device 57, the display as the output device 56 may be The camera may be programmed to display a semi-transparent illustration overlaid on the image being captured. The user can see the illustration and the corresponding part of the body (for example, the uvula or tonsils) overlapping. By moving the imaging device 57 in this way, it becomes possible to obtain an appropriate image for judgment. .

[0061] The ROM 53 stores an application program for executing various processes in the intraoral photography device 5. The ROM53 also stores the algorithms for determining the presence of specific diseases. In addition, the image acquired by the imaging device 57, the identification information of the intraoral photography auxiliary tool 3, and the input device Various information (for example, information on the person 7 to be judged) input from the chair 55 and the judgment results are stored. The ROM 53 may be a built-in type or a USB memory or MicroSD card. It may be a removable type, or may be a memory of an external computer such as an external server. It may also include a storage area for the device.

[0062] The CPU 51 reads the application program stored in the ROM 53 into the RAM 52. The image data can be read and various processes including the following processes (a) to (d) can be executed. If the image acquired by the device 57 is a single still image, the extraction process may be omitted. stomach.

[0063] 3-2 Main processes performed by the CPU (a) Extraction process The CPU 51 selects at least one image that satisfies a predetermined condition from the image acquired from the imaging device 57. For example, when the imaging device 57 captures a moving image, C The PU51 extracts at least one still image from among a plurality of still images included in a moving image. When shooting moving images, still images are recorded at a predetermined frame rate. This should include images with good and bad shooting conditions. A few images taken under good conditions are selected as the first images.

[0064] For example, based on a large amount of similar image data, a specific shooting angle, a specific lighting fixture, etc. In this case, the width of a specific field of view, the imaging position of a specific part (such as the pharynx), and the focus on a specific part are If all or part of the criteria are met, the accuracy of the diagnosis of a specific disease (e.g., influenza) will be improved. This is the standard for determining whether the shooting conditions are good or bad. When such a criterion is adopted, the extraction process is performed by, for example, determining the depiction of the subject, as shown in FIG. The images are ranked based on their positions (step S31) and the degree of focus on a particular part is determined. The images are ranked based on the lighting conditions (step S32). (Step S33), and finally, select several images that are ranked high in the overall ranking (Step S34). In addition, before the overall ranking is calculated, a broadening of the field of view is carried out. The images may be ranked according to criteria such as length or angle of capture. , deep learning functions may also be used.

[0065] (b) Judgment process The CPU 51 receives an image from the imaging device 57 (for example, at least one image obtained by extraction processing). Based on the image (one still image) and the judgment algorithm stored in ROM53, the diagnosis of a specific disease is The possibility of the disease is determined. In this embodiment, the specific disease is influenza. The information of the subject 7 input by the user via the input device 55 (hereinafter referred to as patient information) The patient information may include, for example, age, sex, time elapsed since onset, Whether or not you have flu symptoms (cough, runny nose, chills, etc.) and whether or not you have had the flu with other people Patient information includes race, genetic information, date, season, and location information (latitude and longitude of the place of examination). The information may include all or part of weather information (e.g., weather, temperature, etc.) and weather forecast information (e.g., weather, temperature, etc.).

[0066] Here, the determination algorithm may be generated, for example, according to the procedure shown in FIG. For example, in the case of influenza, first, a medical institution collects images of the patient's throat and The correct answer label indicating whether or not the subject is influenza is collected (step S21). The solution label can be, for example, a rapid swab influenza test taken by a patient, It is granted based on the results of PCR tests and virus isolation and culture tests. Although isolation and culture tests take several weeks to produce results, they are highly accurate. The result is suitable as a correct label. In addition, the correct label can be used not only for image data but also for , may include the patient information described above.

[0067] Next, the results of the PCR test or virus isolation culture test are labeled as correct. Based on this teacher data, the teacher data (image data) is generated (step S22). Based on this, machine learning is performed to generate a judgment algorithm (step S23). The algorithm is an algorithm that, when given an image, determines whether the image looks like influenza or not. This algorithm quantifies the probability of influenza and calculates the probability of influenza. This will allow us to show "98.5%".

[0068] Alternatively, for example, "Result: Influenza positive" and "Result: Influenza negative" can be used. In this case, in addition to the positive or negative determination, the determination The reliability of the information may be quantified or expressed as a scale such as high, medium, or low. The degree of certainty that it is influenza may be indicated using a scale such as high, medium, or low.

[0069] (c) Output processing The CPU 51 outputs the result of the determination process. One example of the output method is to display it on a display. , transmission to another computer.

[0070] (d) Acquisition of identification information of intraoral photography aids Optionally, prior to a new determination, the CPU 51 may select an intraoral imaging supplement for use in the determination. The user may be requested to input the identification information of the assistive tool 3. For example, the user may input the identification information of the assistive tool 3 using the imaging device 57. When the identifier 91 is photographed, the CPU 51 selects the corresponding intraoral photography assistant from the image of the identifier 91. Acquire the identification information of tool 3.

[0071] Next, the CPU 51 searches the records in the ROM 53 and finds the corresponding intraoral photography assisting tool 3. Alternatively, the CPU 51 checks whether there is a matching record. You may also have them check the usage records.

[0072] If there is no matching record, the CPU 51 allows a new determination. In this case, the CPU 51 determines that the corresponding intraoral photographing aid 3 has been used. The CPU 51 may, for example, display an alarm on the display or terminate a series of processes. In other words, the CPU 51 may limit the new determination depending on the search result. can.

[0073] 3-3 Functional configuration of intraoral imaging device 14 shows the functional configuration of the intraoral photography device 5. The intraoral photography device 5 includes an imaging unit 61, an extraction unit 62, a determination unit 63, a camera control unit 64, a memory unit 65, an input unit 66, an output unit 67, and a communication unit 6 The correspondence with the hardware configuration of the intraoral photography device 5 is as follows: The image pickup device 57 is connected to the image pickup section 57, and the extraction section 62, the determination section 63 and the camera control section 64 are connected to the CPU 51. The memory unit 65 is connected to the ROM 53, the input unit 66 is connected to the input device 55, and the output unit 67 is connected to the output device The camera 56 and the communication unit 68 correspond to the communication interface 54. The control 64 controls the imaging device 57 to perform various functions such as autofocus and zoom. It is something that realizes a function.

[0074] Other functions of the intraoral photography device 5 include a timekeeping function to acquire the time when photography is performed, A location information acquisition function that acquires location information of the location where the shadow was taken, and a function that acquires weather information at that location. The timekeeping function may be realized as a built-in clock. Alternatively, it may be a function of a communication interface that accesses an external time server. The location information acquisition function may be realized as, for example, a Global Positioning System (GPS). The information acquisition function is one of the functions of the communication interface that accesses an external weather server. Good too.

[0075] 3-4 Operation example 1 of intraoral photography device An operation example 1 of the intraoral photographing device 5 will be described with reference to FIG. 15. Here, the intraoral photographing device 5 The operation when capturing a moving image will be taken as an example. However, the intraoral photography device 5 does not take still images. In this case, the intraoral photographing device 5 operates in the same manner.

[0076] When the power is turned on, the intraoral photographing device 5 starts photographing with the imaging device 57. In step S1, the recording button (of the input device 55) is pressed. If you do not check whether the recording button has been pressed, The image capturing device 5 repeats step S1.

[0077] When it is confirmed that the recording button has been pressed, the intraoral photographing device 5 starts recording in step S2. At the same time, the intraoral photography device 5 turns on the light source 58. The intraoral photography support tool 3 is attached to the oral cavity 71, and then the imaging device 57 is attached to the intraoral photography support tool 3. The imaging device 57 can also be used to make a decision while the device is sliding inside the intraoral photography aid 3 (see FIG. 1). The inside of the mouth (inside of the oral cavity 71 or pharynx 72) of the subject 7 is photographed.

[0078] In step S3, the intraoral photography device 5 captures a plurality of still images included in the acquired moving image. From the still images, an appropriate still image is extracted for the purpose of judgment. The result may be displayed on a display.

[0079] In step S4, the intraoral photography device 5 uses the extracted still image and the determination algorithm Based on this, the likelihood of a specific disease is determined, and in step S5, the determination result is displayed on a display, for example. This completes the series of operations.

[0080] In this way, the probability of a specific disease can be determined using a judgment algorithm generated by machine learning. Therefore, highly accurate judgment results can be expected. Since images taken under good conditions are selected for the judgment, the accuracy of the judgment is improved. By using the intraoral photography device 5 in combination with the intraoral photography auxiliary tool 3, a wide field of view and clear images can be obtained. This allows for a clear image to be obtained, which contributes to improving the accuracy of the determination.

[0081] 3-5 Operation example 2 of intraoral photography device A second example of operation of the intraoral photographing device 5 will be described with reference to FIG. The same steps as in the first operational example are included, and the extracted image is further confirmed by the user (S14 ), a step of inputting patient information (S16), and a comprehensive judgment (S17).

[0082] Specifically, when the power is turned on, the intraoral photography device 5 checks whether the recording button is pressed ( Step S11), start recording (step S12), and extract an image for judgment (step S13). Then, the intraoral photographing device 5 displays the extracted image on a display, for example. The user is asked to confirm whether or not to use the image for the judgment (step S 14) If the user selects "NO", steps S12 and S13 are executed again, and a new An image for product determination is presented to the user.

[0083] If the user selects "YES" in step S14, the intraoral photographing device 5 The likelihood of a particular disease is determined based on the image (step S15).

[0084] Next, the intraoral photographing device 5 prompts the user to input patient information (step S16 Here, patient information is standardized, such as body temperature at the time of consultation and whether or not the patient has received a vaccination. This patient information is simply information that is stored in the software, as shown in Figure 9. It is entered in a way that can be processed uniformly. For example, it is possible to reject pull-down menus and characters other than half-width numbers. Alternatively, the intraoral photography device 5 may be connected via a wired or patient information is acquired from an external computer (e.g., an electronic medical record system) via a wireless line. It should be noted that step S16 may be executed prior to step S11.

[0085] Then, by combining the above patient information and the image-based assessment of the likelihood of a specific disease, The disease likelihood is calculated as a whole (step S17). The calculation result is displayed on the display, for example. The image is displayed in the ray (step S18), and the series of procedures is completed.

[0086] In this way, the intraoral photography device 5 can identify the specific disease based on the image confirmed by the user. Evaluating the likelihood increases the accuracy and reliability of the determination. Furthermore, if the judgment is based on patient information, it is expected that the accuracy and reliability of the judgment will be further improved. Be waited for.

[0087] 3-6 Operation example 3 of intraoral photography device A third example of operation of the intraoral photographing device 5 will be described with reference to Fig. 19. This third example of operation is The procedure includes a step of acquiring identification information of the assistive tool 3 (step S41).

[0088] Specifically, when the power is turned on, the intraoral photographing device 5 performs the following steps in step S41: For example, the user is prompted to input the identification information of the intraoral photography assisting tool 3 through a display. For example, the user may take a picture of the identifier 91 on the bag 9 with the imaging device 57 or input the When the identification information is input via the chair 55, the intraoral photography device 5 detects the intraoral photography auxiliary tool 3. Obtain identification information.

[0089] The intraoral photography device 5 uses the identification information to check the lot information of the intraoral photography auxiliary tool 3. For example, the intraoral photography device 5 may store the product information of the intraoral photography aid 3 in the ROM 53. You can search for whether the product ID is included, or you can check the presence or absence of the product ID on an external computer. You may have them investigate.

[0090] If the corresponding product ID is in the internal or external record, the intraoral photography device 5 will issue an alarm. The alarm may be, for example, For example, a message indicating that the intraoral photography aid 3 has been used is displayed on the display. Reuse of intraoral photography aids 3 is restricted, and safety of intraoral photography aids 3, including prevention of secondary infection, is ensured. In addition, the intraoral photography aid 3 and the subject 7 who uses it are matched one-to-one. This will make it easier to follow up in the future.

[0091] Thereafter, the intraoral photographing device 5 photographs the inside of the mouth in step S42. The photographing process may be the same as the above-mentioned operation examples 1 and 2, or may be performed according to the procedure described later. Then, in step S43, the intraoral photography device 5 determines whether the image is likely to have a specific disease. In step S44, the determination result is output, and the series of processes ends.

[0092] 3-7 Other examples of intraoral photography Another procedure for intraoral photography will be described with reference to Figure 20. The procedure described here is the same as the above-mentioned procedure. This procedure can be substituted for the image acquisition procedure in Examples 1 to 3. In addition, this procedure is used as a training procedure for machine learning. It can be used to collect training data.

[0093] First, in step S51, the intraoral photography device 5 performs patient registration. This is done by the user inputting the patient ID into the intraoral photography device 5 or recording the patient ID used for photography.

[0094] Next, in step S52, the intraoral photography device 5 acquires an image. is a still image, and for example, a predetermined image is selected from the images captured by the imaging device 57. It may consist of a set of still images taken at time intervals (for example, every second).

[0095] Then, in step S53, the intraoral photographing device 5 displays the acquired image on, for example, a display. If approval is received from the user in step S54, the display is displayed on the display and the user is asked to confirm. In step S55, the intraoral photography device 5 stores the approved image and The process ends. If the user's approval is not obtained, the process returns to step S52 and the image is re-created. Get.

[0096] Although typical embodiments of the present invention have been described above, the present invention is not limited to these. However, various design modifications are possible, and these are also included in the present invention. For example, streptococcal infection, adenovirus infection, EB virus infection, mycoplasma infection It can also be applied to the diagnosis of diseases such as infectious diseases that show differences in findings in the pharynx or oral cavity. [Explanation of symbols]

[0097] 1. Medical devices, 3,13,23,43···Intraoral photography aids, 5. Intraoral photography device, 31,131,231,431···Main body, 34,134,234,434···Flange, 35,135,235,435···Regulatory Department, 37,137,237,437··· scale, 55···Input devices, 56···output device, 57 Imaging device, 58...Light source.

Claims

[Claim 1] an imaging device for acquiring intraoral images; a light source that irradiates a subject of the imaging device with light; a storage device that stores an algorithm for determining a predetermined disease; An intraoral photography device comprising: The computing device A determination process for determining the possibility of the predetermined disease based on the image and the algorithm. and, an output process for outputting a result of the determination process; An intraoral photography device characterized by performing the above.

Images