Intraoral imaging device, medical device, and program

Abstract

To provide an intraoral imaging apparatus, a medical apparatus, and a program capable of providing auxiliary data for determination regarding the diseases having differences in intraoral findings.SOLUTION: The present invention relates to an intraoral imaging apparatus including: an imaging device that acquires an intraoral image; a light source that emits light to a subject of the imaging device; a storage apparatus that stores an algorithm for performing determination of a specific disease; and an arithmetic apparatus, in which the arithmetic apparatus executes: a determination process of determining a possibility of the predetermined disease based on the image and the algorithm; and an output process of outputting a result of the determination process.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an intraoral imaging device for imaging the oral cavity, a medical device including the intraoral imaging device and an intraoral imaging aid, and a program for determining a predetermined disease based on the captured intraoral image.

Background Art

[0002] Non-Patent Document 1 reports that there is a pattern specific to influenza in the lymph follicles that appear in the deepest part of the pharynx. Lymph follicles having such a pattern will be referred to as influenza follicles. Influenza follicles are a sign characteristic of influenza and are considered to appear about 2 hours after the onset of the disease.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The accurate discrimination of influenza follicles is expected to lead to a dramatic improvement in the accuracy of diagnosis. However, the appropriate determination of influenza follicles requires intensive training through many cases and is not at all easy for general physicians. Unfortunately, the above research results have only been utilized among a limited range of physicians. Here, there are many diseases other than influenza that show differences in pharyngeal findings. The same can be said for the diagnosis of such diseases as described above. Furthermore, image diagnosis is also useful for diseases that show differences in oral findings.

[0005] Therefore, an object of the present invention is to provide an intraoral imaging device, a medical device, and a program that can provide auxiliary materials for determining diseases that show differences in intraoral findings.

Means for Solving the Problems

[0006] To solve the above-described problems, the present invention provides an imaging device including an imaging device that acquires an intraoral image, a light source that irradiates light onto a subject of the imaging device, a storage device that stores an algorithm for determining a predetermined disease, and an arithmetic device, wherein the arithmetic device executes a determination process for determining the possibility of the predetermined disease based on the image and the algorithm, and an output process for outputting a result of the determination process. The present invention provides an intraoral imaging device characterized by the above. Here, "intraoral" includes the oral cavity and pharynx of not only humans but also animals in general. Further, "pharynx" includes the "Waldeyer pharyngeal ring" including the lymphoid follicles on the posterior pharyngeal wall. Therefore, the "patient" in the present invention includes not only humans but also animals in general. Further, the light source widely includes those that can achieve the purpose of imaging, and may irradiate visible light, or may irradiate non-visible light such as near-infrared light or infrared light, for example.

[0007] In the intraoral imaging device of the present invention having the above-described configuration, the imaging device may acquire a moving image as the image, and the arithmetic device may further execute an extraction process of extracting at least one still image that satisfies a predetermined condition from a plurality of still images included in the moving image, and execute the determination process based on a result of the extraction process. Here, the acquisition of a moving image means imaging by the imaging device, and may or may not involve recording of the captured image on a recording medium. Further, the predetermined condition may be a condition related to the content of the image or a condition related to the timing of image extraction.

[0008] Further, the intraoral imaging device of the present invention having the above-described configuration may further include an input device that receives an input of patient information, and the arithmetic device may further execute the determination process based on the patient information.

[0009] In addition, the intraoral imaging device of the present invention having the above-described configuration may further include a display device that displays at least one of the image acquired by the imaging device and the result of the extraction process.

[0010] In the intraoral imaging device of the present invention having the above-described configuration, the imaging device acquires an image of the oral cavity inside a cylindrical intraoral imaging aid that is attached to the oral cavity, the storage device stores identification information of the used intraoral imaging aid, and the arithmetic device performs an acquisition process of acquiring identification information of the intraoral imaging aid to be used for a new determination, a search process of checking for the presence or absence of a record in the storage device that matches the identification information of the intraoral imaging aid to be used for the new determination, and a restriction process of restricting the new determination according to the result of the search process.

[0011] The present invention includes the above-described intraoral imaging device and a cylindrical intraoral imaging aid that is detachably attached to the oral cavity. The intraoral imaging aid includes a first end portion having an opening and a second end portion that is located on the side opposite to the first end portion and has a window portion that provides a field of view from the inside of the intraoral imaging aid to the outside of the intraoral imaging aid, and provides a medical device characterized by including the same.

[0012] The present invention also provides a program for causing a computer including a storage device that stores an algorithm for determining a predetermined disease and an arithmetic device to perform a determination process of determining the possibility of the predetermined disease based on the intraoral image acquired by the imaging device and the algorithm, and an output process of outputting the result of the determination process.

Effects of the Invention

[0013] According to the present invention, it is possible to provide auxiliary materials for judging diseases with differences in oral findings.

Brief Description of the Drawings

[0014]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Embodiments for Carrying Out the Invention

[0015] Hereinafter, a medical device including an intraoral imaging device and an intraoral imaging aid according to a representative embodiment of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to such embodiments and drawings. Further, since the drawings are for conceptually explaining the present invention, dimensions, ratios, or numbers may be exaggerated or simplified as necessary for easy understanding.

[0016] Also, the following disclosure assumes that the medical device is used for influenza determination, but the present invention is not limited thereto. For example, there are many diseases that show differences in pharyngeal findings, such as streptococcal infections, adenovirus infections, Epstein-Barr virus infections, mycoplasma infections, etc. Also, in these diseases, important findings may appear in the oral cavity. Furthermore, findings may appear in the oral cavity even in diseases other than these. Thus, the medical device may be used for the determination of any disease in which findings appear in the pharynx and oral cavity. Also, the intraoral imaging aid may be used in combination with other devices such as smartphones and tablet terminals.

[0017] 1 Outline of the Medical Device Referring to FIG. 1, the outline of the medical device 1 of the present embodiment will be described. As shown in the figure, the medical device 1 includes an intraoral imaging device 5 and an intraoral imaging aid 3. The intraoral imaging device 5 is preferably used in combination with the intraoral imaging aid 3, but may also be used alone or in combination with other aids.

[0018] The intraoral imaging device 5 includes an imaging device 57 that acquires an image of a subject, and dedicated software is pre-installed in this device 5. A user (for example, a doctor) causes a determination target person 7 (for example, a patient) suspected of having influenza to hold the intraoral imaging aid 3 to secure a field of view for imaging. Thereafter, the user inserts the imaging device 57 into the intraoral imaging aid 3 and images the pharynx 72 of the target person 7. Further, the user can also image the oral cavity 71 of the target person 7 by adjusting the insertion depth and insertion angle of the intraoral imaging aid 3. Alternatively, the user may insert the intraoral imaging aid portion 3 having the imaging device 57 housed therein into the mouth of the determination target person 7, or may cause the determination target person 7 to insert the intraoral imaging aid portion 3 into the mouth.

[0019] The captured image is processed by a pre-generated determination algorithm. Although such processing is assumed to be performed by the intraoral imaging device 5, it may be performed by another computer. For example, when the determination relates to the possibility of influenza, the determination algorithm detects pharyngeal symptoms (patterns) specific to influenza such as influenza follicles and displays the likelihood of influenza. Thereby, for example, even a doctor or intern with little experience can accurately and early diagnose influenza. Also, for an experienced doctor, useful judgment materials can be obtained. Furthermore, by increasing the correct diagnosis rate of influenza, the patient can complete a hospital visit in one visit and receive appropriate treatment earlier.

[0020] 2-1 Intraoral Imaging Aid With reference to FIGS. 2-4, the intraoral imaging aid 3 of the present embodiment will be described in detail. The intraoral photography assistant tool 3 is an auxiliary tool used for photographing the inside of the mouth (inside of the oral cavity 71 and the pharynx 72) of a person 7. More specifically, the intraoral photography assistant tool 3 is inserted into the oral cavity 71 when photographing the inside of the mouth, in order to obtain a good field of view of the photographing area including the inside of the oral cavity 71 or the pharynx 72. From the viewpoint of obtaining a better field of view, it is preferable that the intraoral photography assistant tool 3 has translucency. In this embodiment, a mouthpiece is assumed as an example of the intraoral photography assistant tool 3, but is not limited thereto.

[0021] 2, the intraoral photography aid 3 includes a main body 31, a flange 34, and a restricting portion 35. However, it is sufficient for the intraoral photography aid 3 to have the main body 31, and it is not necessary for the intraoral photography aid 3 to have both or either of the flange 34 and the restricting portion 35. In this embodiment, the intraoral photography aid 3 is assumed to be an integrally molded resin product, but the intraoral photography aid 3 may be made of other materials such as paper, cloth, metal, etc., or may be made of a plurality of materials. In addition, the intraoral photography aid 3 is assumed to be a disposable type, but it may be a reusable type.

[0022] The main body 31 has a cylindrical shape as a whole. When the main body 31 is inserted deeply into the oral cavity 71, as can be seen, for example, by comparing Fig. 1 with Fig. 21, the tongue 73 is pushed downward and the soft palate 74 is pushed upward. This makes it possible to ensure a good view of the pharynx 72 from inside the intraoral photography aid 3 (main body 31), as can be seen, for example, by comparing Fig. 4 with Fig. 22.

[0023] In this embodiment, the main body 31 extends substantially linearly. That is, the inner and outer diameters of the main body 31 are substantially constant along the longitudinal direction. However, the main body 31 may be partially or entirely curved, and the inner or outer diameter of the main body 31 may vary, as long as the sliding of the imaging device 57 on its inner circumferential surface is not impeded.

[0024] As the cross-sectional shape of the main body 31, a perfect circle is assumed here. However, the cross-sectional shape may be elliptical, may have a polygonal cross-section such as a quadrilateral, or may have an asymmetric shape such as a substantially D-shaped cross-section. When the main body 31 has an elliptical, polygonal or asymmetric cross-sectional shape, the imaging device 57 corresponding to the shape of the main body 31 is restricted or suppressed from moving (i.e., rotating) in the circumferential direction around the axial direction of the main body 31 during sliding within the main body 31. Therefore, an intraoral image with a consistent orientation suitable for determination can be obtained.

[0025] When the main body 31 has a perfect circular cross-sectional shape, as will be described later with reference to FIG. 6, rotation of the imaging device 57 within the main body 31 may be restricted by providing rails and protrusions that engage with each other on the outer surface of the imaging device 57 and the inner circumferential surface of the main body 31.

[0026] As shown in FIG. 3, the main body 31 includes end portions 32 and 33 located on opposite sides of each other. When the intraoral imaging aid 3 is attached to the oral cavity 71, the end portion 32 is exposed to the outside, and the end portion 33 is located within the oral cavity 71. Therefore, the end portion 32 corresponds to the first end portion, and the end portion 33 corresponds to the second end portion.

[0027] The outer peripheral surface of the main body 31 is smooth, and the main body 31 and the end portion 33 are also connected so as to be smoothly continuous and integrated via the connection surface 36. That is, the outer surface of the main body 31 is smoothly processed so as not to damage the oral cavity 71.

[0028] The main body 31 has a scale 37. The scale 37 is arranged along the longitudinal direction of the main body 31 and functions as a guide for how deeply the main body 31 is inserted into the oral cavity 71. The scale 37 may be provided on either the outer peripheral surface or the inner circumferential surface of the main body 31. When the scale 37 is provided on the outer peripheral surface, as shown in FIG. 2, it may be provided on the side where the upper lip and the upper front teeth 75 come into contact, that is, on the upper side. The scales 37 may be arranged at a predetermined interval (for example, in 1 cm increments). Also, the scale 37 shown in FIG. 2 has a length of nearly half a circumference in the circumferential direction of the main body 31, but it is not limited to this, and it may be short or long.

[0029] In this embodiment, as an example of the scale 37, a plurality of raised portions aligned along the longitudinal direction of the main body 31 are assumed. The surface of the raised portion is preferably processed smoothly so as not to damage the oral cavity of the subject 7. However, the scale 37 may be, for example, a substantially linear convex portion extending in the longitudinal direction of the outer peripheral surface of the main body 31, or may be printed or displayed on the outer peripheral surface or the inner peripheral surface of the main body 31.

[0030] As shown in FIG. 3, the end portion 32 has an opening 32A, and the imaging device 57 can be inserted into the opening 32A. Therefore, the imaging device 57 is inserted into the main body 31 from the opening 32A and taken out of the main body 31 from the opening 32A.

[0031] A flange portion 34 is provided at the end portion 32. The flange portion 34 extends radially outward from the end portion 32 toward the main body 31. The flange portion 34 contacts the lip or front teeth of the subject 7 when the main body 31 enters deep into the oral cavity 71, and prevents the subject 7 from accidentally swallowing the intraoral imaging aid 3. That is, the flange portion 34 functions as a stopper. In this embodiment, the flange portion 34 is provided over the entire circumference of the end portion 32. However, for example, it may be partially formed at locations corresponding to the upper lip and the lower lip at the end portion 32. Further, the outer edge of the flange portion 34 may be circular as shown in FIG. 2, may be elliptical, or may be a polygonal shape such as a quadrilateral.

[0032] For example, when the subject 7 coughs, droplets from the subject 7 hit the flange portion 34. That is, the flange portion 34 also helps the doctor to avoid droplets from the subject 7. In order to provide this droplet avoidance function, for example, the shape and dimensions of the flange portion 34 may be appropriately selected according to the age of use, physique, etc.

[0033] The end portion 33 is also open and forms a window portion 33A. This window portion 33A is for providing a view from the inside of the main body 31 to the outside of the main body 31. Here, the lens of the imaging device 57 inside the main body 31 is exposed to the outside. However, the window portion 33A may be covered with a transparent member, for example.

[0034] The end portion 33 protrudes toward the inside of the main body 31 and forms a regulating portion 35. The regulating portion 35 is provided to regulate the imaging device 57 in the main body 31 from coming into contact with and passing through the end portion 33. However, the regulating portion 35 may not be provided on the end portion 33. For example, a guide portion 141 (a recess or a groove), which will be described in relation to FIG. 6 later, contacts the engaging projection 57A of the imaging device 57 at its end portion and regulates the movement of the imaging device 57 toward the back side, thus also serving as the regulating portion 35.

[0035] When photographing the pharynx 72 using the intraoral photographing aid 3 described above, the user inserts the intraoral photographing aid 3 into the oral cavity 71 of the determination subject 7 as shown in FIG. 1. At this time, the main body 31 presses the tongue 73 downward and the soft palate 74 upward. Thereafter or simultaneously, the user inserts the imaging device 57 into the main body 31. At this time, as shown in FIG. 4, neither the tongue 73 nor the soft palate 74 enters the field of view of the imaging device 57, or if they do enter, they only occupy a small range. Therefore, a good view of the pharynx 72 can be obtained.

[0036] Also, the flange portion 34 can prevent the determination subject 7 from accidentally swallowing the intraoral photographing aid 3. At the same time, the flange portion 34 can suppress the scattering of droplets from the mouth of the determination subject 7 to the user, and reduce the risk of secondary infection of infectious diseases such as influenza to the user.

[0037] Furthermore, the scale 37 enables the intraoral photographing aid 3 to be arranged at an appropriate oral cavity depth according to the physique of the determination subject 7 and the photographing site. This contributes to photographing a clear image of the intended site, and can also suppress the discomfort and choking of the determination subject 7 caused by inserting the main body 31 deeper than necessary.

[0038] 2-2 Modification Example 1 of the Intraoral Photographing Aid With reference to FIGS. 5 to 7, the intraoral photographing aid 13 according to Modification Example 1 of the present embodiment will be described. The intraoral imaging aid 13 includes components of the same type as the above-described intraoral imaging aid 3, and further includes a substantially linear guide portion 141. On the other hand, the imaging device 57 includes an engagement protrusion 57A that engages with the guide portion 141. Therefore, the guide portion 141 enables the imaging device 57 to slide within the main body 131 without rotating with respect to the main body 131.

[0039] In Modification 1, as shown in FIG. 6, an example of the guide portion 141 is a groove that extends substantially linearly from the end portion 132 toward the end portion 133 so as to correspond to the engagement protrusion 57A on the outer peripheral surface of the imaging device 57. Alternatively, the guide portion 141 may be a pair of rails protruding from the inner peripheral surface of the main body.

[0040] Optionally, when the cross-sectional shape of the main body 131 is an elliptical shape, a polygonal shape, or an asymmetric shape such as a substantially D-shaped, for example, and the imaging device 57 has an outer shape corresponding to the cross-sectional shape of the main body 131, the imaging device 57 can slide within the main body 131 without rotating with respect to the main body 131. Therefore, the inner peripheral surface of the main body 131 in this case also functions as a guide portion.

[0041] As shown in FIG. 5, on the outer surfaces of the main body 131 and the flange portion 134, an indication display 142 is provided to facilitate the positioning of the main body 131 with respect to the lips of the person to be determined 7. As shown in FIG. 7, the indication display 142 may be disposed, for example, at a position corresponding to the central portion of the upper lip of the person to be determined 7 or the upper front teeth 75, that is, at the center of the upper part. When the user attaches the intraoral imaging aid 3 to the oral cavity 71 with the indication display 142 aligned with the center of the upper lip of the person to be determined 7, for example, the orientations of the images captured by the imaging device 57 will be aligned in substantially the same orientation. This facilitates machine learning using the images and the determination process for a specific disease (such as influenza).

[0042] 2-3 Modification 2 of the intraoral imaging aid Referring to FIG. 8, the intraoral imaging aid 23 according to Modification 2 of the present embodiment will be described. The intraoral imaging aid 23 includes components of the same type as those of the above-described intraoral imaging aid 3, and further has at least one hole 243 in the main body 231. The hole 243 penetrates between the inside and the outside of the main body 231. Such a hole 243 facilitates the breathing of the subject 7 holding the intraoral imaging aid 23, and can give the subject 7 a sense of security. Note that the size, number, and arrangement of the holes 243 may be appropriately set so that saliva of the subject 7 does not easily enter. The components of the above-described modification 2, such as the guide part, can also be applied to the above-described embodiment and modification 1.

[0043] 2-4 Modification 3 of the intraoral imaging aid With reference to FIGS. 9 and 10, the intraoral imaging aid 43 according to Modification 3 of the present embodiment will be described. The intraoral imaging aid 43 includes components of the same type as those of the above-described intraoral imaging aid 3.

[0044] The main body 431 of the intraoral imaging aid 43 is a transparent or translucent resin molded product. Therefore, the imaging area of the intraoral imaging device 5 extends further than the range visible from the window portion 433A, and a wider field of view can be obtained. Further, the inner diameter of the main body 431 is slightly reduced from the end portion 432 toward the end portion 433, which facilitates the resin molding of the intraoral imaging aid 43.

[0045] As shown in FIG. 10, the scale 437 is formed on the inner peripheral surface of the main body 431, whereby the outer peripheral surface of the main body 431 can be made smooth. The scale 437 may be a protrusion protruding from the inner peripheral surface of the main body 431 or a mark displayed or applied on the inner peripheral surface.

[0046] As shown in FIG. 9, the outer edge of the flange portion 434 has an oval shape that is long in the vertical direction, whereby the intraoral imaging aid 43 can be easily positioned with respect to the lips of the subject 7. Further, the outer edge of the flange portion 434 protrudes toward the end portion 433 or is formed to be thicker than other portions. Thereby, the necessary strength is ensured while reducing the amount of material and cost of the flange portion 434.

[0047] 2-5 Other Modification Examples of Intraoral Imaging Aids The main body 31 does not necessarily have substantially the same inner diameter from the end 32 to the end 33. For example, the main body 31 may be configured such that the inner diameter increases toward the end 32. With such a trumpet-shaped main body 31, a plurality of intraoral imaging aids 3 can be stacked, and the space for transportation and storage can be reduced.

[0048] Also, as the imaging device 57, a camera mounted on a smartphone or a tablet terminal may be adopted. In order to fix the positional relationship between such a camera and the intraoral imaging aid 3 (opening 32A), a frame or a clip may be provided on the main body 31 or the flange portion 34. For example, the intraoral imaging aid 3 may be provided with a clip for sandwiching the smartphone from the upper edge or the side edge, or an L-shaped frame for pressing against the corner portion of the smartphone.

[0049] 2-6 Packaging Example of Intraoral Imaging Aids The intraoral imaging aid 3 may be sterilized and individually packaged in a bag 9 on which an identifier 91 is displayed as shown in FIG. 11, thereby enabling hygienic management of the intraoral imaging aid 3. Note that the identifier 91 may be displayed on the intraoral imaging aid 3.

[0050] The identifier 91 includes, for example, identification information including the product ID of the intraoral imaging aid 3. Examples of the identifier 91 include a barcode and an RF tag. However, considering reading by the intraoral imaging device 5 and use in a medical institution of the medical device 1, a barcode is preferable. As the barcode, either a one-dimensional barcode or a two-dimensional barcode can be used.

[0051] For example, before taking an intraoral photograph, the identifier 91 is photographed with the photographing device 57, and the identification information of the intraoral photographing aid 3 in the bag 9 is read into the intraoral photographing device 5, so that the lot information of the corresponding intraoral photographing aid 3 can be confirmed. Thereby, even when a harmful event occurs to the patient due to contact with the oral cavity, traceability can be ensured, and it is also possible to detect the reuse of the intraoral photographing aid 3, thereby preventing contamination and secondary infection and ensuring safety in terms of hygiene.

[0052] 3-1 Intraoral photographing device Referring to FIGS. 12 to 20, the intraoral photographing device 5 will be described in detail. The intraoral photographing device 5 is a computer including an imaging device, an arithmetic device, and a storage device. Here, it is assumed that the intraoral photographing device 5 is composed of one computer, but it may be composed of a plurality of computers. For example, in remote image diagnosis, the photographing function and the determination function may be executed by separate computers. As shown in FIG. 13, the intraoral photographing device 5 includes an imaging device 57, a central processing unit (CPU) 51 as an example of an arithmetic device, a random access memory (RAM) 52 and a read-only memory (ROM) 53 as examples of storage devices, a communication interface 54, an input device 55, an output device 56, and a light source 58.

[0053] The communication interface 54 is a wired or wireless communication module, and is used, for example, for obtaining and updating application programs and determination algorithms, and collecting (transmitting) the photographed images. As the wireless communication interface, for example, a device that satisfies any of the wireless LAN standards such as Wi-Fi, the short-range wireless communication standards such as BLUETOOTH (trademark), and the third-generation and fourth-generation mobile communication standards is assumed, but it is not limited thereto.

[0054] The input device 55 is an example of an input device that receives user input, and is, for example, various operation buttons and operation keys as shown in FIG. 12. Alternatively, the input device 55 may be other input means such as a touch panel, a microphone, an operation dial, a stylus, etc. The input device 55 may be arranged in the main body (housing) of the intraoral imaging device 5, or may be arranged in the imaging device 57, for example. The output device 56 is an example of an output device that outputs a determination result, and is, for example, a display, a speaker, a printer.

[0055] The imaging device 57 acquires an image. In this embodiment, a moving image is assumed as the image acquired by the imaging device 57. The acquired image size is, for example, 640X480 pixels, and the frame rate is, for example, 30 fps, which is sufficient. However, the image size and the frame rate are not limited to this. Optionally or additionally, the imaging device 57 may be enabled to capture a still image. When capturing a still image, it is desirable for the imaging device 57 to have a continuous shooting function, but it is not limited to this.

[0056] In this embodiment, as shown in FIG. 12, it is assumed that the imaging device 57 is separated from the main body (housing) of the intraoral imaging device 5 and is inserted into the intraoral imaging aid 3 alone. The imaging device 57 preferably also has an outer shape (for example, a cylindrical shape) corresponding to the inner peripheral surface of the main body 31 of the intraoral imaging aid 3. However, the imaging device 57 may be incorporated into the main body of the intraoral imaging device 5, such as a smartphone or a tablet terminal, for example.

[0057] The imaging device 57 has an autofocus mechanism (not shown), and for example, the focus may be set so that it matches a specific part in front of the lens. The imaging device 57 may also have a function of automatically recognizing a specific part (for example, the posterior pharyngeal wall) and focusing thereon. The imaging device 57 further has a zoom function, and for example, may be set to capture at an appropriate magnification according to the size of the posterior pharyngeal wall or the follicles.

[0058] During the operation of the imaging device 57, light may be irradiated from the light source 58 toward the subject, thereby ensuring a high-quality image. Here, the light irradiated by the light source 58 may be visible light, or may be non-visible light such as near-infrared light or infrared light, for example. Also, a plurality of light sources 58 may be responsible for irradiating light of a specific wavelength range, for example, one light source irradiates visible light and another light source irradiates near-infrared light or infrared light.

[0059] On the other hand, the imaging device 57 preferably has a type and number of light receiving elements capable of appropriately receiving the light emitted by the light source 58. For example, when the light source 58 emits visible light, the imaging device 57 has a light receiving element suitable for receiving visible light, and when the light source 58 emits non-visible light, the imaging device 57 may have a light receiving element suitable for receiving non-visible light. The light source 58 may be, for example, a light emitting diode (LED) or an organic electroluminescence (OEL).

[0060] Optionally, during the operation of the imaging device 57, it may be programmed so that an image being photographed and a semi-transparent illustration are superimposed and displayed on the display as the output device 56. When the user moves the imaging device 57 so that the illustration and the image of the corresponding part (for example, the uvula or the palatine tonsil) overlap, it becomes possible to obtain an appropriate image for determination.

[0061] The ROM 53 stores an application program for executing various processes in the intraoral imaging device 5 and an algorithm for determining a specific disease. The ROM 53 may also store the image acquired by the imaging device 57, the identification information of the intraoral imaging aid 3, various information input from the input device 55 (for example, information of the determination target person 7), and the determination result. The ROM 53 may be of a built-in type, a removable type such as a USB memory or a MicroSD card, for example, or may further include a storage area of a storage device of an external computer such as an external server.

[0062] The CPU 51 can read the application program stored in the ROM 53 into the RAM 52 and execute various processes including the following processes (a) to (d). When the image acquired by the imaging device 57 is a single still image, the extraction process may be omitted.

[0063] 3-2 Main Processes Executed by the CPU (a) Extraction Process The CPU 51 extracts at least one still image that satisfies a predetermined condition from the image acquired from the imaging device 57. For example, when the imaging device 57 captures a moving image, the CPU 51 extracts at least one still image from among the multiple still images included in the moving image. When capturing a moving image, still images are recorded at a predetermined frame rate. Among them, there should be those with good shooting conditions and those without. Select several images with good shooting conditions as the images to be used in the following determination process.

[0064] For example, based on a large amount of similar image data in advance, it is found that when all or part of a specific shooting angle, a specific lighting condition, a specific field of view width, the depiction position of a specific part (such as the pharynx, etc.), and the degree of focus on a specific part are satisfied, the diagnostic accuracy of a specific disease (such as influenza) is high. This condition is used as the criterion for judging whether the shooting conditions are good or bad. When such a criterion is adopted, the extraction process, for example, as shown in FIG. 18, ranks the images based on the depiction position of the shooting object (step S31), ranks the images based on the degree of focus on the specific part (step S32), ranks the images based on the light irradiation state (step S33), and finally selects several images that are ranked high in the comprehensive ranking (step S34). Additionally, before calculating the comprehensive ranking, the images may be ranked according to the criterion of the field of view width or the shooting angle. Alternatively, a deep learning function may be used for the extraction process.

[0065] (b) Determination Process The CPU 51 determines the possibility of a specific disease based on the image acquired from the imaging device 57 (for example, at least one still image obtained by the extraction process) and the determination algorithm stored in the ROM 53. The specific disease is influenza in this embodiment. For the determination, information of the determination target person 7 (hereinafter referred to as patient information) input by the user via the input device 55 may be used in combination. The patient information includes, for example, age, gender, elapsed time since onset, presence or absence of various symptoms of influenza (such as cough, runny nose, chills, etc.), and contact history with other influenza patients. The patient information may include all or part of race, genetic information, date, season, location information (latitude and longitude of the medical institution), and meteorological information (such as weather, temperature, etc.).

[0066] Here, the determination algorithm may be generated, for example, by the procedure shown in FIG. 17. For example, in the case of influenza, first, at a medical institution, a pharyngeal image of a patient and a correct label indicating whether it is influenza or not are collected (step S21). The correct label is assigned, for example, based on the results of a rapid influenza test by swab, a PCR test, or a virus isolation culture test received from the patient. Although the PCR test and the virus isolation culture test take several weeks until the results are known, since they show extremely high accuracy, their results are suitable as the correct label. Also, the correct label may include not only the image data but also the above patient information.

[0067] Next, teacher data (image data) labeled with the determination result of the above PCR test or virus isolation culture test as the correct answer is generated (step S22). Machine learning is performed based on this teacher data to generate a determination algorithm (step S23). This determination algorithm is an algorithm for determining whether the given image looks like influenza or not. As a result, the possibility of influenza can be quantified and shown, for example, as "98.5%".

[0068] Optionally, for example, like "Determination: Influenza Positive" and "Determination: Influenza Negative", positive or negative determination may be made. In this case, in addition to the positive or negative determination, the reliability of the determination may be quantified or indicated by a stage evaluation such as high, medium, or low. Alternatively, the degree of certainty of influenza may be indicated by a stage evaluation such as high, medium, or low.

[0069] (c) Output processing The CPU 51 outputs the result of the determination process. An example of the output method is display on a display or transmission to another computer.

[0070] (d) Acquisition of identification information of the intraoral imaging aid Optionally, prior to a new determination, the CPU 51 may request the user to input the identification information of the intraoral imaging aid 3 for use in that determination. For example, when the user captures the identifier 91 with the imaging device 57, the CPU 51 acquires the identification information of the corresponding intraoral imaging aid 3 from the image of the identifier 91.

[0071] Next, the CPU 51 searches the records in the ROM 53 and checks for the presence of a record that matches the corresponding intraoral imaging aid 3. Alternatively, the CPU 51 may cause the usage record of the intraoral imaging aid 3 on an external server to be examined.

[0072] If there is no matching record, the CPU 51 allows a new determination. If there is a matching record, the CPU 51 determines that the corresponding intraoral imaging aid 3 has been used. Then, the CPU 51 may, for example, display an alarm on the display or terminate a series of processes. That is, the CPU 51 can limit a new determination according to the search result.

[0073] 3-3 Functional configuration of the intraoral imaging device Figure 14 shows the functional configuration of the intraoral imaging device 5. The intraoral imaging device 5 includes an imaging unit 61, an extraction unit 62, a determination unit 63, a camera control 64, a storage unit 65, an input unit 66, an output unit 67, and a communication unit 68. In terms of the correspondence with the hardware configuration of the intraoral imaging device 5, the imaging unit 61 corresponds to the imaging device 57, the extraction unit 62, the determination unit 63, and the camera control 64 correspond to the CPU 51, the storage unit 65 corresponds to the ROM 53, the input unit 66 corresponds to the input device 55, the output unit 67 corresponds to the output device 56, and the communication unit 68 corresponds to the communication interface 54, respectively. Here, the camera control 64 controls the imaging device 57 to realize various functions such as an autofocus function and a zoom function.

[0074] As other functions, the intraoral imaging device 5 may have a timing function for acquiring the time when imaging is performed, a position information acquisition function for acquiring the position information where imaging is performed, and a weather information acquisition function for acquiring the weather information at the position. The timing function may be realized as a built-in clock or may be a function of a communication interface for accessing an external time server. The position information acquisition function may be realized, for example, as a global positioning system (GPS). The weather information acquisition function may be a function of a communication interface for accessing an external weather server.

[0075] 3-4 Operation Example 1 of Intraoral Imaging Device With reference to Figure 15, operation example 1 of the intraoral imaging device 5 will be described. Here, the operation when the intraoral imaging device 5 captures a moving image is taken as an example. However, the intraoral imaging device 5 may capture a still image, and in this case, the intraoral imaging device 5 operates in the same manner.

[0076] When the power is turned on, the intraoral imaging device 5 starts imaging by the imaging device 57 and displays it on the display, and in step S1, it determines whether the recording button (one of the input devices 55) has been pressed. When the pressing of the recording button is not confirmed, the intraoral imaging device 5 repeats step S1.

[0077] When it is confirmed that the recording button has been pressed, the intraoral imaging device 5 starts recording in step S2. At the same time, the intraoral imaging device 5 turns on the light source 58. The user attaches the intraoral imaging aid 3 to the oral cavity 71 of the subject 7 to be judged, and then inserts the imaging device 57 into the intraoral imaging aid 3 (see Fig. 1). The imaging device 57 images the inside of the subject 7's mouth (oral cavity 71 or pharynx 72) even while sliding inside the intraoral imaging aid 3.

[0078] In step S3, the intraoral imaging device 5 extracts an appropriate still image for determination from among a plurality of still images included in the acquired moving image. At this time, the extracted still image may be displayed on the display as an extraction result.

[0079] In step S4, based on the extracted still image and the determination algorithm, the intraoral imaging device 5 determines the presence of a specific disease, and in step S5, outputs the determination result to, for example, the display. Thereby, a series of operations is completed.

[0080] In this way, since the possibility of a specific disease is evaluated using a determination algorithm generated by machine learning, highly accurate determination results can be expected. Since an image with good shooting conditions is selected for determination, the accuracy of determination is improved. When the intraoral imaging device 5 is used in combination with the intraoral imaging aid 3, a wide field of view and a clear image can be obtained. This contributes to an improvement in determination accuracy.

[0081] 3-5 Operation Example 2 of Intraoral Imaging Device Referring to Fig. 16, operation example 2 of the intraoral imaging device 5 will be described. This operation example 2 includes steps of the same type as operation example 1 described above, and further includes a step (S14) for the user to confirm the extracted image, a step (S16) for inputting patient information, and a comprehensive determination (S17).

[0082] Specifically, when the intraoral imaging device 5 is powered on, it checks for pressing of the recording button (step S11), starts recording (step S12), and extracts an image for determination (step S13). Then, the intraoral imaging device 5 displays the extracted image on, for example, a display, and asks the user whether to use the image for determination (step S14). If the user selects "NO", steps S12 and S13 are executed again to present a new image for determination to the user.

[0083] When the user selects "YES" in step S14, the intraoral imaging device 5 determines the likelihood of a specific disease based on the extracted image (step S15).

[0084] Next, the intraoral imaging device 5 asks the user to input patient information (step S16). Here, the patient information is simple, standardized information such as, for example, body temperature at the time of medical examination and the presence or absence of vaccination. Such patient information is input in a form that can be uniformly processed by software as illustrated in FIG. 9. For example, a pull-down menu or an input form setting that rejects anything other than half-width numbers may be used. Alternatively, the intraoral imaging device 5 may acquire patient information from an external computer (for example, an electronic medical record system) via a wired or wireless connection. Note that step S16 may be executed prior to step S11.

[0085] Then, both the above-mentioned patient information and the evaluation of the likelihood of a specific disease based on the image are integrated to calculate the likelihood of the disease as a whole (step S17). The calculation result is displayed on, for example, a display (step S18), and a series of procedures ends.

[0086] In this way, by the intraoral imaging device 5 evaluating the possibility of a specific disease based on the image confirmed by the user, the accuracy and reliability of the determination are improved. Furthermore, it is expected that the accuracy and reliability of the determination will be further improved if the determination is made based on patient information.

[0087] Operation Example 3 of Intraoral Imaging Device 3-6 Referring to FIG. 19, an operation example 3 of the intraoral imaging device 5 will be described. This operation example 3 includes a procedure (step S41) for acquiring identification information of the intraoral imaging aid 3.

[0088] Specifically, when the power of the intraoral imaging device 5 is turned on, in step S41, for example, via display on the display, the user is requested to input the identification information of the intraoral imaging aid 3. For example, when the user captures the identifier 91 on the bag 9 with the imaging device 57 or inputs the identification information via the input device 55, the intraoral imaging device 5 acquires the identification information of the intraoral imaging aid 3.

[0089] The intraoral imaging device 5 may use the identification information to check the lot information of the corresponding intraoral imaging aid 3. For example, the intraoral imaging device 5 may search the records in the ROM 53 to see if the product ID of the intraoral imaging aid 3 is included, or may have an external computer check for the presence or absence of the product ID.

[0090] If the corresponding product ID is in the internal or external record, the intraoral imaging device 5 may output an alarm or terminate a series of processes. Examples of the alarm include, for example, a display on the display indicating that the intraoral imaging aid 3 has been used. This restricts the reuse of the intraoral imaging aid 3 and enhances the safety of the intraoral imaging aid 3, including the prevention of secondary infection. Also, since the intraoral imaging aid 3 and the subject 7 to be judged using it can be made to correspond one-to-one, future follow-up investigations become easier.

[0091] Thereafter, the intraoral imaging device 5 performs intraoral imaging in step S42. Here, the intraoral imaging process may be the same as in the above-described operation examples 1 and 2, or may be performed according to the procedure described later. Then, the intraoral imaging device 5 determines the presence of a specific disease in step S43, outputs the determination result in step S44, and terminates a series of processes.

[0092] 3-7 Other Examples of Intraoral Imaging Referring to FIG. 20, other procedures for intraoral imaging will be described. The procedures described here can be alternatives to the image acquisition procedures in the above-described operation examples 1 to 3. Further, this procedure can be used for collecting training data for machine learning.

[0093] First, in step S51, the intraoral imaging device 5 performs patient registration. Patient registration is performed, for example, by recording the patient ID input or imaged by the user into the intraoral imaging device 5.

[0094] Next, in step S52, the intraoral imaging device 5 acquires an image. The image here is a still image and may be composed of, for example, a set of still images extracted from the images captured by the imaging device 57 at a predetermined time interval (for example, every 1 second).

[0095] Then, in step S53, the intraoral imaging device 5 displays the acquired image on, for example, a display and requests the user for confirmation. When approval is obtained from the user in step S54, the intraoral imaging device 5 saves the approved image in step S55 and ends a series of imaging processes. If approval from the user is not obtained, the process returns to step S52 to acquire an image again.

[0096] Although the representative embodiments of the present invention have been described above, the present invention is not limited to these, and various design changes are possible and are also included in the present invention. As described above, for example, it can also be applied for the determination of diseases showing differences in findings in the pharynx or oral cavity, such as streptococcal infectious diseases, adenovirus infectious diseases, Epstein-Barr virus infectious diseases, mycoplasma infectious diseases, etc.

Description of Reference Numerals

[0097] 1 ··· Medical device, 3, 13, 23, 43 ··· Intraoral imaging aids, 5 ··· Intraoral imaging device, 31, 131, 231, 431 ··· Main body, 34, 134, 234, 434 ··· Flange part, 35, 135, 235, 435 ··· regulation unit, 37, 137, 237, 437 ··· scale, 55 ··· input device, 56 ··· output device, 57 ··· imaging device, 58 ··· light source.

Claims

1. A computer comprising a storage device for storing an algorithm for determining an infectious disease causing intraoral findings, and a computing device, The computing device includes: A determination process for determining the possibility of the infection based on an image of the inside of the mouth taken by an imaging device and the algorithm; an output process for outputting a result of the determination process; A computer characterized by executing the above.

2. The computer described in claim 1, wherein the possibility of infection is indicated by at least one of a positive or negative result for the infection, the reliability of the determination, and the degree of certainty of the infection.

3. The computer described in claim 1, wherein the imaging device is provided in the computer together with the computing device.

4. The computer described in claim 1, wherein the imaging device that takes the photograph is configured separately from the computer that has the arithmetic unit that makes the judgment.

5. A computer as described in claim 1, wherein the captured image of the inside of the mouth is transmitted to the computer via a wireless line.

6. A computer according to any one of claims 1 to 5; A cylindrical intraoral photography aid that is detachably attached to the inside of the mouth, The intraoral photography aid includes: a first end having an opening; a second end portion located opposite to the first end portion and having a window portion that provides a visual field from the inside of the intraoral photography aid to the outside of the intraoral photography aid; A medical device comprising:

7. A computer including a storage device storing an algorithm for determining an infectious disease causing intraoral findings, and an arithmetic device, A determination process for determining the possibility of the infection based on an intraoral image taken by an imaging device and the algorithm; an output process for outputting a result of the determination process; A program for executing the above.

Images