Intraoral photography auxiliary instrument

Abstract

The invention provides an intraoral photography auxiliary instrument. And an auxiliary material for providing a determination relating to a disease in which an abnormal observation result in the mouth has occurred. An intraoral imaging assistance instrument inserted into an oral cavity for intraoral imaging, in which the intraoral imaging assistance instrument includes a cylindrical body including: a first end portion having an opening into which an imaging device can be inserted; a second end portion located on the opposite side of the first end portion and having a window portion providing a field of view from the inner side of the main body toward the outer side of the main body; and an inner peripheral surface extending from the first end portion toward the second end portion, allowing the image pickup apparatus to move along an axis from the first end portion toward the second end portion.

Description

[0001] This application is filed based on Article 42 of the Implementing Regulations of the Patent Law, and is a divisional application of the invention patent application "Intraoral photography device, medical device and program product" (International Application Number: PCT / JP2018 / 046559) with an application date of December 18, 2018 and application number 201880083646.7. Technical Field

[0002] The invention relates to an intraoral photography auxiliary instrument for photographing the interior of the mouth. Background Art

[0003] Non-patent document 1 reports that lymphoid follicles that appear in the deepest part of the throat have a pattern that is unique to influenza. Lymphoid follicles with this pattern are called influenza follicles. Influenza follicles are a characteristic sign of influenza and appear about 2 hours after the onset of the disease.

[0004] Prior art literature

[0005] Non-patent literature

[0006] Non-patent document 1: Miyamoto Watanabe's "Investigation of the clinical findings of the pharyngeal head (インフルエンザfilter cell) and its meaning" Japanese Medical Journal 72(1):11-18(2013) Summary of the invention

[0007] Problem that the invention aims to solve

[0008] It is expected that accurate identification of influenza follicles will lead to a significant improvement in the accuracy of diagnosis. However, appropriate estimation of influenza follicles requires intensive training on a large number of cases, which is not easy for general doctors. Unfortunately, the above research results are only used effectively among a limited range of doctors.

[0009] Here, there are many diseases other than influenza that cause abnormalities in throat observation results. The same instructions as above can be applied to the diagnosis of these diseases.

[0010] Furthermore, image diagnosis is also useful for diseases that cause abnormalities in oral cavity observation results.

[0011] Therefore, an object of the present invention is to provide an intraoral photography auxiliary instrument capable of providing auxiliary materials.

[0012] Means used to solve problems

[0013] In order to solve the above-mentioned problems, the present invention provides an intraoral photography auxiliary instrument, which is inserted into the oral cavity for intraoral photography, wherein the intraoral photography auxiliary instrument includes a cylindrical main body, and the main body includes: a first end, which has an opening for inserting a camera device; a second end, which is located on the opposite side of the first end and has a window portion that provides a field of view from the inside of the main body toward the outside of the main body; and an inner circumferential surface, which extends from the first end toward the second end, allowing the camera device to move along an axis from the first end toward the second end.

[0014] Here, "intraoral" includes not only humans but also the oral cavity and throat of all animals. In addition, "throat" also includes "Waldeyer's ring", which includes lymphoid follicles on the posterior wall of the throat. Therefore, "patients" in the present invention include not only humans but also all animals.

[0015] The light source includes a wide range of light sources that can achieve the purpose of photography, and may emit visible light, for example, or may emit invisible light such as near infrared light and infrared light.

[0016] In the intraoral photography device of the present invention having the structure as described above, the camera device may acquire a moving image as the image, and the computing device may further perform an extraction process in which at least one static image satisfying a prescribed condition is extracted from a plurality of static images contained in the moving image, and the computing device may perform the determination process based on the result of the extraction process. Here, the acquisition of the moving image means photography performed by the camera device, which may or may not be accompanied by recording the captured image on a recording medium. In addition, the prescribed condition may be a condition related to the content of the image or a condition related to the timing of image extraction.

[0017] Furthermore, the intraoral imaging device of the present invention having the above-described structure may further include an input device for accepting an input of patient information, and the computing device may further execute the determination process based on the patient information.

[0018] Furthermore, the intraoral imaging device of the present invention having the above-described structure may further include a display device that displays at least one of the image acquired by the imaging device and the result of the extraction process.

[0019] In addition, it may be that, in the intraoral photography device of the present invention having the structure as described above, the camera equipment obtains the image of the mouth in a cylindrical intraoral photography auxiliary instrument installed in the mouth, the storage device records the identification information of the used intraoral photography auxiliary instrument, and the computing device also performs the following processing: acquisition processing, obtaining the identification information of the intraoral photography auxiliary instrument used in the new judgment; retrieval processing, investigating whether there is a record in the storage device that is consistent with the identification information of the intraoral photography auxiliary instrument used in the new judgment; and restriction processing, restricting the new judgment according to the result of the retrieval processing.

[0020] The present invention also provides a medical device, which is characterized in that it includes: the above-mentioned intraoral photography device; a cylindrical intraoral photography auxiliary instrument, which is installed in the mouth in a removable manner, and the intraoral photography auxiliary instrument includes: a first end portion, which has an opening; and a second end portion, which is located on the side opposite to the first end portion and has a window portion that provides a field of view from the inside of the intraoral photography auxiliary instrument toward the outside of the intraoral photography auxiliary instrument.

[0021] In addition, the present invention also provides a program for causing a computer to perform determination processing and output processing, the computer comprising: a storage device storing an algorithm for determining a specified disease; and a computing device, wherein in the determination processing, the possibility of the specified disease is determined based on an intraoral image obtained by a camera device and the algorithm, and in the output processing, the result of the determination processing is output.

[0022] Effects of the Invention

[0023] According to the present invention, it is possible to provide auxiliary materials for determining a disease in which an abnormality is observed in the oral cavity. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 1 is a schematic diagram of a medical device 1 including an intraoral imaging device 5 and an intraoral imaging auxiliary tool 3 according to a typical embodiment of the present invention.

[0025] Figure 2 It is shown Figure 1 A stereoscopic view of the intraoral photography auxiliary instrument 3.

[0026] Figure 3 yes Figure 2 A longitudinal sectional view of the intraoral photography auxiliary device 3.

[0027] Figure 4 It shows that Figure 2 A diagram showing an example of a state in which the intraoral photography auxiliary instrument 3 is inserted into the oral cavity 71.

[0028] Figure 5It is a perspective view showing the intraoral photography auxiliary instrument 13 according to Modification 1.

[0029] Figure 6 It is shown Figure 5 A longitudinal sectional view of the intraoral photography auxiliary device 13.

[0030] Figure 7 It shows that Figure 5 A diagram showing an example of a state in which the intraoral photography auxiliary instrument 13 is inserted into the oral cavity 71.

[0031] Figure 8 It is a perspective view showing an intraoral photography assisting device 23 according to a second modification.

[0032] Fig. 9 It is a perspective view of the intraoral photography auxiliary instrument 43 according to the third modification.

[0033] Fig.10 yes Fig. 9 A cross-sectional view of the intraoral photography aid 43.

[0034] Fig.11 1 is a schematic diagram showing the packaged intraoral photography auxiliary instrument 3.

[0035] Fig.12 It is shown Figure 1 A diagram showing an example of the appearance of the intraoral photography device 5.

[0036] Fig.13 It is shown Fig. 9 A block diagram of an example of the hardware structure of the intraoral photography device 5.

[0037] Fig.14 It is shown Fig. 9 A block diagram of an example of the functional structure of the intraoral photography device 5.

[0038] Fig.15 yes Fig. 9 Flowchart of operation example 1 of the intraoral photography device 5.

[0039] Fig.16 yes Fig. 9 Flowchart of action example 2 of the intraoral photography device 5.

[0040] Fig.17 is a flowchart showing the process of generating a determination algorithm.

[0041] Fig.18 This is a flowchart showing an example of the image extraction process.

[0042] Fig.19 yes Fig. 9 Flowchart of operation example 3 of the intraoral photography device 5.

[0043] Fig. 20 It is a flowchart showing an example of the photographing operation of the intraoral photographing device 5 .

[0044] Fig.21 It is a schematic diagram of the cross-sectional shape of the head of a person 7 .

[0045] Fig. 22 This is a schematic diagram of the inside of the oral cavity 71.

[0046] Description of symbols

[0047] 1: Medical devices;

[0048] 3, 13, 23, 43: intraoral photography aids;

[0049] 5: Intraoral photography device;

[0050] 31, 131, 231, 431: main body;

[0051] 34, 134, 234, 434: along the edge;

[0052] 35, 135, 235, 435: Restriction Department;

[0053] 37, 137, 237, 437: scale;

[0054] 55: input device;

[0055] 56: output device;

[0056] 57: Camera equipment;

[0057] 58: Light source. DETAILED DESCRIPTION

[0058] Hereinafter, with reference to the accompanying drawings, a medical device including an intraoral photography device and an intraoral photography auxiliary device according to a representative embodiment of the present invention will be described in detail. However, the present invention is not limited to the embodiment and the accompanying drawings. In addition, the accompanying drawings are used to schematically illustrate the present invention, so in order to facilitate understanding, the size, ratio or quantity may be exaggerated or simplified as needed.

[0059] In addition, the following disclosure envisions the use of a medical device for the determination of influenza, but the present invention is not limited to this. For example, there are many diseases such as streptococcal infection, adenovirus infection, Epstein-Barr virus infection, mycoplasma infection, etc., in which abnormalities appear in observation results of the throat. In addition, in these diseases, important observation results sometimes appear in the oral cavity. And, in diseases other than these diseases, observation results sometimes appear in the oral cavity. In this way, a medical device can be used to determine any disease in which observation results appear in the throat and oral cavity. In addition, the intraoral photography auxiliary instrument can also be used in combination with other devices such as smart phones and tablet terminals.

[0060] 1Overview of Medical Devices

[0061] Reference Figure 1 , the outline of the medical device 1 of this embodiment is described. As shown in the figure, the medical device 1 includes an intraoral photography device 5 and an intraoral photography auxiliary instrument 3. The intraoral photography device 5 is preferably used in combination with the intraoral photography auxiliary instrument 3, but it can also be used alone or in combination with other auxiliary instruments.

[0062] The intraoral photography device 5 includes a camera 57 for acquiring an image of a subject, and dedicated software is pre-installed in the device 5. A user (e.g., a doctor) causes a subject 7 (e.g., a patient) suspected of having influenza to bite the intraoral photography auxiliary instrument 3 to ensure a field of view for photography. Then, the user inserts the camera 57 into the intraoral photography auxiliary instrument 3 to photograph the throat 72 of the subject 7. In addition, the user can also photograph the inside of the oral cavity 71 of the subject 7 by adjusting the insertion depth and insertion angle of the intraoral photography auxiliary instrument 3. Alternatively, the user can insert the intraoral photography auxiliary instrument 3 with the camera 57 stored therein into the mouth of the subject 7, or cause the subject 7 to insert the intraoral photography auxiliary instrument 3 into the mouth.

[0063] The captured image is processed by a judgment algorithm generated in advance. It is envisaged that this processing is performed by the intraoral photography device 5, but it can also be performed by other computers. For example, in the case where the judgment is about the possibility of influenza, the judgment algorithm detects throat symptoms (patterns) inherent to influenza, such as influenza follicles, and displays the possibility of influenza. Thus, for example, even inexperienced doctors or training doctors can accurately and early diagnose influenza. In addition, useful judgment data can also be obtained for experienced doctors. In addition, the correct diagnosis rate of influenza is improved, so that patients can complete medical treatment with a single visit and receive appropriate treatment from an earlier stage.

[0064] 2-1 Intraoral photography aids

[0065] Reference Figure 2-Figure 4, the intraoral photography auxiliary device 3 of this embodiment is described in detail.

[0066] The intraoral photography auxiliary instrument 3 is an auxiliary tool used to photograph the inside of the mouth (the inside of the oral cavity 71 and the throat 72) of the person 7. More specifically, the intraoral photography auxiliary instrument 3 is inserted into the oral cavity 71 when photographing the inside of the mouth, and is used to obtain a good field of view of the photographing area including the inside of the oral cavity 71 or the throat 72. From the viewpoint of obtaining a better field of view, the intraoral photography auxiliary instrument 3 is preferably light-transmissive. In this embodiment, a mouthpiece is envisioned as an example of the intraoral photography auxiliary instrument 3, but it is not limited to this.

[0067] like Figure 2 As shown, the intraoral photography auxiliary instrument 3 has a main body 31, an edge 34, and a limiting portion 35. However, the intraoral photography auxiliary instrument 3 only needs to have the main body 31, and may not have both or one of the edge 34 and the limiting portion 35. In the present embodiment, an integrally molded resin product is envisioned as the intraoral photography auxiliary instrument 3, but the intraoral photography auxiliary instrument 3 can be made of other materials such as paper, cloth, metal, etc., or can be made of multiple materials. In addition, the intraoral photography auxiliary instrument 3 is envisioned to be a disposable type, but it can also be a reusable type.

[0068] The main body 31 is cylindrical in shape as a whole. When the main body 31 is inserted deeply into the oral cavity 71, for example, Figure 1 and Fig.21 As can be seen from the comparison, the tongue 73 is pushed downward and the soft palate 74 is pushed upward. Thus, for example, according to Figure 4 and Fig. 22 As can be seen from the comparison, a good view of the throat 72 can be ensured from the inside of the intraoral photography auxiliary instrument 3 (main body 31).

[0069] In the present embodiment, the main body 31 extends substantially in a straight line. That is, the inner diameter and outer diameter of the main body 31 are substantially constant in the entire length direction. However, the main body 31 may be partially or entirely bent, and the inner diameter or outer diameter of the main body 31 may also be changed, as long as it does not hinder the sliding of the camera device 57 on the inner circumferential surface of the main body 31.

[0070] As the cross-sectional shape of the main body 31, a perfect circle is assumed here. However, the cross-sectional shape may be an ellipse, a polygonal cross-section such as a quadrilateral, or an asymmetric shape such as a roughly D-shape. In the case where the main body 31 has an elliptical, polygonal, or asymmetric cross-sectional shape, when the camera device 57 corresponding to the shape of the main body 31 slides inside the main body 31, the movement (i.e., rotation) in the circumferential direction centered on the axial direction of the main body 31 is limited or suppressed, so that an intraoral image suitable for determination and having a consistent orientation can be obtained.

[0071] In the case where the main body 31 has a perfect circular cross-sectional shape, as shown in FIG. Figure 6 As described later, the rotation of the imaging device 57 in the main body 31 may be restricted by providing a guide rail or a protrusion that engages with the outer surface of the imaging device 57 and the inner peripheral surface of the main body 31 .

[0072] like Figure 3 As shown, the main body 31 includes ends 32 and 33 located on opposite sides. When the intraoral photography auxiliary device 3 is installed in the oral cavity 71, the end 32 is exposed to the outside, and the end 33 is located in the oral cavity 71. Therefore, the end 32 corresponds to the first end, and the end 33 corresponds to the second end.

[0073] The outer peripheral surface of the main body 31 is smooth, and the main body 31 and the end portion 33 are also smoothly connected and integrally connected via the connection surface 36. That is, the outer surface of the main body 31 is processed to be smooth so as not to damage the oral cavity 71.

[0074] The main body 31 has a scale 37. The scale 37 is arranged along the length direction of the main body 31, and serves as a reference for how deeply the main body 31 is inserted into the oral cavity 71. The scale 37 may be provided on either the outer peripheral surface or the inner peripheral surface of the main body 31. In the case where the scale 37 is provided on the outer peripheral surface, as shown in FIG. Figure 2 As shown, it can be set on the side that contacts the upper lip and the upper front teeth 75, that is, the upper side. The scale 37 can be arranged at a predetermined interval (for example, every 1 cm). Figure 2 The scale 37 shown has a length of nearly half the circumference of the main body 31 in the circumferential direction, but is not limited thereto and can be short or long.

[0075] In the present embodiment, as an example of the scale 37, a plurality of raised portions arranged along the length direction of the main body 31 are envisioned. The surface of the raised portion may be processed to be smooth so as not to damage the oral cavity of the determination subject 7. However, the scale 37 may be, for example, a substantially linear convex portion extending in the length direction of the outer peripheral surface of the main body 31, and may also be printed or displayed on the outer peripheral surface or the inner peripheral surface of the main body 31.

[0076] like Figure 3 As shown, the end portion 32 has an opening 32A, and the imaging device 57 can be inserted into the opening 32A. Therefore, the imaging device 57 is inserted into the main body 31 through the opening 32A, and taken out of the main body 31 through the opening 32A.

[0077] The end portion 32 is provided with a rim 34. The rim 34 extends radially outward from the end portion 32 toward the main body 31. When the main body 31 enters deep into the oral cavity 71, the rim 34 contacts the lips or front teeth of the subject 7 to prevent the subject 7 from swallowing the intraoral photography auxiliary device 3 by mistake. That is, the rim 34 functions as a stopper. In the present embodiment, the rim 34 is provided over the entire circumference of the end portion 32, and may also be formed locally in the end portion 32, for example, at a position corresponding to the upper lip and the lower lip. In addition, the outer edge of the rim 34 may be as follows: Figure 2 It may be a perfect circle, an ellipse, or a polygon such as a quadrilateral.

[0078] For example, when the determination subject 7 coughs, droplets from the mouth of the determination subject 7 splash onto the edge portion 34. That is, the edge portion 34 helps the doctor avoid splashing with droplets from the determination subject 7. In order to have this droplet avoidance function, for example, the shape and size of the edge portion 34 can be appropriately selected according to the user's age or physique.

[0079] The end portion 33 is also open to form a window portion 33A. The window portion 33A is used to provide a field of view from the inside of the main body 31 to the outside of the main body 31, and here, the lens of the camera device 57 in the main body 31 is exposed to the outside. However, the window portion 33A may be covered by a transparent member, for example.

[0080] The end portion 33 protrudes toward the inside of the main body 31, forming a limiting portion 35. The limiting portion 35 contacts the camera device 57 in the main body 31 and is provided to limit the camera device 57 from passing through the end portion 33. However, the limiting portion 35 may not be provided at the end portion 33. For example, Figure 6 The guide portion 141 (recess or groove) described in the relationship contacts the engaging protrusion 57A of the camera device 57 at its distal end, restricting the movement of the camera device 57 to the deep side, and therefore also serves as the restriction portion 35.

[0081] When the above-mentioned intraoral photography auxiliary device 3 is used to photograph the throat 72, as shown in FIG. Figure 1 As shown in FIG. 1 , the user inserts the intraoral photography auxiliary device 3 into the oral cavity 71 of the determination subject 7. At this time, the main body 31 pushes the tongue 73 downward and pushes the soft palate 74 upward. Then or simultaneously, the user inserts the camera 57 into the main body 31. At this time, as shown in FIG. Figure 4 As shown, the tongue 73 and the soft palate 74 do not enter the field of view of the camera 57, or even if they enter, they only occupy a small range. Therefore, a good field of view of the throat 72 can be obtained.

[0082] In addition, the edge portion 34 can be used to prevent the determination subject 7 from accidentally swallowing the intraoral photography auxiliary instrument 3. At the same time, the edge portion 34 can suppress the scattering of droplets from the mouth of the determination subject 7 to the user, reducing the risk of secondary infection of infectious diseases such as influenza to the user.

[0083] Furthermore, the scale 37 can arrange the intraoral photography auxiliary instrument 3 at an appropriate depth in the oral cavity according to the physique and the photography part of the determination subject 7. This can facilitate the photography of a clear image of the desired part and suppress the discomfort and swallowing of the determination subject 7 caused by inserting the main body 31 too deep unnecessarily.

[0084] 2-2 Modification 1 of the intraoral photography aid

[0085] Reference Figure 5-Figure 7 , an intraoral photography assisting device 13 according to a first modification of the present embodiment will be described.

[0086] The intraoral photography assisting device 13 has the same structural elements as the above-mentioned intraoral photography assisting device 3, and further includes a substantially linear guide portion 141. On the other hand, the imaging device 57 includes an engaging protrusion 57A, and the engaging protrusion 57A engages with the guide portion 141. Therefore, the guide portion 141 can slide in the main body 131 without rotating the imaging device 57 relative to the main body 131.

[0087] In variation 1, if Figure 6 As shown, an example of guide portion 141 is a groove extending substantially linearly from end 132 toward end 133 so as to correspond to engagement protrusion 57A on the outer peripheral surface of imaging device 57. Alternatively, guide portion 141 may be a pair of guide rails protruding from the inner peripheral surface of the body.

[0088] Optionally, when the cross-sectional shape of the main body 131 is an elliptical, polygonal, or asymmetric shape such as a roughly D-shape and the camera device 57 has an outer shape corresponding to the cross-sectional shape of the main body 131, the camera device 57 can slide within the main body 131 without rotating relative to the main body 131, so the inner circumferential surface of the main body 131 in this case also acts as a guide portion.

[0089] like Figure 5 As shown, an indication display 142 is provided on the outer surface of the main body 131 and the edge portion 134, and the indication display 142 is used to facilitate the positioning of the main body 131 relative to the lips of the determination subject 7. Figure 7As shown, the indication display 142 can be arranged, for example, at a position corresponding to the center of the upper lip or the upper front teeth 75 of the determination subject 7, that is, at the center of the upper part. For example, the user installs the intraoral photography auxiliary device 3 into the oral cavity 71 in a state where the indication display 142 is aligned with the center of the upper lip of the determination subject 7, thereby aligning the direction of the image captured by the camera 57 in almost the same direction. As a result, machine learning using images and determination processing of specific diseases (such as influenza) become easy.

[0090] 2-3 Modification 2 of the intraoral photography aid

[0091] Reference Figure 8 , an intraoral photography assisting device 23 according to a second modification of the present embodiment will be described.

[0092] The intraoral photography assisting device 23 has the same structural elements as the above-mentioned intraoral photography assisting device 3, and has at least one hole 243 in the main body 231. The hole 243 penetrates between the inside and the outside of the main body 231. Through the hole 243, the determination subject 7 who bites the intraoral photography assisting device 23 can breathe easily, which can give the determination subject 7 a sense of security. In addition, the size, number and arrangement of the holes 243 can be appropriately set so that the saliva of the determination subject 7 is difficult to enter.

[0093] The structural elements of the above-mentioned modification example 2, such as the guide portion, can also be applied to the above-mentioned embodiment and modification example 1.

[0094] 2-4 Modification 3 of the intraoral photography aid

[0095] Reference Fig. 9 and Fig.10 Next, an intraoral photography assisting instrument 43 according to a third modification of the present embodiment will be described. The intraoral photography assisting instrument 43 has the same structural elements as the intraoral photography assisting instrument 3 described above.

[0096] The main body 431 of the intraoral photography auxiliary instrument 43 is a transparent or translucent resin molded product. Therefore, the photography area of ​​the intraoral photography device 5 is larger than the range observed from the window 433A, and a wider field of view can be obtained. In addition, the inner diameter of the main body 431 is slightly reduced from the end 432 toward the end 433, thereby making it easier to mold the intraoral photography auxiliary instrument 43 into resin.

[0097] like Fig.10 As shown, the scale 437 is formed on the inner circumference of the main body 431, thereby making the outer circumference of the main body 431 smooth. The scale 437 may be a protrusion protruding from the inner circumference of the main body 431, or a mark displayed or applied on the inner circumference.

[0098] like Fig. 9As shown, the outer edge of the edge 434 is an ellipse that is long in the vertical direction, so that the intraoral photography auxiliary instrument 43 can be easily positioned relative to the lips of the determination subject 7. In addition, the outer edge of the edge 434 is formed to protrude toward the end 433 or to be thicker than other parts. As a result, the amount and cost of the material of the edge 434 are reduced while ensuring the necessary strength.

[0099] 2-5 Other variations of intraoral photography aids

[0100] The main body 31 does not need to have substantially the same inner diameter throughout the entire range from the end 32 to the end 33. For example, the main body 31 may be configured so that the inner diameter increases toward the end 32. With this trumpet-shaped main body 31, a plurality of intraoral photography assisting instruments 3 can be stacked, and the space for transportation or storage can be reduced.

[0101] In addition, a camera mounted on a smartphone or a tablet terminal may be used as the imaging device 57. A frame or a clip may be provided on the main body 31 or the edge portion 34 to fix the positional relationship between such a camera and the intraoral photography auxiliary device 3 (opening 32A). For example, the intraoral photography auxiliary device 3 may have a clip for clamping a smartphone from the upper edge or the lateral edge, or an L-shaped frame for abutting against the corner of the smartphone.

[0102] 2-6 Packaging example of intraoral photography aids

[0103] The intraoral photography aid 3 can also be sterilized, such as Fig.11 As shown, the intraoral photography assisting instrument 3 can be sanitarily managed by individually packaging the instrument in a bag 9 having an identifier 91 displayed thereon. Alternatively, the identifier 91 may be displayed on the intraoral photography assisting instrument 3.

[0104] The identifier 91 includes, for example, identification information including the product ID of the intraoral photography auxiliary device 3. As the identifier 91, for example, a barcode and an RF tag can be cited, but a barcode is preferred in consideration of the reading of the intraoral photography device 5 and the use of the medical device 1 in a medical institution. Either a one-dimensional barcode or a two-dimensional barcode can be used as the barcode.

[0105] For example, before intraoral photography, the identifier 91 is photographed by the camera 57, and the identification information of the intraoral photography auxiliary instrument 3 in the bag 9 is read into the intraoral photography device 5, thereby confirming the batch information of the corresponding intraoral photography auxiliary instrument 3. Thus, even if a harmful event occurs to the patient due to contact with the oral cavity, traceability can be ensured, and since reuse of the intraoral photography auxiliary instrument 3 can be detected, contamination and secondary infection caused by this can be prevented, and safety in terms of hygiene can be ensured.

[0106] 3-1 Intraoral photography device

[0107] Reference Figure 12-Figure 20 , the intraoral photography device 5 is described in detail.

[0108] The intraoral photography device 5 is a computer including an imaging device, a computing device, and a storage device. Here, it is assumed that the intraoral photography device 5 is composed of one computer, but it can also be composed of multiple computers. For example, in remote image diagnosis, the photography function and the judgment function can be performed by a single computer. Fig.13 As shown, the intraoral photography device 5 has a camera device 57, a central processing unit (CPU) 51 as an example of a computing device, a random access memory (RAM) 52 as an example of a storage device and a read-only memory (ROM) 53, a communication interface 54, an input device 55, an output device 56 and a light source 58.

[0109] The communication interface 54 is a wired or wireless communication module, for example, used for obtaining and updating an application program and a determination algorithm, and for collecting (sending) captured images. As a wireless communication interface, for example, a device that satisfies any one of wireless LAN standards such as Wi-Fi, short-range wireless communication standards such as BLUETOOTH (trademark), and third-generation / fourth-generation mobile communication standards is envisioned, but it is not limited thereto.

[0110] The input device 55 is an example of an input device for accepting user input, such as Fig.12 Alternatively, the input device 55 may be other input units such as a touch panel, a microphone, an operation dial, a stylus, etc. The input device 55 may be disposed on the main body (housing) of the intraoral photography device 5, for example, it may also be disposed on the camera device 57.

[0111] The output device 56 is an example of an output means for outputting the determination result, and is, for example, a display, a speaker, or a printer.

[0112] The camera 57 acquires an image. In this embodiment, a moving image is assumed as the image acquired by the camera 57. The acquired image size is, for example, 640×480 pixels, and the frame rate is, for example, 30 fps. However, the image size and frame rate are not limited to these.

[0113] Alternatively or additionally, the camera 57 may be configured to be capable of capturing still images. When capturing still images, the camera 57 preferably has a continuous shooting function, but is not limited thereto.

[0114] In this embodiment, if Fig.12As shown, it is assumed that the camera device 57 is separated from the main body (housing) of the intraoral photography device 5 and is inserted into the intraoral photography auxiliary instrument 3 separately. The camera device 57 also preferably has an outer shape (e.g., a cylindrical shape) corresponding to the inner peripheral surface of the main body 31 of the intraoral photography auxiliary instrument 3.

[0115] However, the imaging device 57 may be incorporated into the main body of the intraoral imaging apparatus 5 like a smartphone or a tablet terminal, for example.

[0116] The camera device 57 has an autofocus function (not shown), for example, it is set to focus on a specific part at the front of the lens. The camera device 57 may also have a function of automatically identifying a specific part (for example, the posterior wall of the throat) and focusing on the specific part. The camera device 57 may also be set to have a zoom function, for example, to shoot at an appropriate magnification according to the size of the posterior wall of the throat or the follicle.

[0117] During the operation of the imaging device 57, the light source 58 may irradiate light to the subject, thereby ensuring a high-quality image. Here, the light irradiated by the light source 58 may be visible light or non-visible light such as near infrared or infrared. In addition, for example, one light source may irradiate visible light and another light source may irradiate near infrared or infrared, so that a plurality of light sources 58 are responsible for irradiating light of a specific wavelength range.

[0118] In contrast, the imaging device 57 only needs to have a light receiving element that can appropriately receive the type and amount of light emitted by the light source 58. For example, when the light source 58 emits visible light, the imaging device 57 only needs to have a light receiving element suitable for receiving visible light, and when the light source 58 emits non-visible light, the imaging device 57 only needs to have a light receiving element suitable for receiving non-visible light. The light source 58 may be, for example, a light emitting diode (LED) or an organic electroluminescent (OEL).

[0119] Alternatively, the program may be programmed to display the image being photographed and the semi-transparent illustration in a superimposed manner on the display as the output device 56 during the operation of the imaging device 57. When the user moves the imaging device 57 so that the illustration overlaps with the image of the part corresponding to the illustration (for example, the uvula or the palatine tonsils), an appropriate image can be obtained for determination.

[0120] The ROM 53 stores application programs for executing various processes in the intraoral photography device 5 and algorithms for determining specific diseases. The ROM 53 may also store images acquired by the camera device 57, identification information of the intraoral photography auxiliary device 3, various information input from the input device 55 (for example, information of the determination subject 7), and determination results. The ROM 53 may be a built-in type or a removable type such as a USB memory or a MicroSD card, and may further include a storage area of ​​a storage device of an external computer such as an external server.

[0121] The CPU 51 can read the application program stored in the ROM 53 into the RAM 52 and execute various processes including the following processes (a) to (d). In addition, when the image acquired by the imaging device 57 is a single still image, the extraction process may be omitted.

[0122] 3-2 Main Processing Executed by the CPU

[0123] (a) Extraction Processing

[0124] The CPU 51 extracts at least one static image that satisfies a specified condition from the images acquired by the camera 57. For example, when the camera 57 captures a moving image, the CPU 51 extracts at least one static image from a plurality of static images included in the moving image. Static images are recorded at a specified frame rate when the moving image is captured. The static images should include those with good shooting conditions and those with bad shooting conditions. Several images with good shooting conditions are selected as images to be used in the next determination process.

[0125] For example, based on a plurality of identical image data, it is possible to find in advance that when a specific shooting angle, a specific lighting level, a specific field of view, a specific part (such as the throat, etc.) is depicted, and the degree of focus on a specific part is satisfied, the accuracy of the diagnosis of a specific disease (such as influenza) is high, and use this as a criterion for judging whether the photographic conditions are good or bad. When such a criterion is adopted, for example, Fig.18 As shown, the extraction process goes through the following process: sorting the images according to the depiction position of the photographic object (step S31), sorting the images according to the degree of focus on a specific part (step S32), sorting the images according to the light irradiation state (step S33), and finally selecting several images that are at the top of the comprehensive order (step S34). In addition, the images can also be sorted according to the size of the field of view or the benchmark of the shooting angle before calculating the comprehensive order. Alternatively, a deep learning function can also be used in the extraction process.

[0126] (b) Determination Process

[0127] CPU 51 determines the possibility of a specific disease based on the image obtained from the camera 57 (for example, at least one static image obtained by extraction processing) and the determination algorithm stored in ROM 53. In the present embodiment, the specific disease is influenza. In order to make a determination, the information of the determination object 7 input by the user via the input device 55 (hereinafter referred to as patient information) can be used simultaneously. Patient information includes, for example, age, gender, time elapsed from the onset of the disease, various symptoms of influenza (coughing, runny nose, chills, etc.), and contact history with other influenza patients. Patient information may include all or part of race or genetic information, date or season, location information (latitude and longitude of the place of consultation) and meteorological information (such as weather, temperature, etc.).

[0128] Here, the decision algorithm can be, for example, Fig.17 The process shown is used to generate.

[0129] For example, in the case of influenza, first, a throat image of the patient and a correct answer label indicating whether it is influenza and attached to the throat image are collected in a medical institution (step S21). For example, the correct label is assigned based on the results of a swab-based influenza rapid test, a PCR test, or a virus isolation and culture test received by the patient. Although PCR tests and virus isolation and culture tests take several weeks to determine the results, they are suitable as correct answer labels because they represent very high accuracy. In addition, the correct answer label contains not only the image data, but also the patient information mentioned above.

[0130] Next, teacher data (image data) is generated in which the judgment result of the above-mentioned PCR test or virus isolation and culture test is labeled as the correct answer (step S22). Machine learning is performed based on the teacher data to generate a judgment algorithm (step S23). The judgment algorithm is an algorithm for judging whether the image is likely to contain influenza when an image is provided. As a result, the possibility of influenza can be quantified, for example, expressed as "98.5%".

[0131] Alternatively, for example, the determination of positive or negative may be performed as "determination: influenza positive" and "determination: influenza negative". In this case, in addition to the determination of positive or negative, the reliability of the determination may be quantified or expressed as a high, medium, and low rating. Alternatively, the degree of certainty that it is influenza may be expressed as a high, medium, and low rating.

[0132] (c) Output processing

[0133] The CPU 51 outputs the result of the determination process. An example of the output method is display on a display or transmission to another computer.

[0134] (d) Acquisition of identification information of intraoral photography aids

[0135] Alternatively, the CPU 51 may request the user to input identification information of the intraoral photography auxiliary instrument 3 used in the new determination before making a new determination. For example, when the user photographs the identifier 91 through the camera 57, the CPU 51 obtains the corresponding identification information of the intraoral photography auxiliary instrument 3 from the image of the identifier 91.

[0136] Next, the CPU 51 searches the records in the ROM 53 to check whether there is a record that matches the corresponding intraoral imaging auxiliary instrument 3. Alternatively, the CPU 51 may check the usage record of the intraoral imaging auxiliary instrument 3 on an external server.

[0137] If there is no matching record, the CPU 51 allows a new determination. If there is a matching record, the CPU 51 determines that the corresponding intraoral photography auxiliary instrument 3 has been used. Then, the CPU 51 can, for example, display an alarm on the display, or terminate a series of processes. That is, the CPU 51 can limit new determinations based on the search results.

[0138] 3-3 Functional structure of intraoral photography device

[0139] Fig.14 1 shows the functional structure of the intraoral photography device 5. The intraoral photography device 5 includes an imaging unit 61, an extraction unit 62, a determination unit 63, a camera control unit 64, a storage unit 65, an input unit 66, an output unit 67, and a communication unit 68. If the corresponding relationship with the hardware structure of the intraoral photography device 5 is shown, the imaging unit 61 corresponds to the imaging device 57, the extraction unit 62, the determination unit 63, and the camera control unit 64 correspond to the CPU 51, the storage unit 65 corresponds to the ROM 53, the input unit 66 corresponds to the input device 55, the output unit 67 corresponds to the output device 56, and the communication unit 68 corresponds to the communication interface 54. Here, the camera control unit 64 controls the imaging device 57, thereby realizing various functions such as a focus function and a zoom function.

[0140] As other functions, the intraoral photography device 5 may also have a timing function for obtaining the time of photography, a position information acquisition function for obtaining the position information of the photography, and a weather information acquisition function for obtaining the weather information of the position. The timing function may be implemented as a built-in clock, or may be a function of a communication interface for accessing an external time server. The position information acquisition function may be implemented, for example, as a global positioning system (GPS). The weather information acquisition function may also be a function of a communication interface for accessing an external weather server.

[0141] 3-4 Example 1 of the operation of the intraoral photography device

[0142] Reference Fig.15 , an operation example 1 of the intraoral photographing device 5 will be described. Here, the operation of the intraoral photographing device 5 taking a moving image is taken as an example. However, the intraoral photographing device 5 can take a still image, and in this case, the intraoral photographing device 5 also operates in the same manner.

[0143] When the power is turned on, the intraoral photography device 5 starts photography with the camera 57 and displays it on the display, and in step S1, determines whether the record button (one of the input devices 55) is pressed. If the recording button is not pressed, the intraoral photography device 5 repeatedly executes step S1.

[0144] When the recording button is confirmed to be pressed, the intraoral photography device 5 starts recording in step S2. At the same time, the intraoral photography device 5 turns on the light source 58. The user installs the intraoral photography auxiliary instrument 3 into the oral cavity 71 of the determination subject 7, and then inserts the camera 57 into the intraoral photography auxiliary instrument 3 (see Figure 1 ). While the imaging device 57 is sliding in the intraoral imaging auxiliary instrument 3, it also captures the inside of the mouth (the oral cavity 71 or the throat 72) of the determination subject 7.

[0145] In step S3, the intraoral imaging device 5 extracts an appropriate static image from a plurality of static images included in the acquired moving image to perform determination. At this time, the extracted static image may be displayed on a display as an extraction result.

[0146] The intraoral imaging device 5 determines the possibility of a specific disease based on the extracted static image and the determination algorithm in step S4, and outputs the determination result to, for example, a display in step S5. Thus, a series of operations are completed.

[0147] In this way, since the possibility of a specific disease is evaluated using a determination algorithm generated by machine learning, a highly accurate determination result can be expected.

[0148] Since an image with good photographic conditions can be selected for determination, the accuracy of determination is improved.

[0149] By using the intraoral photography device 5 in combination with the intraoral photography auxiliary instrument 3, a clear image with a wide visual field can be obtained, which contributes to improving the determination accuracy.

[0150] 3-5 Example 2 of the operation of the intraoral photography device

[0151] Reference Fig.16 , describing an operation example 2 of the intraoral photography device 5. This operation example 2 includes the same steps as the operation example 1 described above, and further includes a step of confirming the extracted image by the user (S14), a step of inputting patient information (S16), and a comprehensive determination (S17).

[0152] Specifically, when the intraoral photography device 5 is powered on, it confirms that the recording button is pressed (step S11), starts recording (step S12), and extracts an image for determination (step S13). Then, the intraoral photography device 5 displays the extracted image on a display, for example, and asks the user to confirm whether to use the image for determination (step S14). If the user selects "no", steps S12 and S13 are executed again, and a new image for determination is presented to the user.

[0153] When the user selects “Yes” in step S14 , the intraoral imaging device 5 determines the possibility of a specific disease based on the extracted image (step S15 ).

[0154] Next, the intraoral photography device 5 requires the user to input patient information (step S16). Here, the patient information is simple and standardized information such as body temperature at the time of consultation and whether or not vaccinations have been taken. Fig. 9 As shown, the patient information is input in a form that can be uniformly processed by the software. For example, a drop-down menu can be used to reject input formats other than half-width numbers. Alternatively, the intraoral photography device 5 can also obtain patient information from an external computer (e.g., an electronic medical record system) via a wired or wireless line. In addition, step S16 can also be executed before step S11.

[0155] Then, the patient information and the evaluation of the probability of a specific disease based on the image are combined to calculate the probability of the disease as a whole (step S17). The calculation result is displayed on a display, for example (step S18), and a series of processes are completed.

[0156] In this way, the intraoral imaging device 5 improves the accuracy and reliability of the determination by evaluating the possibility of a specific disease based on the image confirmed by the user.

[0157] If the determination is also performed based on the patient information, the accuracy and reliability of the determination can be expected to be further improved.

[0158] 3-6 Example 3 of the operation of the intraoral photography device

[0159] Reference Fig.19 Next, an operation example 3 of the intraoral imaging device 5 will be described. The operation example 3 includes a process of acquiring identification information of the intraoral imaging auxiliary instrument 3 (step S41).

[0160] Specifically, when the power is turned on, the intraoral photography device 5 requests the user to input the identification information of the intraoral photography auxiliary instrument 3 by displaying it on the display in step S41. For example, when the user photographs the identifier 91 on the bag 9 using the camera 57 or inputs the identification information through the input device 55, the intraoral photography device 5 obtains the identification information of the intraoral photography auxiliary instrument 3.

[0161] The intraoral photography device 5 may also use the identification information to check the batch information of the intraoral photography auxiliary device 3. For example, the intraoral photography device 5 may search whether the record in the ROM 53 contains the product ID of the intraoral photography auxiliary device 3, or may let an external computer check whether the product ID exists.

[0162] In the case where the corresponding product ID exists in the internal or external record, the intraoral photography device 5 may also output an alarm or terminate a series of processes. As an alarm, for example, a message that the intraoral photography auxiliary device 3 has been used can be displayed on the display. As a result, the reuse of the intraoral photography auxiliary device 3 is restricted, and the safety of the intraoral photography auxiliary device 3, including the prevention of secondary infection, is improved. In addition, the intraoral photography auxiliary device 3 can be matched one-to-one with the determination subject 7 who uses the intraoral photography auxiliary device 3, so future follow-up investigation becomes easy.

[0163] Then, the intraoral photography device 5 performs intraoral photography in step S42. Here, the intraoral photography process can be the same as the above-mentioned operation examples 1 and 2, or can be performed according to the process described later. In addition, the intraoral photography device 5 determines the possibility of a specific disease in step S43, outputs the determination result in step S44, and ends a series of processing.

[0164] 3-7 Other Examples of Intraoral Photography

[0165] Reference Fig. 20 , other processes of intraoral photography are described. The process described here can replace the image acquisition process in the above-mentioned operation examples 1 to 3. In addition, this process can be used to collect training data for machine learning.

[0166] First, in step S51, the intraoral imaging device 5 performs patient registration. Patient registration is performed, for example, by the user inputting the patient ID into the intraoral imaging device 5 or recording the photographed patient ID.

[0167] Next, in step S52, the intraoral imaging device 5 acquires an image. The image referred to here is a static image, and may be composed of, for example, a group of static images extracted from the image captured by the imaging device 57 at a predetermined time interval (for example, every 1 second).

[0168] Then, in step S53, the intraoral photography device 5 displays the acquired image on a display, for example, and requests the user to confirm. If the user approves in step S54, the intraoral photography device 5 stores the approved image in step S55, and ends a series of photography processing. If the user approves, the process returns to step S52, and the image is acquired again.

[0169] The representative embodiments of the present invention have been described above, but the present invention is not limited to these representative embodiments, and various design changes can be made, and these design changes are also included in the present invention. As described above, it can also be applied to the determination of diseases that have problems in observation of the throat or oral cavity, such as streptococcal infection, adenovirus infection, Epstein-Barr virus infection, mycoplasma infection, etc.

Claims

1. An intraoral photography auxiliary instrument, which is inserted into the oral cavity for intraoral photography, wherein: The intraoral photography auxiliary device comprises a cylindrical main body, and the main body comprises: A first end portion having an opening into which a camera device can be inserted; a second end portion, which is located on the opposite side of the first end portion and has a window portion that provides a view from the inside of the main body toward the outside of the main body; and An inner peripheral surface, which extends from the first end toward the second end, allows the imaging device to move along an axis from the first end toward the second end.

2. The intraoral photography aid according to claim 1, wherein: The intraoral photography auxiliary instrument further includes an edge portion disposed at the first end portion.

3. The intraoral photography aid according to claim 1, wherein: The second end portion includes a window portion covered by a transparent member.

4. The intraoral photography auxiliary device according to claim 1, wherein: The intraoral photography assisting instrument further includes a restriction portion that restricts movement of the imaging device in the main body beyond the second end portion.

5. The intraoral photography auxiliary device according to claim 4, wherein: The restriction portion protrudes from the inner peripheral surface of the main body along the circumferential direction of the main body from the second end portion toward the inner side of the main body.

6. The intraoral photography auxiliary device according to claim 4, wherein: The restricting portion is a recessed portion or a groove provided on the inner peripheral surface of the main body between the first end portion and the second end portion.

7. The intraoral photography aid according to claim 1, wherein: The main body has scales arranged on at least one of an outer peripheral surface and an inner peripheral surface along a longitudinal direction of the main body.

8. The intraoral photography aid according to claim 1, wherein: The main body has a guide portion that suppresses rotation of the imaging device in the main body and enables the imaging device to move along the axis in the main body.

9. The intraoral photography auxiliary device according to claim 8, wherein: The inner peripheral surface has a cross-sectional shape corresponding to the outer shape of the imaging device so as to function as the guide portion.

10. The intraoral photography auxiliary device according to claim 9, wherein: The guide portion is formed in a concave shape or a groove shape on the inner peripheral surface of the main body.

11. The intraoral photography assisting device according to claim 1, wherein: The intraoral photography assisting device further includes an indicator portion that facilitates positioning of the main body relative to the oral cavity.

12. The intraoral photography auxiliary device according to claim 11, wherein: The indicator portion is disposed on an edge portion disposed on the first end portion.

13. The intraoral photography assisting device according to claim 1, wherein: The body has at least one hole extending between the inner side and the outer side of the body.

Images