Information processing system, dental clinic apparatus, and program

Abstract

To make medical care performed with reference to a video reflecting a patient's oral cavity easy to perform.SOLUTION: A video generation part generates a partial video 114 shown in a code 8A when a dental mirror 121 is included in a photographed video 116. To be specific, the video generation part generates the partial video 114 which includes the dental mirror 121 and in which the dental mirror 121 is located at a specific part of the partial video 114. Also, when the dental mirror 121 moves, a new partial video 114 is generated and the partial video 114 changes accordingly. When the dental mirror 121 moves, a part selected from the photographed video 116 differs accordingly. The partial video 114 reflected to a display device changes accordingly.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an information processing system, a dental treatment device, and a program. [Background technology]

[0002] Patent document 1 discloses an embodiment in which a barcode is created by embedding basic information about the patient, an intraoral camera is provided to photograph the inside of the patient's oral cavity, and a barcode photographing means is configured to photograph the patient's barcode using this intraoral camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Utility Model Registration No. 3182751 Summary of the Invention [Problem to be solved by the invention]

[0004] In the field of dentistry, an image of a patient's oral cavity is sometimes displayed on a display device, and a practitioner such as a dentist may refer to the display device while providing treatment. An object of the present invention is to make it easier to conduct medical treatment while referring to an image showing the patient's oral cavity. [Means for solving the problem]

[0005] For this purpose, the information processing system to which the present invention is applied is an information processing system comprising: an image acquisition means for acquiring a photographed image, which is an image obtained by photographing a patient's oral cavity; and an image generation means for acquiring a portion of the photographed image in which a specific object is captured from the photographed image, and generating a partial image consisting of the portion, which is an image in which the specific object is captured, and for changing the acquisition position when acquiring the portion from the photographed image in accordance with the movement of the specific object.

[0006] Here, the image generating means may change the acquisition position so that the specific target after movement is positioned at a specific location in the partial image to be generated. The image generating means may change the acquisition position so that the specific target after movement is positioned in the center of the partial image to be generated. In addition, when selecting the portion from the captured image in which the specific object appears before movement, the image generation means may select the portion so that the specific object is located at a specific location within the portion. In addition, when selecting the portion from the captured image in which the specific object appears before movement, the image generation means may select the portion so that the specific object is positioned in the center of the portion. Furthermore, when the specific target is located outside a predetermined range, the image generating means may not change the acquisition position in accordance with movement of the specific target. In addition, when the moving specific target moves from within the predetermined range to outside the predetermined range, the image generation means may acquire acquired position information, which is information about the acquisition position of the part acquired from the captured image when the specific target is located within the predetermined range, and when the specific target is located outside the predetermined range, acquire an image of the captured image acquired by the image acquisition means that is located at the position identified by the acquired position information. In addition, when the specific object located outside the predetermined range moves into the predetermined range, the image generation means may change the acquisition position in accordance with the movement of the specific object. Furthermore, the image generating means may acquire the portion from the captured image under different acquisition conditions depending on the type of the specific target shown in the captured image. In addition, the size of the selection area when the image generation means selects and acquires the portion of the captured image may differ for each type of identified target, and the size of the partial image generated by the image generation means may differ depending on the type of identified target shown in the captured image. Furthermore, for each type of identified target, the position of the identified target when the image generation means selects and acquires the portion of the captured image, the position of the identified target reflected in the portion may be different, and the position of the identified target reflected in the partial image generated by the image generation means may be different depending on the type of identified target. In addition, the image generating means may select an area of ​​the captured image that includes a portion showing a medical instrument used in dental treatment, and generate the partial image consisting of the portion and showing the medical instrument. In addition, the image generating means may select an area of ​​the captured image that includes a portion that shows a specific part of the medical instrument, and generate the partial image that is made up of the portion and shows the specific part of the medical instrument. The image generating means may also be configured to select an area of ​​the captured image that includes a portion showing the teeth in the oral cavity, and generate the partial image consisting of the portion and showing the teeth.

[0007] Furthermore, when the present invention is considered as a dental treatment device, the dental treatment device to which the present invention is applied is a dental treatment device that is an imaging device for photographing a patient's oral cavity, and that is equipped with an imaging device that faces a location where a specific target is located, and a change means that, when the specific target located within the imaging range of the imaging device moves, changes the orientation of the imaging device so that the imaging device faces the specific target.

[0008] From another perspective, a dental treatment apparatus to which the present invention is applicable is a dental treatment apparatus that includes an imaging device that images the oral cavity of a patient, an image acquisition means that acquires the image acquired by the imaging device, and an image generation means that acquires a portion of the image that shows a specific object from the image and generates a partial image that is an image made up of the portion and that shows the specific object, and that changes the acquisition position when acquiring the portion from the image in accordance with movement of the specific object.

[0009] Furthermore, when the present invention is considered as a program, the program to which the present invention is applied is a program for causing a computer to realize an image acquisition function for acquiring a photographed image, which is an image obtained by photographing a patient's oral cavity, and an image generation function for acquiring a portion of the photographed image in which a specific object is captured from the photographed image, and generating a partial image, which is an image made up of the portion and is an image in which the specific object is captured, and for changing the acquisition position when acquiring the portion from the photographed image in accordance with the movement of the specific object. [Effects of the Invention]

[0010] According to the present invention, medical treatment can be performed more easily while referring to an image showing the patient's oral cavity. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a dental treatment device used in dental treatment. [Figure 2] FIG. 1 is a front view of a dental lighting device. [Figure 3] FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing device. [Figure 4] FIG. 2 is a diagram illustrating functional units realized by an information processing device. [Figure 5] FIG. 2 is a diagram illustrating an image obtained by a camera. [Figure 6]FIG. 2 is a diagram illustrating a display screen displayed on a display device. [Figure 7] FIG. 2 is a diagram illustrating a handpiece. [Figure 8] FIG. 10 is a diagram illustrating a process for generating a partial video. [Figure 9] FIG. 10 shows a partial image newly generated after the dental mirror has moved. [Figure 10] FIG. 1 is a diagram showing a display device. [Figure 11] FIG. 10 is a diagram showing an example of a reception screen displayed on a terminal device. [Figure 12] FIG. 2 is a diagram showing an image obtained by a camera and displayed on a display device. [Figure 13] FIG. 10 is a diagram showing a display example on a display device. [Figure 14] FIG. 10 is a diagram showing a partial image displayed on a display device. [Figure 15] FIG. 10 is a diagram showing an example of a display form on a display device. [Figure 16] FIG. 10 is a diagram showing an example of a partial image displayed on a display device. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing a dental diagnostic device 100 used in dental treatment. 1, a dental treatment table 2 that supports a patient from below is provided on the floor. The treatment table 2 is provided with a support unit 200 that supports the patient from below, and an elevation mechanism 250 that raises and lowers the support unit 200. The lifting mechanism 250 is provided with a drive source (not shown) such as a motor, and the support part 200 is raised and lowered by being driven by this drive source.

[0013] A seat plate 2b is provided on the support part 200. Furthermore, a backrest 2c is provided on the examination table 2. One end of the backrest 2c is attached to the seat plate 2b, and the backrest 2c rotates around this end. Furthermore, the examination table 2 is provided with a headrest 2d attached to the backrest 2c to support the patient's head. The examination table 2 is also provided with a leg support 2e for supporting the legs of the patient.

[0014] In this embodiment, the surface of the seat board 2b serves as a support surface 2f that supports the buttocks of the patient, and during medical treatment, the patient first sits on the seat board 2b. At this time (when the patient sits down), the backrest 2c is in an upright position (standing up), unlike the position shown in Fig. 1. Also, when the patient sits down, the leg support 2e is in a hanging position, unlike the position shown in Fig. 1. In this embodiment, the seat plate 2b then rises, and the back plate 2c then tilts down. Also, the leg support 2e rotates around one end 2g, and the other end 2h of the leg support 2e rises.

[0015] The medical examination apparatus 100 is also provided with a tray table 3 for a doctor beside the examination table 2, and further with an instrument holder 10 for a doctor. Furthermore, an instrument holder 4 for an assistant is provided on the opposite side of the tray table 3 across the examination table 2. Furthermore, a movable support arm 13 is provided, and the tray table 3 and the instrument holder 10 are supported by this support arm 13. This allows the tray table 3 and the instrument holder 10 to move horizontally and vertically.

[0016] The diagnostic device 100 is also provided with a dental lighting device 90 that irradiates the oral cavity of a patient with light, an arm 6b that supports the dental lighting device 90, and a support 6c that supports the arm 6b. The diagnostic device 100 is also provided with a display device 300 that displays images. The display device 300 is configured, for example, by a liquid crystal display. The display device 300 is fixed to a wall (not shown) of a room in which the diagnostic device 100 is installed.

[0017] The display device 300 does not necessarily have to be fixed to the wall, but may be provided in a movable state. When the display device 300 is provided in a movable state, for example, a swinging member (not shown) that is attached to the support 6c and swings around the support 6c is provided, and the display device 300 is attached to this swinging member. In this embodiment, a doctor and a patient refer to the image displayed on the display device 300. A doctor may refer to the image displayed on the display device 300 while providing dental care. Furthermore, in this embodiment, a foot controller 400 is provided which is operated by the foot of a medical practitioner such as a doctor.

[0018] The doctor's instrument holder 10 and the assistant's instrument holder 4 hold medical instruments 118 so that they can be inserted and removed freely (only the assistant's medical instrument 118 is shown in FIG. 1). The doctor's medical instruments 118 may include, for example, an air turbine handpiece, a micromotor handpiece, a scaler, a three-way syringe, a root canal locator, a root canal expander, and an intraoral camera. The doctor's instrument holder 10 supports some of these medical instruments 118. Another example of the medical instrument 118 for the doctor is a dental mirror, which is often placed on the tray table 3.

[0019] Furthermore, the assistant's medical instrument 118 may include, for example, a suction instrument 20 for sucking saliva, blood, cutting chips, etc. (hereinafter, sometimes referred to as "waste fluid") from within the patient's oral cavity. In FIG. 1, the instrument holder 4 holds a suction syringe (vacuum syringe) 21 as an example of the suction instrument 20, and a syringe ejector 22. Each of the suction instruments 20 is connected to a suction source (not shown) such as a vacuum pump or a compressor (described later), and the waste liquid is sucked by the suction source.

[0020] In addition, a supply device 5 is provided beside (around) the examination table 2 to supply water to a cup (not shown) that the patient uses for gargling. The supply device 5 is provided with a waste liquid receiving section 52 that receives waste liquid discharged from the patient's oral cavity, a cup water supply section 53 that supplies water to the cup, and a cleaning water supply section 54 that supplies cleaning water to the waste liquid receiving section 52.

[0021] Furthermore, the supply device 5 is provided therein with a storage container (suction tank) 60 for storing waste liquid. The storage container 60 stores waste liquid (waste liquid sucked from the oral cavity of a patient) sucked by the suction instrument 20 (suction syringe 21, saliva ejector 22, etc.). Furthermore, an information processing device 61 is provided inside the supply device 5.

[0022] FIG. 2 is a front view of dental lighting device 90. The dental lighting device 90 is provided with a light source 90A. In addition to the light source 90A, the dental lighting device 90 is also provided with a camera 91. This camera 91, which is an example of an imaging device, is configured to include an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and takes an image of, for example, the oral cavity of a patient undergoing medical treatment.

[0023] FIG. 3 is a diagram showing an example of the hardware configuration of the information processing device 61. As shown in FIG. The information processing device 61 provided in the diagnostic device 100 is composed of a computer. The information processing device 61 is provided with a CPU (Central Processing Unit) 101 as an example of a processor, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103. The information processing device 61 is further provided with an information storage device 104 configured by a hard disk device or the like.

[0024] The ROM 102 stores a program to be executed by the CPU 101. The CPU 101 reads out the program stored in the ROM 102 and executes the program using the RAM 103 as a work area. The program executed by CPU 101 can be provided to information processing device 61 in a state where it is stored on a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. The program executed by the CPU 101 may be downloaded to the information processing device 61 using a communication means such as the Internet.

[0025] In this embodiment, various information processes performed by the medical device 100 are performed by an information processing device 61 provided in the medical device 100. In this embodiment, the portion where the information processing device 61 is provided functions as an information processing system that processes information about the medical device 100, and various types of information processing about the medical device 100 are executed by this information processing system.

[0026] However, without being limited to this, a part or all of the information processing may be performed by an external device such as a server device provided separately from the medical device 100. In other words, a part or all of the information processing performed by the medical device 100 may be performed by an external information processing system provided separately from the medical device 100. Furthermore, when information processing is performed in an external information processing system, the information processing may be performed by one information processing device, or the information processing may be distributed using a plurality of information processing devices. The information processing system is not limited to being realized only by the information processing device 61 provided in the medical device 100, but may also be realized by the information processing device 61 and an external device, or may be realized only by an external device.

[0027] Fig. 4 is a diagram showing functional units realized by the information processing device 61. Fig. 4 shows only functional units related to display control of the display device 300 (see Fig. 1). The information processing device 61 functions as a video acquisition unit 111 and a video generation unit 112 . In this embodiment, the CPU 101 reads out a program stored in the ROM 102 and executes the program using the RAM 103 as a work area, thereby realizing these functional units.

[0028] The image acquisition unit 111, which is an example of an image acquisition means, acquires a captured image, which is an image acquired by capturing an image of the oral cavity of a patient. The image acquisition unit 111 acquires this captured image by acquiring an image captured by a camera 91 (see FIG. 2). The image generation unit 112, as an example of an image generation means, acquires a portion of the captured image in which a specific object (hereinafter referred to as a "specific object") is captured, and generates a partial image consisting of this portion, which is an image in which the specific object is captured.

[0029] As will be described later, examples of this "specific object" include medical instruments 118 such as a handpiece or a dental mirror, and the patient's teeth as an example of a medical site. Furthermore, as will be described later, the video generation unit 112 changes the acquisition position when acquiring the above-mentioned part from the captured video in accordance with the movement of the specific target. As a result, in this embodiment, even if the specific target moves, this specific target will be included in the partial video generated by the video generation unit 112 (details will be described later).

[0030] FIG. 5 is a diagram illustrating an image obtained by the camera 91. As shown in FIG. In this embodiment, the range indicated by the reference numeral 7A is the angle of view of the camera 91, and in this embodiment, an image within this angle of view is acquired. In this embodiment, not all of the image within this range of the angle of view is displayed on the display device 300 (see FIG. 1), but only a part of this image is displayed on the display device 300. As a result, for example, of the images within the range of the angle of view, a part of the image within the range indicated by the reference numeral 7B is displayed on the display device 300. In this embodiment, the video generation unit 112 (see FIG. 4) acquires a portion of the captured video in which a specific target appears, and generates a partial video. In this embodiment, the display device 300 displays this partial image made up of this part.

[0031] FIG. 6 is a diagram illustrating a display screen displayed on display device 300. As shown in FIG. In this embodiment, as described above, not all of the image within the range of the angle of view of the camera 91 is displayed on the display device 300, but only a part of this image is displayed on the display device 300. In FIG. 6, the image within the rectangular frame indicated by reference numeral 6A is the image within the range of the angle of view of the camera 91. 6, the image within the rectangular frame indicated by reference symbol 6B is a portion of the image that is actually displayed on the display device 300. In other words, in FIG. 6, the image within the rectangular frame indicated by reference symbol 6B is the partial image 114 generated by the image generation unit 112.

[0032] In this embodiment, the entire object to be photographed that is within the range of the angle of view of the camera 91 is not displayed on the display device 300, but only a part of the object to be photographed is displayed on the display device 300. To display a part of the photographed object, first, the image acquisition unit 111 (see FIG. 4) of the information processing device 61 acquires the image from the camera 91. More specifically, the video acquisition unit 111 acquires a video that captures all of the objects within the angle of view of the camera 91. Hereinafter, in this specification, this video acquired by the video acquisition unit 111 will be referred to as a "captured video 116." Thereafter, the video generation unit 112 selects a video to be displayed on the display device 300 from the captured video 116 and acquires the selected video. In other words, the video generation unit 112 selects a video to be displayed on the display device 300 from the captured video 116 and generates the partial video 114.

[0033] Then, the information processing device 61 outputs the partial video 114 to the display device 300 (see FIG. 1) so that the partial video 114 is displayed on the display device 300. The display device 300 displays the partial video 114 generated by the video generation unit 112. In other words, the display device 300 displays a portion of the image included in the photographed image 116, which is selected and cut out from the photographed image 116 by the image generating section 112.

[0034] In this embodiment, the oral cavity of a patient undergoing dental treatment is photographed using a camera 91. By this photographing, first, the image acquiring unit 111 acquires a photographed image 116 (see FIG. 6) showing the oral cavity of the patient. Thereafter, the video generation unit 112 selects a video from the captured video 116 and generates a partial video 114 . The image generating unit 112 generates a partial image 114 to be displayed on the display device 300 based on the position of the medical tool 118, such as a handpiece or dental mirror, that appears in the captured image 116.

[0035] Here, the handpiece is a medical instrument 118 to which a cutting rotor 119A is attached and which is held by a dentist or the like, as shown in FIG. 7 (a diagram for explaining a handpiece). The handpiece is provided with a rotation mechanism 119B inside the handpiece that rotates a rotor 119A. Furthermore, a dental mirror (not shown in FIG. 7) refers to a medical instrument 118 that has a mirror part that reflects the condition inside the oral cavity and is used by dentists and the like to check the condition inside the oral cavity. The structure of the dental mirror will be described later.

[0036] FIG. 8 is a diagram illustrating the process of generating the partial video 114. In FIG. 8 will be described as an example of processing when the medical instrument 118 is a dental mirror 121. In other words, in FIG. 8, the processing will be described as an example of processing when the specific object for which the partial video 114 is generated is the dental mirror 121. As shown in FIG. 8, when the captured image 116 includes a dental mirror 121, the image generating section 112 generates a partial image 114 indicated by the reference symbol 8A. Specifically, the image generator 112 generates the partial image 114 in which the dental mirror 121 is included and the dental mirror 121 is positioned at a specific location in the partial image 114 .

[0037] More specifically, the image acquisition unit 111 generates a partial image 114 that includes the dental mirror 121 and in which a mirror part 121A of the dental mirror 121 is positioned at a central part 6X of the partial image 114. The image generating unit 112 selects a portion of the image from the captured image 116 and generates a partial image 114 that includes a dental mirror 121 and has a mirror part 121A of the dental mirror 121 positioned at a center 6X of the partial image 114. In this embodiment, the generated partial video 114 is then displayed on the display device 300 (see FIG. 1).

[0038] In this partial image 114 displayed on the display device 300, the mirror portion 121A of the dental mirror 121 is located at the center 6X of this partial image 114. When the medical instrument 118 shown in the captured image 116 is a handpiece (see FIG. 7), the rotating body 119A is located at a specific location in the partial image 114, such as the center 6X of the partial image 114, for example.

[0039] In this embodiment, the image generation unit 112 selects an area of ​​the captured image 116 that includes a portion showing a medical instrument 118 used in dental treatment, and generates a partial image 114 that is an image consisting of a portion of the captured image 116. In this case, the partial image 114 shows a medical instrument 118 . More specifically, the image generating unit 112 selects an area of ​​the captured image 116 that includes a portion of the captured image 116 that shows a specific part of the medical instrument 118, such as the portion of the captured image 116 that shows the mirror portion 121A described above. As a result, a partial image 114 is generated, which is an image made up of a part of the captured image 116 and in which a specific part of the medical instrument 118 is shown.

[0040] As shown in FIG. 8, the dental mirror 121 includes a gripping portion 121B that is gripped by a practitioner, and a mirror portion 121A that reflects the treatment site such as teeth. In the example shown in FIG. 8, the image generating unit 112 generates the partial image 114 so that the mirror unit 121A, which is a part of the medical instrument 118, is positioned at the center 6X, which is an example of a specific location of the partial image 114. As a result, in the generated partial image 114, mirror portion 121A of dental mirror 121 is positioned at center portion 6X of this partial image 114, as shown in FIG.

[0041] The partial image 114 has a rectangular shape. The central portion 6X of the partial image 114 refers to the point where a straight line (not shown) connecting the midpoints C1 of the two long sides 114L of this rectangular partial image 114 intersects with a straight line (not shown) connecting the midpoints C2 of the two short sides 114S of this rectangular partial image 114.

[0042] Fig. 8 shows a dental mirror 121, which is an example of a specific object before it is moved. The dental mirror 121 is moved by an operation by a dentist or the like, but Fig. 8 shows the state before this movement occurs. In this embodiment, when the video generation unit 112 selects a portion from the captured video 116 showing the specific target before it moves and generates the partial video 114, it selects this portion so that the specific target is located at a specific location in this portion. More specifically, when the image generating unit 112 selects a portion from the captured image 116 showing the specific object before it moves, the image generating unit 112 selects this portion so that the specific object is located in the center of this portion, for example. 8, the rectangle designated by the reference symbol 8E indicates a portion selected from the photographed video 116, and the video generator 112 selects this portion from the photographed video 116 so that the specific target is located in the center of this portion. In this way, the first partial video 114 is generated.

[0043] FIG. 9 is a diagram showing a partial image 114 newly generated after the dental mirror 121 has moved. In this embodiment, when the dental mirror 121 moves, a new partial image 114 is generated, and the partial image 114 changes accordingly, as shown in FIGS. In this embodiment, when dental mirror 121 moves, the part selected from captured image 116 changes accordingly, and partial image 114 displayed on display device 300 changes accordingly.

[0044] In this embodiment, as shown in FIGS. 8 and 9, even if partial image 114 changes, mirror portion 121A of dental mirror 121 is positioned at center portion 6X of partial image 114. In this case, partial image 114 changes so as to follow mirror portion 121A of dental mirror 121 that is moving. More specifically, partial image 114 changes so that central portion 6X of partial image 114 follows mirror portion 121A of dental mirror 121 as it moves. In this embodiment, the display on the display device 300 changes in accordance with the movement of the dental mirror 121.

[0045] In this embodiment, the partial video 114 is generated so that a specific object such as a medical instrument 118 is located at a specific location of the partial video 114, such as the central portion 6X of the partial video 114. Furthermore, in this embodiment, when a specific object such as a medical instrument 118 moves, the image generation unit 112 changes the acquisition position when acquiring the above-mentioned portion from the captured image 116 when generating the partial image 114 so that the specific object after movement is located at a specific location in the partial image 114 to be generated. More specifically, the video generation unit 112 changes the acquisition position when acquiring the above-mentioned portion from the captured video 116 so that the specific target after movement is positioned in the center 6X of the partial video 114 to be generated.

[0046] It should be noted that this "specific location" is not limited to the central portion 6X of the partial video 114. The central portion 6X of the partial video 114 is an example of a specific location, and the specific location may be a location other than the central portion 6X of the partial video 114. For example, the specific location may be a location located at the bottom of partial video 114 or a location located at the top of partial video 114. Also, for example, the specific location may be a location located to the right of central portion 6X of partial video 114 or a location located to the left of central portion 6X of partial video 114.

[0047] In this embodiment, images of each medical instrument 118 are registered in advance in the information storage device 104 (see FIG. 3). The image generating unit 112 compares this registered image (hereinafter referred to as the "registered image") with the image of the medical instrument 118 shown in the photographed image 116, and determines whether the photographed image 116 includes the registered image. In other words, the image generating unit 112 determines whether the medical instrument 118 to be tracked is captured in the captured image 116.

[0048] Then, if the captured video 116 includes the registration video, the video generation unit 112 generates the partial video 114. In this partial image 114, as described above, the medical instrument 118 that appears in the captured image 116 and matches the registered image is located at a predetermined specific location.

[0049] Alternatively, a partial video 114 including a medical instrument 118 specified by a specified person such as a dentist may be generated. When generating a partial video 114 including a medical instrument 118 identified by an identifier, for example, the identifier first performs an operation on the display device 300 to identify the medical instrument 118 displayed on the display device 300. In other words, the person specifying the medical instrument 118 to be followed operates the display device 300 to specify the medical instrument 118 to be followed.

[0050] In this case, the image generating unit 112 generates a partial image 114 that includes the medical instrument 118 identified by the identifier. More specifically, the video generation unit 112 generates a partial video 114 that includes the medical instrument 118 that appears in the captured video 116 and that has been identified by the identified person performing an operation on the display device 300. In this case, as in the above case, the image generating unit 112 generates a partial image 114 in which the medical instrument 118 is located at a specific location in the partial image 114 .

[0051] When the identifier operates the display device 300 to identify the medical instrument 118 displayed on the display device 300, for example, as shown in FIG. 10 (a diagram showing the display device 300), the identifier selects and identifies the medical instrument 118 while the medical instrument 118 is displayed on the display device 300. In other words, while the image obtained by the camera 91 is displayed on the display device 300, the person identifying the medical instrument 118 selected from the image is able to identify it.

[0052] More specifically, in this case, the person specifying the medical instrument 118 displayed on the display device 300 performs an operation on a pointing device (not shown), for example. Alternatively, if the display device 300 is configured with a touch panel, the user can directly operate the display device 300 to identify the medical instrument 118 displayed on the display device 300.

[0053] When the identifier operates the display device 300 to identify the medical instrument 118, information about the medical instrument 118 identified by the identifier is transmitted to the information processing device 61 from the pointing device and the display device 300. As a result, the image generating unit 112 acquires information about the medical instrument 118 selected and identified by the person who identifies it.

[0054] More specifically, in this case, information about the position of the part where the specified person performed an operation on the display device 300 and made a selection is transmitted from the pointing device or the display device 300 to the information processing device 61. The information processing device 61 first acquires information about the position of the medical instrument 118 identified by the identifier.

[0055] Next, the video generation unit 112 acquires and stores the video present at the position specified by the information about this position from the captured video 116. Hereinafter, this video will be referred to as the "verification video." The medical instrument 118 identified by the person who identified it is shown at the position identified by the information about the position. In this case, the image generator 112 acquires an image of the medical instrument 118 from the captured image 116 as a comparison image. Thereafter, the image generating unit 112 identifies the medical instrument 118 to be tracked based on this comparison image.

[0056] Thereafter, the video generator 112 generates the first partial video 114. The image generating unit 112 generates a partial image 114 that includes the medical tool 118 specified by the user and in which the medical tool 118 is located in a central portion 6X of the partial image 114 (not shown in FIG. 10). In other words, the image generating unit 112 generates a partial image 114 in which the medical instrument 118 located at the point where the specified person performed the above-mentioned operation on the display device 300 and made the selection is located in the center 6X of the partial image 114. As a result, the partial image 114 in which the medical instrument 118 is located at the center 6X of the partial image 114 is displayed on the display device 300, similar to the above.

[0057] Thereafter, when the medical instrument 118 moves, the image generator 112 generates a new partial image 114 in which the moved medical instrument 118 (not shown in FIG. 10) is positioned at the center 6X of the partial image 114. As a result, the newly generated partial image 114 is displayed on the display device 300. More specifically, when the medical instrument 118 has moved, the image generating unit 112 identifies the medical instrument 118 after the movement from the captured image 116 based on the stored comparison image. Then, the information processing device 61 generates a new partial image 114 in which the identified moved medical instrument 118 is positioned in the center 6X of the partial image 114.

[0058] When the partial image 114 is generated based on the identification of the medical instrument 118 by the identifier, the image displayed on the display device 300 does not change until the identifier identifies the medical instrument 118. In other words, if the medical instrument 118 has not yet been selected by a specific person, the image displayed on the display device 300 does not change. When the person specifying the medical instrument 118 performs an operation on the display device 300 to select the medical instrument 118 and specify the medical instrument 118, generation of the partial image 114 begins, and the partial image 114 is displayed on the display device 300. Furthermore, when the medical instrument 118 moves, a new partial image 114 is displayed on the display device 300 in response.

[0059] The identification of the medical instrument 118 by the identifier is not limited to the operation on the display device 300 described above, but may be performed via a terminal device 500 such as a tablet terminal or a PC. FIG. 11 is a diagram showing an example of a reception screen displayed on terminal device 500. As shown in FIG. In FIG. 11, a reception screen 501 displayed on a terminal device 500 displays candidates for the medical instrument 118 from which the partial video 114 is to be generated. In this processing example, the identifier specifies the medical instrument 118 by operating the terminal device 500. When the identifier specifies the medical instrument 118, information about the specified medical instrument 118 is transmitted to the information processing device 61. Thereafter, if the medical instrument 118 identified by the person via the terminal device 500 is included in the photographed video 116, the video generation unit 112 generates a partial video 114 including the medical instrument 118 based on the photographed video 116, as described above.

[0060] More specifically, in this case, first, the information processing device 61 reads and acquires the registered image corresponding to the medical instrument 118 identified by the person via the terminal device 500 from the information storage device 104 (see FIG. 3). Then, if the captured video 116 includes this registration video, the information processing device 61 generates the partial video 114. In the generated partial image 114, the medical instrument 118 is positioned at a specific location of the partial image 114, such as the central portion 6X of the partial image 114, in the same manner as described above.

[0061] [Generation of display images based on treatment area] In the above, a case has been described in which the medical instrument 118 is the target of tracking, and the partial video 114 including this medical instrument 118 is generated. However, the present invention is not limited to this, and a partial image 114 may be generated in which a tooth, which is an example of a treatment region, is included and the tooth is positioned at a specific location of the partial image 114 . In this case, the patient's tooth, which is an example of a treatment region to be treated, is positioned at the center 6X of the partial image 114, for example. When a patient's teeth are positioned at a specific location on the partial image 114, even if the patient's head moves and the position of the teeth changes, the teeth will remain positioned at a specific location on the partial image 114, such as the center 6X of the partial image 114.

[0062] When generating a partial image 114 in which a tooth, which is an example of a treatment area, is located at a specific location in the partial image 114, the image generation unit 112 selects an area of ​​the captured image 116 that includes a portion in which the tooth in the oral cavity is shown. Then, the image generating unit 112 cuts out this selected area and generates a partial image 114 that is an image made up of a part of the photographed image 116 and that shows this tooth.

[0063] FIG. 12 is a diagram showing an image obtained by camera 91 and displayed on display device 300. As shown in FIG. When generating a partial image 114 in which the treatment region is located at a specific location, the person specifying the tooth to be located at the specific location of the partial image 114 refers to the image shown in FIG. 12, for example. Specifically, in this case, the person specifying the tooth performs an operation on the display device 300 to specify the tooth that the person wants to position at the specific location of the partial image 114, for example. More specifically, in this case, the person identifying the teeth identifies the teeth from the image displayed on the display device 300, as described above, for example, by operating a pointing device (not shown) or by operating the display device 300 configured as a touch panel.

[0064] In response to this, the image generating unit 112 generates a partial image 114 (not shown in FIG. 12) in which the tooth selected and identified by the person who specified it is located in a specific location. Once this partial video 114 is generated, it is displayed on the display device 300 in the same manner as above. Furthermore, when a tooth is selected and identified by the person specifying the tooth, the image generating unit 112 stores information about the tooth selected and identified by the person specifying the tooth.

[0065] Specifically, in this case, the image generating unit 112 stores, as information about the identified tooth, information about the position of the tooth and information about the features of the tooth, such as the shape of the tooth. An example of "information about the tooth position" is the number of teeth counted in order from the reference tooth to the tooth to be tracked. This allows the image generating unit 112 to identify the tooth after it has moved, even if the patient's head moves and the tooth has moved.

[0066] When the patient's head moves and the tooth to be displayed at a specific location in the partial image 114 moves, the image generating unit 112 identifies the tooth after the movement based on the information about the tooth that has been stored. Then, the image generator 112 generates a new partial image 114 that includes the moved tooth and positions the moved tooth at a specific location. In this case, the partial image 114 displayed on the display device 300 changes in accordance with the movement of the teeth.

[0067] In addition, when the specifier specifies the tooth that he or she wants to position at a specific location in the partial image 114, the specifier may specify the tooth by operating the reception screen 501 displayed on a terminal device 500 such as a PC (see Figure 11), as described above. Specifically, in this case, for example, a screen for specifying the tooth to be displayed at the specific location is displayed on the reception screen 501.

[0068] Specifically, in this case, for example, the reception screen 501 displays a display for selecting whether the tooth to be displayed at a specific location is an upper tooth or a lower tooth, a display for selecting whether the tooth is a right-side tooth or a left-side tooth, and a display for inputting a specific numerical value indicating the position of the tooth. In this case, the person specifying performs an operation on this reception screen 501 to specify the tooth that the person wants to position at the specific location of the partial image 114 .

[0069] In response to this, the image generating unit 112 acquires and stores information about the tooth specified by the user. Here, the image generating unit 112 acquires and stores position information, which is information about the position of the tooth, as information about the tooth. Then, the image generating unit 112 identifies the tooth that is located at the position identified by this position information from the captured image 116. Then, the image generating unit 112 generates a partial image 114 in which the identified tooth is located at a specific location of the partial image 114, such as the center 6X of the partial image 114.

[0070] [Processing when a medical instrument moves outside the set area] Alternatively, if the medical instrument 118 moves out of a preset area, a process may be performed in which a new partial image 114 is not generated. The processing executed for the set area will be described below. In the first stage of this process, the operator first manually moves the dental lighting device 90 (see Figure 2) equipped with the camera 91 so that the treatment area is displayed in the image 13X displayed on the display device 300, as shown in Figure 13 (a diagram showing an example of display on the display device 300).

[0071] Next, the operator operates the display device 300 to set the setting area 600 . More specifically, the operator performs an operation on a pointing device or on the display device 300 configured as a touch panel to draw an image of a rectangular frame indicated by the reference numeral 13Z, for example. In this processing example, the area inside the frame image becomes the set area 600. In this processing example, the operator sets the setting region 600 by performing an operation to draw an image of this frame on the display device 300. In Fig. 13, the treatment site is positioned inside the setting region 600.

[0072] When the setting area 600 is set by the operator, information on the operation performed by the operator for this setting is transmitted to the information processing device 61. In response to this, the image generating unit 112 specifies the set area 600 based on the information of this operation. The frame image may be erased once the setting area 600 is set, or may be continuously displayed on the display device 300 even after the setting area 600 has been set.

[0073] Thereafter, in this processing example, when mirror portion 121A (not shown in FIG. 13) of dental mirror 121 is positioned within this set area 600, partial image 114 (not shown in FIG. 13) is generated by image generation unit 112. Accordingly, the partial video 114 generated by the video generating section 112 is displayed on the display device 300, as shown in FIG. 14 (a diagram showing the partial video 114 displayed on the display device 300).

[0074] When the image generating unit 112 acquires the captured image 116 (not shown in FIG. 14), it analyzes the captured image 116 and determines whether the mirror unit 121A is located within the set area 600. When the mirror section 121A is located within the set area 600, the image generating section 112 generates the partial image 114 in which the mirror section 121A is located at the center 6X of the partial image 114. As a result, the partial image 114 shown in FIG.

[0075] In this embodiment, when the mirror portion 121A located within the setting area 600 moves out of the setting area 600, the image generation unit 112 does not generate a new partial image 114 in which the mirror portion 121A is located in the center 6X, which is an example of a specific location of the partial image 114. When the medical instrument 118 moves out of the set area 600, the image generation unit 112 generates an image to be displayed on the display device 300 when the medical instrument 118 moves out of the set area 600, based on position information about the partial image 114 generated just before the medical instrument 118 moves out of the set area 600.

[0076] Although not described above, every time the video generator 112 generates a partial video 114, it also generates position information for the generated partial video 114. Specifically, the video generation unit 112 generates, as the position information of the partial video 114, information indicating the position of the partial video 114 relative to the shot video 116. More specifically, the image generating unit 112 generates the position information of the partial image 114 by taking the central part 6Y (see FIG. 6) of the shot image 116 as the origin, and generating the position of the partial image 114 relative to this origin as the position information of the partial image 114.

[0077] In this processing example, when the medical instrument 118 (see FIG. 14) moves out of the set area 600, the image generation unit 112 acquires position information about the partial image 114 that it generated just before the medical instrument 118 moved out of the set area 600. Figure 15 (a diagram showing an example of the display format on the display device 300) shows the partial image 114 generated just before the medical instrument 118 leaves the setting area 600, and displayed on the display device 300. In this embodiment, when the medical instrument 118 deviates from the set area 600, position information is acquired about the partial image 114 shown in Fig. 15 that was generated immediately before the deviation. Then, based on this acquired position information, an image to be displayed on the display device 300 when the medical instrument 118 deviates from the set area 600 is generated.

[0078] When the medical instrument 118 is outside the set area 600, the image generating unit 112 obtains an image of the position specified by the obtained position information from the captured image 116 obtained at that time. Then, the image generating unit 112 causes the obtained image to be displayed on the display device 300. As a result, the display device 300 displays an image in which the medical instrument 118 is out of the center 6X of the partial image 114, which is an example of a specific location, as shown in Figure 16 (a diagram showing an example of a partial image 114 displayed on the display device 300).

[0079] In this processing example, partial image 114 resumes following mirror unit 121A when mirror unit 121A returns to within set area 600. In other words, in this case, generation of partial image 114 resumes with mirror unit 121A positioned at center 6X of partial image 114. It is assumed that mirror portion 121A is positioned at center portion 6X of partial image 114 regardless of the position of mirror portion 121A. In this case, even though the mirror unit 121A is far away from the treatment region, the partial image 114 in which the mirror unit 121A is positioned at the center 6X is likely to be generated.

[0080] In this case, the treatment area may be significantly deviated from the center 6X of the partial image 114, making it difficult to confirm the treatment area through the display device 300. In contrast to this, in the above process, when mirror section 121A moves out of set area 600, partial image 114 does not follow mirror section 121A. In this case, compared to when the partial image 114 follows the mirror unit 121A even when the mirror unit 121A moves out of the set area 600, the treatment area is less likely to move far away from the center 6X of the partial image 114.

[0081] In this embodiment, when the medical instrument 118, which is an example of a specific target, is located outside the above-mentioned set area 600, which is an example of a predetermined range, the image generation unit 112 does not change the acquisition position in accordance with the movement of the specific target. In addition, when the moving specific object moves from within this predetermined range to outside this predetermined range, the image generation unit 112 acquires acquisition position information, which is information about the acquisition position of a portion of the image acquired from the captured image 116 when the specific object is located within this predetermined range. Specifically, in this embodiment, as described above, the acquired position information is the position information about the partial image 114 generated by the image generation unit 112 immediately before the medical instrument 118 leaves this predetermined range.

[0082] Then, when the specific target is located outside this predetermined range, the image generating unit 112 acquires the image from the captured image 116 acquired by the image acquiring unit 111 that is located at the position identified by the acquired position information. As a result, in this case, as shown in FIG. 16, the display device 300 displays an image in which the medical instrument 118 is out of the center portion 6X, which is an example of a specific location. Furthermore, when a specific target located outside a predetermined range moves into the predetermined range, the video generating unit 112 changes the acquisition position in accordance with the movement of the specific target. In other words, in this case, the video generator 112 resumes changing the acquisition position in accordance with the movement of the identified target.

[0083] [Generation process according to type] Additionally, the conditions for generating the partial image 114 may be varied depending on the type of medical instrument 118 to be displayed at a specific location on the partial image 114. In other words, the acquisition conditions when the image generating unit 112 acquires the above-mentioned part from the captured image 116 may be different for each type of specific object shown in the captured image 116. Specifically, for example, the conditions for generating the partial image 114 may be changed depending on whether the medical instrument 118 to be displayed at a specific location on the partial image 114 is a handpiece or a dental mirror 121.

[0084] More specifically, for example, the size of the selection area when selecting the image that will be the source of the partial image 114 from the captured image 116 may be changed depending on whether the medical instrument 118 to be displayed at a specific location in the partial image 114 is a handpiece or a dental mirror 121. In other words, the size of the selection area when the video generation unit 112 selects and acquires a part of the captured video 116 may be made different for each type of identification target. In this case, the size of the partial video 114 generated by the video generating section 112 will differ depending on the type of specific target captured in the captured video 116.

[0085] When the size of the partial image 114 differs depending on the type of specific object shown in the photographed image 116, the size of the image cut out from the photographed image 116 differs depending on the type of medical instrument 118. In this embodiment, a portion of the captured video 116 is cut out from the captured video 116 to obtain a partial video 114. If the size of the selection area when selecting the partial video 114 from the photographed video 116 is changed, the size of the partial video 114 cut out from the photographed video 116 will differ depending on the type of medical instrument 118. In this case, the degree of enlargement of the medical instrument 118 displayed on the display device 300 will differ depending on the type of the medical instrument 118 to be displayed in a specific location of the partial image 114.

[0086] When the partial image 114 is displayed on the display device 300, the partial image 114 is enlarged and then displayed at a predetermined fixed size. In this case, if the sizes of the partial images 114 are made different as described above, the degree of enlargement of the partial images 114 when they are actually displayed on the display device 300 will differ for each partial image 114. For example, if the partial image 114 is large, the degree of enlargement when the partial image 114 is displayed on the display device 300 will be small. On the other hand, if the partial image 114 is small, the degree of enlargement of the partial image 114 when it is displayed on the display device 300 will be large.

[0087] To explain this using a specific example, if the medical instrument 118 to be displayed at a specific location in the partial image 114 is a dental mirror 121, the selection area when selecting the partial image 114 from the captured image 116 is made larger than when it is a handpiece, and the generated partial image 114 is made larger. In this case, the degree of enlargement of partial image 114 when it is displayed on display device 300 becomes smaller, and in this case, the degree of enlargement of dental mirror 121 reflected on display device 300 becomes smaller.

[0088] Regarding the dental mirror 121, the practitioner may move the dental mirror 121 in order to examine a plurality of teeth in turn. In this case, if the partial image 114 is small and is enlarged to a large extent when displayed on the display device 300, it may be difficult for the practitioner to see the mirror portion 121A of the dental mirror 121 in the partial image 114. If the degree of magnification is large, mirror portion 121A of dental mirror 121 in partial image 114 is likely to shake, and it may become difficult for the user to visually recognize mirror portion 121A in partial image 114. In contrast to this, if partial image 114 is large and the degree of enlargement of partial image 114 is small, this problem of mirror portion 121A becoming difficult to view is less likely to occur.

[0089] Additionally, for example, the specific location in the partial image 114 where the medical instrument 118 is positioned may be changed depending on the type of medical instrument 118 to be displayed in the partial image 114. More specifically, for example, the specific location where the medical instrument 118 in the partial image 114 is located may be different depending on whether the medical instrument 118 to be displayed in the partial image 114 is a handpiece or a dental mirror 121. For example, if the medical instrument 118 is a handpiece, the specific location may be a location outside the center 6X of the partial image 114, and if the medical instrument 118 is a dental mirror 121, the specific location may be the center 6X of the partial image 114.

[0090] When a viewer such as a dentist views the dental mirror 121, it is equivalent to looking at the treatment area itself, and if the specific location where the dental mirror 121 is positioned is the center 6X of the partial image 114, the viewer can easily see the treatment area. On the other hand, when the medical instrument 118 is a handpiece, it is assumed that the viewer will view the treatment site together with the handpiece. In this case, if the specific location is set to a location outside the center 6X of the partial image 114 as described above, the viewer can easily view both the treatment site and the handpiece through the partial image 114.

[0091] In this process, the position of the specific target differs for each type of specific target when the image generating unit 112 selects and acquires a portion of the captured image 116. More specifically, in this process, the position of the specific target captured in this portion differs for each type of specific target. In other words, the position of the specific target shown in the partial video 114 generated by the video generating section 112 will differ depending on the type of the specific target.

[0092] Additionally, the conditions for generating the partial image 114 may be varied depending on whether the type of object to be displayed in a specific location of the partial image 114 is the medical instrument 118 or the medical site. When the conditions for generating the partial image 114 are varied depending on whether the type of object is a medical instrument 118 or a medical site, for example, when the type of object is a medical site, the area used to cut out the above-mentioned portion from the captured image 116 is made smaller than when the type is a medical instrument 118, and the generated partial image 114 is processed to be smaller. In this case, when the partial image 114 is displayed on the display device 300, the partial image 114 is displayed in a more enlarged state on the display device 300, and the treatment area is displayed in a more enlarged state. Treatment areas such as teeth are less likely to move than the treatment instrument 118. In this case, even if the partial image 114 is displayed on the display device 300 at a high magnification, the teeth in the partial image 114 are less likely to shake.

[0093] [Image generation by camera movement] In the above, we have described a case where the camera 91 itself is not moved, but a portion of the captured image 116 is selected to generate a partial image 114 in which a medical instrument 118 or a medical treatment area is located at a specific location. However, the generation of the image displayed on the display device 300 is not limited to this. For example, the orientation of the camera 91 itself may be changed so that the medical instrument 118 or the treatment area is positioned at a specific location in the image displayed on the display device 300. In this case, a mechanism for changing the orientation of the camera 91 is provided, and the orientation of the camera 91 is changed in response to an instruction from the information processing device 61 . More specifically, the direction of the camera 91 is changed in response to an instruction from the information processing device 61 so that the camera 91 faces the medical instrument 118 or the medical region.

[0094] When this process is performed, a change mechanism is provided as an example of a change means for changing the orientation of the camera 91. This change mechanism is realized by the information processing device 61 that functions as a control unit and a camera driving mechanism provided in correspondence with the camera 91. The camera drive mechanism includes known mechanisms such as motors and cams, and physically changes the orientation of the camera 91 . When a specific object located within the range of photography by camera 91, which is a photography device, moves, the change mechanism changes the direction of camera 91 so that camera 91 faces the specific object.

[0095] When processing to change the orientation of the camera 91 is performed, in the first stage of this processing, the orientation of the camera 91 is set so that the camera 91 first faces the location where the specific target is located. Then, using a known image recognition technique, the image captured by the camera 91 is analyzed to identify the specific target, thereby enabling tracking of the specific target. In this case, when a specific object located within the range of photography by camera 91 moves, the change mechanism changes the orientation of camera 91. As a result, camera 91, which has been facing in a direction other than the specific object, will once again face the specific object.

[0096] In addition, when a partial image 114 showing a medical instrument 118 or a medical area positioned at a specific location is displayed on the display device 300, if the medical instrument 118 or the medical area moves, a new partial image 114 may not be displayed immediately. For example, a new partial image 114 may be generated and displayed on the display device 300 after a predetermined time has elapsed since the medical instrument 118 or the medical area has been moved. In this case, frequent switching of the partial images 114 in accordance with the movement of the medical instrument 118 or the medical region is suppressed. [Explanation of symbols]

[0097] 6X...center section, 61...information processing device, 91...camera, 100...medical device, 111...image acquisition section, 112...image generation section, 114...partial image, 116...captured image, 118...medical instrument, 600...setting area

Claims

1. An image acquisition means for acquiring a captured image, which is an image acquired by photographing the oral cavity of a patient; an image generating means for acquiring a portion of the photographed image in which a specific object is captured from the photographed image, and generating a partial image consisting of the portion, the partial image being an image in which the specific object is captured, the image generating means changing an acquisition position when acquiring the portion from the photographed image in accordance with movement of the specific object; An information processing system comprising:

2. The image generating means changing the acquisition position so that the specific target after movement is positioned at a specific location in the partial image to be generated; The information processing system according to claim 1 .

3. The image generating means changing the acquisition position so that the specific target after movement is positioned at the center of the partial image to be generated; The information processing system according to claim 2 .

4. The image generating means When selecting the portion from the captured image in which the specific object appears before the movement, the portion is selected so that the specific object is located at a specific location in the portion. The information processing system according to claim 1 .

5. The image generating means When selecting the portion from the captured image in which the specific object before movement is captured, the portion is selected so that the specific object is located at the center of the portion. The information processing system according to claim 4 .

6. The image generating means When the specific target is located outside a predetermined range, the acquired position is not changed in accordance with the movement of the specific target. The information processing system according to claim 1 .

7. The image generating means When the moving specific target moves from within the predetermined range to outside the predetermined range, acquired position information is acquired which is information about an acquired position of the part acquired from the photographed video when the specific target is located within the predetermined range; When the specific target is located outside the predetermined range, an image located at a position specified by the acquired position information is acquired from the captured image acquired by the image acquisition means. The information processing system according to claim 6 .

8. The image generating means When the specific target located outside the predetermined range moves into the predetermined range, the acquired position is changed in accordance with the movement of the specific target. The information processing system according to claim 6 .

9. an acquisition condition when the image generating means acquires the portion from the captured image differs depending on the type of the specific target shown in the captured image; The information processing system according to claim 1 .

10. a size of a selection area when the image generation means selects and acquires the portion of the captured image differs for each type of the identified target, a size of the partial image generated by the image generation means differs depending on the type of the specific target shown in the captured image; The information processing system according to claim 9 .

11. a position of the specific target when the image generation means selects and acquires the portion of the photographed image, the position of the specific target in the portion being different for each type of the specific target; a position of the specific target in the partial image generated by the image generating means differs depending on the type of the specific target; The information processing system according to claim 9 .

12. The image generating means selecting an area of ​​the captured image that includes a portion showing a dental treatment tool used in dental treatment, and generating the partial image that is made up of the portion and shows the dental treatment tool; The information processing system according to claim 1 .

13. The image generating means selecting an area of ​​the captured image that includes a portion showing a specific part of the medical instrument, and generating the partial image that is an image consisting of the portion and shows the specific part of the medical instrument; The information processing system according to claim 12.

14. The image generating means selecting an area of ​​the captured image that includes a portion showing the teeth in the oral cavity, and generating the partial image that is an image consisting of the portion and shows the teeth; The information processing system according to claim 1 .

15. An imaging device for photographing the oral cavity of a patient, the imaging device being directed toward a location where a specific object is located; a change means for changing the orientation of the photographing device when the specific object located within a photographing range of the photographing device moves, so that the photographing device faces the specific object; A dental treatment device comprising:

16. an imaging device for photographing the oral cavity of a patient; an image acquisition means for acquiring a captured image, which is an image acquired by the imaging device; an image generating means for acquiring a portion of the photographed image in which a specific object is captured from the photographed image, and generating a partial image made up of the portion, the partial image being an image in which the specific object is captured, the image generating means changing an acquisition position when acquiring the portion from the photographed image in accordance with movement of the specific object; A dental treatment device comprising:

17. an image acquisition function for acquiring a captured image, which is an image acquired by photographing the oral cavity of a patient; an image generation function that acquires a portion of the captured image in which a specific object is captured from the captured image, and generates a partial image that is an image made up of the portion and is an image in which the specific object is captured, and that changes an acquisition position when acquiring the portion from the captured image in accordance with movement of the specific object; A program to make the above happen on a computer.

Images