Image processor, image processing system, method for processing image, and image processing program

Abstract

To provide a technique of dealing with video data properly while protecting privacy according to a content agreed by an imaged person.SOLUTION: An image processor 100 includes: an input unit for receiving input of video data obtained by imaging a patient diagnosed by a dental diagnosis device 1; a storage unit for storing consent content data 130 including a consent content of a patient on usage of video data; and an operation unit for executing image processing according to the consent content data 130 stored in the storage unit on the video data.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to an image processing device, an image processing system, an image processing method, and an image processing program for processing an image. [Background technology]

[0002] Conventionally, in order to protect the privacy of a photographed person, a technique for performing image processing on a face image so as to obscure the face of the person has been known. For example, Patent Document 1 discloses an image processing device that performs mask processing of a substantially rectangular shape on the eye portion of a person shown in a photographed image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-278325 A Summary of the Invention [Problem to be solved by the invention]

[0004] The image processing device disclosed in Patent Document 1 makes it possible to protect the privacy of the person who is photographed. However, since ideas about privacy protection differ from person to person, it is important to handle video data appropriately while protecting the privacy according to the content of the consent regarding privacy protection of the person who is photographed.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a technology for appropriately handling video data while protecting the privacy of the people being filmed in accordance with their consent. [Means for solving the problem]

[0006] The image processing device of the present disclosure includes an input unit for inputting video data obtained by photographing a patient being treated by a dental treatment device, a memory unit for storing consent content data including the patient's consent regarding the use of the video data, and a calculation unit for performing image processing on the video data in accordance with the consent content data stored in the memory unit.

[0007] The image processing system according to the present disclosure includes a dental diagnostic device, a camera, and an image processing device that performs image processing on video data obtained by the camera capturing an image of a patient being treated by the diagnostic device. The image processing device includes an input unit to which the video data is input, a storage unit that stores consent content data including the patient's consent regarding the use of the video data, and a calculation unit that performs image processing on the video data according to the consent content data stored in the storage unit.

[0008] The image processing method of the present disclosure includes, as processing executed by a computer, a step of receiving video data obtained by photographing a patient being treated using a dental treatment device, a step of storing consent content data including the patient's consent regarding the use of the video data, and a step of performing image processing on the video data in accordance with the consent content data stored in the storing step.

[0009] The image processing program of the present disclosure causes a computer to execute the steps of receiving video data obtained by photographing a patient being treated using a dental treatment device, storing consent content data including the patient's consent regarding the use of the video data, and performing image processing on the video data in accordance with the consent content data stored in the storing step. Effect of the Invention

[0010] According to the present disclosure, image processing is performed on video data in accordance with the consent of the patient being treated by the dental treatment device regarding the use of the video data, thereby enabling the video data to be handled appropriately while protecting the privacy of the patient who was filmed in accordance with the consent of the patient. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic diagram showing an overall configuration of an image processing system according to a first embodiment. [Diagram 2] FIG. 11 is a diagram for explaining an example of an image captured by the overall camera. [Diagram 3] FIG. 13 is a diagram for explaining an example of an image captured by a patient camera. [Figure 4] FIG. 2 is a diagram for explaining an example of an image captured by a rear camera. [Diagram 5] 1 is a block diagram showing an internal configuration of an image processing system according to a first embodiment. [Figure 6] FIG. 11 is a diagram for explaining an example of consent content data. [Figure 7] 13 is a diagram illustrating an example of a video corresponding to consent A. FIG. [Figure 8] 13 is a diagram illustrating an example of a video corresponding to consent B. [Figure 9] 13 is a diagram illustrating an example of a video corresponding to consent C. [Figure 10] 4 is a flowchart of image processing executed by the image processing device according to the first embodiment. [Figure 11] 11 is a flowchart of image processing executed by an image processing device according to the second embodiment. [Figure 12] 11 is a flowchart of image processing executed by an image processing device according to the third embodiment. [Figure 13] 13 is a flowchart of image processing executed by an image processing device according to embodiment 4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Embodiment 1> A first embodiment of the present disclosure will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference characters and description thereof will not be repeated.

[0013] [Overall configuration of image processing system] The overall configuration of an image processing system 1000 according to embodiment 1 will be described with reference to Fig. 1 to Fig. 4. Fig. 1 is a schematic diagram showing the overall configuration of an image processing system 1000 according to embodiment 1. As shown in Fig. 1, the image processing system 1000 includes a medical examination device 1 and an image processing device 100.

[0014] The medical treatment device 1 is, for example, a chair unit for an operator to perform dental treatment on a patient. The "treatment" includes at least one of examination and treatment of a patient performed by a dental medical professional (hereinafter also referred to as "operator") such as a dentist, a dental assistant, a professor at a dental university, a student at a dental university, and a dental technician. In the first embodiment, the content of the treatment is also referred to as "treatment content". The "examination" includes the operator's exploration of the patient's dental-related condition and cause of the disease. In the present embodiment, the content of the examination is also referred to as "examination content". The "treatment" includes the operator's curing of a patient's dental-related disease and the operator's maintaining the beauty and health of the patient's teeth (aesthetic treatment). In the first embodiment, the content of the treatment is also referred to as "treatment content". The "treatment content" includes at least one of the "examination content" and the "treatment content". Actions (treatments) taken by a practitioner to cure a patient's dental disease and actions (treatments) taken by a practitioner to maintain the beauty and health of the patient's teeth are also referred to as treatments, and a treatment is composed of a combination of one or more treatments. In this embodiment, the content of a treatment is also referred to as "treatment content." "Treatment content" includes one or more "treatment contents."

[0015] Examples of treatment contents include caries treatment, root canal treatment, plaque removal, implants, orthodontics, and whitening, but any treatment contents that the surgeon performs to cure a patient's dental disease and any aesthetic treatment contents that the surgeon performs to maintain the beauty and health of the patient's teeth are included in the treatment contents. Examples of procedures include examination, cutting, filing, root canal cleaning, drying, temporary filling, impression, scaling, prosthetic correction, periodontal pocket measurement, suction, and tooth extraction, but any treatment contents that the surgeon performs to cure a patient's dental disease and any aesthetic treatment contents that the surgeon performs to maintain the beauty and health of the patient's teeth are included in the treatment contents.

[0016] For example, root canal treatment is necessary when the dental pulp (nerves, blood vessels, etc.) inside the tooth root becomes inflamed or infected due to the progression of caries, and involves removing the damaged dental pulp, cleaning and disinfecting the root canal, and filling the tooth root to prevent re-infection. Root canal treatment consists of examination, pulp removal, root canal length measurement, cleaning and disinfection, root canal filling, and filling and capping, and the surgeon can perform root canal treatment on the patient by performing each of these procedures in order.

[0017] Examination is a procedure in which the surgeon interviews the patient and examines the patient's oral cavity to identify the patient's dental condition and the cause of the disease and to formulate a treatment plan. Pulp removal is a procedure in which the damaged pulp is removed in root canal treatment. Root canal length measurement is a procedure in which the length of the hollow root canal is measured after the pulp is removed. Cleaning and disinfection is a procedure in which the hollow root canal is cleaned to the back and disinfected. Root canal filling is a procedure in which a special drug is filled into the root canal to prevent bacteria from entering the root canal after cleaning and disinfection. Filling and capping is a procedure in which a rubber-like filling material is filled into the root canal, a metal or fiber base is made on top of it, and a cap (crown) is placed on the base.

[0018] The medical treatment device 1 includes a chair 11, a basin unit 12, a tray table 13, an instrument holder 14 for holding a medical treatment instrument 15, a foot controller 16, a display 17, an operation panel 18, a lighting device (operating light) 19, an instrument control device 21, a display control device 22, and a speaker 35.

[0019] The chair 11 is a treatment chair on which a patient sits or lies during treatment. The chair 11 includes a headrest 11a for supporting the patient's head, a backrest 11b for supporting the patient's back, a seat 11c for supporting the patient's buttocks, and a footrest 11d for supporting the patient's feet. The treatment device 1 may include a treatment table on which a patient lies, instead of the chair 11.

[0020] The basin unit 12 is a water supply / drainage device including a basin 12a with a drainage hole formed therein, a cup stand 12b on which a cup is placed, and a water faucet 12c for supplying water to the cup.

[0021] The tray table 13 is used as a storage table during medical treatment. The tray table 13 is connected to an arm (not shown) extending from the chair 11 or the floor on which the chair 11 is placed. The tray table 13 may be suspended by an arm (not shown) extending from the chair 11 or the floor on which the chair 11 is placed. For example, the tray table 13 may be suspended by an arm 6 branching off from an upper portion of a pole 5 extending from the chair 11 or the floor on which the chair 11 is placed. The surgeon can manually rotate, move horizontally, and move vertically the tray table 13 relative to the chair 11. During medical treatment, the surgeon may place a tray 30 on the upper surface of the tray table 13. One or more medical instruments for treating a patient are placed on the tray 30.

[0022] The "medical instruments" are instruments used by the surgeon during treatment, such as a rubber dam moisture-proof set, a rubber dam sheet, a root canal length measuring device, a bur set, a file (reamer), an oral corner counter electrode, a false clip, a broach, a cleaning needle, a cleaning syringe, a temporary filling material filling device, a cleanser, a turbine, tweezers, a vacuum, a mirror, an excavator, a probe, and a root canal material injector. The "medical instruments" include the medical instruments 15 held by the instrument holder 14 of the medical device 1, but the tray 30 mainly contains medical instruments that are not held by the instrument holder 14.

[0023] The medical instruments 15 are dental instruments such as an air turbine handpiece, a micromotor handpiece, an ultrasonic scaler, and a vacuum syringe, and are driven under the control of the instrument control device 21. Note that the medical instruments 15 are not limited to these, and may be an intraoral camera, a photopolymerization irradiator, a root canal length measuring instrument, a three-dimensional scanner, a root canal enlarger, or a non-driven instrument such as a mirror, a syringe, and a filling instrument.

[0024] The foot controller 16 has a number of switches (pedals) that accept the foot operation of the surgeon. The surgeon can assign a predetermined function to each of the switches. For example, the surgeon can assign a function to change the state of the chair 11 to a switch of the foot controller 16, and when the foot controller 16 accepts the foot operation of the switch by the surgeon, the headrest 11a and the like are driven based on the foot operation. Furthermore, the surgeon can also assign a function to drive the medical instrument 15 to a switch of the foot controller 16, and when the foot controller 16 accepts the foot operation of the switch by the surgeon, the medical instrument 15 is driven by the control of the instrument control device 21 based on the foot operation. The surgeon can also assign other functions to the switch of the foot controller 16, such as a function to control the lighting and turning off of the lighting device 19.

[0025] The display 17 is attached to the tray table 13 and displays various images under the control of a display control device 22 .

[0026] The operation panel 18 includes switches for operating the chair 11 and the medical instrument 15, etc., or for setting the operations. For example, when the operation panel 18 receives an input operation for operating the chair 11, the chair 11 operates based on the input operation. For example, when the operation panel 18 receives an input operation for setting the rotation speed, etc., of the medical instrument 15, the rotation speed, etc. of the medical instrument 15 can be set based on the input operation.

[0027] The lighting device 19 is provided at the tip of an arm 6 that branches off at the top of the chair 11 or the pole 5 that extends from the floor on which the chair 11 is placed. The lighting device 19 can be switched between a lighted state and an off state, and supports the surgeon's medical treatment by irradiating light mainly onto the inside of the patient's oral cavity. The surgeon can change the position of the lighting device 19 by moving the arm. It should be noted that not only the lighting device 19 but also the display 17 may be attached to the tip of the pole 5 or the arm 6.

[0028] The speaker 35 outputs various sounds, such as sounds that alert the surgeon and the patient, and assist sounds that assist medical treatment.

[0029] Furthermore, the image processing system 1000 includes a microphone 60 , a display 110 , and an input device 120 .

[0030] The microphone 60 collects voices of the patient, the surgeon, etc. during medical treatment. Voice data indicating the voices collected by the microphone 60 is acquired by the image processing device 100.

[0031] The display 110 is connected to the image processing device 100 and displays various images under the control of the image processing device 100 .

[0032] The input device 120 is connected to the image processing device 100 and is an interface for a user such as an operator to input various data to the image processing device 100. For example, the input device 120 includes a keyboard or a mouse. Note that the input device 120 may be an information terminal capable of communicating with the image processing device 100, such as a smartphone, a smart watch, a wearable device, or a tablet PC.

[0033] By using the medical treatment device 1 configured as described above, the practitioner can perform dental treatment on the patient. Here, the image processing system 1000 is configured to capture images of the practitioner and the patient during dental treatment, and accumulate and store video data including images obtained by capturing images (hereinafter also referred to as "captured images"). By accumulating and saving the video data during treatment, accidents that occur during treatment can be recorded, and the captured images can also be used as teaching materials for dental treatment.

[0034] Specifically, the image processing system 1000 includes a tray camera 51 attached to the display 17, an overall camera 52 attached to the top of the pole 5, a patient camera 53 attached to the lighting device 19, and a rear camera 54 attached to the back of the chair 11.

[0035] The tray camera 51 is disposed so as to capture a video or still image of an area including at least the tray 30. Video data including the captured image obtained by the tray camera 51 (hereinafter also referred to as "tray video data") is acquired by the image processing device 100. Various settings of the tray camera 51, such as the shutter speed, are adjusted in advance to an extent that the image processing device 100 can recognize the presence, shape, and type of medical instruments placed on the tray 30, and the positions of the medical instruments in the capture area of ​​the tray camera 51. The tray camera 51 may be installed anywhere as long as it can capture an image of an area including at least the tray 30.

[0036] The overall camera 52 is disposed so as to capture, as a moving image or a still image, an area including at least the treatment space including the medical treatment apparatus 1. Specifically, the overall camera 52 is disposed so as to capture, as a moving image or a still image, a wide area including at least the dentist, dental assistant, and patient in the treatment space during treatment using the medical treatment apparatus 1. Since the overall camera 52 is attached to the upper part of the pole 5, it captures an overhead view of the actions of the dentist, dental assistant, and patient during treatment, and the operation of the medical treatment apparatus 1.

[0037] Fig. 2 is a diagram for explaining an example of an image captured by the overall camera 52. As shown in Fig. 2, an area including at least the treatment space is captured by the overall camera 52. During treatment, a dental treatment is performed by an operator using treatment tools, and the image captured by the overall camera 52 shows the behavior of the operator (dentist 3 or dental assistant 4) during treatment, the behavior of the patient 2, the type of treatment tool being used, the position of the treatment tool, the operation of the treatment device 1, and the like.

[0038] The "treatment space" is not limited to a space including all of the objects included in the treatment space, but may be a space including some of the objects included in the treatment space, such as the surgeon, the patient, and the treatment device 1 during treatment. Video data including images captured by the overall camera 52 (hereinafter also referred to as "overall video data") is acquired by the image processing device 100. Various settings of the overall camera 52, such as the shutter speed, are adjusted in advance to an extent that the image processing device 100 can recognize the actions of the surgeon, such as the dentist or dental assistant, the actions of the patient, and the operation of the treatment device 1 during treatment.

[0039] The overall camera 52 may be installed anywhere as long as it can capture an image of at least an area including the examination space where the patient is examined. The overall camera 52 may be a depth camera that can recognize the examination space in a plane and also in a depth direction. The overall camera 52 may be a 360-degree camera that can capture the examination space in all directions. Furthermore, the overall camera 52 may be capable of tracking a subject to be captured (e.g., a person such as a surgeon or a patient) present in the examination space.

[0040] The patient camera 53 is positioned so as to capture video or still images of an area including at least the inside of the patient's mouth. Normally, during medical treatment, the lighting device 19 is positioned in front of the patient's face, so the patient camera 53 attached to the lighting device 19 can naturally capture an image of an area including the patient's face from the front. Video data including images captured by the patient camera 53 (hereinafter also referred to as "patient video data") is acquired by the image processing device 100. Various settings of the patient camera 53, such as the shutter speed, are adjusted in advance to an extent that the image processing device 100 can recognize the inside of the patient's mouth during medical treatment.

[0041] Fig. 3 is a diagram for explaining an example of an image captured by patient camera 53. As shown in Fig. 3, an area including at least the face of patient 2 is captured by patient camera 53. During treatment, dental treatment is performed using dental instruments in the patient's oral cavity, and the image captured by patient camera 53 shows the patient's face and the surrounding situation during treatment.

[0042] The patient camera 53 may be installed anywhere as long as it can capture an image of at least an area including the inside of the patient's oral cavity. The patient camera 53 may be capable of detecting three-dimensional position coordinates in the same manner as the whole camera 52 so that the image processing device 100 can detect the positional relationship between the area around the oral cavity and the medical instruments in the depth direction (for example, the direction in which the patient is viewed from the patient camera 53).

[0043] The rear camera 54 is disposed so as to capture a moving or still image of an area including at least the patient sitting on the chair 11 from the rear of the chair 11 of the medical treatment device 1. Video data including the imaging information obtained by the rear camera 54 (hereinafter also referred to as "rear video data") is acquired by the image processing device 100. Various settings of the rear camera 54, such as the shutter speed, are adjusted in advance to an extent that the image processing device 100 can recognize the patient sitting on the chair 11 and the surroundings of the chair 11.

[0044] Fig. 4 is a diagram for explaining an example of an image captured by the rear camera 54. As shown in Fig. 4, the rear camera 54 captures an image of an area including at least the patient 2 positioned on the chair 11 from the back of the chair 11. During treatment, the practitioner performs dental treatment using medical instruments, and the image captured by the rear camera 54 shows the behavior of the practitioner (dentist 3 or dental assistant 4) during treatment, the behavior of the patient 2, the type of medical instrument being used, the position of the medical instrument, the operation of the medical device 1, and the like.

[0045] The above-mentioned tray video data, overall video data, patient video data, and rear video data are collectively referred to as "video data." Note that the term "video data" may mean all of the tray video data, overall video data, patient video data, and rear video data, or may mean at least one of the tray video data, overall video data, patient video data, and rear video data.

[0046] Furthermore, the image processing device 100 is configured to estimate the treatment contents or medical treatment contents using data on images captured during treatment and an estimation model including a neural network that has been machine-learned. Specifically, there is a demand for practitioners to accurately and easily grasp the treatment contents for patients. For example, dentists are required to record the progress of patients without delay after treating them. However, dentists are also required to treat patients efficiently in a short time, so they may not be able to record the treatment contents or medical treatment contents performed during treatment each time. In recent years, technology has been developed that uses AI (Artificial Intelligence) to analyze and learn data, and if dental treatment contents can be estimated using AI technology, the treatment contents can be estimated accurately and easily, and more convenient dental treatment can be realized.

[0047] Here, as a feature unique to dental treatment, the surgeon performs various actions during treatment, such as combining multiple procedures according to the purpose of treatment, selecting an appropriate medical instrument from multiple medical instruments for each treatment, and taking it out of the tray 30 to use it. The order in which the medical instruments are used and their types can also be said to represent the contents of the treatment during treatment. Furthermore, since there is a hierarchical structure in which the treatment contents are represented by the combination of multiple treatment contents, it is possible to estimate the treatment contents by understanding the hierarchy.

[0048] For example, the image processing device 100 can identify the presence, shape, type, and position of medical instruments placed on the tray 30 by analyzing tray video data corresponding to the image captured by the tray camera 51 using image recognition or the like.

[0049] The image processing device 100 can analyze the overall video data corresponding to the image captured by the overall camera 52 using image recognition or the like, thereby identifying the behavior of the surgeon during the examination, the behavior of the patient, the type of medical instruments being used, the position of the medical instruments, and the operation of the medical device 1.

[0050] The image processing device 100 can analyze patient video data corresponding to images captured by the patient camera 53 using image recognition or the like, thereby identifying the behavior of the surgeon during treatment, the behavior of the patient, the type of medical instruments being used, and the position of the medical instruments.

[0051] The image processing device 100 can analyze rear video data corresponding to the image captured by the rear camera 54 using image recognition or the like, thereby identifying the behavior of the surgeon during treatment, the behavior of the patient, the type of medical instruments being used, the position of the medical instruments, and the operation of the medical device 1.

[0052] The image processing system 1000 (image processing device 100) is configured to estimate the treatment details or medical treatment details by analyzing and learning the operation of the tray 30 and the medical treatment device 1, the behavior of the surgeon, and the behavior of the patient based on the tray video data, overall video data, patient video data, and back video data using AI.

[0053] In order to estimate the contents of medical treatment, it is necessary to perform machine learning on an estimation model including a neural network provided in the image processing device 100 using images taken during medical treatment. For this purpose, images are taken of not only test patients but also patients who actually visit a dental clinic. It is important to protect the privacy of the photographed patients, but the way of thinking about privacy protection varies from person to person. For example, some patients agree to be photographed during medical treatment, while others agree to be photographed if the photographed images are processed in such a way that the individual cannot be identified, such as by mosaic processing. Therefore, as described below, the image processing device 100 is configured to protect the privacy of the photographed patients according to their thoughts.

[0054] [Internal configuration of image processing system] The internal configuration of the image processing system 1000 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the internal configuration of the image processing system 1000 according to the first embodiment. As shown in Fig. 5, the image processing system 1000 includes a medical examination device 1, an image processing device 100, a plurality of cameras (a tray camera 51, a whole view camera 52, a patient camera 53, and a rear view camera 54), a microphone 60, a display 110, an input device 120, and a server device 200.

[0055] The medical treatment device 1 includes a chair 11, an instrument control device 21, a display control device 22, a sound control device 32, and a basin unit 12. Inside the medical treatment device 1, the chair 11, the instrument control device 21, the display control device 22, the sound control device 32, and the basin unit 12 can transmit and receive data via CAN (Controller Area Network) communication. The medical treatment device 1 can also transmit and receive data to and from the image processing device 100 via wired or wireless LAN (Local Area Network) communication, for example, WiFi communication. The medical treatment device 1 may also transmit and receive data to and from the image processing device 100 via communication via a USB (Universal Serial Bus) connection.

[0056] The chair 11 includes a headrest 11a, a backrest 11b, a seat 11c, and a footrest 11d, each of which is driven under the control of the chair control unit 111. Specifically, when the chair control unit 111 receives control data based on the operation of the surgeon accepted by the foot controller 16 or the operation panel 18, or control data from the image processing device 100, the chair control unit 111 raises or lowers the seat 11c, and moves the headrest 11a, the backrest 11b, and the footrest 11d vertically or horizontally relative to the seat 11c, based on the control data. When the headrest 11a, the backrest 11b, and the footrest 11d are positioned vertically relative to the seat 11c, the chair 11 is in an upright state. This allows the patient to sit on the chair 11. When the headrest 11a, the backrest 11b, and the footrest 11d are positioned horizontally relative to the seat 11c, the chair 11 is inclined. As a result, the patient lies on his / her back in the chair 11. In this manner, the chair control unit 111 drives the headrest 11a, the backrest 11b, the seat 11c, and the footrest 11d to change the position of the chair 11.

[0057] The instrument control device 21 includes an instrument control unit 211. When the instrument control unit 211 receives control data based on the operation of the surgeon accepted by the foot controller 16 or the operation panel 18, or control data from the image processing device 100, the instrument control unit 211 controls the drive or setting contents of the medical instrument 15 based on the control data. For example, when the surgeon operates a switch for driving the air turbine handpiece in the foot controller 16 with his / her foot, the instrument control device 21 rotates a cutting tool held in a head part of the air turbine handpiece. For example, when the image processing device 100 outputs control data for controlling the rotation direction or rotation speed of the air handpiece, the instrument control device 21 sets the rotation direction or rotation speed of the air turbine handpiece based on the control data. In this way, the instrument control device 21 controls the drive of the medical instrument 15 based on the operation of the foot controller 16 or the operation panel 18 by the surgeon.

[0058] The display control device 22 includes a display control unit 221 and a panel control unit 222. When the display control unit 221 receives control data from the image processing device 100, it controls the display 17 based on the control data. When the panel control unit 222 receives control data based on the control of the image processing device 100, it controls the operation panel 18 based on the control data.

[0059] The sound control device 32 includes a sound control unit 321. When the sound control unit 321 receives control data from the image processing device 100, it controls the speaker 35 based on the control data.

[0060] The basin unit 12 includes a basin control unit 121 and an illumination control unit 122. Upon receiving control data from the image processing device 100, the basin control unit 121 controls the water supply and drainage in the basin unit 12 based on the control data. Upon receiving control data from the image processing device 100, the illumination control unit 122 controls the lighting and extinguishing of the illumination device 19 based on the control data.

[0061] Each of the chair control unit 111, the instrument control unit 211, the display control unit 221, the panel control unit 222, the sound control unit 321, the basin control unit 121, and the lighting control unit 122 described above is configured with a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random access memory) mounted on a board (not shown). Each of the chair control unit 111, the instrument control unit 211, the display control unit 221, the panel control unit 222, the sound control unit 321, the basin control unit 121, and the lighting control unit 122 may be provided in advance in the medical treatment device 1, or may be modularized so that they can be optionally attached to the medical treatment device 1.

[0062] In the CAN communication in each of the chair control unit 111, the appliance control unit 211, the display control unit 221, the panel control unit 222, the sound control unit 321, the basin control unit 121, and the lighting control unit 122, medical care-related data including log data in each control unit is converted into communication packets, and communication is performed between the control units. Note that in the communication between the control units, the medical care-related data does not necessarily have to be converted into communication packets as long as the medical care-related data is transmitted and received.

[0063] The "medical treatment related data" includes at least one of past and present control data of at least one of the chair 11, the basin unit 12, the lighting device 19, the instrument control device 21, the display control device 22, the medical treatment device 15, the foot controller 16, the display 17, and the operation panel 18 included in the medical treatment device 1. For example, as described above, the "medical treatment related data" includes log data indicating the history of operation and control of each of the chair 11, the basin unit 12, the lighting device 19, the instrument control device 21, the display control device 22, the medical treatment device 15, the foot controller 16, the display 17, and the operation panel 18 included in the medical treatment device 1. Note that the "medical treatment related data" is not limited to the history data of operation and control of each of the various devices as in the log data, but may also include real-time data of operation and control of each of the various devices. Furthermore, the "medical treatment related data" may include data regarding the current status of each of the various devices. For example, the "medical treatment related data" may include data for identifying the current state (posture, position, etc.) of the chair 11.

[0064] The basin unit 12 includes a storage unit 123 that stores medical-related data including log data within the medical device 1, and a communication unit 124 for outputting the medical-related data stored by the storage unit 123 to the image processing device 100 via communication.

[0065] The storage unit 123 collects and stores medical care-related data from each control unit by communicating via CAN with the chair control unit 111, the instrument control unit 211, the display control unit 221, the panel control unit 222, the sound control unit 321, the basin control unit 121, and the lighting control unit 122. The storage unit 123 may be configured with a memory such as a ROM or RAM mounted on a board (not shown), or may be configured with a non-volatile storage medium such as a memory card.

[0066] The communication unit 124 communicates with the image processing device 100 via wired or wireless LAN communication, or USB connection. When the storage unit 123 is configured with a non-volatile storage medium such as a memory card, the image processing device 100 may acquire medical care-related data stored in the storage medium via the communication unit 124 of the medical care device 1 by the communication device 103. The image processing device 100 may also directly acquire medical care-related data flowing in CAN communication via a volatile storage medium that temporarily stores the data.

[0067] The image processing device 100 includes a calculation device 101, a memory 102, a communication device 103, an input / output interface 104, and a storage device 105. The image processing device 100 may be configured as a general-purpose computer connected to each medical device 1, such as a desktop PC (Personal Computer) or a laptop PC, or may be configured as an in-hospital server installed in the medical space, or an out-of-hospital server installed outside the medical space.

[0068] The arithmetic device 101 is an arithmetic entity (computer) that executes various processes by executing various programs, and is an example of a "arithmetic unit." The arithmetic device 101 is configured with a processor such as a central processing unit (CPU) or a micro-processing unit (MPU). The processor, which is an example of the arithmetic device 101, has a function of executing various processes by executing a program, but some or all of these functions may be implemented using a dedicated hardware circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The "processor" is not limited to a processor in the narrow sense that executes processes using a stored program method such as a CPU or an MPU, but may include a hardwired circuit such as an ASIC or an FPGA. For this reason, the "processor," which is an example of the arithmetic device 101, may be read as a processing circuitry in which processing is defined in advance by computer-readable code and / or a hardwired circuit. The arithmetic device 101 may be configured with one chip or multiple chips. Furthermore, the processor and associated processing circuitry may be implemented as multiple computers interconnected by wire or wirelessly, such as via a local area network or wireless network. The processor and associated processing circuitry may be implemented as a cloud computer that performs remote calculations based on input data and outputs the results of the calculations to other devices at remote locations.

[0069] The memory 102 has a volatile storage area (for example, a working area) that temporarily stores program codes or work memory when the arithmetic device 101 executes various programs. An example of the memory 102 is a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The arithmetic device 101 may be a microcomputer including a memory.

[0070] The communication device 103 acquires medical-related data from the medical device 1 by communicating with the medical device 1 through wired or wireless LAN communication or USB connection. The communication device 103 may acquire medical-related data from the medical device 1 in other formats. For example, as described above, when the storage unit 123 is configured with a non-volatile storage medium such as a memory card, the image processing device 100 may acquire medical-related data stored in the storage medium by the communication device 103 via the communication unit 124 of the medical device 1. Furthermore, the communication device 103 exchanges various data with the server device 200 through wired or wireless LAN communication. For example, the communication device 103 outputs to the server device 200 video data acquired from each of the multiple cameras (tray camera 51, overall camera 52, patient camera 53, and rear camera 54), or video data after image processing in which image processing has been applied to the video data.

[0071] The input / output interface 104 is an interface for inputting and outputting various data between each of the multiple cameras (tray camera 51, overall camera 52, patient camera 53, and rear camera 54), the microphone 60, and the display 110, and is an example of an "input unit" and an "output unit". For example, the input / output interface 104 acquires video data from each camera by communicating with each camera through wired or wireless LAN communication or USB connection. The input / output interface 104 may acquire video data from each camera in other formats. For example, the input / output interface 104 may acquire video data temporarily recorded on a non-volatile recording medium such as a memory card removed from each camera. The input / output interface 104 also acquires voice data indicating the collected voices of the patient and the surgeon during the medical treatment by communicating with the microphone 60. Furthermore, the input / output interface 104 outputs control data for controlling the display 110 from the arithmetic device 101 to the display 110 by communicating with the display 110.

[0072] The storage device 105 has a non-volatile storage area for storing various programs executed by the arithmetic device 101 or various data, and is an example of a "storage unit." The storage device may be one or more non-transitory computer readable media, or may be one or more computer readable storage media. Examples of the storage device include a hard disk drive (HDD) and a solid state drive (SSD).

[0073] The storage device 105 stores the consent content data 130 and the image processing program 150. Although not shown, the storage device 105 may store the above-mentioned estimation model. The arithmetic device 101 can estimate the medical care contents of the patient using the estimation model by inputting at least one of the video data acquired from each camera and the medical care-related data acquired from the medical care device 1 into the estimation model. The estimation model can improve the estimation accuracy of the medical care contents of the patient by optimizing the parameters used in the processing in the neural network based on teacher data (for example, a set of the video data, the medical care-related data, and the medical care contents as the correct answer data).

[0074] The consent content data 130 includes the consent content of the patient regarding the use of video data obtained by photographing the patient being treated by the medical treatment device 1. Specifically, before treating the patient using the medical treatment device 1, the surgeon asks the patient for consent to photographing the surgeon and the patient during dental treatment using the overall camera 52, the patient camera 53, and the back camera 54, and to the protection of privacy regarding the handling of the video data obtained by the photographing. The surgeon inputs the content of the agreement (consent content) between the surgeon and the patient into the image processing device 100 using the input device 120. The consent content of the patient regarding the use of the video data input in this manner is stored in the storage device 105 as consent content data 130.

[0075] The image processing program 150 is a program for causing the arithmetic device 101 to execute image processing according to the consent content data 130 stored in the storage device 105 for video data acquired from each camera.

[0076] Specifically, the arithmetic device 101 executes the image processing program 150 to store the video data acquired from each camera in the storage device 105 without processing it, or to output it to the server device 200. The arithmetic device 101 also executes the image processing program 150 to process the video data acquired from each camera so that at least the shape of the patient's eyes contained in the image of the video data becomes unclear, and then stores the video data in the storage device 105 or outputs it to the server device 200. Note that "processing" includes any processing that processes an image so that at least the shape of the patient's eyes becomes unclear, such as, for example, a process of mosaic-ing a part including at least the patient's eyes, a process of blurring the image, a process of masking the part, a process of reducing the luminance or illuminance of the part, and a process of changing the brightness (tone) of the part. Note that the "part" may include at least the patient's eyes (one eye or both eyes), and may also include other parts of the patient, such as ears, nose, and eyebrows. Furthermore, by executing the image processing program 150, the computing device 101 selects only video data (e.g., tray video data) that is composed of images that do not include the patient's face from the video data acquired from each camera, and stores only that video data in the storage device 105 or outputs it to the server device 200.

[0077] In this way, "image processing" includes storing or externally outputting the video data acquired from each camera without processing it, storing or externally outputting the video data acquired from each camera after processing it, and selecting and storing or externally outputting a portion of the video data acquired from each camera. Note that, among "image processing", the processing of the video data acquired from each camera may include a plurality of processes with different degrees of processing according to the consent content data 130 stored in the storage device 105. For example, the computing device 101 may vary the fineness of the mosaic applied to at least the parts including the patient's eyes, or may vary the luminance, illuminance, or brightness (tone) of the parts, according to the consent content data 130 stored in the storage device 105.

[0078] The server device 200 is an in-hospital server installed in the medical space, an out-of-hospital server installed outside the medical space, or a cloud computer configured to be able to communicate with each of the multiple image processing devices 100. The server device 200 accumulates and stores video data of multiple cameras (tray camera 51, overall camera 52, patient camera 53, and rear camera 54) acquired from the image processing device 100, or video data after image processing performed by the arithmetic device 101 on the video data.

[0079] [An example of a video based on the consent] An example of a moving image according to the patient's consent content generated by the image processing device 100 according to the first embodiment will be described with reference to Fig. 6 to Fig. 9. Fig. 6 is a diagram for explaining an example of consent content data 130. As shown in Fig. 6, the consent content data 130 includes a patient ID, face authentication data, voice authentication data, and consent content.

[0080] The patient ID is identification information assigned to a patient registered in the image processing system 1000, and is used by a user such as an operator to identify the patient.

[0081] The face authentication data is data of a captured image of the patient's face registered in the image processing system 1000, and is used by the image processing device 100 to authenticate the patient. The face authentication data is associated with each patient ID. From the viewpoint of protecting the privacy of the patient, it is preferable that the surgeon obtains the patient's consent in advance regarding storing the face authentication data for face authentication in the storage device 105.

[0082] The voice authentication data is voice data indicating the voice of a patient registered in the image processing system 1000, and is used by the image processing device 100 to authenticate the patient. The voice authentication data is associated with each patient ID. From the viewpoint of protecting the privacy of the patient, it is preferable that the surgeon obtains the patient's consent in advance regarding storing the voice authentication data for voice authentication in the storage device 105.

[0083] The consent contents include contents related to the level of protection of the patient's privacy regarding imaging. Specifically, three types of identification information, consent A, consent B, and consent C, are provided as identification information for identifying the consent contents, and in the consent content data 130, one of consent A, consent B, and consent C is associated with each patient ID.

[0084] The contents of the agreement corresponding to agreement A include not processing (image processing) the patient's eyes, etc., included in the image of the video data obtained by photographing the patient. When the patient selects agreement A, the image processing device 100 stores the video data of the patient acquired from each camera in the storage device 105 without processing it. Alternatively, the image processing device 100 outputs the video data of the patient acquired from each camera to the server device 200 without processing it. The server device 200 stores the unprocessed video data acquired from the image processing device 100.

[0085] Furthermore, if the patient selects consent A, the image processing device 100 outputs the video data of the patient acquired from each camera during the medical examination without processing it to the display 110. The display 110 displays the video during the medical examination based on the unprocessed video data acquired from the image processing device 100.

[0086] For example, Fig. 7 is a diagram for explaining an example of a video corresponding to consent A. As shown in Fig. 7, when a patient selects consent A, a video of the medical treatment in raw image mode is displayed on display 110 together with an image showing the consent content selected by the patient (in this example, consent A). In raw image mode, the appearance of the patient and the surgeon being photographed by each of tray camera 51, overall camera 52, patient camera 53, and rear camera 54 is displayed on display 110 without any processing such as mosaic being applied to the patient.

[0087] The consent content corresponding to consent B includes processing the eyes of the patient so that the shape of at least the patient's eyes included in the image of the video data obtained by photographing the patient becomes unclear. When the patient selects consent B, the image processing device 100 processes the eyes of the patient's video data acquired from each camera so that the shape of at least the patient's eyes included in the image of the video data becomes unclear, and then stores the processed video data in the storage device 105. Alternatively, the image processing device 100 processes the eyes of the patient's video data acquired from each camera so that the shape of at least the patient's eyes included in the image of the video data becomes unclear, and then outputs the processed video data to the server device 200. The server device 200 stores the processed video data acquired from the image processing device 100. Alternatively, the image processing device 100 outputs the video data of the patient acquired from each camera and consent data indicating the consent content corresponding to consent B to the server device 200. Based on the consent content of consent B, the server device 200 processes the eyes of the patient's video data acquired from the image processing device 100 so that the shape of at least the patient's eyes included in the image of the video data becomes unclear, and stores the processed video data.

[0088] Furthermore, if the patient selects consent B, the image processing device 100 processes video data of the patient acquired from each camera during the medical examination, and outputs the video data to the display 110. The display 110 displays the video during the medical examination based on the processed video data acquired from the image processing device 100.

[0089] For example, FIG. 8 is a diagram for explaining an example of a video corresponding to consent B. As shown in FIG. 8, when the patient selects consent B, a video of the medical treatment in the processed image mode is displayed on the display 110 together with an image showing the consent content selected by the patient (in this example, consent B). In the processed image mode, the state of the patient and the surgeon being photographed by each of the tray camera 51, the overall camera 52, the patient camera 53, and the rear camera 54 is displayed on the display 110, but the image of the patient's eye is processed so that the shape of the eye becomes unclear. In this example, a mosaic image 10 is superimposed on the image of the patient's eye so that the shape of the patient's eye becomes unclear.

[0090] The consent contents corresponding to consent C include not including the patient's face in the image of the video data obtained by photographing the patient. When the patient selects consent C, the image processing device 100 stores only the video data consisting of images not including the patient's face among the video data of the patient acquired from each camera in the storage device 105, and deletes the other video data consisting of images including the patient's face. Alternatively, the image processing device 100 outputs only the video data consisting of images not including the patient's face among the video data of the patient acquired from each camera to the server device 200, and deletes the other video data consisting of images including the patient's face. The server device 200 stores the video data consisting of images not including the patient's face acquired from the image processing device 100. Alternatively, the image processing device 100 outputs the video data of the patient acquired from each camera and consent data indicating the consent contents corresponding to consent C to the server device 200. Based on the consent contents of consent C, the server device 200 stores only the video data consisting of images not including the patient's face among the video data of the patient acquired from the image processing device 100, and deletes the other video data consisting of images including the patient's face.

[0091] Furthermore, when the patient selects consent C, the image processing device 100 outputs only video data consisting of images not including the patient's face, among the video data of the patient acquired from each camera during the medical examination, to the display 110. The display 110 displays the video during the medical examination, based on the video data consisting of images not including the patient's face acquired from the image processing device 100.

[0092] For example, Fig. 9 is a diagram for explaining an example of a video corresponding to consent C. As shown in Fig. 9, when a patient selects consent C, a video of the medical treatment being performed in tray image mode is displayed on display 110 together with an image showing the consent content selected by the patient (consent C in this example). In tray image mode, the state of the tray being photographed by tray camera 51 is displayed on display 110, but videos obtained by overall camera 52, patient camera 53, and rear camera 54 that may show the patient's face are not displayed on display 110.

[0093] In this way, the image processing device 100 performs image processing on the patient's video data obtained by shooting with each camera in accordance with the contents of the consent given by the patient, stores the video data after image processing, and displays a video based on the video data after image processing on the display 110.

[0094] [Image processing of image processing device] Image processing executed by the image processing device 100 will be described with reference to Fig. 10. Fig. 10 is a flowchart of image processing executed by the image processing device 100 according to embodiment 1. Each step (hereinafter, indicated by "S") shown in Fig. 10 is realized by the arithmetic device 101 of the image processing device 100 executing the image processing program 150.

[0095] As shown in FIG. 10, the image processing device 100 judges whether or not the start of medical treatment has been estimated (S1). For example, the image processing device 100 estimates that medical treatment has started when it is determined that the backrest 11b and the seat sheet 11c of the chair 11 have moved to a medical treatment position based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may estimate that medical treatment has started when it is determined that the lighting device 19 has been turned on based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may estimate that medical treatment has started when it is determined that a medical instrument such as an air turbine handpiece has been operated based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may perform voice recognition of the conversation between the patient and the surgeon based on the voice data acquired from the microphone 60, and estimate that medical treatment has started based on the recognition result. In addition, the image processing device 100 may estimate the start of treatment by other methods, such as estimating that treatment has started when it determines that the load applied to the seat sheet 11c has reached a predetermined value or above, or when it determines that medical instruments have been placed on the tray 30 placed on the top surface of the tray table 13.

[0096] When the image processing device 100 does not estimate the start of medical treatment (NO in S1), it repeats the process of S1. On the other hand, when the image processing device 100 estimates the start of medical treatment (YES in S1), it executes an authentication process for authenticating the patient who is the subject of medical treatment (S2).

[0097] For example, the image processing device 100 compares a captured image of the patient included in video data acquired by at least one of the overall camera 52, the patient camera 53, and the rear camera 54 with face authentication data included in the consent content data 130, and determines whether or not the captured image of the face of the patient who is the subject of medical treatment matches the face authentication data included in the consent content data 130. Alternatively, the image processing device 100 compares voice data of the patient who is the subject of medical treatment acquired by the microphone 60 with voice authentication data included in the consent content data 130, and determines whether or not the voice data of the patient who is the subject of medical treatment matches the voice authentication data included in the consent content data 130. Alternatively, the image processing device 100 may acquire the patient ID by reading a barcode printed on an ID card or the like owned by the patient with a camera or the like.

[0098] Based on the result of the authentication process, the image processing device 100 judges whether the patient ID of the patient to be treated is registered in the consent content data 130 (S3). The image processing device 100 may authenticate the patient introduced into the medical device 1 by other methods, not limited to face authentication or voice authentication. For example, another PC installed in the hospital may track the movement of a patient whose patient ID has been identified by self-reception or the like using a security camera in the hospital, recognize the medical device 1 into which the patient has been introduced, and notify the image processing device 100 associated with the medical device 1 of the patient ID of the introduced patient. By using such a method, the image processing device 100 can identify the patient ID without creating a database for face authentication or voice authentication, so that consideration can be given to patients who do not want their face or voice information to be acquired.

[0099] If the patient ID of the patient to be treated is not registered in the consent content data 130 (NO in S3), the image processing device 100 registers the patient ID of the patient in the consent content data 130 based on data input by a user such as a surgeon using the input device 120 (S4). Furthermore, the image processing device 100 registers the consent content of the patient in the consent content data 130 based on data input by the user using the input device 120 (S5).

[0100] After registering the patient ID and consent details in consent details data 130, the image processing device 100 captures images of the patient and surgeon during treatment using the tray camera 51, overall camera 52, patient camera 53, and rear camera 54 (S6).

[0101] On the other hand, if the patient ID of the patient to be treated has already been registered in the consent content data 130 (YES in S3), the image processing device 100 captures images of the patient and the surgeon during treatment using the tray camera 51, the overall camera 52, the patient camera 53, and the rear camera 54 (S7). After starting image capture in S6 or S7, the image processing device 100 temporarily stores the video data input and acquired from the tray camera 51, the overall camera 52, the patient camera 53, and the rear camera 54 in the volatile memory 102, performs image processing according to the consent content, and then stores the video data after image processing in the storage device 105. After that, the image processing device 100 extracts the consent content of the patient identified based on the result of the authentication process from the consent content data 130 stored in the storage device 105 (S8).

[0102] The image processing device 100 determines whether the consent details registered in S5 or the consent details extracted in S8 are associated with consent A (S9). If the extracted consent details are associated with consent A (YES in S9), the image processing device 100 stores the video data stored in the volatile memory 102 in the storage device 105 without processing it (S10).

[0103] On the other hand, when the extracted consent details are not associated with consent A (NO in S9), the image processing device 100 judges whether the consent details registered in S5 or the consent details extracted in S8 are associated with consent B (S11). When the extracted consent details are associated with consent B (YES in S11), the image processing device 100 processes the moving image data stored in the volatile memory 102 so that at least the shape of the patient's eyes contained in the image of the moving image data becomes unclear, and then stores the moving image data in the storage device 105 (S12). That is, the image processing device 100 stores the moving image data after image processing is performed on the moving image data input via the input / output interface 104 in the storage device 105.

[0104] The image processing device 100 may execute a process of encrypting the image of the video data stored in the storage device 105 to make it unreadable, or a process of decrypting the image of the encrypted video data to make it readable, according to the consent content data. For example, when the extracted consent content is associated with consent B, the image processing device 100 may encrypt the raw video data stored in the memory 102, lock it to be unreadable, and store it in the storage device 105, and process the raw video data and store it in the storage device 105. That is, the storage device 105 may store locked raw video data and unlocked processed video data. In this way, even if the consent content included in the consent content data 130 is changed back from consent B to consent A again, the image processing device 100 may delete the processed video data stored in the storage device 105 and decrypt the raw video data stored in the storage device 105 to unlock it to be readable.

[0105] On the other hand, when the extracted consent contents are not associated with consent B (NO in S11), the image processing device 100 determines that the consent contents registered in S5 or the consent contents extracted in S8 are associated with consent C, and stores only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the volatile memory 102 in the storage device 105 (S13). Note that other video data composed of images including the patient's face (for example, whole video data, patient video data, and back video data) is deleted when the power supply to the memory 102 is cut off. Note that the image processing device 100 may delete the video data stored in the memory 102 by outputting a delete command to the memory 102 while the power supply to the memory 102 is continued.

[0106] The image processing device 100 may execute a process of encrypting the image of the video data stored in the storage device 105 to make it unreadable, or a process of decrypting the image of the encrypted video data to make it readable, according to the consent content data. For example, when the extracted consent content is associated with consent C, the image processing device 100 may encrypt and lock the video data (e.g., whole video data, patient video data, and back video data) composed of images including the patient's face among the video data stored in the memory 102 to make it unreadable and store it in the storage device 105, and may store only the video data (e.g., tray video data) composed of images not including the patient's face in an unencrypted state in the storage device 105, when the extracted consent content is associated with consent C. That is, the storage device 105 may store locked video data (e.g., whole video data, patient video data, and back video data) composed of images not including the patient's face that are locked, and unlocked video data (e.g., tray video data) composed of images not including the patient's face that are unlocked. In this way, even if the consent content included in the consent content data 130 is changed back from consent C to consent B, the image processing device 100 only needs to decrypt and unlock the video data (e.g., overall video data, patient video data, and back video data) composed of images including the patient's face stored in the storage device 105 so that it can be read.

[0107] After S10, S12, or S13, the image processing device 100 displays on the display 110 a video of the medical treatment in a mode corresponding to the contents of the consent, together with an image indicating the contents of the patient's consent, as shown in Figures 7 to 9 (S14).

[0108] The image processing device 100 judges whether or not the consent contents have been changed during the medical treatment (S15). For example, the image processing device 100 judges whether or not the user has input data for changing the consent contents using the input device 120 in response to the patient's request. Alternatively, the image processing device 100 may recognize the consent contents requested by the patient by voice recognition based on the voice data of the conversation between the surgeon and the patient collected by the microphone 60, and judge whether or not the consent contents have been changed according to the recognized consent contents. Furthermore, the image processing device 100 may compare the recognized consent contents with the consent contents already stored in the storage device 105 as the consent contents data 130, and if the two do not match, judge that the consent contents have been changed, and if the two match, judge that the consent contents have not been changed.

[0109] If the consent details have been changed (YES in S15), the image processing device 100 changes the consent details included in the consent details data 130 (S16). After that, the image processing device 100 executes image processing on the video data stored in the storage device 105 in accordance with the changed consent details data, and edits (modifies or deletes) the video data (S17).

[0110] For example, when the consent content included in the consent content data 130 is changed from consent A to consent B, the image processing device 100 processes the unprocessed video data stored in the storage device 105 so that at least the shape of the patient's eyes included in the image of the video data becomes unclear, and then stores the processed video data in the storage device 105. When the consent content included in the consent content data 130 is changed from consent B to consent C, the image processing device 100 stores only video data composed of images that do not include the patient's face (for example, tray video data) in the storage device 105, and deletes other video data composed of images that include the patient's face (for example, whole video data, patient video data, and back video data). After that, the image processing device 100 returns to the process of S8.

[0111] In addition, when the agreement content contained in the agreement content data is changed, the image processing device 100 may execute a process of encrypting the image of the video data stored in the storage device 105 to make it unreadable, or a process of decrypting the image of the encrypted video data to make it readable, depending on the changed agreement content data.

[0112] For example, when the consent content included in the consent content data 130 is changed from consent A to consent B, the image processing device 100 may encrypt the raw video data stored in the storage device 105 to lock it so that it cannot be read, while processing the raw video data and storing it in the storage device 105. That is, the storage device 105 may store locked raw video data and unlocked processed video data. In this way, even when the consent content included in the consent content data 130 is changed back from consent B to consent A, the image processing device 100 may delete the processed video data stored in the storage device 105 and decrypt the raw video data stored in the storage device 105 to unlock it so that it can be read.

[0113] Furthermore, when the consent contents included in the consent contents data 130 are changed from consent B to consent C, the image processing device 100 may encrypt and lock the video data (for example, whole video data, patient video data, and back video data) composed of images including the patient's face among the video data stored in the storage device 105 so as to make them unreadable, while storing only the video data (for example, tray video data) composed of images not including the patient's face in an unencrypted state in the storage device 105. That is, the storage device 105 may store the locked video data (for example, whole video data, patient video data, and back video data) composed of images including the patient's face and the unlocked video data (for example, tray video data) composed of images not including the patient's face. In this way, even if the consent contents included in the consent contents data 130 are changed back from consent C to consent B, the image processing device 100 may decrypt and unlock the video data (for example, whole video data, patient video data, and back video data) composed of images including the patient's face stored in the storage device 105 so as to make them readable.

[0114] On the other hand, if there is no change in the consent content (NO in S15), the image processing device 100 judges whether or not the end of medical treatment has been estimated (S18). For example, the image processing device 100 estimates that medical treatment has ended when it is determined that the backrest 11b and the seat sheet 11c of the chair 11 have moved to a non-medical position based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may estimate that medical treatment has ended when it is determined that the lighting device 19 has been turned off based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may estimate that medical treatment has ended when it is determined that a medical instrument such as an air turbine handpiece has stopped based on medical treatment-related data acquired from the medical treatment device 1. The image processing device 100 may perform voice recognition of the conversation between the patient and the surgeon based on the voice data acquired from the microphone 60, and estimate that medical treatment has ended based on the recognition result. In addition, the image processing device 100 may estimate the end of treatment by other methods, such as estimating that the treatment has ended when it determines that the load applied to the seat sheet 11c has fallen below a predetermined value, or when it determines that the medical instruments on the tray 30 placed on the top surface of the tray table 13 have been put away.

[0115] When the image processing device 100 does not estimate the end of medical treatment (NO in S18), it returns to the process of S8. On the other hand, when the image processing device 100 estimates the end of medical treatment (YES in S18), it stops capturing images using the tray camera 51, the overall camera 52, the patient camera 53, and the back camera 54, and stops storing the video data in the storage device 105. After that, the image processing device 100 ends this processing flow.

[0116] As described above, the image processing device 100 according to the first embodiment stores the moving image data in the storage device 105 without processing it, stores the moving image data in the storage device 105 after processing the eyes so that the shape of at least the patient's eyes contained in the image of the moving image data is unclear, or stores only the moving image data (for example, tray moving image data) composed of images not including the patient's face in the storage device 105, according to the consent of the patient who has been photographed. In addition, the image processing device 100 automatically stores the moving image data in the storage device 105 while protecting the privacy of the patient according to the consent of the patient, thereby improving the convenience of the user.

[0117] When the image processing device 100 estimates the start of dental treatment, it authenticates the patient and extracts the patient's consent from the consent content data 130 stored in the storage device 105 based on the authentication result, so that the user does not need to search for the patient's consent content by himself, improving user convenience. Furthermore, for example, even if multiple surgeons treat one patient at different times, the image processing device 100 automatically authenticates the patient and extracts the patient's consent content, so that the patient's consent content can be shared among multiple surgeons, and multiple surgeons do not need to ask one patient about the consent content multiple times.

[0118] The image processing device 100 authenticates the patient based on a captured image of the patient's face included in the video data, the patient's voice data, or a patient ID indicated by a barcode printed on an ID card or the like owned by the patient, eliminating the need for the user to authenticate the patient themselves, improving user convenience.

[0119] The image processing device 100 displays on the display 110 the patient's consent and a video based on the video data after image processing according to the consent content data, so that the user can perform medical treatment while checking that the video data has been image-processed according to the patient's consent. This improves user convenience because the user does not need to check the stored video data later. In addition, by checking the video displayed on the display 110, the patient can receive medical treatment with peace of mind knowing that his or her privacy is protected.

[0120] When the consent content data is changed, the image processing device 100 modifies or deletes the images of the video data stored in the storage device 105 according to the changed consent content data, and therefore can appropriately perform image processing on the video data according to the change in the patient's consent content. Furthermore, the image processing device 100 can accept changes to the patient's consent content even during medical treatment, and can appropriately perform image processing on the video data according to the changed patient's consent content, thereby improving user convenience.

[0121] <Embodiment 2> A second embodiment of the present disclosure will be described with reference to the drawings. In the following, only parts of the image processing device 100 according to the second embodiment that are different from the image processing device 100 according to the first embodiment will be described, and the same configurations and processes as those of the image processing device 100 according to the first embodiment will be denoted by the same reference numerals, and description thereof will be omitted.

[0122] Fig. 11 is a flowchart of image processing executed by the image processing device 100 according to the second embodiment. As shown in Fig. 11, the image processing device 100 executes processes S1 to S7 in the same manner as the image processing device 100 according to the first embodiment. After starting shooting in S6 or S7, the image processing device 100 determines whether or not an external output of moving image data has been accepted (S21). If the image processing device 100 has not accepted an external output of moving image data (NO in S21), the image processing device 100 proceeds to the process of S28.

[0123] When the image processing device 100 receives the external output of the moving image data (YES in S21), it extracts the patient's consent details from the consent details data 130 stored in the storage device 105 (S22).

[0124] The image processing device 100 determines whether the extracted consent content is associated with consent A (S23). If the extracted consent content is associated with consent A (YES in S23), the image processing device 100 outputs the video data stored in the volatile memory 102 to the outside without processing it (S24). For example, the image processing device 100 outputs the video data stored in the volatile memory 102 to the server device 200 without processing it. The server device 200 stores the video data received from the image processing device 100. Note that the "external output" is not limited to the server device 200, and may also mean outputting the video data to the display 110 or the storage device 105.

[0125] On the other hand, when the extracted consent contents are not associated with consent A (NO in S23), the image processing device 100 judges whether the extracted consent contents are associated with consent B (S25). When the extracted consent contents are associated with consent B (YES in S25), the image processing device 100 processes the moving image data stored in the volatile memory 102 so that at least the shape of the patient's eyes included in the image of the moving image data becomes unclear, and then outputs the moving image data to the outside (S26). For example, the image processing device 100 processes the moving image data stored in the volatile memory 102 so that at least the shape of the patient's eyes included in the image of the moving image data becomes unclear, and then outputs the moving image data to the server device 200. The server device 200 stores the processed moving image data received from the image processing device 100. Note that the "external output" is not limited to the server device 200, and may be outputting the moving image data to the display 110 or the storage device 105.

[0126] The image processing device 100 may encrypt the raw video data stored in the memory 102, lock it so that it cannot be read, and store it in the storage device 105, and may process the raw video data and output it to the server device 200. In this way, even if the agreement contents included in the agreement contents data 130 are changed back from agreement B to agreement A, the image processing device 100 may delete the processed video data stored in the server device 200 and decrypt the raw video data stored in the storage device 105 to unlock it so that it can be read.

[0127] On the other hand, when the extracted consent contents are not associated with consent B (NO in S25), the image processing device 100 determines that the extracted consent contents are associated with consent C, and outputs only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the volatile memory 102 to the outside (S27). For example, the image processing device 100 outputs only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the volatile memory 102 to the server device 200. The server device 200 stores the video data composed of images not including the patient's face received from the image processing device 100. Note that the "external output" is not limited to the server device 200, and may be outputting the video data to the display 110 or the storage device 105. Note that the other video data composed of images including the patient's face (for example, whole video data, patient video data, and back video data) is deleted when the power supply to the memory 102 is cut off. In addition, the image processing device 100 may delete video data (e.g., overall video data, patient video data, and back video data) consisting of images including the patient's face stored in the memory 102 by outputting a delete command to the memory 102 while power supply to the memory 102 is continued.

[0128] The image processing device 100 may encrypt and lock unreadable video data (e.g., whole video data, patient video data, and back video data) composed of images including the patient's face among the video data stored in the memory 102 and store the encrypted data in the storage device 105, and may output only the video data composed of images not including the patient's face (e.g., tray video data) in an unencrypted state to the server device 200. In this way, even if the consent content included in the consent content data 130 is changed back from consent C to consent B again, the image processing device 100 only needs to decrypt and unlock the video data composed of images including the patient's face stored in the storage device 105 (e.g., whole video data, patient video data, and back video data) so that it can be read.

[0129] The image processing device 100 judges whether the consent contents have been changed after S24, S26, or S27 (S28). If the consent contents have been changed (YES in S28), the image processing device 100 changes the consent contents included in the consent contents data 130 (S29). After that, the image processing device 100 executes image processing on the video data that has been output to the outside according to the changed consent contents data, and edits (modifies or deletes) the video data (S30). For example, the image processing device 100 outputs a signal for executing image processing on the video data stored in the server device 200 to the server device 200, executes image processing on the video data stored in the storage device 105, and edits (modifies or deletes) the video data, or executes image processing on the video data displayed on the display 110, and edits (modifies or deletes) the video data. After that, the image processing device 100 returns to the process of S21.

[0130] As in embodiment 1, when the agreement content contained in the agreement content data is changed, the image processing device 100 may execute a process of encrypting the image of the video data stored in the storage device 105 to make it unreadable, or a process of decrypting the image of the encrypted video data to make it readable, depending on the changed agreement content data.

[0131] For example, when the consent content included in the consent content data 130 is changed from consent A to consent B, the image processing device 100 may encrypt the raw video data stored in the storage device 105 to lock it so that it cannot be read, while processing the raw video data and outputting it to the outside to the server device 200. In this way, even when the consent content included in the consent content data 130 is changed back from consent B to consent A, the image processing device 100 may delete the processed video data stored in the server device 200 and decrypt the raw video data stored in the storage device 105 to unlock it so that it can be read.

[0132] Furthermore, when the consent content included in the consent content data 130 is changed from consent B to consent C, the image processing device 100 may encrypt and store in the storage device 105 the video data consisting of images including the patient's face (for example, full video data, patient video data, and back video data) among the video data stored in the storage device 105, while outputting only the video data consisting of images not including the patient's face (for example, tray video data) in an unencrypted state to the server device 200. In this way, even when the consent content included in the consent content data 130 is changed back from consent C to consent B again, the image processing device 100 only needs to decrypt and unlock the video data consisting of images including the patient's face stored in the storage device 105 (for example, full video data, patient video data, and back video data) so as to be readable.

[0133] On the other hand, if there is no change in the consent content (NO in S28), the image processing device 100 judges whether or not the end of medical treatment has been estimated (S31). If the image processing device 100 has not estimated the end of medical treatment (NO in S31), the process returns to S21. On the other hand, if the image processing device 100 has estimated the end of medical treatment (YES in S31), the image processing device 100 ends photographing by the tray camera 51, the overall camera 52, the patient camera 53, and the rear camera 54 (S32). After that, the image processing device 100 ends this processing flow.

[0134] As described above, the image processing device 100 according to the second embodiment outputs the video data as it is without processing it, outputs the video data after processing the eyes so that the shape of at least the patient's eyes contained in the video data is unclear, or outputs only the video data (for example, tray video data) composed of images that do not include the patient's face, in accordance with the consent of the patient who is photographed, in accordance with the consent of the patient. Furthermore, the image processing device 100 automatically outputs the video data in accordance with the consent of the patient while protecting the privacy of the patient, improving the convenience for the user.

[0135] <Embodiment 3> A third embodiment of the present disclosure will be described with reference to the drawings. In the following, only parts of the image processing device 100 according to the third embodiment that are different from the image processing device 100 according to the first embodiment will be described, and the same configurations and processes as those of the image processing device 100 according to the first embodiment will be denoted by the same reference numerals, and description thereof will be omitted.

[0136] Fig. 12 is a flowchart of image processing executed by the image processing device 100 according to the third embodiment. As shown in Fig. 12, the image processing device 100 executes the processes of S1 to S7 in the same way as the image processing device 100 according to the first embodiment. After starting shooting in S6 or S7, the image processing device 100 determines whether or not the consent details have been changed (S41). If the consent details have been changed (YES in S41), the image processing device 100 changes the consent details included in the consent details data 130 (S42). After that, the image processing device 100 returns to the process of S41.

[0137] On the other hand, if there is no change in the consent content (NO in S41), the image processing device 100 judges whether or not the end of medical treatment has been estimated (S43). If the image processing device 100 has not estimated the end of medical treatment (NO in S43), the process returns to S41. On the other hand, if the image processing device 100 has estimated the end of medical treatment (YES in S43), the image processing device 100 ends capturing images using the tray camera 51, the overall camera 52, the patient camera 53, and the rear camera 54 (S44).

[0138] Thereafter, the image processing device 100 extracts the patient's consent details from the consent details data 130 stored in the storage device 105 (S45). The image processing device 100 determines whether the extracted consent details are associated with consent A (S46). If the extracted consent details are associated with consent A (YES in S46), the image processing device 100 stores the video data stored in the volatile memory 102 in the storage device 105 without processing it (S47).

[0139] On the other hand, when the extracted consent content is not associated with consent A (NO in S46), the image processing device 100 determines whether or not the extracted consent content is associated with consent B (S48). When the extracted consent content is associated with consent B (YES in S48), the image processing device 100 processes the video data stored in the volatile memory 102 so that at least the shape of the patient's eyes included in the image of the video data becomes unclear, and then stores the video data in the storage device 105 (S49).

[0140] On the other hand, if the extracted consent details are not associated with consent B (NO in S48), the image processing device 100 determines that the extracted consent details are associated with consent C, and stores in the storage device 105 only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the volatile memory 102 (S50). Note that other video data composed of images including the patient's face (for example, whole video data, patient video data, and back video data) is deleted when the power supply to the memory 102 is cut off. Thereafter, the image processing device 100 ends this processing flow. Note that the image processing device 100 may delete the video data stored in the memory 102 by outputting a delete command to the memory 102 while the power supply to the memory 102 is continued.

[0141] As described above, after the image capturing by each camera is completed, the image processing device 100 according to the third embodiment stores the moving image data in the storage device 105 without processing it, stores the moving image data in the storage device 105 after processing the eyes so that the shape of at least the patient's eyes contained in the image of the moving image data is unclear, or stores only the moving image data (for example, tray moving image data) composed of images not including the patient's face in the storage device 105, according to the consent of the patient after the image capturing by each camera is completed. In addition, since the image processing device 100 automatically stores the moving image data in accordance with the consent of the patient while protecting the privacy of the patient, the convenience of the user is improved.

[0142] <Fourth embodiment> A fourth embodiment of the present disclosure will be described with reference to the drawings. In the following, only parts of the image processing device 100 according to the fourth embodiment that are different from the image processing device 100 according to the first embodiment will be described, and the same configurations and processes as those of the image processing device 100 according to the first embodiment will be denoted by the same reference numerals, and description thereof will be omitted.

[0143] Fig. 13 is a flowchart of image processing executed by the image processing device 100 according to the fourth embodiment. As a premise, in the image processing device 100 according to the fourth embodiment, video data obtained by each camera is stored in the storage device 105 as is without being processed. The storage device 105 ensures security so that unprocessed video data is not leaked to the outside. In this state, as shown in Fig. 13, the image processing device 100 determines whether or not it has accepted an external output of the video data stored in the storage device 105 (S61). If the image processing device 100 has not accepted an external output of the video data (NO in S61), it repeats the process of S61.

[0144] When the image processing device 100 receives an external output of video data (YES in S61), it extracts the patient's consent content shown in the video that is the target of external output from the consent content data 130 stored in the storage device 105 (S62).

[0145] The image processing device 100 determines whether the extracted consent content is associated with consent A (S63). If the extracted consent content is associated with consent A (YES in S63), the image processing device 100 outputs the video data stored in the storage device 105 to the outside without processing it (S64). For example, the image processing device 100 outputs the video data stored in the storage device 105 to the server device 200 without processing it. The server device 200 stores the video data received from the image processing device 100. Note that the "external output" is not limited to the server device 200, and may also mean outputting the video data to the display 110.

[0146] On the other hand, when the extracted consent contents are not associated with consent A (NO in S63), the image processing device 100 judges whether the extracted consent contents are associated with consent B (S65). When the extracted consent contents are associated with consent B (YES in S65), the image processing device 100 processes the eyes of the moving image data stored in the storage device 105 so that at least the shape of the patient's eyes included in the image of the moving image data becomes unclear, and then outputs the moving image data to the outside (S66). For example, the image processing device 100 processes the eyes of the moving image data stored in the storage device 105 so that at least the shape of the patient's eyes included in the image of the moving image data becomes unclear, and then outputs the moving image data to the server device 200. The server device 200 stores the processed moving image data received from the image processing device 100. Alternatively, the image processing device 100 outputs the moving image data stored in the storage device 105 and consent data indicating the consent contents corresponding to consent B to the server device 200. Based on the consent content of consent B, the server device 200 processes the moving image data acquired from the image processing device 100 so that at least the shape of the patient's eyes included in the image of the moving image data becomes unclear, and stores the processed moving image data. Note that the "external output" is not limited to the server device 200, and may be outputting the moving image data to the display 110.

[0147] On the other hand, when the extracted consent contents are not associated with consent B (NO in S65), the image processing device 100 determines that the extracted consent contents are associated with consent C, and outputs only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the storage device 105 to the outside (S67). For example, the image processing device 100 outputs only the video data (for example, tray video data) composed of images not including the patient's face among the video data stored in the storage device 105 to the server device 200. The server device 200 stores the video data composed of images not including the patient's face received from the image processing device 100. Alternatively, the image processing device 100 outputs the video data stored in the storage device 105 and consent data indicating the consent contents corresponding to consent C to the server device 200. Based on the consent contents of consent C, the server device 200 stores only the video data composed of images not including the patient's face among the video data of the patient acquired from the image processing device 100 and deletes the other video data composed of images including the patient's face. Note that the "external output" is not limited to the server device 200, and may be output of video data to the display 110. After that, the image processing device 100 ends this processing flow.

[0148] As described above, after the image capturing by each camera is completed, the image processing device 100 according to the fourth embodiment outputs the video data as it is without processing it, outputs the video data after processing the eyes so that at least the shape of the patient's eyes contained in the video data is unclear, or outputs only the video data (for example, the tray video data) composed of images that do not include the patient's face, according to the consent of the patient who is captured after the image capturing by each camera is completed, while protecting the privacy of the patient. Furthermore, since the image processing device 100 automatically outputs the video data according to the consent of the patient while protecting the privacy of the patient, the convenience of the user is improved.

[0149] <Modification> The present disclosure is not limited to the above-described embodiment, and various modifications and applications are possible. Modifications that can be applied to the present disclosure will be described below.

[0150] In the image processing device 100 according to each of the above-described embodiments, examples of "image processing" include storing or externally outputting video data acquired from each camera without processing it, processing video data acquired from each camera and then storing or externally outputting it, and selecting a portion of the video data acquired from each camera and storing or externally outputting it. However, other processes may also be performed as "image processing".

[0151] For example, the image processing device 100 may change the degree to which at least the shape of the patient's eyes included in the image of the video data obtained by each camera is obscured according to the level of protection of the patient's privacy stipulated in the consent content included in the consent content data. For example, when the level of protection of the patient's privacy stipulated in the consent content is a first level, the image processing device 100 may make the mosaic applied to at least the part including the patient's eyes finer or reduce the luminance, illuminance, or brightness (tone) of the part compared to when the level of protection of the patient's privacy is a second level lower than the first level.

[0152] Furthermore, the image processing device 100 may change the range in which the shape of the patient's eyes is obscured, centered on at least the position of the patient's eyes included in the image of the video data obtained by each camera, according to the level of protection of the patient's privacy stipulated in the consent content included in the consent content data. For example, when the level of protection of the patient's privacy stipulated in the consent content is a first level, the image processing device 100 may make the range in which the shape of the patient's eyes is obscured larger than when the level of protection of the patient's privacy stipulated in the consent content is a second level lower than the first level.

[0153] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present disclosure is indicated by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. Note that the configurations exemplified in the present embodiment and the configurations exemplified in the modified examples can be appropriately combined. [Explanation of symbols]

[0154] 1 medical device, 2 patient, 3 dentist, 4 dental assistant, 5 pole, 6 arm, 10 mosaic image, 11 chair, 11a headrest, 11b backrest, 11c seat, 11d footrest, 12 basin unit, 12a bowl, 12b cup stand, 12c water tap, 13 tray table, 14 instrument holder, 15 medical device, 16 foot controller, 17, 110 display, 18 operation panel, 19 lighting device, 21 instrument control device, 22 display control device, 30 tray, 32 sound control device, 35 speaker, 51 tray camera, 52 overall camera, 53 patient camera, 54 rear camera, 60 microphone, 100 image processing device, 101 calculation device, 102 memory, 103 communication device, 104 input / output interface, 105 Storage device, 111 chair control unit, 120 input device, 121 basin control unit, 122 lighting control unit, 123 storage unit, 124 communication unit, 130 consent content data, 150 image processing program, 200 server device, 211 appliance control unit, 221 display control unit, 222 panel control unit, 321 sound control unit, 1000 image processing system.

Claims

1. An image processing device for processing an image, an input unit for inputting video data obtained by photographing a patient being examined by the dental examination device; a storage unit for storing consent content data including consent content of the patient regarding use of the video data; and a calculation unit that executes image processing on the video data in accordance with the consent content data stored in the memory unit.

2. The image processing device according to claim 1 , wherein the calculation unit stores in the storage unit data obtained by performing the image processing on the video data input to the input unit.

3. The calculation unit is The video data input to the input unit is stored in the storage unit; The image processing device according to claim 1 , further comprising: an image processing unit configured to perform image processing on the video data stored in the storage unit;

4. The calculation unit is When it is estimated that dental treatment will start, authentication of the patient is performed; 4. The image processing device according to claim 1, further comprising: extracting the consent details of the patient from the storage unit based on a result of the authentication.

5. The image processing device according to claim 4 , wherein the calculation unit performs the authentication based on a captured image of the face of the patient included in the video data.

6. The image processing apparatus according to claim 4 , wherein the calculation unit performs the authentication based on voice data of the patient inputted from the input unit.

7. 4. The image processing device according to claim 1, wherein the consent content data includes, as the consent content, a content related to a level of protection of the patient's privacy.

8. The image processing device of claim 7, wherein the consent content data includes at least one of the following as the consent content: processing the eyes of the patient included in the image of the video data so that the shape of the eyes is unclear; not processing the eyes included in the image of the video data; and not including the face of the patient in the image of the video data.

9. The image processing device described in claim 7, wherein the calculation unit changes the degree to which at least the shape of the patient's eyes contained in the image of the video data is obscured depending on the level of protection of the patient's privacy, or changes the range in which the shape of the eyes is obscured centered on the position of at least the patient's eyes contained in the image of the video data.

10. The image processing device according to any one of claims 1 to 3, wherein the calculation unit displays on a display the agreement content contained in the agreement content data and a video based on the video data after the image processing in accordance with the agreement content data.

11. The image processing device according to any one of claims 1 to 3, wherein when the agreement content data is changed, the calculation unit modifies or deletes images of the video data stored in the memory unit in accordance with the changed agreement content data.

12. The image processing device according to any one of claims 1 to 3, wherein the calculation unit performs a process of encrypting the image of the video data stored in the memory unit to make it unreadable, or a process of decrypting the encrypted image of the video data to make it readable, depending on the consent content data.

13. The calculation unit is Recognizing the content of the consent based on the voice data of the patient input from the input unit; 4. The image processing device according to claim 1, further comprising: causing the memory unit to store the consent content data including the recognized consent content.

14. The image processing device according to claim 13 , wherein the calculation unit compares the recognized content of agreement with the content of agreement included in the content of agreement data stored in the storage unit.

15. An image processing system for processing an image, comprising: Dental treatment equipment, A camera and an image processing device that performs image processing on video data obtained by photographing a patient being examined by the medical examination device with the camera; The image processing device includes: an input unit to which the video data is input; a storage unit for storing consent content data including consent content of the patient regarding use of the video data; and a calculation unit that executes the image processing according to the consent content data stored in the memory unit on the video data.

16. An image processing method for processing an image by a computer, comprising the steps of: The process executed by the computer is receiving video data obtained by photographing a patient being treated by a dental treatment device; storing consent content data including consent content of the patient regarding use of the video data; and executing image processing on the video data in accordance with the consent content data stored in the storing step.

17. An image processing program for processing an image, On the computer, receiving video data obtained by photographing a patient being treated by a dental treatment device; storing consent content data including consent content of the patient regarding use of the video data; and a step of executing image processing on the video data in accordance with the consent content data stored in the storing step.

Images