Operation support device and operation support method

Abstract

To provide a mechanism capable of improving operation technique for a living body.SOLUTION: A dental operation support device comprises: a receiving part which receives selection of an operation content for a living-body model; a data acquisition part which acquires check data corresponding to the selected operation content; a display part which displays an AR model generated based on augmented reality (AR) data corresponding to the operation content, in association with the living-body model being imaged; and an evaluation part which evaluates the operation for the living-body model based on the check data and outputs a result of the evaluation.SELECTED DRAWING: Figure 21

Description

[Technical field]

[0001] The present technology relates to a treatment support device and a treatment support method. [Background technology]

[0002] As a background technology of this technical field, there is JP 2023-002280 A (Patent Document 1). This publication states that "a) a function in which a first dentist performs user registration from a first user terminal 111 via a network, a function in which the first dentist uses a 3D model or the like to explain a dental case, transmitted from the first user terminal, receives via a network a video or the like of the explanation of the dental case, a function in which the video or the like received by the function in (b) is classified and displayed on the second user terminal 112 of the first viewer or the first user terminal via a network (c), and when the first viewer selects a video or the like classified and displayed on the second user terminal, a function in which the selected video or the like is displayed on the second user terminal via a network (d), and a function in which the first viewer performs a procedure for purchasing a 3D model or the like from the second user terminal via a network (f) A dental comprehensive training site 118 having a program that realizes this function" (see abstract). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-002280 A Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses a business model for a comprehensive dental training site. However, it does not disclose a mechanism for improving treatment techniques for living organisms. Therefore, the present technology provides a mechanism that can improve treatment techniques for living organisms. [Means for solving the problem]

[0005] In order to solve the above problems, for example, the configurations described in the claims are adopted. The present application includes multiple means for solving the above-mentioned problems. As one example, the present application provides a treatment support device including: a reception unit that receives a selection of treatment content for a biological model; a data acquisition unit that acquires check data corresponding to the selected treatment content; a display unit that displays an AR model generated based on augmented reality (AR) data corresponding to the treatment content in correspondence with the biological model being imaged; and an evaluation unit that evaluates the treatment for the biological model based on the check data and outputs the evaluation result. Effect of the Invention

[0006] According to the present technology, a mechanism can be provided that can improve the treatment techniques of dentists. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 shows an example of the overall configuration of a dental treatment support system 100. [Diagram 2] FIG. 2 shows an example of the hardware configuration of the management server 101. [Diagram 3] FIG. 3 shows an example of the hardware configuration of the user terminal 102. [Figure 4] FIG. 4 is an example of user information 400. [Diagram 5] FIG. 5 is an example of the AR model data 500. [Figure 6] FIG. 6 is an example of training data 600. [Figure 7] FIG. 7 shows an example of check data 700 in the case of implant placement. [Figure 8] FIG. 8 is an example of NG area data 800. [Figure 9] FIG. 9 is an example of a training preparation flow 900. [Figure 10] FIG. 10 is an example of a treatment evaluation flow 1000. [Figure 11] FIG. 11 is an example of a treatment evaluation process flow 1100. [Figure 12] FIG. 12 is another example of a treatment evaluation process flow 1200. [Figure 13] FIG. 13 is another example of a treatment evaluation process flow 1300. [Figure 14] FIG. 14 is another example of a treatment evaluation process flow 1400. [Figure 15] FIG. 15 is another example of a treatment evaluation process flow 1500. [Figure 16] FIG. 16 is another example of a treatment evaluation process flow 1600. [Figure 17] FIG. 17 is another example of a treatment evaluation process flow 1700. [Figure 18] FIG. 18 is an example of an AR model. [Figure 19] FIG. 19 shows an example of a dental arch model. [Figure 20] Figure 20 shows an example of an AR model and a NG area. [Figure 21] FIG. 21 shows another example of an AR model and a NG area. [Figure 22] FIG. 22 is a diagram illustrating a state in which the AR model is superimposed on the dental arch model. [Figure 23] FIG. 23 is an example of an AR model of the mandible. [Figure 24] FIG. 24 is another example of a screen 2400 during treatment evaluation. [Diagram 25] FIG. 25 shows an example of a state in which a guide is attached to a dental arch model. [Figure 26] FIG. 26 shows another example of the dental arch model. [Figure 27] FIG. 27 shows an example of a support base for a dental arch model. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, a treatment support device, a treatment support method, and a program according to the present technology will be described with reference to the drawings. Note that in each drawing, configurations having the same functions may be denoted by reference numerals and may not be described in detail.

[0009] [Dental treatment support system] FIG. 1 is an example of a configuration diagram of a dental treatment support system 100 according to an embodiment. The dental treatment support system 100 according to the present technology is configured to be able to evaluate treatment using a dentition model (an example of a biological model) on the spot during the training stage or treatment stage of dental treatment. In this embodiment, the present technology will be described using an example of a case in which implant insertion surgery is practiced using a patient's dentition model as a treatment in the dental field.

[0010] As shown in FIG. 1, the dental treatment support system 100 includes one or more management servers 101 and one or more user terminals 102. The dental treatment support system 100 may additionally include, for example, a 3D printer 103. Each of the one or more user terminals 102 is configured to be connectable to one or more management servers 101 via a network. The network may be wired or wireless, and each terminal is capable of transmitting and receiving information to and from each other via the network. The user terminal 102 may be provided separately from the management server 101, or may be provided integrally with the management server 101.

[0011] The management server 101 and the user terminal 102 in the dental treatment support system 100 (hereinafter, the management server 101 and the user terminal 102 may be simply referred to as "terminals") may be, for example, a mobile terminal such as a smartphone, tablet, mobile phone, or personal digital assistant (PDA), or may be a wearable terminal such as glasses (including goggles), wristwatch, or clothing. Each terminal may be a stationary or mobile computer, or a server located on the cloud or a network. From the viewpoint of functionality, each terminal may be a VR (Virtual Reality) terminal, an AR (Augmented Reality) terminal, or an MR (Mixed Reality) terminal. Alternatively, each terminal may be a combination of a plurality of these terminals. For example, a combination of one smartphone and one wearable terminal may function logically as one terminal. Each terminal may also be an information processing terminal other than these.

[0012] Each terminal and management server 101 of the dental treatment support system 100 may optionally include a processor that executes an operating system, an application, a program, etc., a main storage device such as a RAM (Random Access Memory), an auxiliary storage device such as an IC card, a hard disk drive, an SSD (Solid State Drive), a flash memory, etc., a communication control unit such as a network card, a wireless communication module, a mobile communication module, etc., an input device such as a touch panel, a keyboard, a mouse, a voice input device, a motion controller, an input device that detects motion by capturing an image of a camera unit, an input device such as a GPS, a gyro sensor, an acceleration sensor, etc., and an output device such as a monitor, a display, a printer, a voice output device, an oscillator, etc. The output device may be a device or terminal that transmits information to be output to an external monitor, a display, a printer, a device, etc.

[0013] The main memory stores various programs and applications (software modules), and the processor executes these programs and applications to realize each functional element of the overall system. Each module may be implemented as an independent program or application, or as a subprogram or function within a single integrated program or application. Each module may also be implemented as hardware by integrating circuits or employing a microcomputer (hardware module).

[0014] Furthermore, each module may be realized by a single processor or by multiple processors. Also, each module may be provided in a single terminal (including a management server) or may be provided separately in two or more terminals (including a management server) connected to each other via a network. Also, each module may be provided in each or any one or more of two or more terminals (including a management server) connected to each other via a network. Cases in which some modules are realized in a different country from the other modules are also considered.

[0015] In this specification, each module is described as an entity (subject) that performs processing, but in reality, processing is performed by a processor executing various programs, applications, and the like.

[0016] The auxiliary storage device stores various databases (DB). A "database" is a set of data that is organized and collected so as to be compatible with any data operation (e.g., extraction, addition, deletion, overwriting, etc.) from the processor or an external computer. The auxiliary storage device is a functional element (storage unit) that stores one or more sets of data. There are no limitations on the method of implementing the database, and it may be, for example, a database management system, spreadsheet software, or text files such as XML and JSON. Some or all of this information may be stored in a relational database or a non-relational database. The database may be provided independently in a state that is connectable to the processor, etc.

[0017] [Management Server] 2 illustrates an example of a hardware configuration of the management server 101. The management server 101 is an element that manages this dental treatment support system 100. The management server 101 is typically a terminal used by an administrator who manages and operates this dental treatment support system 100. The management server 101 is configured, for example, by a computer server or the like arranged on a cloud.

[0018] The management server 101 includes a main storage device 201 and an auxiliary storage device 202. The management server 101 also includes a processor 203, an input device 204, an output device 205, and a communication control unit 206 as described above.

[0019] The main memory device 201 stores programs and applications such as a user terminal management module 211, a dental CT acquisition module 212, an AR data generation module 213, a dentition model generation module 214, a NG area data generation module 215, and a server-side evaluation module 216. Each functional element of the management server 101 is realized by the processor 203 executing these programs and applications stored in the main memory device 201. Note that some of these modules, such as the server-side evaluation module 216, are optional components of the management server 101 and may be omitted.

[0020] The auxiliary storage device 202 stores information necessary for the operation of the dental treatment support system 100. For example, the auxiliary storage device 202 stores user information 400, dental CT data 220, dentition model data 230, AR model data 500, training data 600, check data 700, and NG area data 800. Details of these pieces of information will be described later.

[0021] Each functional element of the management server 101 will now be briefly described. The user terminal management module 211 manages the operation of the user terminal 102. The user terminal management module 211 cooperates with a management module 311 of the user terminal 102 and the like to control basic operations for realizing the functions of the dental treatment support system 100 in the user terminal 102.

[0022] For example, the user terminal management module 211 cooperates with the management module 311 of the user terminal 102 to output (display) the homepage, login page, menu page of treatment contents, etc. of the dental treatment support site provided on the web by the management server 101 to the output device 305 such as a display of the user terminal 102. In addition, the user terminal management module 211 cooperates with various modules of the user terminal 102, for example, to acquire information input from the user terminal 102 via these pages, and output information to the user terminal 102. For example, the user terminal management module 211 can operate based on information (various information, instructions, etc.) acquired from the user terminal 102, and output (store) the acquired information to the auxiliary storage device 202 as user information 400, etc. In addition, information such as AR model data corresponding to the selected treatment contents can be output to the user terminal 102.

[0023] The dental CT acquisition module 212 acquires dental CT data. The dental CT data is an example of medical image data of a living body. The medical image data of a living body broadly includes information that can visualize the internal structure and function of a living body as an image for the diagnosis and treatment of a disease, and may be any one or a combination of two or more of data acquired by X-ray photography, computed tomography (CT), nuclear medicine diagnosis, magnetic resonance imaging (MRI), ultrasonic tomography, etc. These medical image data may be reconstructed so that the internal structure and function of the living body can be visualized as an image.

[0024] Furthermore, in this embodiment, an example is shown in which medical / dental CT (Computed Tomography) data of the stomatognathic region is used as dental CT data, but it is not limited to this as long as it can acquire three-dimensional morphological information of biological tissues of the stomatognathic region. The dental image may be, for example, one or a combination of two or more of various medical / dental image data such as plain / contrast CT data, magnetic resonance imaging data, digital X-ray imaging data, computed radiography data, single photon emission computed tomography imaging data, positron emission computed tomography imaging data, and ultrasound imaging data. Although not limited thereto, the dental CT data may be, for example, in accordance with the DICOM (Digital Imaging and Communications in Medicine) communication standard, and the data format may be HL7 (Health Level Seven). Note that the dental CT data referred to in this specification may include, but is not limited to, so-called dental cone beam CT optimized for CT imaging of teeth, jaws, and faces.

[0025] The dental CT acquisition module 212 may acquire dental CT data from a CT imaging modality installed in a dental clinic or the like, or may acquire imaging data that has been captured in advance and stored in a cloud database or various recording media. The dental CT acquisition module 212 stores the acquired dental CT data in the auxiliary storage device 202 as dental CT data 220.

[0026] The AR data generation module 213 creates Augmented Reality (AR) display data from the dental CT data. In the present technology, the AR data is not particularly limited as long as it can display virtual visual information superimposed on a real-world image on a computer, and may be simple Augmented Reality data or Mixed Reality (MR) data. The AR data may also include audio information. The AR data generation module 213 typically creates data (3DCT data) corresponding to a three-dimensional (3D) model of the stomatognathic region from the CT data of the stomatognathic region, and creates AR data (contents) from the 3DCT data. Hereinafter, the 3D model of the stomatognathic region may be referred to as a base model, and the 3D model data of the stomatognathic region may be referred to as base data.

[0027] The AR model data created by the AR data generation module 213 may have a trigger for superimposing on a real image of a location (position information) type, a vision (image recognition) type, or a combination of these. The vision type may be any one of a marker type, a space recognition type, an object recognition type (three-dimensional recognition type), etc., or a combination of two or more of these. The AR model data is preferably an object tracking type AR model data that recognizes the shape of the object itself as a marker in real time without requiring a marker, and displays the AR model in an expanded form. For example, the AR model data may be configured to track a dental model having the same or similar form as the form of the AR model itself so that the orientation and dimensions are common.

[0028] The AR data generation module 213 processes the dental CT data by, for example, a three-dimensional computer-aided design (CAD) function and an image processing function. The image processing function typically includes a function unit that realizes binarization to multi-value processing, noise removal processing, edge enhancement processing, image recognition processing, 3D modeling, rendering processing, digital synthesis, and the like, and can be realized by, for example, 3DCG (three-dimensional computer graphics) software or the like. The image processing function may include an image analysis function, and can be realized by, for example, 3D modeling software (for example, Fiji: an open source platform for biological image analysis), OrtogOnBlender (open source 3D content creation software), and the like. In addition, the AR data generation module 213 creates AR data from the 3DCT data by, for example, utilizing an AR content creation function (for example, ARCore, ARKit, and the like).

[0029] The AR data generation module 213 first creates 3DCT data of the maxilla, upper dentition, mandible, lower dentition, upper gingiva, and lower gingiva as base data from the dental CT data. Specifically, the AR data generation module 213 creates a 3DCT image from the acquired dental CT data, cuts out a portion including the maxilla and upper dentition and a portion including the mandible and lower dentition, and then extracts (segmentation) the hard tissues of the maxilla, upper dentition, mandible, and lower dentition, and the soft tissues of the upper gingiva, lower gingiva, and dental pulp, based on the difference in the amount of X-ray absorption for each biological tissue. At this time, the AR data generation module 213 also deletes, for example, the cervical vertebrae, cheek, tongue, and other artifact parts that are not necessary for the dentition model from the 3DCT image. This generates 3DCT data of the hard tissue and the soft tissue.

[0030] The AR data generation module 213 further creates characteristic part data based on the 3DCT data (an example of base data). The characteristic part data is data related to a 3D image corresponding to characteristic parts such as positions that require attention and positions that are not to be treated when performing a treatment on a living body. The AR data generation module 213 identifies characteristic parts by image processing based on the difference in X-ray absorption amount and position information in the 3DCT data, for example, and generates 3D data related to the characteristic parts as characteristic part data. The AR data generation module 213 identifies each characteristic part by extracting parts that are candidates for characteristic parts based on the difference in X-ray absorption amount in the 3DCT data, for example, and comparing them with representative position information prepared in advance for each characteristic part.

[0031] Specific examples of the characteristic parts in the treatment of the oral cavity region include the mental foramen, mandibular canal (inferior alveolar canal), incisive canal, posterior alveolar canal (superior alveolar canal), greater palatine foramen, dental pulp portion, jawbone portion, nerves or arteries and veins, cysts, tumors, and other lesions, which are related to the running positions of nerves and blood vessels. The characteristic parts may also include cortical bone, maxillary sinus walls, and other tissues. The characteristic parts may further include dentition (which may be predetermined teeth including natural teeth and dentures), implant bodies, and the like. Since the positions and shapes of these characteristic parts differ from patient to patient, the characteristic part data is patient-specific information, similar to dental CT data.

[0032] The AR data generation module 213 generates base data and feature part data by image processing based on at least one of the detection amount characteristics and the three-dimensional structure in the acquired dental CT data (an example of medical image data). The detection amount characteristics refer to information on the amount and distribution of signals emitted from a living body and received (detected) by a detector or the like to create an image. In X-ray photography, X-ray CT, and nuclear medicine diagnosis, radiation emitted from a living body (including when passing through a chiropractor) is detected and the detection signal is imaged. Nuclear magnetic resonance imaging detects the nuclear magnetic resonance signal of water emitted from a living body, and ultrasonic tomographic imaging detects the reflected wave of the ultrasound transmitted to the living body and images the detection signal. When using nuclear magnetic resonance imaging, image processing can be performed similarly based on the amount of hydrogen detection.

[0033] The AR data generation module 213 stores the 3D model data (base data) of the maxilla, upper dentition, mandible, lower dentition, upper gingiva, and lower gingiva generated as described above, and the characteristic part data, in the auxiliary storage device 202. At this time, the AR data generation module 213 stores the 3D model data, for example, in a file format that can be displayed in AR (for example, USDZ format or GBL format). In this way, the AR model data 500 is created. The AR data generation module 213 stores the base data and the characteristic part data in association with each other. In this embodiment, the AR model data 500 is created by the AR data generation module 213, but the AR model data 500 may be created manually.

[0034] The dentition model generating module 214 generates dentition model data from dental CT data. The dentition model generating module 214 generates 3D printer data for forming a dentition model with a three-dimensional modeling device (3D printer 103) based on, for example, CT data of the patient's oral and maxillofacial region. The dentition model generating module 214 may generate dentition model data by using, for example, the above-mentioned base data, the AR model data 500, and data in an image file format generated by the AR data generating module 213. Although not limited thereto, for example, the dentition model generating module 214 may generate upper jaw model data from data of the upper jaw and upper dentition part, and generate lower jaw model data from data of the mandible and lower dentition part, for hard tissue. The dentition model generating module 214 may output, for example, a 3D surface of the upper jaw and upper dentition part as dentition model data. The 3D printer data is, for example, STL (Standard Triangulated Language) data. The dentition model generation module 214 is realized, for example, by a computer-aided design (CAD) function.

[0035] The teeth model generating module 214 stores the generated teeth model data as teeth model data 230 in the auxiliary storage device 202. The teeth model data 230 is data representing the shape of the teeth model to be modeled when the teeth model is modeled by the 3D printer 103. The teeth model generating module 214 also outputs the generated teeth model data to the 3D printer 103, for example. The teeth model generating module 214 outputs an instruction to the 3D printer 103 to create the teeth model data based on the teeth model data, for example. As a result, a teeth model corresponding to the teeth model data is created.

[0036] The NG area data generation module 215 creates the NG area data 800. The NG area data generation module 215 creates the NG area data 800 based on the above-mentioned AR model data created by the AR data generation module 213. The NG area data is data that indicates positions that require attention when performing treatment, positions where treatment is not performed, etc., and is data that is used as an evaluation criterion in the treatment evaluation related to the present technology. The NG area data is an example of check data in the present technology.

[0037] The NG area data may be, for example, position information representing a biological part such as the mental foramen, the mandibular canal, the posterior alveolar canal, and the greater palatine foramen in the above-mentioned characteristic part data, and a region surrounding the biological part with a predetermined dimension. The dimension (separation distance) of the region surrounding the biological part may vary depending on the target biological part and the treatment content, for example, as shown in check data 700 (FIG. 7) described later. The NG area data may be, for example, position information representing the teeth in the above-mentioned upper dentition and lower dentition and a region surrounding the teeth with a predetermined dimension, or a region of a predetermined thickness on the side end (bone wall) of the buccal and lingual sides of the maxilla and mandible. The NG area data may be, for example, information representing a relatively inappropriate positional relationship of the guide with respect to the dentition or teeth. The NG area data generation module 215 generates the NG area data based on, for example, the characteristic part data and the dimensional information of the region surrounding the characteristic part included in the check data 700. The NG area data generation module 215 stores the created NG area data 800 in, for example, the auxiliary storage device 202 as the NG area data 800.

[0038] The NG area data generation module 215 may be configured to cooperate with the evaluation module 315 of the user terminal 102 to generate new NG area data (hereinafter, sometimes referred to as second NG area data) based on information indicating the user's treatment acquired by the user terminal 102. In this case, the generation process of the second NG area data by the NG area data generation module 215 may be similar to the generation process of the second NG area data by the evaluation module 315 of the user terminal 102, and a description thereof will be omitted here. The NG area data generation module 215 outputs the generated second NG area data to, for example, the auxiliary storage device 302 of the user terminal 102 as NG area data 800. In this embodiment, the NG area data 800 is generated by the NG area data generation module 215, but the NG area data 800 may be manually generated.

[0039] The server-side evaluation module 216 evaluates the treatment by the user. The server-side evaluation module 216 cooperates with, for example, the evaluation module 315 of the user terminal 102 to evaluate the treatment by the user. The evaluation process in the server-side evaluation module 216 may be similar to the evaluation process in the evaluation module 315 described below, and a description thereof will be omitted here. The server-side evaluation module 216 cooperates with the evaluation module 315 of the user terminal 102 to output (display) the evaluation result on the display (an example of the output device 305; the same applies below) of the user terminal 102.

[0040] [User device] 3 is an example of a hardware configuration of the user terminal 102. The user terminal 102 is a terminal operated by a user who uses the dental treatment support system 100, and is an example of a dental treatment support device in the present technology. The user terminal 102 is configured by a terminal such as a smartphone, a tablet, a computer with AR glasses, a computer with a head-mounted display, or a head-mounted AR terminal.

[0041] The user terminal 102 includes a main memory device 301 and an auxiliary memory device 302. The user terminal 102 also includes a processor 303, an input device 304, an output device 305, a camera 306, and a communication control unit 307 as described above. The camera 306 may be an imaging device built into a smartphone or a tablet, or may be an imaging device built into a wearable device such as AR glasses or a head-mounted display. The output device 305 may be a display device (display) provided in the smartphone or tablet, or may be a display device (display) in the AR glasses or a head-mounted display.

[0042] The main memory device 301 stores programs and applications such as a management module 311, a reception module 312, a data acquisition module 313, a display module 314, and an evaluation module 315. The processor 303 executes these programs and applications to realize each functional element of the user terminal 102.

[0043] The auxiliary storage device 302 stores information necessary for the operation of the user terminal 102. For example, the auxiliary storage device 302 stores user information 400, AR model data 500, training data 600, check data 700, NG area data 800, etc. The auxiliary storage device 302 may be a part or all of this information stored in the auxiliary storage device 202 of the management server 101.

[0044] A brief explanation will be given below of each functional element of the user terminal 102. The specific operation of each functional element will be described later. The management module 311 controls the basic operation of the user terminal 102 when using the dental treatment support system 100. The management module 311 cooperates with the user terminal management module 211 of the management server 101, for example, to output (display) a login page for the dental treatment support site, a menu page showing training contents for treatment on a dentition model, and the like, on the display of the user terminal 102.

[0045] The reception module 312 receives an operation of the user terminal 102 by the user. The reception module 312 receives, for example, a selection of treatment contents for a dentition model. The reception module 312 receives, for example, a selection operation for a treatment content that the user wishes to train in from among the treatment training contents displayed on a menu page.

[0046] The data acquisition module 313 acquires information corresponding to the selected treatment content. The data acquisition module 313 cooperates with the management module 311 of the management server 101 to acquire, for example, AR model data, NG area data, and check data corresponding to the selected treatment content. The data acquisition module 313 stores the acquired AR model data, NG area data, and check data, for example, in the auxiliary storage device 302, as AR model data 500, check data 700, and NG area data 800, respectively. Furthermore, the data acquisition module 313 inputs training data 600, which will be described later, based on the acquired data.

[0047] The display module 314 displays the AR model generated based on the AR model data on a display. The display module 314 displays the AR model generated based on the AR model data in association with the dental arch model being imaged. The display module 314 may be configured to display the AR model in a form that can be switched between AR content and an object in response to a user's selection, for example.

[0048] The evaluation module 315 evaluates the treatment performed on the dentition model and outputs the evaluation result. The evaluation module 315 evaluates the treatment performed on the dentition model by the user based on, for example, the check data 700, and outputs the evaluation result. In addition, in the treatment evaluation, the evaluation module 315 performs image recognition and generates second NG area data based on the treatment imaging data captured by the camera 306. The evaluation module 315 stores the generated second NG area data in, for example, the auxiliary storage device 202 as NG area data 800.

[0049] [Information DB] FIG. 4 is an example of user information 400. The user information 400 is information about a user who uses this dental treatment support system 100. The user information 400 includes, for example, a user ID, a user display ID, a user name, an address, payment information, password information, and personal identification information, and values ​​such as those shown as examples in sample values ​​420 are input for each field name 410. The outline of the field name 410 and the sample value 420 are explained in an outline section 430. The contents of the user information 400 are not limited to this example.

[0050] FIG. 5 is an example of the AR model data 500. The AR model data 500 is information about an AR model of a patient who is a target of treatment. The AR model data 500 includes information such as an AR model ID, a user ID, a patient ID, a mandible model, a lower dentition model, a lower gum model, and a mandibular canal model, and values ​​such as those shown as sample values ​​520 are input to the respective field names 510.

[0051] The AR model ID is a code given to identify the AR model of the patient who is to be operated by the user. The patient ID is a code given to identify the patient who is the origin of the AR model. The mandible model, the lower dentition model, the lower gum model, and the mandibular canal model are AR models of the mandible, the lower dentition, the lower gum, the mandibular canal, etc., which respectively constitute the AR model, and information on these AR models is stored, for example, in a file with a file name shown in the value 520 column. Note that the value 520 column may store the storage destination of these AR model files. However, the contents of the AR model data 500 are not limited to this example.

[0052] FIG. 6 is an example of training data 600. The training data 600 is information about data used for training provided for each treatment content. The training data 600 includes information such as a training ID, an AR model ID, a checkpoint ID, and an NG area ID, and values ​​such as those shown as sample values ​​620 are input for each field name 610.

[0053] The training ID is a code given to identify the training provided for each treatment content. The treatment content may include, for example, steps such as tooth extraction, incision, drilling, and implant insertion. The checkpoint ID is a code given to identify information related to the treatment content (checkpoint) to be checked, which is set for each training or for each treatment step of the training. The NG area ID is a code given to identify information indicating the NG area for each AR model. The treatment content may differ depending on the patient. In addition, the spread of the NG area may differ depending on the patient. The ID of the training performed for each treatment content for the AR model and the ID of the checkpoint and the NG area used in the training are linked by this training data 600.

[0054] FIG. 7 is an example of check data 700. The check data 700 is information on the contents to be checked for each checkpoint ID. For example, in the check data 700, values ​​such as those exemplified by sample values ​​720 are input for field names 710 including detailed checkpoint IDs (detailed CPIDs). The contents of the information indicated by the sample values ​​720 are written in the summary 730 column. For example, the check data 700 includes information on treatment conditions that must be met when performing treatment. For example, the check data 700 includes information indicating areas that require attention and areas that should not be treated, based on the characteristics of a living body. The contents of the check data 700 are not limited to this example. Although not specifically described, the check data 700 can be set for each treatment content or each treatment step, for example.

[0055] The check data 700 may include, for example, information regarding the tool to be used. The information regarding the tool may include, for example, a tool ID for identifying the tool, information regarding the 3D shape of the tool, and information such as the type of tool to be used for each treatment step. The check data 700 may also include, for example, information regarding the treatment position and treatment depth of the tool, the angle (posture) of the tool, and the like. As described above, the NG area data 800 shown below is an example of the check data 700.

[0056] FIG. 8 is an example of NG area data 800. The NG area data 800 is information about the NG area. The NG area data 800 is, for example, information about the position of one or more NG areas provided for each AR model identified by an AR model ID. The NG area may be provided for each detailed checkpoint ID so as to correspond to the detailed checkpoint ID indicated in the check data 700. For example, the NG area may be provided so as to include a case where the treatment condition (check content) to be satisfied at the checkpoint identified by each detailed checkpoint ID is not satisfied. In this embodiment, the information about the position of the NG area is expressed, for example, as a three-dimensional coordinate group (hereinafter, may be simply referred to as a "coordinate group"). However, the position information in the present technology is not limited to this. In the NG area data 800, for example, values ​​such as those exemplified by the sample value 820 are input for the field name 810. In addition, the content indicated by the sample value 820 is described in the summary 830 column.

[0057] [Dental treatment support method] In this embodiment, the dental treatment support system 100 is used to evaluate treatment (training) on ​​a dental arch model. [Training Preparation] First, a brief description of training preparation will be given. Figure 9 shows an example of a training preparation flow 900.

[0058] In step S910, the dental CT acquisition module 212 of the management server 101 acquires dental CT data of a patient imaged in advance, for example, from the user terminal 102. Then, in step S920, the AR data generation module 213 creates 3D model data (base data) for the dentition model and the AR model based on the acquired dental CT data.

[0059] In step S930, the AR data generation module 213 creates AR model data from the 3D model data. Fig. 18 is an example of an AR model 1800. In Fig. 18, from the viewpoint of ease of viewing the drawing, only the left side of the mandible of the AR model 1800 is displayed by dividing the mandible by the median plane. The AR model 1800 includes, for example, a mandible model 1810 and a tooth model 1820. As shown in this AR model 1800, the related patient is missing a first molar.

[0060] In step S940, the NG area data generation module 215 creates NG area data from the 3D model data for the dentition model. The NG area data generation module 215 processes, for example, characteristic part data related to the mandibular canal, and generates the mandibular canal and a region surrounding it with a thickness of 3 mm as NG area data.

[0061] 20 shows an example of an AR model 2000 and a NG area 2030. The AR model 2000 includes a mandible model 2010 and a tooth model 2020. The NG area 2030 is one of the NG areas displayed based on the NG area data created by the NG area data generation module 215. The NG area 2030 has an area that combines a portion corresponding to the mandibular canal and a portion 3 mm around the portion. The tool 2040 is, for example, a treatment sample that shows an ideal treatment example for the mandible model 2010.

[0062] The NG area data generation module 215 can generate NG area data not only for the NG area 2030 shown in Fig. 20 but also for multiple other checkpoints. For example, the NG area data generation module 215 processes the tooth model data and generates NG area data for the tooth and an area surrounding it with a thickness of 1.5 mm. The tooth may be any of a natural tooth, a denture, and an implant.

[0063] FIG. 21 shows another example of the AR model 2100 and the NG area 2130. The AR model 2100 includes a mandible model 2110 and a tooth model 2120. The NG area 2130 is one of the NG areas displayed based on the above-mentioned NG area data created by the NG area data generation module 215. The NG area 2130 has an area that combines a part corresponding to the tooth and a part 1.5 mm around it. The NG area data generation module 215 can create NG area data not only for the NG area 2130 shown in FIG. 21 but also for a plurality of other NG areas. The tool 2140 is, for example, a treatment sample that shows an ideal treatment example for the mandible model 2110.

[0064] In step S950, the dentition model generating module 214 generates dentition model data. The dentition model generating module 214 generates the dentition model data based on, for example, one or more of the base data and the characteristic part data. The dentition model generating module 214 generates the dentition model data in, for example, an STL format. Here, for example, the dentition model data generated based on the base data and the characteristic part data generated based on the same base data are associated with each other. In addition, for example, the dentition model data and the characteristic part data are associated with each other and stored in, for example, the auxiliary storage device 202. Note that, if the AR data generating module 213 generates the base data in, for example, an STL format, the generation of the dentition model data in step 950 can be omitted.

[0065] In step S960, the dentition model generating module 214 outputs the created dentition model data to the 3D printer 103. As a result, the 3D printer models the dentition model. The configuration, type, etc. of the 3D printer are not particularly limited, and for example, one or a combination of two or more of various 3D printers such as a liquid vat photopolymerization type, an inkjet type, and a powder lamination type can be used. Note that the material used to model the dentition model is not limited to resin, and may be resin, ceramic, metal, or a composite material thereof in part or in whole. In this way, a dentition model of a patient to be used for training can be obtained.

[0066] The dental model of this embodiment is composed of only the mandible and the left part of the lower dentition. For this dental model, for example, a softer resin can be used to integrally form the model artificial periosteum and the artificial gingiva. This makes it possible to realize a dental model having an outer shape corresponding to the user's jaw, and training can be performed under conditions closer to actual surgery. This dental model is, for example, sent to the user. This dental model is missing a first molar on the left side of the mandible. Using this dental model, the user can receive training on, for example, surgery to embed an implant at the position of the first molar. The material used to form the dental model is not limited to resin, and may be resin, ceramic, metal, or a composite material thereof in part or in whole.

[0067] Although not limited thereto, the dentition model generating module 214 may generate dentition model data by using, for example, any of the above-mentioned AR model data 500 and data in an image file format generated by the AR data generating module 213. For example, with respect to hard tissues, the dentition model generating module 214 may generate upper jaw model data from data of the upper jaw and upper dentition portion, and generate lower jaw model data from data of the mandible and lower dentition portion. The dentition model generating module 214 may generate the upper jaw model data and the lower jaw model data so as to include, for example, any one or a combination of two or more of the above-mentioned characteristic portion data.

[0068] Furthermore, the dentition model generating module 214 may generate dentition model data by using, for example, any of the above-mentioned characteristic part data generated by the AR data generating module 213. Specifically, for example, the dentition model generating module 214 may generate upper jaw model data and / or lower jaw model data including at least one or more characteristic parts of a tooth part, a dental pulp part, a jawbone part, a nerve or artery and vein, a cyst, a tumor, and other lesions. The dentition model generating module 214 typically forms these characteristic part data so that they fit together without overlapping with each other. This allows these characteristic parts to be structurally reflected in the upper jaw model and / or the lower jaw model. For example, it is possible to form a dentition model having a structure corresponding to the AR model displayed in this system. Furthermore, by using such dentition model data, it is possible to form these characteristic parts in the upper jaw model and / or the lower jaw model in a color and / or a material different from other parts.

[0069] Furthermore, the dentition model generating module 214 may generate upper jaw model data and / or lower jaw model data that does not include at least one of the above-mentioned characteristic parts in the upper jaw part and the lower jaw part, leaving the characteristic part empty. For example, when cancellous bone tissue does not affect the treatment, the dentition model generating module 214 may generate dentition model data that does not include cancellous bone tissue and leaves the cancellous bone tissue part empty. By using such dentition model data, it is possible to form an upper jaw model and / or a lower jaw model that does not include cancellous bone tissue, thereby making it possible to reduce the weight of the dentition model, save on the material for forming, and reduce the cost.

[0070] FIG. 19 is an example of a molded dental model 1900. The dental model 1900 of this embodiment is composed of only the mandible and the left part of the lower dentition. For this dental model 1900, for example, a model artificial periosteum and artificial gingiva can be integrally formed using a softer resin. This makes it possible to realize a dental model having an outer shape corresponding to the AR model, and training can be performed under conditions closer to actual surgery. This dental model is sent to a user, for example. This dental model is missing a first molar on the left side of the mandible. Using this dental model, a user can perform training for a surgery to embed an implant at the position of the first molar, for example.

[0071] [Training Preparation] The flow of the treatment training by the user will be described. FIG. 10 is an example of a treatment evaluation flow 1000.

[0072] The user prepares a dental model and prepares for implant insertion surgery into the dental model. For example, based on a treatment plan created in advance, the user prepares an implant body (which may be for practice) and surgical tools required for the implant insertion surgery. Once the preparations are complete, the user accesses a dental treatment support site on the web via the user terminal 102, for example, and selects a desired training from a training menu. Here, for example, the user can select training for implant insertion surgery using an AR model that corresponds to the dental model obtained by the user and is linked by a user ID.

[0073] When the user selects the desired treatment content for the dentition model, in step S1010, the reception module 312 of the user terminal 102 receives the selection of the treatment content. The reception module 312 cooperates with the management module 311 of the management server 101, and transmits information about the training selected by the user (for example, the "drilling process (drilling, making a hole)" step in an implant insertion surgery) to the management server 101. The management module 311 of the management server 101 that has received the information about the training selected by the user transmits AR data and check data corresponding to the selected training to the user terminal 102.

[0074] Therefore, in step S1020, the data acquisition module 313 acquires AR model data and check data (including NG area data 800) corresponding to the selected training (for example, the "drill step (implantation hole formation)" step in the implant insertion surgery). Then, in step S1030, the display module 314 displays the AR model and the NG area on a display (for example, a head-mounted display) based on the AR model data and the NG area data. The display module 314 can display the AR model and the NG area on the display as, for example, a transparent image.

[0075] FIG. 22 is a diagram illustrating an example of superimposing the AR model 2220 on the dental model 2210. Here, when the imaging function (for example, the camera 306 provided in the head mounted display) of the user terminal 102 is not operating, the display module 314 may be configured to activate the imaging function. For example, an object tracking function is implemented in the AR model data. In addition, the display module 314 is configured to be able to recognize the three-dimensional shape of the object to be imaged. Therefore, as shown in FIG. 22, when the user images the dental model 2210 with the camera 306, the dental model 2210 is displayed on the display and the three-dimensional shape of the dental model 2210 is recognized.

[0076] This allows the display module 314 to display the AR model 2220 and / or the NG area (not shown) in association with the dental model being imaged as the origin (see, for example, FIG. 23(B) and FIG. 24(B)). That is, the display module 314 displays the AR model 2220 in association with the dental model 2210 so that the up-down, front-back, left-right orientations and dimensions of the dental model 2210 match the up-down, front-back, left-right orientations (common origin) and dimensions of the AR model 2220 and the NG area. As a result, the user can roughly grasp where on the dental model 2210 the NG area is located.

[0077] The AR model 2220, the NG area, and the dental model 2210 are created based on the same 3DCT data. Therefore, for more accurate tracking, the AR model 2220, the NG area data, and the dental model 2210 may each be provided with three or more corresponding markers. For example, the evaluation module 315 may be configured to superimpose the AR model 2220, the NG area, and the dental model 2210 in a state where at least one of the occlusal plane and the Camper plane coincides. The occlusal plane can be defined as, for example, a plane including the midpoint (incisal point) between the mesial angles of the left and right mandibular central incisors and the distal buccal cusp tips of the left and right mandibular second molars. The Camper plane can be defined as, for example, a plane including the subala point and the left and right upper edge points of the tragus. In addition, markers may be provided for each part defining the occlusal plane and / or the Camper plane, or for any combination of other characteristic parts such as the incisive papilla, the maxillary tuberosity, and the hard palate. This makes it possible to superimpose and track the AR model 2220, the NG area, and the dental model 2210 while reducing deviations in position, inclination, size, and the like.

[0078] [Treatment and its evaluation] The user can perform a treatment on the dental model while wearing, for example, AR glasses. When forming an implant bed, the user uses, for example, a cutting tool (drill, cutting bar) to form an implant cavity (prepared hole) for embedding an implant body at a predetermined position (here, the position of the first molar on the left side of the mandible). When forming the implant cavity, for example, the position, depth, implant embedding direction, etc. need to be appropriately managed. In step S1040, the evaluation module 315 evaluates the user's treatment on the dental model based on the check data, and outputs (displays) the evaluation result on the display.

[0079] <Treatment evaluation 1> 11 is an example of a treatment evaluation process flow 1100 that corresponds to step S1040 of the treatment evaluation flow 1000.

[0080] In step S1110, the evaluation module 315 acquires, for example, position information of a tool during treatment. The evaluation module 315 captures an image of the tool together with the dentition model using, for example, the camera 306, and recognizes and analyzes the 3D form using an image processing function. The evaluation module 315 thereby acquires, for example, relative position information of the tool with respect to the dentition model. The evaluation module 315 can acquire, for example, position information of a tool being drilled by a user during formation of an implantation cavity in real time.

[0081] In step S1120, the evaluation module 315 compares the tool position based on the tool position information with the NG area defined by the NG area data 800. Then, in step S1130, the evaluation module 315 determines whether the tool position and the NG area overlap. For example, when evaluating a procedure based on the NG area 2030 shown in Fig. 20, the evaluation module 315 judges whether the position (e.g., a group of coordinates) of the tool 2040 overlaps with the NG area 2030 (e.g., a group of coordinates). In other words, it evaluates whether the detailed checkpoint ID satisfies the check condition defined in "CP001-04", "the distance between the implant and the mandibular canal is approximately 3 mm or more".

[0082] If the tool position and the NG area do not overlap (No in step S1130), the evaluation module 315 outputs information indicating that the treatment is appropriate in step S1140. On the other hand, if the tool position and the NG area overlap (Yes in step S1130), the evaluation module 315 outputs information indicating that the treatment is inappropriate in step S1150. The evaluation module 315 evaluates the treatment in real time, for example, and outputs the result.

[0083] The method of outputting whether the treatment is appropriate or not is not particularly limited. The evaluation module 315 may output that the treatment is appropriate by, for example, lighting a green or blue light on the display, and may output that the treatment is inappropriate by, for example, lighting a red or yellow light on the display. The evaluation module 315 may also output that the treatment is appropriate by, for example, displaying a character or symbol indicating that the treatment is appropriate on the display, and may output that the treatment is inappropriate by, for example, displaying a character or symbol indicating that the treatment is inappropriate on the display.

[0084] Furthermore, for example, when the treatment is appropriate, the evaluation module 315 may indicate that the treatment is appropriate by not outputting anything, and may output that the treatment is not appropriate only when the treatment is inappropriate. Also, for example, the evaluation module 315 may output information indicating whether the treatment is appropriate or inappropriate by causing the user terminal 102 to execute any one or more operations perceptible to the user. An operation perceptible to the user is, for example, any one or a combination of two or more of display of information by light, characters, figures, etc., generation of sound, generation of vibration, and the like.

[0085] For example, the evaluation module 315 may output that the treatment is appropriate by outputting a brisk and clear correct sound from a speaker, or may output that the treatment is not appropriate by outputting an incorrect sound such as a low cracking sound (for example, a buzzer sound). Furthermore, for example, the evaluation module 315 may output that the treatment is appropriate by causing an oscillator to output a single vibration, and may output that the treatment is not appropriate by causing the oscillator to output a plurality of continuous vibrations. The evaluation module 315 may output a combination of any of the above.

[0086] For example, as shown in FIG. 7, one treatment step in training may include a plurality of checkpoints. Therefore, in step S1160, the evaluation module 315 checks, for example, for each treatment step whether the evaluation of all checkpoints has been completed. If the evaluation of all checkpoints has not been completed (No in step S1160), the evaluation of the next checkpoint is performed as shown in step S1170. Then, for example, when the evaluation of all checkpoints has been completed (Yes in step S1160), the evaluation process flow 1100 for the treatment evaluation is terminated.

[0087] <Non-display mode of the AR model> In the above description, the display module 314 displayed the AR model and the NG area on the display during the user's treatment. In this case, the user can perform the treatment while checking the NG area with the head-mounted display on. However, the display module 314 may be configured to be able to accept, for example, the user's selection to hide the AR model and the NG area. When the display module 314 accepts the selection to hide the AR model and the NG area, it does not display the AR model and the NG area on the display.

[0088] <Image Training Using AR Model> Also, in the above description, the display module 314 displayed the AR model and the NG area on the display during the user's treatment. In this case, the user can perform the treatment while checking the NG area with the head-mounted display on. However, the display of the AR model and the NG area on the display by the display module 314 is not limited to during the user's treatment. For example, the display module 314 can display the AR model and the NG area on the display when the user is not performing the treatment.

[0089] In this case, the AR model can include, for example, a treatment result model. The treatment result model can be, for example, a treatment result model (e.g., a tool model in a state where ideal cutting has been performed) representing an ideal treatment mode for each treatment step, created under the supervision of a skilled dentist. The display module 314 can display this treatment result model (e.g., the tool model) together as the AR model. Thereby, the user can, for example, perform image training on the ideal treatment for the patient's dental model before the actual training or treatment. Thereby, the load on the actual training or treatment can be reduced.

[0090] <Treatment Evaluation 2> In the above description, the user performs the treatment while wearing the head mounted display. However, if the user does not like the treatment while wearing the head mounted display, the evaluation module 315 may evaluate the treatment with respect to the dental model after the treatment by the user (post-treatment evaluation mode).

[0091] FIG. 23 is an example of a screen 2300 during treatment evaluation. The display module 314 displays, for example, (B) an AR model 2320 (and a NG area) corresponding to the step in question, superimposed on (A) a post-treatment dentition model 2310. The evaluation module 315 acquires position information about a tool used in the treatment (step S1110) and compares the position of the tool with the NG area (step S1120).

[0092] If the tool position does not overlap with the NG area (No in step S1130), the evaluation module 315 outputs (C) that the treatment is appropriate (step S1140). If the tool position overlaps with the NG area (Yes in step S1130), the evaluation module 315 outputs that the treatment is inappropriate (step S1150). With this configuration, the treatment can also be evaluated.

[0093] <Treatment evaluation 3> 12 is another example of a treatment evaluation process flow 1200 that may correspond to step S1040 of the treatment evaluation flow 1000. The treatment evaluation process flow 1200 is a flow in the case where multiple NG areas are set for one checkpoint. For example, the AR data generation module 213 processes the characteristic part data related to the mandibular canal, creates a first NG area data for the mandibular canal and an area surrounding it with a thickness of 3 mm, and additionally creates a second NG area data for the mandibular canal and an area surrounding it with a thickness of 3.5 mm.

[0094] In step S1020, the data acquisition module 313 acquires AR model data corresponding to the selected training (for example, the "drilling process (hole making)" step) and check data including the first NG area data and the second NG area data.

[0095] For example, the evaluation module 315 first confirms that the treatment is not completed in step S1205 (No in S1205), and acquires position information of the tool in step S1210. The evaluation module 315 can acquire, for example, relative position information of the tool with respect to the dentition model by, for example, capturing an image of the tool with the camera 306 and recognizing the 3D form of the tool with an image processing function. For example, the evaluation module 315 acquires, in real time, position information of the tool being moved by the user during the treatment.

[0096] In step S1215, the evaluation module 315 compares the tool position (e.g., a group of coordinates) based on the tool position information with the second NG area (e.g., a group of coordinates) defined by the NG area data 800. Then, in step S1220, the evaluation module 315 determines whether the tool position and the second NG area overlap. In other words, for example, in relation to the check condition defined by the detailed checkpoint ID "CP001-04" in Fig. 7, it is evaluated whether the distance between the implant and the mandibular canal is approximately 3.5 mm or more.

[0097] If the position of the tool does not overlap with the second NG area (No in step S1220), the evaluation module 315 returns to step S1205 and continues the treatment. On the other hand, if the position of the tool overlaps with the second NG area (Yes in step S1220), the evaluation module 315 outputs information indicating that the treatment should be performed with caution in step S1225. In other words, the evaluation module 315 notifies the user that the first NG area is approaching.

[0098] The evaluation module 315 then confirms in step S1230 that the treatment is not complete (No in S1230), and acquires the tool position information in step S1235. Then, in step S1240, the evaluation module 315 compares the tool position (e.g., a set of coordinates) based on the tool position information with the first NG area (e.g., a set of coordinates) defined by the NG area data 800. Then, in step S1245, the evaluation module 315 determines whether the tool position and the first NG area overlap. In other words, for example, in relation to the check condition defined by the detailed checkpoint ID "CP001-04" in FIG. 7, it evaluates whether the distance between the implant and the mandibular canal is approximately 3 mm or more.

[0099] If the position of the tool does not overlap with the first NG area (No in step S1245), the evaluation module 315 returns to step S1230 and continues the treatment. On the other hand, if the position of the tool overlaps with the first NG area (Yes in step S1245), the evaluation module 315 outputs information indicating that the treatment is inappropriate in step S1250.

[0100] It should be noted that, in step S1205, when the evaluation module 315 confirms that the treatment has been completed (Yes in S1205), it can end the treatment evaluation process flow 1200. For example, the evaluation module 315 can complete the treatment without outputting information indicating that the treatment should be careful about. In addition, in step S1230, when the evaluation module 315 confirms that the treatment has been completed (Yes in S1230), it can end the treatment evaluation process flow 1200. For example, the evaluation module 315 can complete the treatment without outputting information indicating that the treatment is inappropriate, after outputting information indicating that the treatment should be careful about.

[0101] According to the above configuration, for example, before the drilling reaches the first NG area in the drilling step, etc., it is possible to warn that the drilling is close to the first NG area. This allows users who are not accustomed to reading dental CT images or users who have little experience in implant insertion surgery to recognize that they are performing the procedure close to an inappropriate area without performing an inappropriate procedure (i.e., without accumulating failure experience), and to gain experience in the procedure.

[0102] In addition, for an implant surgery instrument (for example, a surgical tool), depending on the tip shape of the tool (cutting tip) used, there may be a portion where the cutting depth is deeper than the effective cutting length. According to the above configuration, for example, for a tool used for the first time, the treatment sensation remembered by the user can be associated with the actual treatment result, enabling more appropriate treatment.

[0103] In this example, the NG area data generation module 215 generates two NG areas, a first NG area and a second NG area, but the number of NG areas and the method of setting the areas are not limited to the above example. For example, the NG area data generation module 215 may generate a location other than the ideal treatment area as a third NG area. In this case, the evaluation module 315 can output information indicating that the tool position is outside the ideal treatment area when the tool position overlaps with the third NG area. This allows users who are not accustomed to reading dental CT images or users who have little experience in implant insertion surgery to perceive the extent to which the ideal treatment area extends, and further cultivate treatment experience.

[0104] <Treatment evaluation 4> FIG. 13 is another example of a procedure evaluation process flow 1300 that may correspond to step S1040 of the procedure evaluation flow 1000. The procedure evaluation process flow 1300 is a flow for evaluating whether the angle of the tool is appropriate at one checkpoint. In an implant insertion operation, for example, in order to stably fix the implant body, it is required to embed at least a part of the implant body in a relatively hard part near the side of the jawbone (buccolingual side) while securing a certain distance from the buccal and lingual sides. In addition, in order to avoid perforation of the maxillary sinus, chin, etc., the implant body may be intentionally inclined with respect to the mandible (inclined insertion). There is a certain amount of leeway (tolerance) in the appropriate implantation position and implantation angle, but even if the entire implant is placed in the appropriate implantation position, if the axis of the implant is too far off from the optimal angle, it is not preferable from the viewpoints of occlusal function, fixation force, and aesthetics. The data acquisition module 313 evaluates whether the angle of the tool during implant hole preparation is appropriate in the selected training (eg, the "drilling" step).

[0105] FIG. 24 is another example of the in-treatment screen 2400. The evaluation module 315 acquires position information (e.g., a coordinate group) of the tool in step S1310. The evaluation module 315 can acquire the position information of the tool by capturing an image of the tool with the camera 306, for example, as shown in FIG. 24(A).

[0106] In step S1320, the evaluation module 315 acquires axis information of the tool, for example, from the position information of the tool. The evaluation module 315 can acquire the axis information of the tool used by the user for treatment, for example, based on a comparison between the 3D shape information of the tool stored in the check data 700 and the axis information. Alternatively, the evaluation module 315 may be configured to calculate the axis direction of the tool by three-dimensionally analyzing a group of coordinates of the tool extending in the longitudinal direction, for example.

[0107] In step S1330, the evaluation module 315 acquires an angle related to the treatment position of the tool based on the axis information of the tool. The axis information of the tool can be, for example, vector information defined based on the position information of two different points on the axis. This makes it possible to grasp, for example, the relative positional relationship of the user's treatment tool with respect to the ideal treatment posture of the tool (the tool posture in the treatment plan).

[0108] The check data includes, for example, treatment angle data of a tool used for treatment on the dentition model. The treatment angle data indicates a range of appropriate angles (postures) of the tool with respect to the treatment position of the dentition model, and can be set based on a treatment plan. In step S1340, the evaluation module 315 compares the angle of the tool with the appropriate angle range, for example, as shown in FIG. 24(B). In step S1350, the evaluation module 315 evaluates whether the angle of the tool with respect to the treatment position is outside the appropriate angle range, and outputs that the treatment is appropriate (step S1360) if the angle of the tool is within the appropriate angle range (No in step S1350). On the other hand, if the angle of the tool is outside the appropriate angle range (Yes in step S1350), the evaluation module 315 outputs that the treatment is not appropriate (step S1370) as shown in FIG. 24(C). With this configuration, the angle of the tool in the treatment can be evaluated. The evaluation of the angle of the tool in the treatment can be evaluated in parallel with other checkpoints (for example, the position of the tool).

[0109] <Treatment evaluation 5> 14 is another example of a treatment evaluation process flow 1400 that may correspond to step S1040 of the treatment evaluation flow 1000. In the above treatment evaluations 1 to 3, a NG area was set based on characteristic part data related to the running positions of nerves and blood vessels, etc., by providing a predetermined distance around the area. Then, it was evaluated whether the position of the tool overlapped with this NG area. In treatment evaluation 5, the characteristic part data related to the running positions of nerves and blood vessels, etc. are used as NG area data, and the running positions of nerves and blood vessels, etc. are used as NG area data to evaluate the treatment.

[0110] The evaluation module 315 acquires, for example, in step S1410, position information (for example, a group of coordinates) of the tool. In step S1420, the evaluation module 315 acquires tool perimeter information indicating a predetermined range surrounding the tool, for example, based on the tool position information. For example, the evaluation module 315 can set a range surrounding the tool with a thickness of 1.5 mm as the tool perimeter information for a tooth located next to the treatment position. The evaluation module 315 can also set a range surrounding the tool with a thickness of 3 mm as the tool perimeter information for an adjacent implant. Furthermore, the evaluation module 315 can set a range surrounding the tool with a thickness of 5 mm as the tool perimeter information for a mental foramen.

[0111] For example, in step S1430, the evaluation module 315 compares the tool periphery defined by the tool periphery information with the NG area. The NG area is, for example, a tooth located next to the treatment position, an adjacent implant, and a mental foramen. In step S1440, the evaluation module 315 evaluates whether the tool periphery overlaps with the NG area, and if the tool periphery does not overlap with the NG area (No in step S1440), it outputs that the treatment is appropriate (step S1450). On the other hand, if the tool periphery overlaps with the NG area (Yes in step S1440), the evaluation module 315 outputs that the treatment is not appropriate (step S1460). With this configuration, the treatment (for example, position, depth, angle, etc.) can be evaluated. Note that this treatment evaluation can be performed simultaneously for multiple checkpoints (for example, a tooth located next to the treatment position, an adjacent implant, and a mental foramen).

[0112] <Treatment evaluation 6> FIG. 15 is another example of a procedure evaluation process flow 1500 that may correspond to step S1040 of the procedure evaluation flow 1000. The above procedure evaluations 1 to 5 have described the evaluation of the formation of a single implantation cavity using one tool. In an implant insertion surgery, when forming an implantation cavity, multiple tools with different cutting diameters are used in ascending order of diameter to gradually enlarge the shape of the hole. In procedure evaluation 6, an evaluation is made on the case where a first tool and a second tool with different diameters are used to cut at the same position.

[0113] The user forms an implantation cavity using a first tool. The formation of the hole using the first tool can be evaluated by the above-mentioned treatment evaluation method. For example, in step S1510, the evaluation module 315 acquires position information (for example, a coordinate group) of the first tool. Then, in step S1520, the evaluation module 315 acquires position information of the first treatment area by the first tool. Here, the evaluation module 315 estimates the first treatment area as an overlapping portion between the jawbone part based on the position information of the jawbone part included in the AR model and the position of the tool based on the position information of the tool. Then, the evaluation module 315 generates position information of the first treatment area based on the overlapping portion between the jawbone part and the tool position.

[0114] In step S1530, the evaluation module 315 generates position information of the second NG area based on the generated position information of the first treatment area so that an area that is a predetermined distance or more away from the first treatment area becomes the second NG area. This predetermined distance that defines the second NG area corresponds to a value obtained by adding a radius difference between the first tool and the second tool to a deviation tolerance.

[0115] The user uses a second tool to form a hole overlapping the first treatment area. The evaluation module 315 acquires position information of the second treatment area by the second tool in step S1540. Specifically, the evaluation module 315 first acquires position information of the second tool, and generates position information of the second treatment area in the same manner as the first treatment area. Then, the evaluation module 315 compares the second NG area with the second treatment area in step S1550, and evaluates whether the second NG area and the second treatment area overlap in step S1560.

[0116] If the second NG area and the second treatment area do not overlap (No in step S1560), the evaluation module 315 outputs that the treatment is appropriate (step S1570). On the other hand, if the second NG area and the second treatment area overlap (Yes in step S1560), the evaluation module 315 outputs that the treatment is not appropriate (step S1580). With this configuration, it is possible to evaluate whether the treatment is appropriate when the same position is treated in overlapping fashion. Note that the same evaluation can also be performed when the same position is treated three or more times in overlapping fashion.

[0117] <Treatment evaluation 7> FIG. 16 is another example of a procedure evaluation process flow 1600 that may correspond to step S1040 of the procedure evaluation flow 1000. In procedure evaluation 6, evaluation is performed for the case where a first tool and a second tool of different diameters are used to cut at the same position. When embedding multiple implants, multiple implantation holes may be formed at adjacent positions, for example. In this case, adjacent implants need to be spaced apart by 3 mm or more based on the distal or mesial cervical part. Therefore, in procedure evaluation 7, evaluation is performed for the case where implantation holes are formed at adjacent positions.

[0118] The user uses a tool to form a first hole. The formation of the first hole can be evaluated by treatment evaluations 1 to 5, etc. The evaluation module 315 acquires position information of the tool (e.g., a coordinate group) in step S1610, for example. Then, the evaluation module 315 acquires position information of the formed first treatment area in step S1620. The method of acquiring the position information of the treatment area can be the same as in treatment evaluation 6.

[0119] Then, in step S1630, the evaluation module 315 generates position information of the second NG area so as to include the first treatment area and an area of ​​a predetermined range surrounding the first treatment area. This predetermined distance defining the second NG area can be set in the treatment plan so that the distance between the cervical parts of the first implant and the adjacent second implant is 3 mm or more, taking into consideration the dimensions of the implant bodies and crown parts used in the first implant and the adjacent second implant.

[0120] The user continues to use the same tool, for example, to form a second hole at the formation position of the insertion hole of the second implant. In step S1640, the evaluation module 315 acquires position information of the second treatment area for the second hole. Specifically, the evaluation module 315 first acquires position information of the tool when the second hole is formed, and estimates the second treatment area as an overlapping portion between the jawbone part based on the position information of the jawbone part included in the AR model and the position of the tool based on the position information of the tool when the second hole is formed. Then, the evaluation module 315 generates position information of the second treatment area based on the overlapping portion between the jawbone part and the tool position.

[0121] Then, in step S1650, the evaluation module 315 compares the second NG area with the second treatment area, and in step S1660, evaluates whether the second NG area and the second treatment area overlap. If the second NG area and the second treatment area do not overlap (No in step S1660), the evaluation module 315 outputs that the treatment is appropriate (step S1670), and if the second NG area and the second treatment area overlap (Yes in step S1660), the evaluation module 315 outputs that the treatment is not appropriate (step S1680). With this configuration, it is possible to evaluate whether the treatment is appropriate when implants are placed in adjacent positions. It is also possible to similarly evaluate when three implants are placed adjacent to each other.

[0122] <Control of the second prohibited area> Regarding treatment evaluations 6 and 7, the evaluation module 315 may be configured to change the second NG area for the second treatment relative to the first NG area for the first treatment based on the check data when at least one of the tool and treatment position of the second treatment is different from that of the first treatment. Such processing can be preferably realized by, for example, flag processing.

[0123] For example, the evaluation module 315 can be configured in advance to execute a process of calculating information about the first treatment area and a predetermined range of areas surrounding the first treatment area based on the flag A. For example, if the tools used for the first treatment and the second treatment are the same, the flag A is set, and if the tools used for the first treatment and the second treatment are different, the flag A is not set. According to such a configuration, for example, as shown in treatment evaluation 6, if the tools used for the first treatment and the second treatment are different, the flag A is not set, so the evaluation module 315 operates not to include the above-mentioned predetermined range of areas in the second NG area. For example, as shown in treatment evaluation 7, if the tools used for the first treatment and the second treatment are the same, the flag A is set, so the evaluation module 315 operates to include the above-mentioned predetermined range of areas in the second NG area.

[0124] In other words, if the tools used for the first treatment and the second treatment are the same, the evaluation module 315 (an example of an evaluation unit) includes the first treatment area and a specified area surrounding the first treatment area in the second NG area, and if the tools used for the first treatment and the second treatment are different, the evaluation module 315 (an example of an evaluation unit) does not include the first treatment area and a specified area surrounding the first treatment area.

[0125] Also, for example, the evaluation module 315 can be configured in advance to execute a process of calculating information about an area farther away than a predetermined range surrounding the first treatment area based on a predetermined flag B. For example, when the treatment area is the same between the first treatment and the second treatment, the flag B is set, and when the treatment area is different between the first treatment and the second treatment, the flag B is not set. According to such a configuration, for example, as shown in treatment evaluation 6, when the treatment area is the same between the first treatment and the second treatment, the flag B is set, so the evaluation module 315 operates to include the area of ​​the above-mentioned predetermined range in the second NG area. And, for example, as shown in treatment evaluation 7, when the treatment area is different between the first treatment and the second treatment, the flag B is not set, so the evaluation module 315 operates not to include the area of ​​the above-mentioned predetermined range in the second NG area.

[0126] In other words, if the treatment area is the same for the first treatment and the second treatment, the evaluation module 315 (an example of an evaluation section) includes an area that is further than a specified range surrounding the first treatment area in the second NG area, and if the treatment area is different for the first treatment and the second treatment, the evaluation module 315 (an example of an evaluation section) does not include an area that is further than a specified range surrounding the first treatment area in the second NG area.

[0127] The above flags A and B may be used in combination. For example, if the tools used in the first and second treatments are the same, flag A is set, and if the tools used in the first and second treatments are different, flag B is set. As a result, for example, as shown in treatment evaluation 7, if the tools used in the first and second treatments are the same, flag A is set, and the evaluation module 315 operates to include the first treatment area and a predetermined range surrounding it in the second NG area. And, for example, as shown in treatment evaluation 6, if the tools used in the first and second treatments are different, flag B is set, and the evaluation module 315 operates to include an area farther away than the predetermined range surrounding the first treatment area in the second NG area.

[0128] In other words, if the tools used for the first treatment and the second treatment are the same, the evaluation module 315 (an example of an evaluation section) includes the first treatment area and a predetermined range surrounding the first treatment area in the second NG area, and if the tools used for the first treatment and the second treatment are different, the evaluation module 315 (an example of an evaluation section) includes an area further away than the predetermined range surrounding the first treatment area in the second NG area.

[0129] Also, for example, if the treatment area is the same between the first treatment and the second treatment, flag B is set, and if the treatment area is different between the first treatment and the second treatment, flag A is set. As a result, for example, as shown in treatment evaluation 6, if the treatment area is the same between the first treatment and the second treatment, flag B is set, so the evaluation module 315 operates to include an area farther away than a predetermined range surrounding the first treatment area in the second NG area. And, for example, as shown in treatment evaluation 7, if the treatment area is different between the first treatment and the second treatment, flag A is set, so the evaluation module 315 operates to include the first treatment area and a predetermined range of areas surrounding it in the second NG area.

[0130] In other words, if the treatment area is the same for the first treatment and the second treatment, the evaluation module 315 (an example of an evaluation section) includes an area farther away than a specified range surrounding the first treatment area in the second NG area, and if the treatment areas are different for the first treatment and the second treatment, the evaluation module 315 (an example of an evaluation section) includes the first treatment area and an area of ​​a specified range surrounding the first treatment area in the second NG area.

[0131] According to the above configuration, when the second NG area is calculated based on the first or second treatment area, the operation of the evaluation module 315 can be simplified.

[0132] <Treatment evaluation 8> FIG. 17 is another example of a surgical procedure evaluation process flow 1700 that may correspond to step S1040 of the surgical procedure evaluation flow 1000. When implanting an implant, a plurality of tools with different cutting diameters are used to form an implantation cavity. The tools may vary depending on, for example, the dimensions of the implant to be used and the hardness of the patient's mandible. For example, to form one implantation cavity, about 5 to 8 tools are selected from about 6 to 10 tools (cutting tips). A user who is not familiar with using tools may mistake the tool to be used. Therefore, in the surgical procedure evaluation 8, the type of cutting tool used to form the implantation cavity and the order of use thereof are evaluated. The check data 700 includes information on the cutting tools used to form the implantation cavity and the order of use thereof for each patient (i.e., for each AR model ID) based on the treatment plan.

[0133] The user mounts a cutting tool on the cutting drill to prepare for forming a first hole. For example, the user captures an image of the tool to be used with the camera 306. For example, in step S1710, the evaluation module 315 acquires information about the tool to be used in the treatment based on the captured image data. The information about the tool is a feature for identifying the tool that is provided in advance on the tool, and may be, for example, the 2D or 3D shape of the tool, a color identifier, an identification code (letters, numbers, etc.), an engraving, a two-dimensional code, an RFID, etc.

[0134] For example, in step S1720, the evaluation module 315 compares the acquired information about the tool with information about the tool to be used for each treatment. Then, in step S1730, the evaluation module 315 evaluates whether the acquired information about the tool corresponds to the information about the tool to be used based on the check data 700. For example, the evaluation module 315 checks whether the acquired information about the tool (e.g., a tool ID) matches the information about the tool to be used first recorded in the check data.

[0135] When the acquired tool-related information corresponds to the tool-related information to be used (Yes in step S173), the evaluation module 315 outputs that the tool is appropriate (step S1740), and when the acquired tool-related information corresponds to the tool-related information to be used (No in step S1730), the evaluation module 315 outputs that the tool is not appropriate (step S1750). With this configuration, it is possible to evaluate whether the tool that the user is going to use for treatment is appropriate. The second and subsequent tools can also be evaluated in order, for example, for each treatment step.

[0136] <Treatment evaluation 9> Therefore, in treatment evaluation 9, the attachment of this clip-type guide will be evaluated.

[0137] FIG. 25(A) shows an example of a state in which a guide is attached to a dentition model. The guide is a treatment guide that can be used in surgery such as apicoectomy and radicular cystectomy. The guide is, for example, clip-shaped and has a size that covers two adjacent teeth in the mesial and distal directions relative to the tooth loss position at the treatment position. Although such a clip-shaped guide is easy to handle, it has a problem of poor attachment stability. Therefore, in treatment evaluation 9, the attachment of this clip-shaped guide is evaluated.

[0138] This guide is designed so that one guide hole, which is placed on the buccal side of the maxilla when attached to a tooth, corresponds to a position of a lesion such as a tumor at the root end of a tooth. This guide is designed to be able to appropriately guide the drill position (cutting position) to the lesion. The check data 700 includes guide model data corresponding to this clip-type guide for each patient (i.e., for each AR model ID) based on the treatment plan.

[0139] After the user attaches the guide to be used for the treatment to the dental model, the camera 306 captures the dental model with the guide attached. The evaluation module 315 then acquires position information of the guide with respect to the dental model. The position information of the guide can be acquired, for example, as three-dimensional coordinate group information with respect to the dental model. When the relationship between the position information of the guide and the position information of the dental model does not satisfy a predetermined standard based on the check data, the evaluation module 315 outputs information indicating that the method of attaching the guide to the dental model is not appropriate.

[0140] <Gap volume> For example, specifically, the evaluation module 315 acquires position information of the guide with respect to the dentition model, and calculates the volume of the space between the position of the guide based on the position information of the guide (e.g., a group of coordinates) and the position of the dentition model based on the position information of the dentition model (e.g., a group of coordinates). This volume can be calculated based on spatial coordinates. Then, when this calculated volume is larger than a predetermined standard based on the check data (e.g., 10% or more of the volume of the part surrounded by the clip wall of the clip-type guide having a substantially U-shaped cross section), the evaluation module 315 can evaluate that the method of attaching the guide to the dentition model is not appropriate. In FIG. 25, the clip-type guide has two notches along the near-far direction, but when calculating the volume, it can be assumed that there are no notches and that the clip wall having a substantially U-shaped cross section is smoothly continuous.

[0141] <Tooth tip gap> Furthermore, the evaluation module 315, for example, acquires position information of the guide relative to the dentition model, and compares the position of the guide based on the position information of the guide (e.g., a group of coordinates) with the position of the dentition model based on the position information of the dentition model (e.g., a group of coordinates). If there is a gap of a predetermined dimension or more (e.g., 3 mm or more) between the tip of the tooth in the dentition model and the inner surface of the clip wall of the guide, it can be evaluated that the method of attaching the guide to the dentition model is not appropriate.

[0142] The evaluation module 315 can extract the surface structures of the teeth and the guide, for example, by employing a surface rendering process based on the position information (coordinate group) of the teeth and the guide. The evaluation module 315 calculates the distance between the tip of the tooth (for example, the downward protruding portion) and the opposing surface of the guide, and if this distance is greater than a predetermined threshold value (for example, 3 mm), can evaluate that the method of attaching the guide to the dentition model is not appropriate.

[0143] <Tooth coverage rate> The evaluation module 315, for example, acquires position information of the guide relative to the dentition model, and compares the position of the guide based on the position information of the guide (for example, a set of coordinates) with the position of the dentition model based on the position information of the dentition model (for example, a set of coordinates). Then, for a tooth at least partially covered by the guide in the dentition model, if the surface coverage rate of the guide is less than a predetermined rate (for example, 80% or less), it can be evaluated that the method of attaching the guide to the dentition model is inappropriate. The evaluation module 315 can extract the surface structures of the tooth and the guide, for example, by employing a surface rendering process based on the position information (set of coordinates) of the tooth and the guide.

[0144] The evaluation module 315 calculates, for example, the ratio of the guide projection area on the tooth to the cheek tooth surface area when the buccal part of the guide is projected from the cheek side onto the tooth surface. At this time, the predetermined surface coverage ratio may be calculated, for example, by assuming that there is no notch for the notch part provided in the guide, and the guide projection area on the tooth may also be calculated assuming that there is no notch. Then, the evaluation module 315 can evaluate that the method of attaching the guide to the dentition model is inappropriate when the surface coverage ratio of the tooth by the guide does not meet a predetermined standard.

[0145] According to the above configuration, if the guide is improperly attached, the user can reattach the guide, thereby enabling the implant to be embedded in a more accurate position.

[0146] <Invagination into the maxillary sinus wall> If the maxillary sinus is located near the cutting position, the AR data generation module 213 can create feature data based on the maxillary sinus. The NG area data generation module 215 can create NG area data with the maxillary sinus and a part of a certain thickness surrounding it as the NG area based on the feature data related to the maxillary sinus. The evaluation module 315 can evaluate the procedure for forming the cutting hole based on the NG area data related to the maxillary sinus. The procedure evaluation method in this case can refer to, for example, one or more of the procedure evaluations described above as appropriate.

[0147] <Other treatment evaluations> Fig. 26 shows another example of the dental model. Fig. 27 shows an example of a support base for the dental model. In order for the display module 314 to more accurately superimpose the dental model and the AR model, for example, the dental model may be provided with a support base of a predetermined dimension that can be used as a reference for superimposition. This support base may also serve as a support base that supports an overhanging portion when forming the dental model with a 3D printer of the liquid vat photopolymerization type. The display module 314 can display the dental model and the AR model in a reliable correspondence with each other by using, for example, position information of three or more predetermined points of this support base as a reference.

[0148] The support base may be designed, for example, to be a mounting base for mounting the dental model in the oral cavity of a humanoid doll. The dimensions of such a support base can be designed to match the shape of the oral cavity of the humanoid doll so that the dental model can be mounted in the oral cavity of the humanoid doll in a more natural posture. This allows the dental model to be mounted in the oral cavity of the humanoid doll in a posture close to reality, and allows training in the treatment using the dental model under more realistic conditions.

[0149] In the above embodiment, as an example of treatment evaluation, the treatment evaluation is performed using the position information of a tool such as a cutting tool, but the treatment evaluation of the present technology is not limited to the case where the position information of the tool is used. For example, when treatment such as cutting is performed using a tool, the treatment evaluation may be performed using the position information of the treatment site in the oral cavity, such as the part where the tooth is cut. More specifically, for example, the evaluation module 315 (an example of an evaluation unit) acquires the position information of the treatment site in the oral cavity that has been treated using a tool. The evaluation module 315 captures an image of the treatment site in the oral cavity together with the dentition model, for example, by the camera 306, and recognizes and analyzes the 3D form by an image processing function. The evaluation module 315 thereby acquires, for example, the relative position information of the treatment site in the oral cavity with respect to the dentition model. In addition, the evaluation module 315 compares the position of the treatment site in the oral cavity based on the position information of the treatment site in the oral cavity with the NG area defined by the NG area data. Then, the evaluation module 315 judges whether the position of the treatment site in the oral cavity overlaps with the NG area. When the position of the treatment site in the oral cavity overlaps with the NG area, the evaluation module 315 outputs, for example, information indicating that the treatment is inappropriate. When the position of the treatment site in the oral cavity does not overlap with the NG area, the evaluation module 315 outputs, for example, information indicating that the treatment is appropriate. In addition, the position information of the tool and the position information of the treatment site in the oral cavity are examples of position information of the treatment unit related to the treatment.

[0150] In the above embodiment, the dentition model is that of a patient to be treated, but the dentition model is not limited to that of a patient to be treated. For example, the dentition model is not limited to that of a patient to be treated, but may be that of another living body, or may be a dentition model generated from 3D printer data of a typical case (including a virtual model case, etc.; the same applies below). In addition, other data, such as data of characteristic parts and dental CT data, is not limited to that specific to the patient. The other data may be, for example, that of another living body, or may be data of a typical case, such as data of characteristic parts of a typical case or dental CT data of a typical case.

[0151] In the above embodiment, the present technology has been described using dental treatment as an example, but the treatment on the living body is not limited to dental treatment, and can be, for example, any surgical operation on the whole body of a person without any particular limitation. In this case, various medical imaging data can be used instead of dental CT imaging data.

[0152] Each module disclosed in the above embodiment may be configured by combining multiple sub-modules. Furthermore, some or all of the operations performed or functions realized by one module may be performed or realized by another module.

[0153] In the above embodiment, one or more functional elements implemented by the execution of each module of the user terminal 102 may be implemented by the execution of a module of the management server 101 .

[0154] The present technology not only provides an invention related to the dental treatment support system 100, but also, in another aspect, can provide an invention related to a dental treatment support method.

[0155] The present technology also provides a program for making a computer execute each procedure in the dental treatment support method. The program may be composed of one program, or may be composed of two or more subprograms. The program may also be a program for making a computer execute any one or two or more of the above procedures.

[0156] Furthermore, one or more of the management servers 101 and one or more user terminals 102 constituting the dental treatment support system 100 may be installed in different countries. Furthermore, the management server 101 may be realized by one or more computers, any of which may be installed in different countries.

[0157] The present technology is not limited to the above-described embodiments, and various modifications are included. For example, the above-described embodiments have been described in detail to clearly explain the present technology, and are not necessarily limited to those having all of the configurations described. In addition, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

[0158] In addition, the above-mentioned configurations, functions, processing units, processing means, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the program, table, file, etc. that realizes each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.

[0159] In addition, the control lines and information lines shown are those that are considered necessary for the explanation, and not all control lines and information lines in the product are necessarily shown. In reality, it can be considered that almost all components are connected to each other. The above-mentioned embodiments disclose at least the configurations described in the claims. [Explanation of symbols]

[0160] 100...dental treatment support system, 101...management server, 211...user terminal management module, 212...dental CT acquisition module, 213...AR data generation module, 214...dental model generation module, 215...NG area data generation module, 216...server side evaluation module, 311...management module, 312...reception module, 313...data acquisition module, 314...display module, 315...evaluation module

Claims

1. A reception unit that receives a selection of a treatment content for the biological model; A data acquisition unit that acquires check data corresponding to the selected treatment content; a display unit that displays an AR model generated based on augmented reality (AR) data corresponding to the treatment content in association with the biological model being imaged; an evaluation unit that evaluates the treatment on the biological model based on the check data and outputs an evaluation result; A treatment support device equipped with the above.

2. The check data includes NG area data indicating an area not to be treated, The evaluation unit is Acquire location information of the treatment area involved in the treatment, 2. The treatment support device according to claim 1, wherein, when a position of the treatment part based on the position information of the treatment part overlaps with an area defined by the NG area data, information indicating that the treatment on the biological model is inappropriate is output.

3. The check data includes NG area data indicating an area not to be treated, The evaluation unit is Acquire the location information of the tools used in the treatment, 3. The treatment support device according to claim 1, further comprising: a device that outputs information indicating that the treatment on the biological model is inappropriate when the position of the tool based on the position information of the tool overlaps with an area defined by the NG area data.

4. The check data includes first NG area data indicating an area not to be treated, and second NG area data surrounding the first NG area data with a predetermined dimension, The evaluation unit is acquiring position information of a tool used for performing a treatment on the biological model; The treatment support device of claim 1 or 2, which outputs information indicating that the treatment should be performed with caution when the position of the tool based on the position information of the tool overlaps with an area defined by the second NG area data.

5. the check data includes treatment angle data indicating an appropriate range of angles of a tool used for a treatment on the biological model with respect to a treatment position on the biological model; The evaluation unit is obtaining angle information regarding a treatment position of the tool on the phantom; The treatment support device according to claim 1 or 2, which outputs information indicating that the treatment is inappropriate when the angle of the tool relative to the treatment position is outside of an appropriate angle range defined by the treatment angle data.

6. The evaluation unit is Acquiring axis information of the tool based on position information of the tool; The treatment support device according to claim 5 , further comprising: acquiring angle information regarding the treatment position of the tool based on axis information of the tool.

7. The check data includes NG area data indicating an area not to be treated, The evaluation unit is acquiring position information of a tool used for performing a treatment on the biological model; acquiring tool boundary information indicating a predetermined range surrounding the tool based on position information of the tool; The treatment support device according to claim 1, further comprising: a treatment support device that outputs information indicating that the treatment on the biological model is inappropriate when a position within the specified range based on the tool peripheral information overlaps with an area defined by the NG area data.

8. The check data includes NG area data indicating an area not to be treated, The evaluation unit is Obtain information about the tools used to perform procedures on the phantom; The treatment support device according to claim 1, wherein when at least one of a tool and a treatment position used in a second treatment is different from that of a first treatment, a second NG area for the second treatment is changed relative to a first NG area for the first treatment based on the check data.

9. When the tool used for the first treatment and the second treatment is the same, the evaluation unit includes, in the second NG area, a first treatment area which is a treatment area by the first treatment and a predetermined range of an area surrounding the first treatment area, When the tools used for the first treatment and the second treatment are different, the evaluation unit does not include the first treatment area and a predetermined range of areas surrounding the first treatment area. The treatment support device according to claim 8.

10. When the tool used for the first treatment and the second treatment is the same, the evaluation unit includes, in the second NG area, a first treatment area which is a treatment area by the first treatment and a predetermined range of an area surrounding the first treatment area, 10. The treatment support device according to claim 8 or 9, wherein when tools used for the first treatment and the second treatment are different, the evaluation unit includes an area farther away than a predetermined range surrounding the first treatment area in the second NG area.

11. When the treatment area is the same for the first treatment and the second treatment, the evaluation unit includes, in the second NG area, an area farther than a predetermined range surrounding the first treatment area, which is the treatment area for the first treatment, The treatment support device according to claim 8, wherein when the treatment areas are different between the first treatment and the second treatment, the evaluation unit does not include an area farther than a predetermined range surrounding the first treatment area in the second NG area.

12. When the treatment area is the same for the first treatment and the second treatment, the evaluation unit includes, in the second NG area, an area that is farther than a predetermined range surrounding the first treatment area, which is the treatment area for the first treatment, The treatment support device according to claim 8, wherein when the treatment areas are different between the first treatment and the second treatment, the evaluation unit includes the first treatment area and a predetermined range of an area surrounding the first treatment area in the second NG area.

13. The check data includes tool data including information on a tool to be used for each treatment content, The evaluation unit is The treatment support device according to claim 1, wherein an overlapping portion between a jawbone portion based on position information of the jawbone portion included in the AR model and a position of the tool based on position information of the tool is estimated as a treatment area, and position information of the treatment area is generated based on the overlapping portion.

14. The check data includes tool data including information on a tool to be used for each treatment content, The evaluation unit is obtaining information regarding a tool to be used to perform a procedure on the phantom; The treatment support device of claim 1, which outputs information indicating that the treatment using the tool is inappropriate when the information regarding the tool does not correspond to the information of the tool to be used in the treatment content selected based on the tool data.

15. The treatment support device according to claim 3 , wherein the NG area data is position information including at least one of natural teeth, dentures, nerves, implants, holes in the jawbone, and areas at a predetermined distance therefrom as NG areas.

16. The check data includes NG area data, The evaluation unit is Acquire position information of a guide used for treatment on a dental model; The treatment support device according to claim 1, wherein, when a relationship between the position information of the guide and the position information of the biological model does not satisfy a predetermined standard based on the check data, information indicating that a method of attaching the guide to the biological model is inappropriate is output.

17. The evaluation unit is Acquire position information of a guide used for treatment on the biological model; calculating a volume of a space between a position of the guide based on the position information of the guide and a position of the biological model based on the position information of the biological model; The treatment support device according to claim 1 , wherein, when the volume is larger than a predetermined standard based on the check data, the method of attaching the guide to the biological model is evaluated as being inappropriate.

18. The evaluation unit is Acquire position information of a guide used for treatment on the biological model; 2. The treatment support device according to claim 1, wherein when the position of the guide based on the position information of the guide is projected in a predetermined direction onto a crown adjacent to a treatment position predetermined on the biological model, if the overlap rate of the projection of the guide onto the crown does not meet a predetermined criterion, the method of attaching the guide to the biological model is evaluated as inappropriate.

19. 3. The treatment support device according to claim 2, wherein the evaluation unit acquires position information of a treatment unit related to a treatment, and when the treatment on the biological model is completed and a position of the treatment unit based on the position information of the treatment unit does not overlap with a coordinate group defined by the NG area data, outputs that the treatment on the biological model is appropriate.

20. Accept the selection of treatment contents for the biological model, Acquire augmented reality (AR) data and check data corresponding to the selected treatment content, displaying an AR model generated based on the AR data in correspondence with the biological model being imaged; The treatment support method includes evaluating a treatment performed on the biological model based on the check data, and outputting an evaluation result.

21. A program for causing a computer to execute each step of the method according to claim 20.

Images