Dental treatment support device, dental treatment support system, dental treatment support method, dental treatment support program, and dental product sales promotion device

Abstract

To enable appropriate guidance of a process procedure corresponding to a treatment step, and a further suitable assistance of a dental treatment without relying on a human memory and the like.SOLUTION: A dental treatment assistance device (10) includes a photographing part (1) that photographs an oral cavity of a person to be treated including a treatment target, an input part (3) into which input information on a use purpose and a use product is input, a display (4) that displays a photographed image, a memory (17) that stores multiple pieces of product information and process procedure information for a purpose of each product, a product information acquiring part (24) that acquires the product information and the process procedure information corresponding to a use purpose and a use product from the memory (17), a photographed image analyzer (22) that detects the treatment target of the photographed image to identify the treatment step, a process procedure control part (25) that selects the process procedure corresponding to the treatment step, and a display image control part (26) that displays the process procedure and the photographed image side by side on the display (4).SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a dental treatment support device, a dental treatment support system, a dental treatment support method, a dental treatment support program, and a dental product sales promotion device. [Background technology]

[0002] In clinical dentistry, filling and restorative materials, such as composite resins for fillings and core buildup, and crown and crown restorative materials, such as metal alloys, ceramics, and resin materials, are typically used to repair teeth damaged by caries or fractures. In addition, adhesives, such as bonds and cements, are commonly used to bond the filling and crown and crown restorative materials to the tooth. A typical treatment procedure involves applying a bond to the damaged tooth, drying it with an air blower for a predetermined time, polymerizing and curing it with light using a light curing device for a predetermined time, and then filling it with a composite resin for filling, which is then polymerized and cured using light using a light curing device for a predetermined time. During such dental treatment, a dental hygienist is present to support the dentist by handing over the dental materials to be used and mixing the medications. However, since the usage instructions vary depending on the product, dentists and other professionals must memorize them in advance. If you can't remember everything, you can check the procedure using the manual, the internet, or an app, but checking it every time you treat someone can be cumbersome and can make it difficult to provide smooth treatment and support. Also, when a new product is introduced, the method of use changes and needs to be re-learned. For this reason, many dentists are reluctant to introduce new products.

[0003] In addition, it is difficult for dental hygienists to directly observe the oral cavity of the patient being treated together with the dentist, making it difficult to confirm which step has been reached in the treatment process, which can affect support work.

[0004] Meanwhile, a dental treatment support system using images of the oral cavity taken with a camera has been developed (see, for example, Patent Document 1). The treatment support system described in Patent Document 1 supports treatment by the dentist by superimposing images of nerves, blood vessels, implants, etc. acquired based on CT images of the patient on actual images of the oral cavity taken with a camera and displaying the images on a head-mounted display worn by the dentist.

[0005] However, the conventional technology described in Patent Document 1 does not guide dentists and other professionals in the procedures for using the products required for treatment steps, and dentists and other professionals still have to rely on their own memory for the procedures. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-200537 Summary of the Invention [Problem to be solved by the invention]

[0007] The present disclosure has been made in consideration of the above circumstances, and is capable of accurately guiding the processing procedures corresponding to treatment steps without relying on human memory, etc., thereby enabling more appropriate support for dental treatment. [Means for solving the problem]

[0008] In order to achieve the above object, the dental treatment support device according to the present application comprises a display unit, an imaging unit that captures images of the oral cavity of a patient including a treatment target, an input unit to which input information relating to at least one of an intended use and a dental material product to be used is input, a storage unit that stores a plurality of pieces of dental material product information and processing procedure information for each intended use of each dental material product, an image analysis unit that analyzes the images captured by the imaging unit, identifies a treatment step for the treatment target based on the analysis result and the input information, and analyzes the images to detect the start and end of a predetermined process of the processing procedure, and a display unit that displays the input information input from the input unit and the dental material products corresponding to the treatment steps. a processing procedure control unit that counts processing time when the start of a predetermined step in the processing procedure is detected and issues an alarm when the processing time reaches the predetermined time; and a display image control unit that displays, on the display unit, a predetermined processing procedure selected from the processing procedure information for each treatment step alongside the captured image, and displays on the display unit a counter image corresponding to the processing time counted when the start of a predetermined step in the processing procedure is detected, and displays the next processing procedure on the display unit when the end of the predetermined step in the processing procedure is detected. [Effects of the Invention]

[0009] According to the present disclosure, the product processing procedure is displayed on the display unit, so that the product processing procedure can be confirmed. Therefore, the processing procedure corresponding to the treatment step can be accurately guided without relying on human memory, etc., and it is possible to more appropriately support dental treatment. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing an example of the hardware configuration of a dental treatment support device according to a first embodiment of the present disclosure. [Figure 2] FIG. 2 is a functional block diagram of the dental treatment support device shown in FIG. [Figure 3]2 is an explanatory diagram for explaining an example of a flow of images displayed on a display unit of the dental treatment support device shown in FIG. 1. FIG. [Figure 4A] 2 is an explanatory diagram for explaining an example of a flow of images displayed on a display unit of the dental treatment support device shown in FIG. 1. FIG. [Figure 4B] 2 is an explanatory diagram for explaining an example of a flow of images displayed on a display unit of the dental treatment support device shown in FIG. 1. FIG. [Figure 5] 4 is a flowchart showing an example of the operation of the dental treatment support device according to the first embodiment. [Figure 5A] FIG. 10 is a schematic diagram showing the configuration of a dental treatment support device according to a second embodiment. [Figure 5B] FIG. 10 is a schematic diagram showing the configuration of a dental treatment support device according to a third embodiment. [Figure 6] FIG. 10 is a functional block diagram of a dental treatment support system according to a fourth embodiment. [Figure 7] 10 is a flowchart showing an example of the operation of the dental treatment support system according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] (First embodiment) A dental treatment support system according to a first embodiment of the present disclosure will be described below with reference to the drawings. Fig. 1 is a schematic diagram showing the hardware configuration of a dental treatment support device 10 according to this embodiment. As shown in Fig. 1, the dental treatment support device 10 is mainly configured to include an imaging unit 1, an information processing unit (control device) 2, an input unit 3, a display unit 4, and a sound output unit 5. In addition to these, the dental treatment support device 10 may also include a printer as an output destination for printing images captured by the imaging unit 1 and dental treatment support results, a communication device for communicating with the outside, etc.

[0012] The imaging unit 1 is a device that captures images of the oral cavity, including the treatment target, such as the teeth of the patient. The imaging unit 1 is not particularly limited, and suitable examples include a microscope, a wearable camera, a CCD camera, and a digital video camera fixed to an examination table, etc. At least one imaging unit 1 is sufficient, but there may be multiple imaging units of the same type, or multiple imaging units of different types may be combined. When multiple units are used, by capturing images of the treatment target from various angles and under various imaging conditions, it is possible to detect the treatment target and treatment steps in more detail, display the treatment target in 3D, etc.

[0013] The imaging unit 1 and the information processing unit 2 are connected by a wired connection such as a connection cable or by a wireless LAN such as Wi-Fi (registered trademark). Image signals of the treatment target captured by the imaging unit 1 are output to the information processing unit 2 in real time. The captured images may be still images or moving images. In this embodiment, moving images are captured and output to the information processing unit 2 in real time.

[0014] The hardware configuration of the information processing unit 2 is, as shown in FIG. 1, composed of a CPU 11, a ROM 12, a RAM 13, an input I / F (interface) 14, an output I / F 15, an external device I / F 16, a memory unit 17, etc., but is not limited to this configuration.

[0015] The CPU 11 is a central processing unit that controls the overall operation of the dental treatment support device 10. The ROM 12 is a read-only memory that stores a control program, a dental treatment support program, etc., to be executed by the CPU 11. The RAM 13 is a read-and-write memory that is used as a work area for the CPU 11. That is, the CPU 11 uses the RAM 13 as a work area to execute the dental treatment support program stored in the ROM 12, thereby operating the dental treatment support device 10.

[0016] The storage unit 17 is composed of a recording medium such as a hard disk, a flash memory, etc. The input I / F 14 is an interface for connecting the input unit 3 and the CPU 11. The output I / F 15 is an interface for connecting the display unit 4 and the sound output unit 5 with the CPU 11. The external device I / F 16 is an interface for connecting an external device with the CPU 11, and in this embodiment, the imaging unit 1 is connected to the CPU 11.

[0017] The storage unit 17 stores in advance various information necessary for dental treatment support processing, such as product information for various products, processing procedure (usage procedure) information for each product purpose, etc. Furthermore, the storage unit 17 stores images of the treatment state captured by the imaging unit 1 in association with support results, etc. The storage unit 17 may also temporarily store calculation results, etc. from each unit.

[0018] The product information includes, for example, the product name, the names of dental materials contained in the product, the components of each dental material, the uses for which the material can be used, and information on the instruments and devices used for each use. These are categorized by product and stored in the storage unit 17. The storage unit 17 also stores, as product information, a list that associates products that can be used for each use, product introduction documents, product introduction information consisting of URLs of product-related sites, etc.

[0019] The product may be a product consisting of one dental material, or a kit product consisting of multiple dental materials, etc. Examples of dental materials include, but are not limited to, bonds, cements, composite resins for filling, composite resins for core construction, metal alloys, ceramics, hardened resins, gypsum materials, investing materials, grinding and abrasive materials, etc.

[0020] Here, even a single dental material can have a variety of uses. For example, "Clearfil (registered trademark) Universal Bond" manufactured by Kuraray Noritake Dental Co., Ltd. can be used for cavity filling and restoration using dental composite resin (hereinafter referred to as "CR"), cavity sealing, treatment of exposed root surfaces, repair of crown restorations using CR, implantation of posts, and various other treatments and procedures. Furthermore, the instruments and equipment used, as well as the dental materials (CR, etc.) used separately, may differ depending on the application. Therefore, information regarding such applications and the instruments used for each application is also required for dental treatment support. Therefore, the processing procedure information, such as the processing steps for each application of each product, the instruments and equipment used in each processing step, and the processing time for each processing step, is stored in the memory unit 17.

[0021] The support results refer to the actual treatment process and treatment results using the dental treatment support device 10. As support results, for example, information on the products used and their uses, the actual treatment process in the treatment steps, and information on the execution results of the processing steps (for example, if the drying time required is 10 seconds when it is 5 seconds), are stored in the storage unit 17.

[0022] In this embodiment, the information processing unit 2 is configured from a desktop personal computer (PC). Note that the information processing unit 2 is not limited to a desktop PC, and may be configured from a notebook PC integrated with a display unit 4. Furthermore, the information processing unit 2 is not limited to a PC, and may be configured from a portable information device such as a smartphone, mobile phone, or tablet terminal integrated with a display unit 4.

[0023] The input unit 3 is a device for inputting letters, numbers, various instructions, etc., and is operated by dentists, dental hygienists, etc. Examples of the input unit 3 include a keyboard, a mouse, and a numeric keypad. If the display unit 4 is a touch panel display, the touch panel screen also functions as the input unit 3. The input unit 3 accepts input information such as the intended use (contents of the treatment steps) and the products used (dental materials) by dentists, dental hygienists, etc. Signals of the input information are output to the information processing unit 2.

[0024] The display unit 4 is a device that displays an input screen for the intended use and the product to be used, the image captured by the imaging unit 1, and the processing procedure for the dental material. Suitable examples of the display unit 4 include a liquid crystal display and an organic EL display. When a portable information device is used as the information processing unit 2, the display unit 4 is a touch panel display, but when a PC is used, a touch panel display may also be used.

[0025] At least one display unit 4 is sufficient, but multiple display units 4 may be provided. For example, if a display unit 4 is provided for a dentist and a dental hygienist, the dentist and dental hygienist can provide treatment and support while viewing the display unit 4 located in an easily visible position at their respective work positions. Furthermore, by providing multiple display units 4 or using a large monitor, people other than dentists and dental hygienists can also view the treatment proceedings following the usage procedure, making the device suitable for use in classes, public treatments, product demonstrations, and the like, for example.

[0026] Furthermore, the display unit (display) of a head-mounted display may be the display unit 4 of this embodiment. If a dentist wears such a head-mounted display, the dentist can observe the inside of the oral cavity through the head-mounted display and perform treatment while checking the processing procedure displayed on the display unit 4. Furthermore, by attaching a wearable camera as the imaging unit 1 to the head-mounted display, it is possible to obtain captured images that correspond to the line of sight of the dentist or the like.

[0027] The sound output unit 5 is a device that outputs notification sounds to give predetermined notifications to dentists, dental hygienists, etc., and examples thereof include speakers and buzzers. The notification sounds output from the sound output unit 5 are not particularly limited and may include buzzer sounds or alarm sounds that notify the drying time of dental materials or the start or end of light irradiation time. It may also emit sounds or voices that count time, or notify the passage of time by sound or voice. It may also notify the content of the treatment process by voice, such as "apply bond" or "irradiate light."

[0028] Next, the functions of the information processing unit 2 that controls the overall operation of the dental treatment support device 10 will be described using the functional block diagram of Fig. 2. As shown in Fig. 2, the information processing unit 2 functions as a captured image acquisition unit 21, a captured image analysis unit 22, an input information acquisition unit 23, a product information acquisition unit 24, a processing procedure control unit 25, and a display image control unit 26.

[0029] The captured image acquisition unit 21 converts the image signal input in real time from the imaging unit 1 into a digital signal, and passes the captured image that has undergone appropriate image processing to the captured image analysis unit 22 and the display image control unit 26.

[0030] Furthermore, the photographed image acquisition unit 21 may control the imaging unit 1 to take a magnified photograph of the vicinity of the detected treatment target, or may use object tracking technology to control the imaging unit 1 to track and photograph the detected treatment target. Alternatively, the imaging unit 1 may be configured to automatically detect the treatment target and focus on, magnify, or track the treatment target using an autofocus function, object recognition function, or the like possessed by the imaging unit 1.

[0031] The photographed image analysis unit 22 analyzes the photographed image received from the photographed image acquisition unit 21 to detect treatment targets such as caries, cavities, root canals, etc. For example, object recognition processing such as feature extraction and pattern matching is performed to detect caries, cavities, etc., and set them as treatment targets. At this time, the treatment target may be detected according to the application input by the input unit 3. For example, if the application is filling and repairing or sealing a cavity, the cavity is detected from the photographed image and set as the treatment target. More simply, a tooth, etc. specified by a dentist, etc., using a mouse click or touch operation on a touch panel on the photographed image displayed on the display unit 4 may be detected as the treatment target.

[0032] The captured image analysis unit 22 also analyzes the captured image and identifies the treatment steps that the dentist will perform (or intend to perform) on the treatment target based on the analysis results and input information. Information on the detected treatment target and the recognized treatment steps are passed to the treatment procedure control unit 25. The system may also include a learning unit with artificial intelligence (AI), which provides more detailed and advanced treatment support based on the information analyzed by the captured image analysis unit 22 and pre-stored training data. For example, the captured image analysis unit 22 identifies the treatment target through image analysis and inputs the feature values ​​and input information of the treatment target to the learning unit. The learning unit uses data corresponding to feature values ​​representing various states of caries, cavities, root canals, etc. that require treatment, and actual treatment steps, treatment processes, product information, etc. for these various states of caries, cavities, root canals, etc. as training data, and uses a machine learning algorithm such as a neural network based on the input feature values ​​and input information of the treatment target to determine the shape of the cavity, etc. of the treatment target, identify the treatment steps, and output the corresponding treatment procedures, materials, etc. Based on the output from this learning unit, the captured image analysis unit 22 may present the dentist or the like with more appropriate materials to be used according to the treatment step. Also, data associating the treatment step with the tools (brushes, instruments, etc.) and materials (properties, colors, etc.) may be used as training data, and based on the analysis results of the captured image, the learning unit may determine the tools (brushes, instruments, etc.) and materials (properties, colors, etc.) used by the dentist, and determine which processing step of the treatment step is being performed.

[0033] The input information acquisition unit 23 acquires input information relating to the intended use, the product used, etc., input from the input unit 3. The product information acquisition unit 24 acquires the relevant product information and processing procedure information corresponding to the intended use from the storage unit 17, based on the information on the intended use and the product used acquired by the input information acquisition unit 23. The acquired product information and processing procedure information are passed to the processing procedure control unit 25.

[0034] The processing procedure control unit 25 selects an arbitrary processing procedure corresponding to the input information from the processing procedure information acquired by the product information acquisition unit 24. In the first embodiment, the processing procedure control unit 25 selects a processing procedure corresponding to the treatment step analyzed by the captured image analysis unit 22 in addition to the input information. The processing procedure control unit 25 also controls the display image control unit 26 to display the selected processing procedure information on the display unit 4. In addition, in the case of a processing step that requires measurement of processing time (for example, a drying step or a light irradiation step), the processing procedure control unit 25 measures the processing time once the processing is started, and when a predetermined processing time is reached, causes the sound output unit 5 to output an alarm sound or the like.

[0035] Furthermore, when treatment is completed, the treatment procedure control unit 25 associates the captured image with the support result and stores them in the storage unit 17. Examples of the support result include product information such as the name of the product used, the intended use, and the actual processing execution results of the treatment procedure (for example, the actual drying time and light irradiation time, and if a process other than the predetermined process is performed, the process, etc.).

[0036] Furthermore, the processing procedure control unit 25 controls the display image control unit 26 as necessary to display a screen of product introduction information on the display unit 4. The introduction information screen may be, for example, a screen that describes detailed instructions for using the product being used, or a screen that describes instructions for using another product that has the same purpose as the product being used. By viewing these screens, dentists and dental hygienists can re-acquaint themselves with the product's usage procedures, learn about other uses for the product, and learn about products that are more suitable for the intended use.

[0037] Furthermore, the introductory information screen may display a screen including URLs of websites where information about these products is publicly available and videos showing examples of how to use the products. By clicking on such URLs, dentists and other related parties are directed to the websites, where they can learn more detailed information about the products and examples of how to use them, and can consider purchasing the products.

[0038] The display image control unit 26 generates and displays images to be displayed on the display surface 4a of the display unit 4 (see FIG. 3, etc.), such as an intended use selection screen 41 and a product selection screen 42 shown in FIG. 3, and a support screen 43 shown in FIGS. 4A and 4B. The support screen 43 has an image display area 43a that displays real-time images captured by the imaging unit 1, a material display area 43b that displays images of the dental materials and instruments being used, and a treatment procedure display area 43c that displays each step of the treatment procedure corresponding to the treatment step. In addition, a counter image 43d (see FIG. 4A) may be displayed in the treatment procedure display area 43c while the treatment time is being measured.

[0039] An example of dental treatment support processing (dental treatment support method, dental treatment support program) executed by the dental treatment support device 10 configured as described above will be described with reference to the explanatory diagrams of the flow of displayed images in Figures 3, 4A, and 4B, and the flowchart in Figure 5. Here, the description will be given assuming a situation in which a dental hygienist supports a dentist in treatment while visually checking an image displayed on the display surface 4a of the display unit 4.

[0040] First, a dental treatment support program is started up in the PC serving as the information processing unit 2, thereby starting up the dental treatment support device 10, and the imaging unit 1 starts capturing images of the inside of the oral cavity of the patient.

[0041] Then, the display image control unit 26 displays a usage purpose selection screen 41 showing a list of usage purposes on the display surface 4a of the display unit 4, as shown in the upper diagram of FIG. 3 (step S1). The dental hygienist or the like can select a usage purpose by clicking a mouse or touching the touch panel on a predetermined purpose on the usage purpose selection screen 41. The input information acquisition unit 23 acquires information on the selected usage purpose (step S2). Here, it is assumed that "filling and restoration" has been selected.

[0042] According to the intended use acquired by the input information acquisition unit 23, the product information acquisition unit 24 acquires product information (here, a list of names, etc.) corresponding to the intended use from the storage unit 17 (step S3). Then, the display image control unit 26 displays a product selection screen 42 displaying a list of products to be used, as shown in the center diagram of Fig. 3 (step S4). The input information acquisition unit 23 acquires information on the products to be used selected by the dental hygienist or the like from this product selection screen 42 (step S5). Here, it is assumed that product A has been selected.

[0043] In this embodiment, the intended use is selected first, and then the product is selected, but the present invention is not limited to this configuration, and the intended use may be selected first from the intended uses displayed for the product. Alternatively, only the intended use may be input, and a product corresponding to the intended use may be automatically selected, or only the product to be used may be selected, and the intended use of the product to be used may be identified based on the treatment steps identified by analyzing the captured images.

[0044] Once the intended use is selected, the product information acquisition unit 24 then acquires product information corresponding to the acquired product to be used from the storage unit 17. More specifically, the product information acquisition unit 24 acquires processing procedure information from the storage unit 17, including information on the processing procedure of the product according to the intended use, the necessary dental materials, instruments, etc. (this is step S6).

[0045] This starts the treatment support process according to the intended use and product. The captured images (moving images) taken by the imaging unit 1 are acquired by the captured image acquisition unit 21 and analyzed by the captured image analysis unit 22 to detect the treatment target. The captured image analysis unit 22 controls the imaging unit 1 to take a magnified image of the treatment target or to track and photograph the treatment target (this is step S7).

[0046] The captured images captured by the imaging unit 1 are displayed in real time on the display unit 4 by the display image control unit 26. More specifically, as shown in the lower diagram of FIG. 3, the display image control unit 26 displays the acquired captured images in the captured image display area 43a, images of the dental materials and instruments to be used in the material etc. display area 43b, and images of the treatment procedure in the treatment procedure display area 43c, to display a support screen 43 on the display surface 4a of the display unit 4 (the above is step S8). The captured image display area 43a may display an image of the vicinity of the treatment target, or may further display an enlarged image of the treatment target, etc. Furthermore, when imaging is performed using multiple imaging units 1, one or more of these captured images may be appropriately selected and displayed as needed.

[0047] By visually checking the captured image displayed in the captured image display area 43a of this support screen 43, the dental hygienist can confirm the treatment steps being performed by the dentist. By visually checking the material etc. display area 43b, the dental hygienist can confirm the necessary dental materials and instruments. Furthermore, by visually checking the treatment procedure display area 43c, the dental hygienist can confirm the specific steps of the treatment procedure. This allows the dental hygienist to more accurately and smoothly assist in treatment, such as preparing instruments and preparing and mixing dental materials.

[0048] Next, the captured image analysis unit 22 analyzes the captured image to detect specific treatment steps performed by the dentist, and the treatment procedure control unit 25 selects dental materials, instruments, and treatments corresponding to the detected treatment steps. The display image control unit 26 displays the selected dental materials and instruments in the material etc. display area 43b, and displays details of the treatment procedure in the treatment procedure display area 43c (step S9). At this time, the sound output unit 5 may output the content of the treatment procedure steps, for example, a message such as "Apply bond to the cavity," by voice.

[0049] The captured image analysis unit 22 then analyzes the captured image and determines whether the processing has started (step S10). If the processing has not started (NO in step S10), the program waits until it has started. If it is determined that the processing has started (YES in step S10), the program proceeds to step S11. In the next step S11, the processing procedure control unit 25 counts the processing time if necessary. At this time, the display image control unit 26 displays a counter image 43d in the processing procedure display area 43c. When the processing time has elapsed, the processing procedure control unit 25 controls the sound output unit 5 to output an alarm sound, an alarm message, or the like, and issues an alarm (step S12). This alarm notification allows not only the dental hygienist but also the dentist to more clearly know that the drying time, etc. has been reached.

[0050] If the dentist performs the treatment for a time different from the treatment time preset by the product distributor, the treatment procedure control unit 25 may store the actual treatment time. For example, the prescribed treatment time may not be sufficient for drying or hardening, and the dentist may decide to extend the treatment time. In this case, collecting and examining data on the actual treatment time can serve as a reference for changing the treatment procedure to a more suitable one.

[0051] Next, in step S13, it is determined whether or not there is a next processing step, and if there is a processing step (determination in step S13 is YES), the process returns to step S9 and steps S9 to S12 are repeated.

[0052] On the other hand, if all the processing steps are completed (NO in step S13), the process proceeds to step S14, where it is determined whether or not the treatment has ended. For example, when a dental hygienist or the like inputs an instruction to end the treatment from the input unit 3, it is determined that the treatment has ended (YES in step S14), and the process proceeds to step S15.

[0053] On the other hand, if an instruction to continue or an instruction to return to the intended use selection screen 41 is received from the input unit 3, it is determined that treatment should be continued (NO in step S14), and the process returns to step S1 to repeat the processing of steps S1 to S13.

[0054] In step S15, upon completion of treatment, the processing procedure control unit 25 stores in the memory unit 17 the images captured by the imaging unit 1 in association with the support results such as the product used, the purpose of use, and the actual processing steps.

[0055] If necessary, the process proceeds to step S16, where the display image control unit 26 displays product introduction information on the display unit 4. As described above, information introducing the product or leading to a purchasing site may be displayed, or information introducing other uses of the product used this time may be displayed. Furthermore, if the dentist only uses a certain product for a certain purpose based on the support results accumulated in the memory unit 17, a screen introducing other products used for the same purpose may be displayed. Furthermore, product advertising information may be displayed in a predetermined area on the display surface 4a, like a so-called listing advertisement.

[0056] 4A and 4B, a specific example of the flow of the support screen 43 displayed on the display unit 4 will be described. In the upper diagram of Fig. 4A, the bond application process has been identified as a specific processing process of the treatment step, so images of the bond material and applicator are displayed in the material etc. display area 43b, and "bond application" is displayed as a processing process in the processing procedure display area 43c.

[0057] The captured image analysis unit 22 detects the application of the bond by detecting an applicator in the captured image and detecting the liquid surface of the bond. In response to this detection, for the next drying step, the display image control unit 26 displays the air nozzle, the processing step (air blow), and the processing time (5 seconds or more) on the support screen 43, as shown in the central diagram of FIG. 4A. When the captured image analysis unit 22 detects air injection from the air nozzle in the captured image, the processing procedure control unit 25 starts counting the processing time, and the display image control unit 26 displays a counter image 43d, as shown in the central diagram of FIG. 4A. When the processing time is reached, the processing procedure control unit 25 outputs an alarm sound from the sound output unit 5.

[0058] When the captured image analysis unit 22 detects the end of the drying process, the process proceeds to support the light irradiation process. As shown in the lower diagram of FIG. 4A, the display image control unit 26 displays the light irradiator, the processing process (light irradiation process), and the processing time (10 seconds) on the support screen 43. When the captured image analysis unit 22 detects light irradiation, the processing procedure control unit 25 starts counting the processing time and displaying a counter image 43d. When the processing time is reached, the processing procedure control unit 25 outputs an alarm sound from the sound output unit 5.

[0059] The upper diagram in FIG. 4B shows a support screen 43 for the filling process of light-cured dental composite resin for filling, which is carried out after the application of the bond. This support screen 43 displays an image of the composite resin material to be used and the processing process (light-cured composite resin filling). When the captured image analysis unit 22 detects the end of filling, the display image control unit 26 displays the light irradiator, the processing process (light irradiation process), and the processing time (Y seconds) on the support screen 43, as shown in the lower diagram in FIG. 4B. In this case, the processing procedure control unit 25 also counts the processing time and outputs an alarm sound. Subsequently, a support screen 43 for a polishing process, etc. may be displayed.

[0060] In the above description, the dental treatment support device 10 of this embodiment is used to assist a dental hygienist, but the use is not limited to this. For example, the device may be used by a dentist himself, and when a dental hygienist is not available, the dentist can perform treatment while checking the treatment steps and treatment time himself.

[0061] (Variation) As a modification of the first embodiment, a simpler embodiment will be described. In the first embodiment, the captured image analyzer 22 automatically displays the support screen 43 corresponding to each treatment step and counts the treatment time based on the treatment steps detected by image analysis. However, this is not limited to this. For example, simply displaying the support screen 43 shown in the lower diagram of FIG. 3 on the display surface 4a allows the user to grasp at a glance the dental materials, instruments, and treatment procedures to be used. While checking the treatment steps using the real-time captured images displayed in the captured image display area 43a, the user can perform assistive tasks such as transferring instruments, mixing medications, and counting the treatment time according to the treatment steps displayed in the treatment procedure display area 43c. Alternatively, a dentist or other professional can perform treatment or other procedures while checking the display surface 4a. In this embodiment, the captured image analyzer 22 is not required, resulting in a dental treatment support device 10 with a simpler configuration and faster speed.

[0062] In another different embodiment (variant), the product information acquisition unit 24 may acquire processing procedure information corresponding to the input information from the storage unit 17 based on input information regarding the intended use, the product used, etc., input from the input unit 3, and display the acquired processing steps alongside the real-time captured image on the display unit 4. This allows the dentist or other professional to perform treatment or assist in treatment while checking the processing steps. The first processing step of the processing procedure information may also be displayed alongside the captured image on the display unit 4 (e.g., the upper view of FIG. 4A ), allowing the dentist or other professional to perform treatment or assist in treatment while checking the captured image and the processing steps. After the processing step is completed, for example, by clicking a “Next” button, the screen transitions to a screen displaying the next processing step alongside the captured image, thereby enabling more appropriate dental treatment support. In this case, the captured image analysis unit 22 may also be omitted.

[0063] In yet another embodiment (modification), for example, a dental hygienist checks the dentist's application of the bond on the captured image on the display unit 4, and selects "bond application" in the procedure display area 43c of the support screen 43 shown in the lower diagram of FIG. 3 by clicking or touching. This selection operation may be configured to count the drying time and sound an alarm. Alternatively, the support screen 43 of either FIG. 4A or FIG. 4B may be displayed by the dental hygienist selecting each process step in the procedure display area 43c by clicking or the like in accordance with each treatment step.

[0064] As described above, according to the first embodiment and its modified examples, by inputting input information regarding the intended use or the product to be used, a suitable processing procedure (usage procedure) corresponding to the input information is selected and displayed on the display unit 4. This allows dentists, dental hygienists, and the like to confirm the product processing procedure. Furthermore, the first embodiment and its modified examples include an imaging unit 1 that captures images of the intraoral cavity of a patient, including the treatment target, and a display image control unit 26 that displays a predetermined processing procedure selected from the processing procedure information and the captured images captured by the imaging unit 1 side by side on the display unit 4. Therefore, by visually checking the captured images displayed on the display unit 4, dental hygienists and the like can clearly check the treatment target and the progress of the treatment steps performed by the dentist. Furthermore, while visually checking the captured images, assistive tasks such as preparing and transferring dental materials and instruments can be performed more accurately and smoothly according to the processing procedures displayed on the display unit 4. Alternatively, dentists and the like can perform treatment while visually checking the captured images and processing procedures on the display unit 4. Therefore, processing procedures corresponding to the intended use, the product to be used, or the treatment steps can be accurately guided without relying on human memory, etc. As a result, it is possible to provide a dental treatment support device 10, a dental treatment support method, and a dental treatment support program that enable more appropriate support of dental treatment.

[0065] Moreover, the first embodiment further includes a captured image analysis unit 22 that detects a treatment target in a captured image and identifies a treatment step to be performed on the treatment target, and a processing procedure control unit 25 that selects a processing procedure corresponding to the treatment step from processing procedure information. With this configuration, the processing procedure (usage procedure) corresponding to the progress of the treatment step can be displayed on the display unit 4 together with the captured image. Therefore, there is no need for a dentist or the like to check the treatment step, and a more appropriate processing procedure corresponding to the actual progress of the treatment step can be displayed, thereby more appropriately supporting dental treatment.

[0066] In the first embodiment, the procedure control unit 25 can be configured to count the processing time when a predetermined step of the procedure is executed, and to issue an alarm when the processing time is reached. This configuration allows not only dental hygienists but also dentists and others to more clearly know that the processing time has passed, thereby further improving the effectiveness of support.

[0067] In the first embodiment, the procedure control unit 25 can be configured to notify the procedure by voice. With this configuration, not only dental hygienists but also dentists and others can learn the procedure by voice, thereby further improving the support effect.

[0068] Furthermore, in the first embodiment, the processing procedure control unit 25 can be configured to store the support results, including the input information, product information, processing procedures, and execution results of the processing procedures, in the storage unit 17. With this configuration, a dentist or the like can check the support results after treatment is completed, thereby checking the treatment status and using the results for future treatment.

[0069] Furthermore, in the first embodiment, the processing procedure control unit 25 can be configured to display, on the display unit 4, information introducing the product used or information introducing the product corresponding to the processing procedure based on the support result. This configuration allows dentists and other professionals to learn more about the product's use and other details. Furthermore, they can learn about other products that are more suitable for their use, which can eliminate resistance to new products and encourage them to actively introduce new products. This also leads to sales promotion for product distributors. Therefore, a dental treatment support device 10 can be provided that can contribute to the active introduction and sales promotion of products.

[0070] The dental treatment support device 10 may also be configured to include a learning unit with an artificial intelligence (AI) function. By including such a learning unit, it is possible to more accurately analyze captured images, identify treatment targets and treatment steps, and select suitable treatment procedures. Furthermore, by accumulating and utilizing the learning results, it becomes possible to provide advanced dental treatment support that is adapted to the user's requests.

[0071] (Second embodiment) Next, a dental treatment support device 10A according to a second embodiment will be described with reference to Fig. 5A. As shown in Fig. 5A, the dental treatment support device 10A according to the second embodiment is mainly configured to include a head-mounted display 6 and an information processing unit (control device) 2 made up of a PC. The information processing unit 2 includes an input unit 3, a display unit 4, etc. The configuration of the information processing unit 2 is the same as that of the first embodiment, so detailed description will be omitted.

[0072] The head mounted display 6 includes a control unit 6a, a display unit 4A, etc. The control unit 6a includes a CPU, a ROM, a RAM, a storage unit, etc., and controls the overall operation of the head mounted display 6. The control unit 6a communicates with the information processing unit 2 via wired or wireless communication, and displays information for supporting dental treatment on the display unit 4A based on a control signal from the information processing unit 2.

[0073] The display unit 4A is transparent so that the treatment target can be viewed while displaying the treatment procedure as information for supporting dental treatment. For example, an organic electroluminescence (EL) display or the like is preferably used as the display unit 4A. The display unit 4A can display information on the entire surface, but in this embodiment, a treatment procedure display area 43c that displays the treatment procedure is provided in the upper right corner of the display surface 4a of the display unit 4A so as not to interfere with the visibility of the treatment target. The position of this treatment procedure display area 43c is not limited to the upper right corner of the display unit 4A, and can be provided in an appropriate position depending on the treatment procedure, the purpose of treatment, etc.

[0074] The head-mounted display 6 is not particularly limited as long as it includes a display unit 4A capable of displaying dental treatment support information and allows the treatment target to be viewed through the display unit 4A. The form is also not particularly limited, and any appropriate type, such as goggles, helmets, or glasses, can be used. Furthermore, the head-mounted display is not limited to the second embodiment and the third embodiment described below, which include transparent display units 4A and 4B that allow the treatment target to be viewed while displaying the treatment procedure. In another embodiment, for example, a small display unit (monitor) such as a liquid crystal display may be attached to a fixture attached to the head or the like, or to the tip of an arm extending from an information processing unit attached to the head or the like, and the display unit may be positioned within the wearer's field of view. This allows the wearer to view the treatment procedure and other information displayed on the display unit, and by changing their viewpoint, they can view the treatment target.

[0075] In the dental treatment support device 10A of the second embodiment configured as described above, for example, a dentist (a wearer) wears the head-mounted display 6 on his or her head and visually recognizes the teeth to be treated through the transparent display unit 4A. Next, when the dentist or dental hygienist inputs the intended use, the products used, etc., through the input unit 3, the information processing unit 2 acquires product information and a processing procedure from the storage unit 17 based on these inputs and transmits a control signal for displaying the processing procedure to the control unit 6a of the head-mounted display 6. The control unit 6a displays the processing procedure on the display unit 4A based on this control signal. The processing procedure may be transmitted from the information processing unit 2, or images may be stored in advance in the storage unit of the head-mounted display 6, and the control unit 6a may display the corresponding images on the display unit 4A based on the control signal from the information processing unit 2.

[0076] As described above, the dentist can perform treatment while visually checking the processing procedure and the like on the display unit 4A and the treatment target, and while checking the processing procedure displayed on the display unit 4A. At this time, the processing procedure and the like are also displayed on the display unit 4 of the information processing unit 2, so that the dental hygienist or the like can also check the processing procedure. Furthermore, the dental hygienist or the like may wear the head-mounted display 6, and can assist the dentist while visually checking the treatment target and checking the processing procedure.

[0077] (Third embodiment) Next, a dental treatment support device 10B according to a third embodiment will be described with reference to FIG. 5B. The dental treatment support device 10B according to the third embodiment has the same basic configuration as the dental treatment support device 10A according to the second embodiment shown in FIG. 5A, except that the head-mounted display 6B includes an information processing unit 2B instead of the control unit 6a and further includes an imaging unit 1B. Therefore, the same components as those in the second embodiment are denoted by the same reference numerals as those in the second embodiment, and detailed description thereof will be omitted. Note that, to distinguish the information processing unit 2B provided in the head-mounted display 6B from the information processing unit 2 formed by a PC, the information processing unit 2B provided in the head-mounted display 6B will be referred to as a "mobile information processing unit 2B" below.

[0078] 5B, a dental treatment support device 10B according to the third embodiment is mainly configured to include a head-mounted display 6B. The head-mounted display 6B is mainly configured to include an imaging unit 1B, a mobile information processing unit 2B, an input unit 3B, a display unit 4B, and a sound output unit 5B.

[0079] The imaging unit 1B is installed on the side or above the display unit 4B in a position that allows capturing images of the oral cavity from the wearer's line of sight. The imaging unit 1B is preferably a wearable camera or the like, similar to that used in the first embodiment. This imaging unit 1B can capture images that correspond to the line of sight of the dentist or the like. The captured images are transmitted to, for example, an information processing unit 2' (described below), and displayed on a display unit 4' of the information processing unit 2' or on a display unit 4B of a head-mounted display 6B worn by the dental hygienist or the like. This allows the dental hygienist or the like to check the treatment steps being performed by the dentist from the dentist's line of sight.

[0080] The mobile information processing unit 2B is fixed to the main body of the head mounted display 6 (in this embodiment, to the temples of the eyeglass-type head mounted display 6B). Alternatively, the mobile information processing unit 2B may be a separate type that can be stored in a pocket or the like of the wearer and connected to the main body by wire or wirelessly.

[0081] The mobile information processing unit 2B is a small-sized information processing device, and includes a CPU such as a microprocessor, and a storage unit 17B such as a RAM, a ROM, a storage medium, etc. Similarly to the information processing unit 2 of the first embodiment, the mobile information processing unit 2B also functions as a captured image acquisition unit 21, a captured image analysis unit 22, an input information acquisition unit 23, a product information acquisition unit 24, a processing procedure control unit 25, and a display image control unit 26 (see FIG. 2).

[0082] The head-mounted display 6B is connected, by wire or wirelessly, to an information processing unit 2' consisting of a PC equipped with an input unit 3' such as a keyboard, mouse, and numeric keypad, and a display unit 4', and / or an input unit 3'' consisting of a mouse or the like that can be operated with the operator's hands or feet. The input unit 3' of this information processing unit 2' and the input unit 3'' consisting of a mouse or the like function as the input unit 3B of this embodiment. Therefore, the wearer or the like can select the purpose of use or the like by clicking the input unit 3B on various selection screens displayed on the display unit 4B. An input signal resulting from this selection operation is output to the information processing unit 2B.

[0083] The storage unit 17B stores in advance information necessary for treatment support, such as product information for various products and information on processing procedures (usage procedures) for each product purpose. This information can be transferred from the information processing unit 2' to the storage unit 17B by operating the input unit 3B (copying, uploading, etc.). Furthermore, the storage unit 17B may store images of the treatment state captured by the imaging unit 1B in association with the support results, etc. This information can be transferred from the storage unit 17B to the information processing unit 2' by operating the input unit 3B (copying, downloading, etc.).

[0084] The display unit 4B is transparent so that the treatment target can be seen while the treatment procedure is displayed, and similar to the display unit 4A of the second embodiment, an organic electroluminescence (EL) display or the like is preferably used. A treatment procedure display area 43c is provided on the display surface 4a of the display unit 4B. The sound output unit 5B is used to provide predetermined notifications to the wearer. In this embodiment, an earphone-type sound output unit 5B that can be easily attached to the wearer's ear is used, but the present invention is not limited to this, and any appropriate device such as a speaker can be used.

[0085] The dental treatment support device 10B according to the third embodiment, configured as described above, also provides the same effects as those of the first and second embodiments. That is, a dentist wearing the head-mounted display 6B can perform treatment while visually checking the treatment target via the display surface 4a and confirming the procedure displayed on the display unit 4A. The head-mounted display 6B may also be worn by a dental hygienist or other professional, who can assist the dentist while visually checking the treatment target and confirming the procedure. Furthermore, by displaying the captured image captured by the imaging unit 1 and the procedure on the display unit 4' of the information processing unit 2' and the display unit 4B of the head-mounted display 6B worn by the dental hygienist or other professional, the dental hygienist or other professional can assist the dentist while checking the treatment target, treatment steps, and procedure from the same perspective as the dentist.

[0086] Furthermore, in the third embodiment, the small mobile information processing unit 2B can be attached to the head-mounted display 6B or stored in a pocket or the like, thereby providing a dental treatment support device 10B that is small, lightweight, and highly portable. Also, by providing the head-mounted display 6B that can be worn on the head of a dentist or the like and the input unit 3' that can be operated with the feet, the dentist or the like does not need to use his or her hands for operation, etc., and can freely use both hands to perform treatment or assist.

[0087] Furthermore, the dental treatment support device 10B according to the third embodiment may further include a sound input unit 3B' such as a microphone as shown by the dashed line in FIG. 5B as an input unit, and may have sound analysis software (sound analysis unit) installed in the information processing unit 2B. With this configuration, a dentist or other professional can orally (audio) instruct the selection of the intended use through the sound input unit, and the sound analysis software analyzes the sound, and the information processing unit 2B executes various processes according to the analysis results. Therefore, there is no need to use hands or feet for operation, allowing the dentist or other professional to more freely and easily perform treatment or assist.

[0088] (Fourth embodiment) Next, a dental treatment support system 100 according to a fourth embodiment will be described with reference to the block diagram of FIG. 6 and the flowchart of FIG.

[0089] 6, a dental treatment support system 100 according to the fourth embodiment includes a dental treatment support device 10 installed on the client side, such as a dental clinic, and a server 30 managed by a dental treatment support service provider, etc. The dental treatment support device 10 and the server 30 are connected via a communication network N, such as the Internet.

[0090] At least one dental treatment support device 10 is sufficient, and more preferably, multiple devices are provided, allowing for the collection of more support results for a variety of cases. In the case of multiple devices, one or more dental treatment support devices 10 are installed in each of multiple dental clinics, etc. Furthermore, together with or instead of the dental treatment support device 10, dental treatment support devices 10A and 10B such as those of the second and third embodiments may be provided in any of the dental clinics, etc.

[0091] The dental treatment support device 10 of the fourth embodiment has the same basic configuration as the dental treatment support device 10 of the first embodiment, except for some differences in the functions of each unit and the information stored in the memory unit 17. Therefore, the same components as those of the dental treatment support device 10 of the first embodiment are denoted by the same reference numerals as in the first embodiment, and detailed description thereof will be omitted.

[0092] In the fourth embodiment, the identification of treatment steps by analyzing captured images, the selection of processing procedures to be displayed, and product information are performed by the server 30. The dental treatment support device 10 of the fourth embodiment transmits captured images and input information to the server 30 via the communication network N, receives treatment steps, processing procedures, product information, etc. from the server 30, and performs dental treatment support based on these. Details of the functions of each unit will be explained together with the explanation of the operation using the flowchart in Figure 7, which will be described later.

[0093] The server 30 is configured from a server PC equipped with a CPU, RAM, ROM, storage media, etc., but a general-purpose large computer (mainframe) can also be used. The server PC may be one that uses a cloud computing service, or may be a server PC owned by a data center or a vendor.

[0094] The server 30 mainly comprises a learning unit 31 and a database 32, but also comprises general configurations and functions of a server 30, such as a communication unit and an image display unit.

[0095] The database 32 stores product information, processing procedure information, etc., and further stores various information used for object recognition, etc. The database 32 also stores photographed images, support results, etc. received from each dental treatment support device 10. The product information and processing procedures stored in the database 32 are successively updated (upgraded) by being rewritten by the learning unit 31 or by new information provided by product vendors. The updated information may be transmitted to each dental treatment support device 10 at a predetermined timing and reflected in the storage unit 17.

[0096] The learning unit 31 has an artificial intelligence function. For example, it uses training data that associates features representing various states of caries, cavities, root canals, etc. requiring treatment with actual treatment steps for these various states of caries, cavities, root canals, etc., as well as treatment processes and materials used. Based on the features of the input photographed images, the learning unit 31 uses a machine learning algorithm to output treatment steps and even optimal treatment processes and materials. This enables more advanced analysis and judgment. Based on input information received from each dental treatment support device 10, the learning unit 31 acquires product information and treatment procedure information from the database 32 and transmits them to the dental treatment support device 10. The learning unit 31 analyzes the photographed images transmitted from each dental treatment support device 10 using object recognition technology, identifies treatment steps, and transmits them to the dental treatment support device 10. Furthermore, it may have a function to determine the execution status of each processing step of the dental step (for example, dental material is applied, air is sprayed, light is irradiated, etc.), determine display information, audio information, etc. corresponding to the execution status, and transmit it to the dental treatment support device 10.

[0097] The learning unit 31 also stores product information, processing procedure information, support results, etc. of the products used in the database 32. The learning unit 31 also acquires product introduction information from the database 32 based on the support results and transmits it to the dental treatment support device 10. The learning unit 31 can also be configured to analyze the accumulated test results, derive more suitable uses and processing procedures, and reflect them in the processing procedures, etc. of the database 32.

[0098] An example of dental treatment support processing executed by the dental treatment support system 100 configured as described above will be described with reference to the flowchart of FIG. 7, while clarifying the differences from the respective parts of the first embodiment.

[0099] When the dental treatment support program is started in the dental treatment support device 10, communication with the server 30 begins, and when there is an update to the product information or processing procedure information in the database 32, the updated information is received from the server 30 and the memory unit 17 is updated (step S20).

[0100] Next, in step S21, the display image control unit 26 displays a use purpose selection screen 41 (see FIG. 3) on the display unit 4. In step S22, the input information acquisition unit 23 acquires information on the selected use purpose. In step S23, the product information acquisition unit 24 acquires a list of product names from the storage unit 17 according to the use purpose, and in step S24, the display image control unit 26 displays a use product selection screen 42 on the display unit 4 (see FIG. 3). In step S25, the input information acquisition unit 23 acquires information on the use product.

[0101] In step S26, the information processing unit 2 transmits the captured image acquired by the captured image acquisition unit 21 and input information consisting of the acquired information on the intended use and the products used to the server 30. In step S27, the learning unit 31 of the server 30 analyzes the received captured image while referring to the information on the intended use and the input information on the products used, and identifies the treatment steps. Since the learning unit 31 has an artificial intelligence function, more accurate analysis is possible. In step S28, based on the treatment steps and the input information, the learning unit 31 acquires, from the database 32, processing procedure information including the processing procedure corresponding to the treatment step and information on the dental materials, instruments, etc. used in each step of the processing procedure.

[0102] Next, in step S29, the server 30 transmits the acquired processing procedure information to the dental treatment support device 10. In step S30, upon receiving this, the display image control unit 26 of the dental treatment support device 10 generates a support screen 43 that displays real-time captured images in the captured image display area 43a, images of dental materials and instruments corresponding to the treatment steps in the material etc. display area 43b, and processing procedures and individual processing steps corresponding to the treatment steps in the processing procedure display area 43c, and displays this support screen 43 on the display surface 4a of the display unit 4. By visually checking this support screen 43, the dental hygienist or the like can confirm the treatment steps, necessary dental materials, instruments, and processing procedures.

[0103] Next, in step S31, the captured image analysis unit 22 analyzes the captured image to determine whether the processing has started. This determination may be made by the learning unit 31 of the server 30, allowing for more accurate determination. While the processing has not started (determination of NO in step S31), the program waits until the processing has started, and when it is determined that the processing has started (determination of YES in step S31), the processing procedure control unit 25 proceeds to step S32 to count the processing time and display the counter image 43d, if it is necessary to measure the processing time, and issues an alarm in step S33 when the time is up.

[0104] Even in the fourth embodiment, when a dentist performs processing using a time or procedure different from the preset processing time, the processing procedure control unit 25 stores the actual processing time and procedure, which can be used as useful information for the learning unit 31 of the server 30 to later analyze the support results.

[0105] Next, in step S34, the processing procedure control unit 25 determines whether there is a next processing step, and if there is a processing step (YES), returns to step S26 and sequentially executes the following: sending the captured image to the server 30, analyzing the captured image in step S27, obtaining processing procedure information in step S28, sending the processing procedure information, etc. to the dental treatment support device 10 in step S29, displaying the support screen 43 on the display unit 4 in step S30, determining whether to execute processing in step S31, counting the processing time, etc. as necessary in step S32, and issuing an alarm in step S33. These steps S26 to S33 are repeated until all processing steps are completed (until the determination in step S34 becomes NO).

[0106] Thereafter, the process proceeds to step S35, where it is determined whether or not the treatment has ended. If not (NO), the process returns to step S21, and the processes of steps S21 to S34 are repeated for the next treatment step.

[0107] If the information processing unit 2 determines in step S35 that the treatment has ended (YES), in step S36 the processing procedure control unit 25 associates the captured image with the support results, such as the product used, the purpose of use, and the actual processing procedure, stores them in the memory unit 17, and transmits them to the server 30. In step S37, the server 30 stores the received information in the database 32 in association with the identification number of the dental treatment support device 10, and analyzes this information as necessary. Based on this analysis, the content of the processing procedure may be changed to a more appropriate one, such as by setting more appropriate processing times for drying and light irradiation, and the processing procedure information in the database 32 may be updated.

[0108] Furthermore, if necessary, the process proceeds to step S38, where product introduction information (see the introduction information in the first embodiment) is extracted from the database 32 and transmitted to the dental treatment support device 10. In the dental treatment support device 10, the display image control unit 26 displays the received introduction information on the display unit 4 in step S39.

[0109] The server 30 may also collect the support results of a plurality of dental treatment support devices 10 and store them in a database 32, and the stored support results may be analyzed and learned by the learning unit 31. This allows dentists and other professionals to learn which products they prefer and the trends in their uses, which can be effectively utilized in sales strategies, product improvements, and new product development.

[0110] As described above, the dental treatment support system 100 of the fourth embodiment includes the dental treatment support device 10, and displays real-time images of the treatment target captured by the imaging unit 1 and processing procedures corresponding to the products used and their intended use on the display unit 4, which is visible to dentists, dental hygienists, etc. Furthermore, by including a learning unit 31 with artificial intelligence capabilities, treatment steps and their execution status can be identified in more detail and with higher accuracy. Therefore, it is possible to provide a dental treatment support system 100 that can accurately guide the processing procedures corresponding to treatment steps without relying on human memory, etc., and can more appropriately support dental treatment.

[0111] Furthermore, by connecting the server 30 to multiple dental treatment support devices 10, support results for various cases can be collected on the server 30 side. By analyzing the collected support results, it is possible to understand product usage conditions and products preferred by dentists, etc., and to consider more suitable products and usage procedures for each treatment step, which can lead to product improvements and the development of new products.

[0112] (Fifth embodiment) Next, a dental product sales promotion device and a dental product sales promotion method using this dental product sales promotion device will be described as a fifth embodiment. The dental product sales promotion device of the fifth embodiment is configured to include the dental treatment support device 10 of the first embodiment shown in Figure 1 and a sales promotion unit. In this embodiment, the processing procedure control unit 25 functions as the sales promotion unit.

[0113] The sales promotion unit (processing procedure control unit 25) has a function of displaying, on the display unit 4, information on the purchasing site of the product used or information on the purchasing site of another product with the same purpose as the product used, based on the support results from the dental treatment support device 10. In this embodiment, the processing procedure control unit 25 of the dental treatment support device 10 functions as the sales promotion unit, but this configuration is not limited to this. As a variation, a sales promotion unit may be provided separately from the processing procedure control unit 25, or a sales promotion unit may be provided in a server or the like connected via a communication network.

[0114] The dental material sales promotion method executed by the dental product sales promotion device configured as described above displays, on the display unit 4, information on the purchasing site for the product used or information on the purchasing site for another product with the same intended use, based on the support results obtained by a method similar to the dental treatment support method executed by the dental treatment support device 10 of the first embodiment. As such purchasing site information, for example, the URL of the purchasing site is displayed. Clicking on this URL can lead to the purchasing site, making it possible to more effectively promote the sales of products needed by dentists and the like.

[0115] Although the embodiments of the present disclosure have been described in detail above with reference to the drawings, the above-described embodiments are merely examples of the present disclosure, and the present disclosure is not limited to the configurations of the above-described embodiments. Of course, any design changes that do not deviate from the gist of the present disclosure are also included in the present disclosure. [CROSS-REFERENCE TO RELATED APPLICATIONS]

[0116] This application claims priority based on Japanese Patent Application No. 2018-192868, filed with the Japan Patent Office on October 11, 2018, the entire disclosure of which is incorporated herein by reference in its entirety.

Claims

1. A display unit; An imaging unit that captures an image of the oral cavity of a patient including a treatment target; an input unit into which input information relating to at least one of the intended use of the dental material product and the dental material product to be used is input; a storage unit for storing a plurality of pieces of dental material product information and processing procedure information for each use of each dental material product; an image analysis unit that analyzes the images captured by the imaging unit, identifies treatment steps for the treatment target based on the analysis results and the input information, and analyzes the images to detect the type of dental instrument and the operating state of the dental instrument from the images, thereby automatically detecting the start and end of a predetermined step in a treatment procedure; a product information acquisition unit that acquires, from the storage unit, the input information input from the input unit, and the dental material product information and the treatment procedure information corresponding to the treatment step; a processing procedure control unit that notifies the content of a predetermined step of the processing procedure by voice, counts a processing time when a start of the predetermined step of the processing procedure is detected, and issues an alarm when the processing time reaches a predetermined time included in the processing procedure information; a display image control unit that displays, for each treatment step, images of a predetermined treatment procedure selected from the treatment procedure information and the dental materials and instruments to be used alongside the captured image on the display unit in real time, and that displays, on the display unit, a counter image corresponding to the treatment time that is counted when the start of a predetermined step of the treatment procedure is detected, and that displays, on the display unit, the next treatment procedure when the end of the predetermined step of the treatment procedure is detected; Equipped with A dental treatment support device characterized by:

2. 2. The dental treatment support device according to claim 1, wherein the display unit is provided on a head-mounted display, and the display unit has transparency so that the treatment target can be visually recognized while displaying the processing procedure.

3. 3. The dental treatment support device according to claim 1, wherein the predetermined steps of the processing procedure include either a drying step or a light irradiation step.

4. A dental treatment support device as described in any one of claims 1 to 3, characterized in that the processing procedure control unit issues an alarm notification of the start of a specified step in the processing procedure.

5. A dental treatment support device as described in any one of claims 1 to 4, characterized in that when the actual processing time of the specified process is different from the processing time previously set by the seller of the dental material product included in the processing procedure information, the processing procedure control unit sets the actual processing time in the processing procedure information and updates the processing procedure information in the memory unit.

6. A dental treatment support device as described in any one of claims 1 to 5, characterized in that the processing procedure control unit stores the captured image in the memory unit in association with the input information, the dental material product information, the processing procedure, and support results including the execution results of the processing procedure.

7. The dental treatment support device according to claim 6, characterized in that the processing procedure control unit displays, on the display unit, introduction information about the product used or introduction information about the product corresponding to the processing procedure based on the support result.

8. 8. The dental treatment support device according to claim 1, further comprising a learning unit having an artificial intelligence function.

9. a dental treatment support device; and a server connected to the dental treatment support device via a communication network; The dental treatment support device includes: A display unit; An imaging unit that captures an image of the oral cavity of a patient including a treatment target; an input unit into which input information relating to at least one of the intended use of the dental material product and the dental material product to be used is input; an information processing unit that transmits the captured image captured by the imaging unit and the input information input from the input unit to the server, The server includes a learning unit having an artificial intelligence function; a database in which information on a plurality of dental material products and processing procedure information for each use of each dental material product are stored; the learning unit is configured to acquire the photographed image and the input information from the dental treatment support device via the communication network, analyze the photographed image, identify a treatment step for the treatment target based on the analysis result and the input information, acquire the dental material product information and the processing procedure information corresponding to the treatment step from the database based on the identified treatment step and the input information, and transmit them to the dental treatment support device; and when the start of a predetermined step in the processing procedure is detected, the information processing unit counts the processing time and displays a counter image corresponding to the processing time on the display unit. When the processing time reaches a predetermined time included in the processing procedure information, an alarm is issued. When the end of a predetermined step in the processing procedure is detected, the information processing unit counts the processing time and displays a counter image corresponding to the processing time on the display unit. When the end of a predetermined step in the processing procedure is detected, the information processing unit counts the processing time and displays a counter image corresponding to the processing time on the display unit. When the end of the ...

10. A method for operating a dental treatment support device, which is executed by an information processing unit included in the dental treatment support device according to any one of claims 1 to 8, an imaging step of photographing the oral cavity of a patient including a treatment target; an image analysis process for analyzing the image captured by the imaging unit, identifying a treatment step for the treatment target based on the analysis result and the input information, and automatically detecting the start and end of a treatment process by analyzing the image and detecting the type of dental instrument and the operating state of the dental instrument from the image; a product information acquisition step of acquiring, from the storage unit, the input information input from the input unit and the dental material product information and the treatment procedure information corresponding to the treatment step; a processing procedure control step of notifying the content of a predetermined step of the processing procedure by voice, counting a processing time when the start of the predetermined step of the processing procedure is detected, and notifying an alarm when the processing time reaches a predetermined time included in the processing procedure information; a display image control process for displaying, on the display unit in real time, a predetermined processing procedure selected from the processing procedure information and an image of the dental materials and instruments to be used alongside the captured image for each treatment step, and displaying, on the display unit, a counter image corresponding to the processing time that is counted when the start of a predetermined step of the processing procedure is detected, and displaying, on the display unit, a next processing procedure when the end of the predetermined step of the processing procedure is detected.

11. Computer, a storage means for storing dental material product information and processing procedure information; an image acquisition means for acquiring an image of the oral cavity of a patient including a treatment target; an input information acquisition means for acquiring input information relating to at least one of the intended use of the dental material product and the dental material product to be used; a photographed image analysis means for analyzing the photographed image, identifying a treatment step for the treatment target based on the analysis result and the input information, and analyzing the photographed image to detect the type of dental instrument and the operating state of the dental instrument from the photographed image, thereby automatically detecting the start and end of a predetermined step in the treatment procedure; a product information acquisition means for acquiring the dental material product information and the treatment procedure information corresponding to the input information and the treatment step from the storage means; a processing procedure control means for notifying the content of a predetermined step of the processing procedure by voice, counting a processing time when the start of the predetermined step of the processing procedure is detected, and notifying an alarm when the processing time reaches a predetermined time included in the processing procedure information; A program for functioning as a display image control means that displays, for each treatment step, a predetermined processing procedure selected from the processing procedure information and images of the dental materials and instruments to be used alongside the captured image on the display unit in real time, and displays, on the display unit, a counter image corresponding to the processing time that is counted when the start of a predetermined step of the processing procedure is detected, and displays, on the display unit, the next processing procedure when the end of the predetermined step of the processing procedure is detected.

12. A dental treatment support device according to any one of claims 1 to 8, a sales promotion unit that displays on the display unit information on a purchasing site for the dental material product used or information on a purchasing site for another dental material product having the same application as the used dental material product, based on the support results of the dental treatment support device; 1. A dental product sales promotion device comprising:

Images