Data processing device, data processing method, data processing program, and data processing system

Abstract

To provide a technique of comparing soft tissues in an oral cavity in a time sequence.SOLUTION: Data processing device 1 includes: an input interface 14 in which first third-dimensional data and second three-dimensional data are input which show an object obtained at different timings from the same subject; and a calculation device 11 in which, based on a shape of at least one tooth contained in the object, soft tissues of the at least one tooth are compared between the first three-dimensional data and the second three-dimensional data and comparative information of the comparative results are output.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present disclosure relates to a data processing apparatus, a data processing method, a data processing program, and a data processing system for processing three-dimensional data of an object in the oral cavity.

Background Art

[0002] It is known that keeping teeth in a healthy state helps to extend the healthy life span. Therefore, the introduction of so-called national dental check-ups, which obligate all citizens to undergo a dental examination every year, is being considered. In a dental examination, a practitioner such as a dentist diagnoses not only the health state of teeth but also the health state of the gums. By diagnosing the state of the gums, the practitioner can discover and treat diseases such as gingivitis, dental caries, or periodontal disease, and can also prevent the onset of these diseases.

[0003] Patent Document 1 discloses a gingivitis inspection system capable of determining the state of gingivitis of a subject using a captured image obtained by photographing the oral cavity of the subject to be diagnosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] According to the system disclosed in Patent Document 1, the state of gingivitis can be determined by comparing the color of the gingiva shown in the captured image of the oral cavity with the color swatch of the gingiva created from the colors of the gingiva of multiple people. However, since the color of soft tissues such as the gingiva varies among individuals, it is not possible to accurately know whether the soft tissues of the subject are in a healthy state by comparing the color of the soft tissues with a predetermined color swatch. Without comparing the color of the soft tissues in the past and the current color of the soft tissues in the same subject, it is not possible to accurately know whether the soft tissues of the subject are in a healthy state. Also, if dental check-ups are to be carried out annually with the introduction of national dental health examinations, it is important to know the annual changes in the state of the soft tissues in the oral cavity.

[0006] The present disclosure has been made to solve such problems, and an object thereof is to provide a technique capable of comparing soft tissues in the oral cavity in a time series.

Means for Solving the Problems

[0007] According to an example of the present disclosure, a data processing device for processing three-dimensional data of an object in the oral cavity is provided. The data processing device includes an input unit to which first three-dimensional data and second three-dimensional data are input, the first three-dimensional data and the second three-dimensional data including position information of each point group indicating at least one tooth included in the object and the surface of the gingiva around the at least one tooth, which are acquired at different timings for the same person, and an arithmetic unit that compares the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown part of at least one tooth, and outputs comparison information regarding the comparison result. The arithmetic unit compares the gingiva around at least one tooth based on each point group constituting the gingiva around at least one tooth shown by the first three-dimensional data and each point group constituting the gingiva around at least one tooth shown by the second three-dimensional data.

[0008] According to an example of the present disclosure, a data processing method for processing three-dimensional data of an object in the oral cavity is provided. The data processing method includes, as processes executed by a computer, a step of acquiring first three-dimensional data and second three-dimensional data including position information of each of a point group indicating at least one tooth included in the object and the surface of the gingiva around the at least one tooth, which are acquired at different timings for the same person; a step of comparing the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth; and a step of outputting comparison information regarding the comparison result. The comparing step compares the gingiva around the at least one tooth based on each of the point groups constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each of the point groups constituting the gingiva around the at least one tooth indicated by the second three-dimensional data.

[0009] According to an example of the present disclosure, a data processing program for processing three-dimensional data of an object in the oral cavity is provided. The data processing program causes a computer to execute a step of acquiring first three-dimensional data and second three-dimensional data including position information of each of a point group indicating at least one tooth included in the object and the surface of the gingiva around the at least one tooth, which are acquired at different timings for the same person; a step of comparing the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth; and a step of outputting comparison information regarding the comparison result. The comparing step compares the gingiva around the at least one tooth based on each of the point groups constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each of the point groups constituting the gingiva around the at least one tooth indicated by the second three-dimensional data.

[0010] According to an example of the present disclosure, a data processing system for processing three-dimensional data of an object in the oral cavity is provided. The data processing system includes a three-dimensional scanner that acquires three-dimensional data of the object, and a data processing device that processes the three-dimensional data acquired by the three-dimensional scanner. The data processing device includes an input unit to which first three-dimensional data and second three-dimensional data are input, the first three-dimensional data and the second three-dimensional data including position information of each point group indicating at least one tooth included in the object and the surface of the gingiva around the at least one tooth, which are acquired at different timings for the same person, and an arithmetic unit that compares the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth, and outputs comparison information regarding the comparison result. The arithmetic unit compares the gingiva around the at least one tooth based on each point group constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each point group constituting the gingiva around the at least one tooth indicated by the second three-dimensional data.

Advantages of the Invention

[0011] According to the present disclosure, a user can compare soft tissues in the oral cavity in time series using first three-dimensional data and second three-dimensional data indicating objects in the oral cavity acquired at different timings for the same person.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0013] <Embodiment 1> Embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the same or corresponding parts in the drawings are denoted by the same reference numerals and their description will not be repeated.

[0014] [Application Example] With reference to FIGS. 1 to 3, an application example of the data processing system 10 and the data processing apparatus 1 according to Embodiment 1 will be described. FIG. 1 is a diagram showing an application example of the data processing system 10 and the data processing apparatus 1 according to Embodiment 1.

[0015] As shown in FIG. 1, the data processing system 10 according to Embodiment 1 includes a data processing device 1 and a three-dimensional scanner 2. A user can acquire three-dimensional data indicating the shapes of a plurality of objects in the oral cavity by scanning the inside of the oral cavity of a subject using the three-dimensional scanner 2. The data processing device 1 is communicably connected to the three-dimensional scanner 2 and processes the three-dimensional data acquired by the three-dimensional scanner 2.

[0016] The "user" may be any person who acquires three-dimensional data of objects such as teeth and soft tissues using the three-dimensional scanner 2, such as a dental professional like a dentist, a dental assistant, a teacher or student at a dental university, a dental technician, a manufacturer's technician, a worker in a manufacturing factory, etc. The "subject" may be any person who can be the subject of scanning by the three-dimensional scanner 2, such as a patient in a dental clinic or a subject at a dental university.

[0017] The "object" to be scanned may be any object that can be the subject of scanning by the three-dimensional scanner 2, such as the upper and lower dental arches in the oral cavity. The "dental arch" includes teeth and the soft tissues surrounding the teeth. The "teeth" include natural teeth and artificial teeth (prostheses, implants, etc.). The "soft tissue" includes at least the gingiva. Note that the "soft tissue" may include the buccal mucosa. The buccal mucosa may include swellings on the mucosa caused by oral inflammation or malignant tumors, etc.

[0018] The three-dimensional scanner 2 is a so-called intraoral scanner (IOS: Intra Oral Scanner) that can optically image the inside of a subject's oral cavity by means of confocal method, triangulation method, or the like. Specifically, the three-dimensional scanner 2 acquires, as three-dimensional data, the position information (coordinates of each axis in the vertical, horizontal, and height directions) of each point in a point cloud (a plurality of points) indicating the surface shape of the object to be scanned by scanning an object inside the oral cavity using an optical sensor or the like. That is, the three-dimensional data is position data (IOS data) including the position information of each point in the point cloud constituting the surface of an object placed in a certain coordinate space. Further, the three-dimensional scanner 2 acquires, as three-dimensional data, color information indicating the color of each point in a point cloud (a plurality of points) indicating the shape of the object to be scanned by scanning an object inside the oral cavity. That is, the three-dimensional data includes the color information of each point in the point cloud so as to be associated with the position information of each point in the point cloud constituting the surface of the object. In the following, the position information of each point in the point cloud constituting the surface of the object to be scanned is also simply referred to as "three-dimensional data".

[0019] Based on the three-dimensional data of the object acquired by the three-dimensional scanner 2, the data processing device 1 generates a two-dimensional image showing the two-dimensional object viewed from an arbitrary viewpoint. Such a two-dimensional image is an image generated by performing processing or editing on the three-dimensional data, and is also referred to as a "rendering image". The data processing device 1 can show the user the surface of the object inside the oral cavity viewed from an arbitrary viewpoint by displaying the generated rendering image on the display 3.

[0020] According to the data processing system 10 as described above, for example, the user can display on the display 3 a rendering image showing the two-dimensional upper and lower dental arches viewed from an arbitrary viewpoint by scanning the upper and lower dental arches inside the oral cavity using the three-dimensional scanner 2.

[0021] With reference to FIG. 2, a method of scanning the oral cavity by the three-dimensional scanner 2 will be described. FIG. 2 is a diagram for explaining the method of scanning the oral cavity by the three-dimensional scanner 2. The scanning range of the three-dimensional scanner 2 is limited by the size of the probe 22 that can be inserted into the oral cavity. Therefore, the user inserts the probe 22 of the three-dimensional scanner 2 into the oral cavity and scans by moving the probe 22 along the dental arch in the oral cavity in multiple scans to scan the oral cavity.

[0022] For example, as shown in FIG. 2, the user switches the scanning ranges in order, such as R1, R2, R3, ··· Rn, by moving the probe 22 in the oral cavity to obtain three-dimensional data of the objects in the oral cavity. More specifically, the user moves the probe 22 from the labial surface of the tooth through the occlusal surface to the lingual surface of the tooth to scan some teeth and the soft tissues corresponding to the teeth (for example, the gingiva around some teeth, etc.), and performs such scans by moving the probe 22 from one molar side through the anterior teeth to the other molar side to sequentially scan a plurality of teeth and the soft tissues corresponding to the teeth. Note that since the way of moving the probe 22 in the oral cavity varies from user to user or dental treatment to dental treatment, the objects in the oral cavity from which the three-dimensional data is obtained and the acquisition order may change.

[0023] With reference to FIG. 3, the generation of three-dimensional data will be described. FIG. 3 is a diagram for explaining the generation of three-dimensional data showing the shapes of the teeth and soft tissues in the oral cavity. As shown in FIGS. 3(A), 3(B), 3(C), and 3(D), the data processing device 1 generates three-dimensional data of the entire dental arch including a plurality of teeth and gingiva by stitching together the three-dimensional data acquired by the three-dimensional scanner 2.

[0024] The three-dimensional data generated as described above can show the shape of the soft tissue corresponding to the entire dentition. Therefore, if the data processing device 1 can compare the first three-dimensional data and the second three-dimensional data indicating the objects in the oral cavity obtained at different timings for the same person, it can detect changes in the state of the soft tissue. For example, the data processing device 1 can detect changes in the state of the soft tissue over one year by comparing the first three-dimensional data indicating the object in the oral cavity of a subject obtained one year ago with the second three-dimensional data indicating the object in the oral cavity of the same subject obtained this year. The "state of the soft tissue" includes at least one of the shape of the soft tissue and the color of the soft tissue.

[0025] Here, as shown in FIG. 2, the user scans the object in the oral cavity in multiple stages from one end of the dentition to the other end, and then, as shown in FIGS. 3(A) to 3(D), combines the three-dimensional data of each part in the oral cavity. However, the shape of the entire dentition indicated by the three-dimensional data generated by this combination may be different from the actual shape of the entire dentition. The reason is that an error occurs between the actual object when combining the three-dimensional data of each part in the oral cavity. Also, the more times of combination, the greater such an error becomes.

[0026] More specifically, in the three-dimensional data combined as shown in FIGS. 3(A) to 3(D), the difference between the shape of the first tooth indicated by the three-dimensional data combined at the beginning and the actual shape of the first tooth is small, while the difference between the shape of the second tooth indicated by the three-dimensional data combined at the end and the actual shape of the second tooth is likely to be large.

[0027] For example, as shown in FIGS. 3(D) and 3(E), the height of the first tooth T1 shown in the three-dimensional data initially joined is generally in agreement with the actual height of the first tooth T1, whereas the height of the tooth T2 shown in the three-dimensional data joined last tends to be significantly different from the actual height of the second tooth T2. In the example of FIG. 3(E), the height of the tooth T2 (the tooth shown by the solid line) shown in the three-dimensional data may be lower (or higher) by the amount of the error L of several millimeters than the height of the actual second tooth T2 (the tooth shown by the dashed line). When scanning along the dental arch direction, the farther the tooth is from the tooth first scanned in the dental arch direction, the greater such an error L can be. Furthermore, since such an error L occurs when joining the three-dimensional data of each part in the oral cavity, it does not always result in the same value each time. That is, the first three-dimensional data showing the object in the oral cavity of a subject acquired one year ago and the second three-dimensional data showing the object in the oral cavity of the same subject acquired this year do not necessarily have the same error L as described above.

[0028] Therefore, when comparing the first three-dimensional data showing the object in the oral cavity of a subject acquired one year ago and the second three-dimensional data showing the object in the oral cavity of the same subject acquired this year in order to detect changes in the state of soft tissues such as the gums over one year, if the two are simply compared across the entire dental arch, there is a risk that due to the non-constant error L, the changes in the state of the soft tissues cannot be accurately detected.

[0029] Therefore, instead of comparing the first three-dimensional data and the second three-dimensional data showing the objects in the oral cavity acquired at different timings for the same person across the entire object in the oral cavity, the data processing apparatus 1 according to Embodiment 1 is configured to compare the soft tissues (a predetermined range of the soft tissues in contact with the tooth) around at least one tooth based on the shape of the crown part of at least one tooth included in the object between the first three-dimensional data and the second three-dimensional data. Hereinafter, the soft tissue comparison process executed by the data processing apparatus 1 will be specifically described.

[0030] [Hardware Configuration of Data Processing Device] With reference to FIG. 4, the hardware configuration of the data processing system 10 and the data processing device 1 according to Embodiment 1 will be described. FIG. 4 is a block diagram showing the hardware configuration of the data processing system 10 and the data processing device 1 according to the embodiment. The data processing device 1 may be realized, for example, by a general-purpose computer or a computer dedicated to the data processing system 10.

[0031] As shown in FIG. 4, the data processing device 1 includes, as main hardware elements, an arithmetic unit 11, a memory 12, a storage device 13, a scanner interface 14, a display interface 15, a peripheral device interface 16, a media reader 17, and a communication device 18.

[0032] The arithmetic unit 11 has the function of an "arithmetic unit" and is composed of a computer such as a processor. The processor is composed of, for example, a microcontroller, a CPU (central processing unit), or an MPU (Micro-processing unit). Note that the processor has the function of executing various processes by executing a program, but a part or all of these functions may be implemented using a dedicated hardware circuit such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array). The "processor" is not limited to a narrow sense processor that executes processing in a stored program manner such as a CPU or an MPU, and may include a hardwired circuit such as an ASIC or an FPGA. Therefore, the processor can also be read as a processing circuitry whose processing is defined in advance by computer-readable code and / or a hardwired circuit. Note that the processor may be composed of one chip or a plurality of chips. Furthermore, the processor and related processing circuits may be composed of a plurality of computers interconnected by wire or wirelessly via a local area network or a wireless network. The processor and related processing circuits may be composed of a cloud computer that remotely performs arithmetic operations based on input data and outputs the arithmetic operation results to other devices located at a remote location.

[0033] Memory 12 provides a storage area for storing program codes, work memories, etc. when the processor of the arithmetic unit 11 executes various programs. Memory 12 may be one or more non-transitory computer readable media. Examples of Memory 12 include volatile memories such as DRAM (dynamic random access memory) and SRAM (static random access memory), or non-volatile memories such as ROM (Read Only Memory) and flash memory.

[0034] Storage device 13 provides a storage area for storing various programs and various data that can be read and executed by the processor of arithmetic unit 11. Storage device 13 may be one or more computer readable storage media. Examples of storage device 13 include storage devices such as HDD (Hard Disk Drive) and SSD (Solid State Drive).

[0035] Storage device 13 stores data processing program 100. Data processing program 100 is a program in which the content of comparison processing for comparing soft tissues is described based on the three-dimensional data of an object in the oral cavity acquired by the three-dimensional scanner 2, and can be read and executed by arithmetic unit 11. Data processing program 100 may be input by the user using keyboard 4 and mouse 5 and executed, or may be read from recording medium 20 by media reader 17, or may be acquired from another device such as a server via a network by communication device 18.

[0036] The scanner interface 14 has the function of an "input unit" and is an interface for connecting the three-dimensional scanner 2. The scanner interface 14 may be composed of input circuitry. The scanner interface 14 realizes the input and output of data between the data processing device 1 and the three-dimensional scanner 2. The data processing device 1 and the three-dimensional scanner 2 are connected via a cable (wired) or wirelessly (such as WiFi, Bluetooth (registered trademark), etc.).

[0037] The display interface 15 is an interface for connecting the display 3 and realizes the input and output of data between the data processing device 1 and the display 3.

[0038] The peripheral device interface 16 is an interface for connecting peripheral devices such as the keyboard 4 and the mouse 5 and realizes the input and output of data between the data processing device 1 and the peripheral devices.

[0039] The media reader / writer 17 reads data stored in the recording medium 20 and writes data to the recording medium 20. The recording medium 20 is a non-transitory and tangible computer readable storage medium, and may be in any form as long as it can record various data, such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a USB (Universal Serial Bus) memory. In the embodiment, the recording medium 20 can store the data processing program 100, and the arithmetic unit 11 can execute the data processing program 100 read from the recording medium 20.

[0040] The communication device 18 transmits and receives data to and from an external device via wired communication or wireless communication. For example, the communication device 18 can be communicatively connected to an in-hospital server or an out-of-hospital server (e.g., a cloud server) via wired using a cable or wirelessly (such as WiFi, Bluetooth (registered trademark), etc.), and thereby transmit comparison information corresponding to the comparison result of soft tissues to the server device.

[0041] [Extraction of three-dimensional data to be subjected to comparison processing] With reference to FIG. 5, the extraction of three-dimensional data that is the object of the comparison processing executed by the data processing device 1 will be described. FIG. 5 is a diagram for explaining the extraction of three-dimensional data that is the object of the comparison processing according to Embodiment 1.

[0042] As shown in FIG. 5, the data processing device 1 extracts three-dimensional data indicating at least one tooth and soft tissue corresponding to the at least one tooth (e.g., the gingiva around the at least one tooth, etc.) from the three-dimensional data showing the entire dentition generated as the comparison object of the comparison processing. That is, the data processing device 1 extracts three-dimensional data indicating at least one tooth and soft tissue corresponding to the at least one tooth by dividing the three-dimensional data showing the entire dentition.

[0043] Specifically, as shown in FIG. 5(A), the data processing device 1 designates, with a designated point P, a portion of the objects in the oral cavity that is the extraction target of the three-dimensional data, and extracts the three-dimensional data of the portion surrounded by a predetermined range Q including the designated point P. Then, as shown in FIG. 5(B), the data processing device 1 moves the position of the designated point P along the dentition, and extracts the three-dimensional data of each portion while switching the portion that is the extraction target of the three-dimensional data.

[0044] For example, in the example of FIG. 5, the data processing device 1 designates one tooth among the plurality of teeth included in the entire generated dental arch at the designation point P. More specifically, the data processing device 1 designates the center of one tooth (for example, the center of the crown portion) at the designation point P. The data processing device 1 extracts three-dimensional data of a portion surrounded by a predetermined range Q including the designated designation point P. Then, the data processing device 1 moves the position of the designation point P along the dental arch to designate the next adjacent tooth at the designation point P, and extracts three-dimensional data of a portion surrounded by the range Q including the designation point P. At this time, the data processing device 1 extracts three-dimensional data of a portion surrounded by the range Q including the designation point P so as to divide the dental arch in a direction substantially orthogonal to the dental arch direction. In this way, the data processing device 1 extracts three-dimensional data of each portion while switching the portion to be the extraction target of the three-dimensional data. The three-dimensional data extracted in this way includes three-dimensional data indicating each tooth and the soft tissue corresponding to each tooth (for example, the gingiva around at least one tooth, etc.).

[0045] Note that the data processing device 1 may determine the portion to be the extraction target of the three-dimensional data according to the designation of the user. For example, the user may set, at the designation point P, the portion for which the user desires to detect the state change of the soft tissue. The data processing device 1 may extract three-dimensional data of a portion surrounded by the range Q including the designation point P set by the user.

[0046] The data processing device 1 may also determine the portion to be the extraction target of the three-dimensional data according to a predetermined order set in advance by the user. For example, the user may set to designate, at the designation point P in a predetermined order, the teeth for which the user desires to extract the three-dimensional data. The data processing device 1 may set the designation point P in the predetermined order set by the user, and extract the three-dimensional data of the portion surrounded by the range Q including the designation point P in the predetermined order.

[0047] The data processing device 1 may determine a portion to be the extraction target of the three-dimensional data according to the data amount of the three-dimensional data to be extracted. For example, the data processing device 1 extracts the three-dimensional data of the first portion (for example, the first tooth), and if the data amount of the extracted three-dimensional data exceeds a predetermined amount, it may extract the three-dimensional data of the next second portion (for example, the second tooth adjacent to the first tooth). In this way, the data processing device 1 may extract the three-dimensional data for each predetermined data amount.

[0048] The data processing device 1 may determine a portion to be the extraction target of the three-dimensional data based on the color of the object. For example, the data processing device 1 may set a designated point P for each object having the same or substantially the same color, and extract the three-dimensional data of the portion surrounded by a predetermined range Q including the designated point P. Note that the data processing device 1 may determine the color of the portion corresponding to each three-dimensional data based on the color information of the object to be scanned included in the three-dimensional data.

[0049] The data processing device 1 may divide the three-dimensional data for each tooth by performing edge extraction processing on the boundary portions between the teeth, the gums, and the adjacent teeth.

[0050] The data processing device 1 may divide the generated entire dentition into individual teeth using AI (artificial intelligence). Then, the data processing device 1 may set a designated point P for each of the divided teeth and extract three-dimensional data of a portion surrounded by a predetermined range Q including the designated point P. The AI is configured by an estimation model trained by machine learning to identify each of a plurality of teeth included in the dentition based on three-dimensional data corresponding to the dentition. The estimation model includes, for example, a known neural network used in recognition processing by deep learning, such as a convolutional neural network (CNN), a generative adversarial network (GAN), a recurrent neural network (recurrent neural network) (RNN), or an LSTM network (Long Short Term Memory Network), and parameters related to the neural network. For the training of the estimation model, refer to Japanese Patent No. 6650996.

[0051] The data processing device 1 may determine the range Q according to the user's designation. For example, the user may input range data for designating a range in which the user wishes to detect a change in the state of soft tissue to the data processing device 1. The data processing device 1 may set the range Q based on the range data input by the user and extract three-dimensional data of a portion surrounded by the range Q including the designated point P. For example, the range Q may be a 360-degree range centered on the designated point P.

[0052] [An example of comparison of soft tissue] With reference to FIG. 6, the comparison of soft tissue in the comparison process executed by the data processing device 1 will be described. FIG. 6 is a diagram for explaining an example of the comparison of soft tissue executed by the data processing device 1 according to Embodiment 1.

[0053] As shown in FIG. 6, the data processing apparatus 1 uses first three-dimensional data and second three-dimensional data indicating objects in the oral cavity acquired at different timings for the same person, and based on the shape of the crown portion of at least one tooth included in the object, compares the soft tissue (a predetermined range of the soft tissue in contact with the tooth) around the at least one tooth using the first three-dimensional data and the second three-dimensional data.

[0054] Specifically, the data processing apparatus 1 extracts three-dimensional data of one tooth and the soft tissue corresponding to the tooth from the three-dimensional data acquired at the first timing by the method shown in FIG. 5. As shown in FIG. 6(A), the extracted three-dimensional data at the first timing is also referred to as the first three-dimensional data. Further, the data processing apparatus 1 extracts three-dimensional data of the same one tooth as the first timing and the soft tissue corresponding to the tooth from the three-dimensional data acquired at the second timing (for example, the timing one year after the first timing) after the first timing by the method shown in FIG. 5. As shown in FIG. 6(B), the extracted three-dimensional data at the second timing is also referred to as the second three-dimensional data. The data processing apparatus 1 can generate a rendering image showing one tooth and the soft tissue corresponding to the tooth based on each of the first three-dimensional data and the second three-dimensional data. Note that the data processing apparatus 1 can also show the color of the soft tissue in addition to the shape of the soft tissue in the rendering image based on the first three-dimensional data and the second three-dimensional data.

[0055] The data processing device 1 sets a predetermined position as the center position C1 in the crown part of the tooth indicated by the first three-dimensional data, and specifies the shape of the crown part surrounded by a predetermined range F1 from the center position C1. Further, the data processing device 1 sets a predetermined position as the center position C2 in the crown part of the tooth indicated by the second three-dimensional data, and specifies the shape of the crown part surrounded by a predetermined range F2 from the center position C2. The center positions C1 and C2 are predetermined, for example, the center positions of the crown parts of the teeth. Also, the ranges F1 and F2 are predetermined, for example, the area of 60% of the occlusal surface shown when the crown part is viewed in plan. Note that the ranges F1 and F2 may be the entire area of the occlusal surface shown when the crown part is viewed in plan.

[0056] As shown in FIG. 6(C), the data processing device 1 superimposes one tooth and soft tissue indicated by the first three-dimensional data and the one tooth and soft tissue indicated by the second three-dimensional data, and compares the two. At this time, the data processing device 1 superimposes one tooth and soft tissue indicated by the first three-dimensional data and the one tooth and soft tissue indicated by the second three-dimensional data while matching the crown part surrounded by the range F1 specified in the first three-dimensional data and the crown part surrounded by the range F2 specified in the second three-dimensional data. Since the crown part is hard tissue, unlike soft tissue such as the gingiva, its shape hardly changes over time. Therefore, the data processing device 1 performs pattern matching between one tooth indicated by the first three-dimensional data and the one tooth indicated by the second three-dimensional data, with the hard tissue crown part as a reference. More specifically, the data processing device 1 limits the object for which pattern matching is performed to the hard tissue crown part, that is, the crown part surrounded by the range F1 specified in the first three-dimensional data and the crown part surrounded by the range F2 specified in the second three-dimensional data. When the crown part surrounded by the range F1 and the crown part surrounded by the range F2 match by such pattern matching, the data processing device 1 compares the shape of the soft tissue indicated by the first three-dimensional data and the shape of the soft tissue indicated by the second three-dimensional data regardless of whether the shapes of the soft tissues match.

[0057] The data processing device 1 extracts a difference for each point by comparing each point group constituting the soft tissue represented by the first three-dimensional data with each point group constituting the soft tissue represented by the second three-dimensional data. Specifically, for each point constituting the soft tissue represented by the first three-dimensional data, the data processing device 1 sets a predetermined range R centered on the each point. Then, the data processing device 1 identifies, from the second three-dimensional data, the one point closest to one point of the first three-dimensional data among the points included in the range R of one point of the first three-dimensional data, and calculates a difference value (distance between two points) between the one point in the identified second three-dimensional data and the one point in the first three-dimensional data. The data processing device 1 associates the calculated shape difference value with the three-dimensional data of the one point that is the comparison target in the second three-dimensional data, and stores it in the memory 12 or the storage device 13. The data processing device 1 performs such comparison for each point constituting the soft tissue represented by each of the first three-dimensional data and the second three-dimensional data, and stores the shape difference value at each point. Note that when the three-dimensional data is mesh data, the data processing device 1 may calculate a difference value (distance between two points) between each mesh vertex, or may calculate a difference value (distance between a point and a plane) between a mesh vertex and the center of a mesh plane, or may calculate a difference value (distance between two planes) between the centers of each mesh plane.

[0058] In addition to the shape of the soft tissue, the data processing device 1 can also detect changes in the color of the soft tissue. For example, the data processing device 1 identifies, from the second three-dimensional data, the point closest to one point of the first three-dimensional data among the points included in the range R of one point of the first three-dimensional data, and calculates the color difference (difference in hue, saturation, or lightness) between the identified point in the second three-dimensional data and the point in the first three-dimensional data. The data processing device 1 associates the calculated color difference value with the three-dimensional data of the one point that is the comparison target in the second three-dimensional data and stores it in the memory 12 or the storage device 13. The data processing device 1 performs such comparison for each point constituting the soft tissue represented by each of the first three-dimensional data and the second three-dimensional data, and stores the color difference value at each point.

[0059] The data processing device 1 can detect changes in the soft tissue throughout the dental arch at the first timing and the second timing by performing the comparison as shown in FIG. 6 for each of the plurality of teeth included in the dental arch. For example, as shown in FIG. 6(C), when each point constituting the soft tissue represented by the second three-dimensional data is located outside the oral cavity compared to each point constituting the soft tissue represented by the first three-dimensional data, the data processing device 1 can detect that the soft tissue has swollen during the period from the first timing to the second timing. On the other hand, when each point constituting the soft tissue represented by the second three-dimensional data is located inside the oral cavity compared to each point constituting the soft tissue represented by the first three-dimensional data, the data processing device 1 can detect that the soft tissue has retracted during the period from the first timing to the second timing.

[0060] In addition, when each point constituting the soft tissue represented by the second three-dimensional data is more reddish than each point constituting the soft tissue represented by the first three-dimensional data, the data processing device 1 can detect that the soft tissue has swollen during the period from the first timing to the second timing.

[0061] The data processing device 1 may predict changes in the soft tissue in the future after the second timing based on the difference value calculated by comparing the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data. For example, the data processing device 1 may predict the shape or color of the future soft tissue using statistical processing based on the calculated difference value and store the prediction result. Alternatively, the data processing device 1 may predict the shape or color of the future soft tissue using an AI (trained estimation model) based on the calculated difference value and store the prediction result.

[0062] In this way, the data processing device 1 can compare the soft tissue corresponding to the tooth indicated by the first three-dimensional data and the soft tissue corresponding to the tooth indicated by the second three-dimensional data based on the shape of the crown part of one tooth. Thereby, the data processing device 1 limits the comparison of the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data to the soft tissue corresponding to one tooth, and can detect changes in the state of the soft tissue with higher accuracy than simply comparing across the entire dental arch. Furthermore, the data processing device 1 compares the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data based on the crown part, which is a hard tissue whose shape hardly changes over time, so that only the changes in the soft tissue can be purely compared. Therefore, it is possible to detect changes in the state of the soft tissue with higher accuracy than basing on the whole of one tooth and the soft tissue corresponding to the tooth.

[0063] [An example of displaying the comparison result] With reference to FIG. 7, the display of the comparison result in the comparison process executed by the data processing device 1 will be described. FIG. 7 is a diagram for explaining an example of the display of the comparison result of the soft tissue executed by the data processing device 1 according to the first embodiment.

[0064] As shown in FIG. 7, the data processing device 1 displays on the display 3 comparison information regarding the comparison result of the soft tissue in the first three-dimensional data and the second three-dimensional data calculated by the comparison process. For example, based on the first three-dimensional data, the data processing device 1 generates a rendering image showing one tooth at the first timing and the soft tissue corresponding to the tooth, and based on the second three-dimensional data, generates a rendering image showing one tooth at the second timing and the soft tissue corresponding to the tooth. The data processing device 1 overlays the two generated rendering images and displays them on the display 3. At this time, the data processing device 1 overlays the two rendering images while matching the crown portion indicated by the first three-dimensional data and the crown portion indicated by the second three-dimensional data. Thereby, the data processing device 1 can display on the display 3 the change condition of the shape and color of the soft tissue in the first three-dimensional data and the second three-dimensional data.

[0065] Furthermore, the data processing device 1 may show, in different colors, one tooth indicated by the first three-dimensional data and the soft tissue corresponding to the tooth, and the tooth indicated by the second three-dimensional data and the soft tissue corresponding to the tooth. For example, the data processing device 1 may show one tooth indicated by the first three-dimensional data and the soft tissue corresponding to the tooth in blue, and show one tooth indicated by the third three-dimensional data and the soft tissue corresponding to the tooth in red.

[0066] Regarding the portion pointed to by the user moving the cursor on the screen of the display 3 using the mouse 5, the data processing device 1 may display on the display 3 a numerical value corresponding to the comparison result between the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data. For example, in the example of FIG. 7, the data processing device 1 displays, as the difference value of the shape between the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data, a difference value corresponding to the soft tissue portion, such as "Difference: 1.5 mm" or "Difference: 3.0 mm", on the display 3.

[0067] The data processing device 1 may emphasize and display a portion where the difference value is equal to or greater than a predetermined value. For example, the data processing device 1 may emphasize and display a portion where the difference value is equal to or greater than a predetermined value using a color, blinking, symbol (e.g., a flag mark), or the like.

[0068] The data processing device 1 may emphasize and display a portion where the difference value is equal to or greater than a predetermined value using a color corresponding to the difference value or the like. For example, in the period from the first timing to the second timing, the data processing device 1 may indicate a portion of the swollen soft tissue and a portion of the retracted soft tissue in different colors. Further, the data processing device 1 may indicate the portion of the swollen soft tissue in different colors according to the degree of swelling of the soft tissue. Also, the data processing device 1 may indicate the portion of the retracted soft tissue in different colors according to the degree of retraction of the soft tissue.

[0069] Regarding the portion pointed to by the user moving the cursor on the screen of the display 3 using the mouse 5, the data processing device 1 may display on the display 3 a comment regarding the comparison result (change) of the shapes of the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data. For example, in the example of FIG. 7, the data processing device 1 displays a comment "It is more swollen than last time." on the display 3.

[0070] Regarding the portion pointed to by the user moving the cursor on the screen of the display 3 using the mouse 5, the data processing device 1 may display on the display 3 a comment regarding the comparison result (change) of the colors between the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data. For example, in the example of FIG. 7, the data processing device 1 displays a comment "The color is more reddish than last time." on the display 3.

[0071] The data processing device 1 may predict the shape or color of the soft tissue in the future after the second timing based on the difference value calculated by comparing the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data using statistical processing and AI, and display the prediction result on the display 3.

[0072] Note that the data processing device 1 may perform all of the above-described display of comparison information described with reference to FIG. 7, or may perform any one of them. The data processing device 1 only needs to perform at least one of the above-described display of comparison information. Further, even if the user does not use the mouse 5, the data processing device 1 may display a comment like the example in FIG. 7 on the display 3 for the portion with a large difference value.

[0073] In this way, the data processing device 1 can easily convey to the user the comparison result of the shape or color between the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data. Further, the data processing device 1 displays not only the numerical value corresponding to the comparison result of the shape, but also a comment regarding the comparison result, highlighting according to the comparison result, prediction of changes in the soft tissue based on the comparison result, etc. on the display 3, so that the comparison result can be more easily conveyed to the user. For example, it is possible to draw attention to and promote prevention regarding swelling or recession of the gums.

[0074] [Flow of Comparison Processing] With reference to FIG. 8, the flow of the soft tissue comparison process executed by the data processing device 1 will be described. FIG. 8 is a flowchart of the soft tissue comparison process executed by the data processing device 1 according to Embodiment 1. The data processing device 1 (arithmetic device 11) can execute the comparison process shown in FIG. 8 by executing the data processing program 100. In FIG. 8, "S" is used as an abbreviation for "STEP".

[0075] As shown in FIG. 8, the data processing device 1 acquires first three-dimensional data and second three-dimensional data (S1). For example, the data processing device 1 stores the first three-dimensional data acquired at the first timing in the memory 12 or the storage device 13, stores the second three-dimensional data acquired at the second timing in the memory 12 or the storage device 13, and in S1, acquires the stored first three-dimensional data and second three-dimensional data from the memory 12 or the storage device 13.

[0076] The data processing device 1 designates one tooth from the dental arches represented by each of the first three-dimensional data and the second three-dimensional data (S2). For example, as shown in FIG. 5(A), the data processing device 1 sets a designated point P for one tooth according to the user's designation from among the plurality of teeth included in the dental arch.

[0077] The data processing device 1 extracts three-dimensional data of a portion corresponding to the tooth designated in S2 from each of the first three-dimensional data and the second three-dimensional data (S3). For example, as shown in FIG. 5(A), the data processing device 1 extracts three-dimensional data of a portion surrounded by a predetermined range Q including the designated point P set for one tooth. Thereby, the data processing device 1 can extract three-dimensional data of one tooth designated by the user and the soft tissue corresponding to the tooth.

[0078] As shown in FIG. 6, the data processing device 1 performs alignment based on the shape of the crown portion of the designated one tooth, and compares the soft tissue around the tooth (a predetermined range of the soft tissue in contact with the tooth) between the first three-dimensional data and the second three-dimensional data (S4). At this time, when the data processing device 1 cannot identify the shape of the crown portion of the designated one tooth due to dental treatment or defect, etc., and cannot match the crown portion of the tooth shown by the first three-dimensional data and the crown portion of the tooth shown by the second three-dimensional data, an error screen may be displayed on the display 3. Alternatively, the data processing device 1 may shift to the process of S2 and designate the next reference tooth.

[0079] The data processing device 1 stores the comparison result of S4 in the memory 12 or the storage device 13 (S5). The data processing device 1 outputs comparison information corresponding to the comparison result of S4 (S6). For example, as shown in FIG. 7, the data processing device 1 displays, as comparison information, an image corresponding to the comparison result, a numerical value corresponding to the comparison result, a comment regarding the comparison result, and information regarding prediction of soft tissue change based on the comparison result, etc. on the display 3. Note that the data processing device 1 may transmit the comparison information corresponding to the comparison result to an in-hospital server or an out-of-hospital server (for example, a cloud server) via the communication device 18. Thereafter, the data processing device 1 ends this processing flow.

[0080] In this way, the data processing device 1 can compare soft tissues using the first three-dimensional data and the second three-dimensional data acquired at different timings, limited to the soft tissues corresponding to the specified tooth, and output the comparison result. Thereby, the data processing device 1 can more accurately detect changes in the state of the soft tissue by comparing the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data, limited to the soft tissues corresponding to the specified tooth, rather than simply comparing over the entire dentition.

[0081] Note that the data processing device 1 may specify a tooth in S2 according to a predetermined order preset by the user and execute the processes of S3 to S6, or may repeatedly execute the processes of S2 to S6 until all the teeth included in the dentition are specified and comparison information is output for all the teeth. The data processing device 1 can detect changes in the soft tissue over time for all the teeth in the entire dentition by executing the comparison process shown in FIG. 8 for all the teeth.

[0082] <Embodiment 2> The data processing device 1 according to Embodiment 2 of the present disclosure will be described in detail with reference to FIG. 9. Note that, in the data processing device 1 according to Embodiment 2, only the parts different from the data processing device 1 according to Embodiment 1 will be described, and the same parts as the data processing device 1 according to Embodiment 1 will be denoted by the same reference numerals and their description will not be repeated.

[0083] FIG. 9 is a diagram for explaining an example of comparison of soft tissues executed by the data processing apparatus 1 according to Embodiment 2. As shown in FIG. 9, the data processing apparatus 1 generates a two-dimensional image including the occlusal surface of at least one tooth based on the first three-dimensional data and the second three-dimensional data, and may compare the soft tissues using the two-dimensional image with reference to the shape of the crown portion.

[0084] For example, the data processing apparatus 1 generates a two-dimensional image of the crown portion of one tooth shown by the first three-dimensional data when viewed from the occlusal surface direction based on the first three-dimensional data. Similarly, the data processing apparatus 1 generates a two-dimensional image of the crown portion of one tooth shown by the second three-dimensional data when viewed from the occlusal surface direction based on the second three-dimensional data. The data processing apparatus 1 overlaps one tooth and the soft tissue shown by the first three-dimensional data and the tooth and the soft tissue shown by the second three-dimensional data so that the crown portion shown by the two-dimensional image generated based on the first three-dimensional data coincides with the crown portion shown by the two-dimensional image generated based on the second three-dimensional data. Thereby, the data processing apparatus 1 can purely compare the soft tissue shown by the first three-dimensional data and the soft tissue shown by the second three-dimensional data with reference to the crown portion shown by the first three-dimensional data and the crown portion shown by the second three-dimensional data.

[0085] Thereby, the data processing apparatus 1 can clarify the shape of the crown portion that is difficult to change over time, and can compare the soft tissues between the first three-dimensional data and the second three-dimensional data with reference to the shape of the crown portion, so that a change in the state of the soft tissue can be detected with high accuracy.

[0086] <Embodiment 3> The data processing apparatus 1 according to Embodiment 3 of the present disclosure will be described in detail with reference to FIG. 10. In the data processing apparatus 1 according to Embodiment 3, only the parts different from the data processing apparatus 1 according to Embodiment 1 will be described, and the same parts as the data processing apparatus 1 according to Embodiment 1 will be denoted by the same reference numerals and their description will not be repeated.

[0087] FIG. 10 is a diagram for explaining the extraction of three-dimensional data that is the object of the comparison process according to Embodiment 3. As shown in FIG. 5, the data processing apparatus 1 according to Embodiment 1 is configured to identify one tooth among a plurality of teeth included in the dental arch indicated by the three-dimensional data, and extract the three-dimensional data of the tooth and the soft tissue corresponding to the tooth. On the other hand, as shown in FIG. 10, the data processing apparatus 1 according to Embodiment 3 is configured to identify two adjacent teeth among a plurality of teeth included in the dental arch indicated by the three-dimensional data, and extract the three-dimensional data of the two teeth and the soft tissue corresponding to the two teeth.

[0088] Specifically, as shown in FIG. 10(A), the data processing apparatus 1 designates, with a designation point P, the boundary portion between two adjacent teeth that are the extraction targets of the three-dimensional data among the plurality of teeth included in the dental arch. Then, as shown in FIG. 10(B), the data processing apparatus 1 extracts the three-dimensional data of the two teeth surrounded by a predetermined range Q including the designation point P and the soft tissue corresponding to the two teeth. Then, as shown in FIG. 10(C), the data processing apparatus 1 moves the position of the designation point P along the dental arch, and extracts the three-dimensional data for each pair of adjacent teeth while switching the portion that is the extraction target of the three-dimensional data.

[0089] In this way, the data processing device 1 sets a designated point P between the first tooth and the second tooth adjacent to the first tooth, sets the first tooth and the second tooth as a set, and extracts three-dimensional data. Then, in the same way as setting the designated point P between the third tooth adjacent to the second tooth and the fourth tooth adjacent to the third tooth, setting the third tooth and the fourth tooth as a set, and extracting three-dimensional data, it is configured to extract three-dimensional data for every two adjacent teeth.

[0090] Note that the data processing device 1 may be configured to extract three-dimensional data for every two adjacent teeth, and for one of the two teeth, extract three-dimensional data repeatedly. That is, the data processing device 1 may extract three-dimensional data for every two adjacent teeth while sequentially switching the teeth designated by the designated point P along the dental arch direction.

[0091] The data processing device 1 may detect changes in the time series of the soft tissue corresponding to the two adjacent teeth, based on the crown portions of the two adjacent teeth, using the three-dimensional data of the two adjacent teeth extracted as described above. Note that the data processing device 1 may compare the soft tissue corresponding to the two adjacent teeth at the first timing and the second timing, based on the set of all crown portions of the two adjacent teeth, or may compare the soft tissue corresponding to the two adjacent teeth at the first timing and the second timing, based on each crown portion of the two adjacent teeth, or may compare the soft tissue corresponding to the two adjacent teeth at the first timing and the second timing, based on any one of the crown portions of the two adjacent teeth.

[0092] As a result, the data processing device 1 according to Embodiment 3 can detect changes in soft tissue over time for every two adjacent teeth, so that the time required for comparison processing can be shortened compared to detecting changes in soft tissue over time for each individual tooth. In addition, the data processing device 1 can detect changes over a wider range, such as the soft tissue near the adjacent part of two teeth, rather than changes in soft tissue for each individual tooth.

[0093] <Embodiment 4> The data processing device 1 according to Embodiment 4 of the present disclosure will be described in detail with reference to FIG. 11. Note that, in the data processing device 1 according to Embodiment 4, only the parts different from the data processing device 1 according to Embodiment 1 will be described, and the same parts as those of the data processing device 1 according to Embodiment 1 will be denoted by the same reference numerals and their description will not be repeated.

[0094] FIG. 11 is a diagram for explaining the extraction of three-dimensional data that is the object of comparison processing according to Embodiment 4. As shown in FIG. 11, the data processing device 1 according to Embodiment 4 identifies three adjacent teeth among a plurality of teeth included in the dental arch indicated by the three-dimensional data, and is configured to extract the three-dimensional data of the three teeth and the soft tissue corresponding to the three teeth.

[0095] Specifically, as shown in FIG. 11(A), the data processing device 1 designates the middle tooth among the three adjacent teeth that are the object of extraction of three-dimensional data among the plurality of teeth included in the dental arch by a designated point P. Then, as shown in FIG. 11(B), the data processing device 1 extracts the three-dimensional data of the three teeth surrounded by a predetermined range Q including the designated point P and the soft tissue corresponding to the three teeth. Then, as shown in FIG. 11(C), the data processing device 1 moves the position of the designated point P along the dental arch, and extracts three-dimensional data for every three adjacent teeth while switching the part that is the object of extraction of the three-dimensional data.

[0096] In this way, the data processing device 1 sets the designated point P on the second tooth among the first tooth, the second tooth adjacent to the first tooth, and the third tooth adjacent to the second tooth, sets the first tooth, the second tooth, and the third tooth as a set, and extracts three-dimensional data. Then, among the fourth tooth adjacent to the third tooth, the fifth tooth adjacent to the fourth tooth, and the sixth tooth adjacent to the fifth tooth, the designated point P is set on the fifth tooth, and the fourth tooth, the fifth tooth, and the sixth tooth are set as a set to extract three-dimensional data. That is, the data processing device 1 is configured to extract three-dimensional data for every three adjacent teeth.

[0097] Note that the data processing device 1 sets the designated point P on the second tooth among the first tooth, the second tooth adjacent to the first tooth, and the third tooth adjacent to the second tooth, sets the first tooth, the second tooth, and the third tooth as a set, and extracts three-dimensional data. Then, among the second tooth, the third tooth, and the fourth tooth adjacent to the third tooth, the designated point P is set on the third tooth, and the second tooth, the third tooth, and the fourth tooth are set as a set to extract three-dimensional data. That is, the data processing device 1 is configured to extract three-dimensional data for every three adjacent teeth and may be configured to extract three-dimensional data repeatedly for any one of the three teeth. That is, the data processing device 1 may extract three-dimensional data for every three adjacent teeth while sequentially switching the tooth designated by the designated point P along the tooth row direction.

[0098] The data processing device 1 may detect changes in the soft tissue corresponding to the three adjacent teeth in the time series, with reference to the crown portions of the three adjacent teeth, using the three-dimensional data of the three adjacent teeth extracted as described above. Note that the data processing device 1 may compare the soft tissue corresponding to the three adjacent teeth at the first timing and the second timing, with reference to the set of all crown portions of the three adjacent teeth, or may compare the soft tissue corresponding to the three adjacent teeth at the first timing and the second timing, with reference to each crown portion of the three adjacent teeth, or may compare the soft tissue corresponding to the three adjacent teeth at the first timing and the second timing, with reference to any one of the crown portions of the three adjacent teeth.

[0099] Accordingly, since the data processing device 1 according to the fourth embodiment can detect changes in the soft tissue in the time series for each set of three adjacent teeth, the time required for the comparison process can be shortened compared to detecting changes in the soft tissue in the time series for each single tooth or each pair of teeth. Further, the data processing device 1 can detect a wider range of changes than changes in the soft tissue for each single tooth or each pair of teeth.

[0100] Note that the data processing device 1 may extract three-dimensional data for each set of four or more adjacent teeth and detect changes in the soft tissue in the time series for each set of four or more adjacent teeth. Further, the data processing device 1 may extract three-dimensional data for each one and a half teeth and detect changes in the soft tissue in the time series for each one and a half teeth. For example, the data processing device 1 may set a specified point P between the first tooth and the second tooth adjacent to the first tooth, extract three-dimensional data with a set of the first tooth and half of the second tooth closer to the first tooth, and then set the specified point P between the second tooth and the third tooth adjacent to the second tooth, and extract three-dimensional data with a set of the remaining half of the second tooth farther from the first tooth and the third tooth, and so on, extracting three-dimensional data for each one and a half teeth.

[0101] <Embodiment 5> The data processing apparatus 1 according to Embodiment 5 of the present disclosure will be described in detail with reference to FIGS. 12 and 13. Note that, in the data processing apparatus 1 according to Embodiment 5, only the parts different from those of the data processing apparatus 1 according to Embodiment 1 will be described, and the same parts as those of the data processing apparatus 1 according to Embodiment 1 will be denoted by the same reference numerals and their description will not be repeated.

[0102] FIG. 12 is a diagram for explaining the extraction of three-dimensional data that is the target of the comparison process according to Embodiment 5. As shown in FIGS. 5, 10, and 11, the data processing apparatus 1 according to Embodiments 1 to 4 is configured to extract three-dimensional data of at least one tooth and the soft tissue corresponding to the at least one tooth by dividing and cutting out a dental arch represented by three-dimensional data for each of at least one tooth. On the other hand, as shown in FIG. 12, the data processing apparatus 1 according to Embodiment 5 is configured to extract three-dimensional data of at least one tooth and the soft tissue corresponding to the at least one tooth while maintaining the shape of the dental arch without dividing and cutting out the dental arch represented by the three-dimensional data.

[0103] Specifically, as shown in FIG. 12(A), the data processing apparatus 1 designates one tooth among a plurality of teeth represented by the first three-dimensional data acquired at the first timing with a designated point P. As shown in FIG. 12(B), the data processing apparatus 1 designates one tooth among a plurality of teeth represented by the second three-dimensional data acquired at the second timing with the designated point P. The designated tooth is the same tooth in the first three-dimensional data and the second three-dimensional data.

[0104] The data processing device 1 compares the soft tissue corresponding to the tooth indicated by the first three-dimensional data and the soft tissue corresponding to the tooth indicated by the second three-dimensional data, based on the crown part of the tooth specified in the first three-dimensional data and the crown part of the tooth specified in the second three-dimensional data. Specifically, as shown in FIG. 12(C), the data processing device 1 overlaps the entire dentition indicated by the first three-dimensional data and the entire dentition indicated by the second three-dimensional data while aligning the crown part of the tooth specified in the first three-dimensional data and the crown part of the tooth specified in the second three-dimensional data. Then, the data processing device 1 compares the soft tissue between the first three-dimensional data and the second three-dimensional data in the portion surrounded by the range Q including the specified point P. In this way, the data processing device 1 according to Embodiment 5 does not divide and cut out the dentition indicated by the three-dimensional data for each at least one tooth as in the data processing device 1 according to Embodiments 1 to 4, but overlaps the entire dentition indicated by the first three-dimensional data and the entire dentition indicated by the second three-dimensional data, and is configured to compare the first three-dimensional data and the second three-dimensional data for the tooth specified by the specified point P and the soft tissue corresponding to the tooth.

[0105] As described above, the data processing device 1 compares the soft tissue corresponding to the one tooth shown by the first three-dimensional data with the soft tissue corresponding to the one tooth shown by the second three-dimensional data based on the specified one tooth, records the comparison result, etc., and then switches the tooth serving as the reference for the comparison process by designating one tooth adjacent to the one tooth at the designated point P. In this way, the data processing device 1 can execute the comparison process for the soft tissue corresponding to each tooth based on each of the plurality of teeth included in the dental arch by switching the tooth designated at the designated point P along the dental arch. Note that the data processing device 1 does not simultaneously execute the comparison process for the tooth to be compared and the tooth at a position far in the dental arch direction from the position of the tooth to be compared (for example, a tooth more than five teeth away from the tooth to be compared). This is because the greater the distance in the dental arch direction, the greater the possibility of an error occurring between the position of the tooth shown in the three-dimensional data and the actual position of the tooth.

[0106] Note that the data processing device 1 may designate the reference tooth at the designated point P according to the user's designation. The data processing device 1 may designate the reference tooth at the designated point P according to a predetermined order preset by the user. The data processing device 1 may automatically switch the tooth designated at the designated point P every time a predetermined time elapses. The data processing device 1 is not limited to designating the reference tooth at the designated point P in order along the dental arch, and may randomly designate the reference tooth at the designated point P.

[0107] In this way, while the data processing device 1 superimposes the entire dental arch shown by the first three-dimensional data and the entire dental arch shown by the second three-dimensional data based on the designated tooth, the soft tissue to be compared is limited to the soft tissue corresponding to the designated tooth (the soft tissue around the designated tooth). Thereby, the data processing device 1 can detect the change in the state of the soft tissue with higher accuracy than simply comparing the first three-dimensional data and the second three-dimensional data for the entire dental arch.

[0108] Figure 13 is a flowchart of the soft tissue comparison process executed by the data processing apparatus 1 according to Embodiment 5. The data processing apparatus 1 (arithmetic unit 11) can execute the comparison process shown in Figure 13 by executing the data processing program 100. In Figure 13, "S" is used as an abbreviation for "STEP".

[0109] As shown in Figure 13, the data processing apparatus 1 acquires first three-dimensional data and second three-dimensional data (S11). For example, the data processing apparatus 1 stores the first three-dimensional data acquired at the first timing in the memory 12 or the storage device 13, and stores the second three-dimensional data acquired at the second timing in the memory 12 or the storage device 13. In S11, the stored first three-dimensional data and second three-dimensional data are acquired from the memory 12 or the storage device 13.

[0110] The data processing apparatus 1 designates one tooth from the dental arches indicated by the first three-dimensional data and the second three-dimensional data respectively (S12). For example, as shown in Figures 12(A) and (B), the data processing apparatus 1 sets a designated point P for one tooth according to the user's designation from among the plurality of teeth included in the dental arch.

[0111] As shown in Figure 12(C), the data processing apparatus 1 performs alignment based on the shape of the crown of the designated one tooth, superimposes the entire dental arch indicated by the first three-dimensional data and the entire dental arch indicated by the second three-dimensional data, and compares the soft tissues (a predetermined range of the soft tissues in contact with the tooth) around the designated one tooth between the first three-dimensional data and the second three-dimensional data (S13). At this time, if the data processing apparatus 1 cannot identify the shape of the crown of the designated one tooth due to dental treatment or defects and cannot match the crown of the tooth indicated by the first three-dimensional data with the crown of the tooth indicated by the second three-dimensional data, it may display an error screen on the display 3. Alternatively, the data processing apparatus 1 may proceed to the process of S12 to designate the next reference tooth.

[0112] The data processing device 1 stores the comparison result of S13 in the memory 12 or the storage device 13 (S14). The data processing device 1 outputs comparison information corresponding to the comparison result of S14 (S15). The data processing device 1 determines whether all the teeth included in the dental arch have been specified (S16). When not all the teeth have been specified (NO in S16), the data processing device 1 proceeds to the process of S12 and specifies the next tooth. On the other hand, when all the teeth have been specified (YES in S16), the data processing device 1 ends this processing flow.

[0113] In this way, the data processing device 1 can compare the soft tissue with the first three-dimensional data and the second three-dimensional data acquired at different timings, and output the comparison result, limited to the soft tissue corresponding to the specified tooth. Thereby, the data processing device 1 compares the soft tissue indicated by the first three-dimensional data and the soft tissue indicated by the second three-dimensional data, limited to the soft tissue corresponding to the specified tooth, so that it can detect changes in the state of the soft tissue with higher accuracy than simply comparing the entire dental arch.

[0114] When the data processing device 1 designates the reference tooth according to the user's designation at the designation point P, in the process of S16, the user may be asked whether to designate a tooth using icon display or the like. In this case, when the user designates the next reference tooth, the process proceeds to S12, and when the user does not designate the next reference tooth, this processing flow may be ended.

[0115] <Modification Example> The present disclosure is not limited to the above-described embodiments, and various modifications and applications are further possible. Hereinafter, modification examples applicable to the present disclosure will be described.

[0116] The data processing device 1 according to the above-described embodiment was configured to detect changes in soft tissue at two different timings, such as the first timing and the second timing. In contrast, the data processing device 1 according to the modified example may be configured to detect changes in soft tissue not only at two different timings but also at three or more different timings. For example, the data processing device 1 compares the soft tissue between the first three-dimensional data acquired at the first timing and the second three-dimensional data acquired at the second timing after the first timing, stores the comparison result, and then compares the soft tissue between the second three-dimensional data acquired at the second timing and the third three-dimensional data acquired at the third timing after the second timing, and stores the comparison result. In this way, the data processing device 1 may compare the soft tissue at three or more different timings and display the changes in the soft tissue at three or more timings on the display 3 or the like. Thereby, for example, the user can record and view the changes in the soft tissue in the time series going back several years in the past.

[0117] The data processing device 1 according to the above-described embodiment was configured to detect changes in soft tissue using IOS data including the position information of each point group indicating the surface of an object in the oral cavity. In contrast, the data processing device 1 according to the modified example may be configured to detect changes in soft tissue using OCT (Optical Coherence Tomography) data including optical coherence tomography information of an object in the oral cavity. For details of the OCT data, refer to Japanese Patent No. 5642114. The data processing device 1 acquires OCT data including optical coherence tomography information of an object in the oral cavity as the first three-dimensional data and the second three-dimensional data from an OCT device such as TD-OCT (Time Domain OCT), SD-OCT (Spectral Domain OCT), or SS-OCT (Swept Source OCT). The data processing device 1 may compare the soft tissue (a predetermined range of the soft tissue in contact with the tooth) around at least one tooth between the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of at least one tooth included in the object indicated by the OCT data.

[0118] The data processing device 1 according to the modification example may further include an input interface to which fluorescence color data including information on the fluorescence color emitted by an object when the object is irradiated with excitation light is input. In the dental field, when excitation light is irradiated onto teeth (crown parts) or soft tissues in the oral cavity using an LED (Light Emitting Diode) or the like, it is known that diseases such as dental caries or malignant tumors can be detected based on the fluorescence color emitted from the irradiated part. Therefore, the data processing device 1 acquires first fluorescence color data including information on the fluorescence color emitted by an object when the object in the oral cavity is irradiated with excitation light at a first timing, and second fluorescence color data including information on the fluorescence color emitted by the object when the object in the oral cavity is irradiated with excitation light at a second timing after the first timing, and can determine the presence or absence of a disease in the object in the oral cavity by comparing the first fluorescence color data and the second fluorescence color data. The data processing device 1 may output comparison information indicating the comparison result between the first fluorescence color data and the second fluorescence color data to the display 3 or a server device or the like.

[0119] The data processing device 1 may be a cloud-type server device. That is, the arithmetic device 11 (arithmetic unit) may have a function as a computer (processor, processing circuit) in a cloud-type server device. For example, the data processing device 1 may be configured to be communicable with a user terminal such as a smartphone possessed by a user or a subject. The data processing device 1 may acquire three-dimensional data acquired by the three-dimensional scanner 2 and output output data including comparison information detected based on the three-dimensional data to the user terminal. The user terminal may become communicable with the data processing device 1 by starting an application downloaded in advance, and may acquire comparison information based on the output data received from the data processing device 1 and display it on the display. Further, the data processing device 1 itself may be a user terminal such as the above-described smartphone.

[0120] The embodiments disclosed herein should be considered illustrative in all respects and not restrictive. The scope of the present disclosure is indicated by the scope of the claims rather than the above description, and it is intended that all modifications within the meaning and scope equivalent to the scope of the claims be included. Note that the configurations illustrated in the present embodiments and the configurations illustrated in the modification examples can be combined as appropriate.

Explanation of Signs

[0121] 1 Data processing device, 2 Three-dimensional scanner, 3 Display, 4 Keyboard, 5 Mouse, 10 Data processing system, 11 Arithmetic unit, 12 Memory, 13 Storage device, 14 Scanner interface, 15 Display interface, 16 Peripheral device interface, 17 Media reader, 18 Communication device, 20 Recording medium, 22 Probe, 100 Data processing program.

Claims

1. A data processing device for processing three-dimensional data of an object in the oral cavity, comprising: an input unit to which first three-dimensional data and second three-dimensional data are input, the first three-dimensional data and the second three-dimensional data including position information of each point group indicating at least one tooth included in the object and the surface of the gingiva around the at least one tooth, the data being obtained for the same person at different timings; an arithmetic unit configured to compare the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth, and output comparison information regarding the comparison result; The arithmetic unit compares the gingiva around the at least one tooth based on each point group constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each point group constituting the gingiva around the at least one tooth indicated by the second three-dimensional data. A data processing device.

2. The data processing device according to claim 1, wherein the arithmetic unit compares the gingiva based on the shape of the entire crown portion or a predetermined range of the at least one tooth.

3. The data processing device according to claim 1 or claim 2, wherein the arithmetic unit extracts the at least one tooth based on a tooth specified by a user or teeth selected in a predetermined order.

4. The data processing device according to claim 1 or claim 2, wherein the arithmetic unit extracts the at least one tooth so as to divide the dental arch in a direction substantially orthogonal to the dental arch direction.

5. The data processing device according to claim 1 or claim 2, wherein the comparison result includes a comparison result of the shape or color of the gingiva.

6. The data processing device according to claim 1 or claim 2, wherein the comparison information includes at least one of a numerical value corresponding to the comparison result, a comment regarding the comparison result, and information regarding prediction of gingival change based on the comparison result.

7. The data processing device according to claim 1 or claim 2, wherein the first three-dimensional data and the second three-dimensional data are IOS (Intra Oral Scanner) data including position information of each point group indicating the surface of the object.

8. A data processing method for processing three-dimensional data of an object in the oral cavity by a computer, the data processing method including, as a process executed by the computer, ​ A step of acquiring first three-dimensional data and second three-dimensional data including position information of each of at least one tooth included in the object acquired at different timings for the same person and the surface of the gingiva around the at least one tooth; A step of comparing the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth; Including a step of outputting comparison information regarding the comparison result; The step of comparing includes comparing the gingiva around the at least one tooth based on each of the point groups constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each of the point groups constituting the gingiva around the at least one tooth indicated by the second three-dimensional data. A data processing method.

9. A data processing program for processing three-dimensional data of an object in the oral cavity, Causing a computer to A step of acquiring first three-dimensional data and second three-dimensional data including position information of each of at least one tooth included in the object acquired at different timings for the same person and the surface of the gingiva around the at least one tooth; A step of comparing the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data based on the shape of the crown portion of the at least one tooth; Executing a step of outputting comparison information regarding the comparison result; The step of comparing includes comparing the gingiva around the at least one tooth based on each of the point groups constituting the gingiva around the at least one tooth indicated by the first three-dimensional data and each of the point groups constituting the gingiva around the at least one tooth indicated by the second three-dimensional data. A data processing program.

10. A data processing system for processing three-dimensional data of an object in the oral cavity, A three-dimensional scanner for acquiring three-dimensional data of the object; Comprising a data processing device for processing the three-dimensional data acquired by the three-dimensional scanner, The data processing device An input unit into which first three-dimensional data and second three-dimensional data including position information of each of at least one tooth included in the object acquired at different timings for the same person and the surface of the gingiva around the at least one tooth are input; Based on the shape of the crown portion of the at least one tooth, a calculation unit that compares the gingiva around the tooth using the first three-dimensional data and the second three-dimensional data and outputs comparison information regarding the comparison result, The calculation unit is a data processing system that compares the gingiva around the at least one tooth based on each of the point groups that make up the gingiva around the at least one tooth indicated by the first three-dimensional data and each of the point groups that make up the gingiva around the at least one tooth indicated by the second three-dimensional data.

Images