Apparatus and method for matching data by simultaneously capturing cone beam CT and three-dimensional scans

Through synchronous acquisition and coordinate matching methods, motion-corrected three-dimensional and CBCT images are constructed, which solves the problem of traditional fixtures affecting facial morphology presentation, and realizes clear and real three-dimensional image acquisition.

CN119031886APending Publication Date: 2024-11-26HDX WILL CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380036712.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-27
Filing Date
2023-02-06
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

When shooting three-dimensional facial scans, the use of fixing devices causes the patient's facial morphology to be unable to accurately present, affecting the authenticity and practicality of the image.

Method used

By synchronously collecting cone beam CT data and 3D scan data, matching the coordinate system, and using depth maps to construct motion-corrected 3D scan and CBCT images, avoiding fixing the patient's face with fixation devices.

Benefits of technology

Clear 3D facial scans and CBCT images are collected without fixing devices, eliminating motion blur and improving the authenticity and practicality of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031886A_ABST
    Figure CN119031886A_ABST
Patent Text Reader

Abstract

The invention relates to a data matching method executed in a data matching device. The data matching method comprises the following steps of synchronizing acquisition time points of CBCT data and three-dimensional scanning data; matching coordinate systems of the CBCT data and the three-dimensional scanning data; matching a depth map generated when the three-dimensional scanning data is collected each time, so as to construct a three-dimensional scanning image subjected to motion correction; and constructing the CBCT three-dimensional image subjected to motion correction according to the CBCT data by utilizing motion information obtained by matching the depth map.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a data matching technology, and more specifically, to a data matching device and method for automatically matching a cone beam CT image and a three-dimensional scanning image. Background Art

[0002] Recently, a technology is being developed that matches 3D facial scans with dental CBCT images to model and diagnose patients. The reason for the additional use of 3D facial scans is that it can virtually predict how the patient's face will change during orthodontic treatment or plastic surgery, while also providing a more realistic representation of the patient's current facial appearance. However, reference Figure 1 , the conventional dental CBCT device 110 requires the patient to place the chin on the chin rest 120 to fix the head, so as to reduce the movement of the patient's head during the shooting process, and use an additional fixture 130 to fix the temple area. When the patient is photographed using the chin rest 120 and the additional fixture 130, although the patient can be forced to remain still, when performing a three-dimensional facial scan, the chin rest 120 will compress the patient's chin, and the additional fixture 130 will block the temple area, that is, both sides of the patient's face, so that the patient's natural and real facial shape cannot be accurately presented. In other words, although the original intention of the three-dimensional facial scan is to check the patient's current actual facial shape, due to the use of a fixture, it is actually difficult to obtain the real facial shape, which greatly reduces the practicality of the three-dimensional facial scan image.

[0003] [Prior art literature] [Patent Document] (Patent Document 1) Korean Registered Patent No. 10-2273437 Summary of the invention The object of the present invention is to provide a data matching device and method, which can abandon the fixing device used to fix the patient's face during CBCT imaging and three-dimensional facial scanning, so as to capture the patient's natural facial morphology and correct the patient movement caused by not using the fixing device, so as to obtain a clear three-dimensional image.

[0004] The problems to be solved by the present invention are not limited to the above problems. For ordinary technicians in this field, other problems not explicitly mentioned can also be identified and solved from the following detailed description.

[0005] In order to achieve the above-mentioned purpose, the first aspect of the present invention provides a data matching method performed in a data matching device, the method comprising the following steps: synchronizing the acquisition time points of Cone Beam Computed Tomography (CBCT) data and three-dimensional scanning data; matching the coordinate systems of the CBCT data and the three-dimensional scanning data; matching the depth map generated each time the three-dimensional scanning data is acquired to construct a motion-corrected three-dimensional scanning image; and, using the motion information obtained by matching the depth map, constructing the motion-corrected CBCT three-dimensional image according to the CBCT data.

[0006] Preferably, the synchronization step includes: matching the frame rates of a CBCT imaging device used to acquire the CBCT data and a three-dimensional scanning imaging device used to acquire the three-dimensional scanning data; and matching the time point when the CBCT imaging device starts detecting the CBCT data and the time point when the three-dimensional scanning imaging device starts capturing the three-dimensional scanning data.

[0007] Preferably, the step of matching the coordinate system includes: using an iterative closest point (ICP) algorithm to calculate a transformation to minimize the matching error between the CBCT data and the three-dimensional scanning data; applying the transformation to the three-dimensional scanning data; and moving the three-dimensional scanning data to which the transformation is applied to a position matching the CBCT data.

[0008] Preferably, the step of constructing the three-dimensional scanning image includes: generating a corresponding depth map for each frame of three-dimensional scanning data collected; if a difference is detected in the generated depth map, using an ICP algorithm to match the two different depth maps; and setting the transformation calculated by the ICP algorithm as motion information to match the two depth maps.

[0009] Preferably, the step of generating the depth map includes: when the camera of the three-dimensional scanning imaging device captures a specific pattern of the photographed object projected by the projector of the three-dimensional scanning imaging device used to collect the three-dimensional scanning data, detecting corresponding points between the cameras or between the camera and the projector from the specific pattern; obtaining depth information of each pixel of the camera at the corresponding point; and, generating the depth map based on the depth information.

[0010] Preferably, the step of constructing the CBCT three-dimensional image comprises: searching for CBCT data acquired at a time point when the three-dimensional scanning data for which the motion information is set is acquired; and performing backprojection on the searched CBCT data by applying the transformation as the motion information.

[0011] In order to achieve the above-mentioned purpose, the second aspect of the present invention provides a data matching device, which includes: a time point synchronization unit, which is used to synchronize the acquisition time points of CBCT data and three-dimensional scanning data; a coordinate synchronization unit, which is used to match the coordinate systems of the CBCT data and the three-dimensional scanning data; a three-dimensional scanning image construction unit, which is used to match the depth map generated each time the three-dimensional scanning data is acquired to construct a motion-corrected three-dimensional scanning image; and a CBCT three-dimensional image construction unit, which is used to construct the motion-corrected CBCT three-dimensional image according to the CBCT data using the motion information obtained by matching the depth map.

[0012] To achieve the objective, a third aspect of the present invention provides a computer program stored on a computer-readable medium, which executes a data matching method when commands of the computer program are executed.

[0013] As described above, the present invention has the following effects: a CBCT image and a three-dimensional facial scan image that have been corrected for motion blur caused by patient movement can be simultaneously acquired without using a fixing device to fix the patient's face to an imaging device, and no additional matching processing is required for the CBCT image and the three-dimensional facial scan image after data acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is an example diagram of a conventional imaging device.

[0015] Figure 2 is a block diagram of a data matching device according to a preferred embodiment of the present invention.

[0016] Figure 3 is a flow chart of a data matching method according to one embodiment.

[0017] Figure 4 is an example diagram of a coordinate system matching process according to one embodiment.

[0018] Figure 5 is an example diagram of a depth map generation process according to one embodiment.

[0019] Figure 6 is an example diagram of a depth map matching process according to one embodiment.

[0020] Figure 7FIG. 4 is an exemplary diagram of a process of constructing a CBCT three-dimensional image according to an embodiment.

[0021] Figure 8 is an example diagram of a CBCT three-dimensional image and a three-dimensional scanning image according to an embodiment.

[0022] Fig. 9 is an exemplary diagram of an imaging device according to an embodiment.

[0023] Description of Reference Numerals 200: Data matching device 210: Time point synchronization unit 220: Coordinate synchronization unit 230: 3D scanning image construction unit 240: CBCT 3D image construction unit 250: Control Department DETAILED DESCRIPTION Below, the present invention is described in detail in conjunction with the accompanying drawings and subsequent embodiments, which will clearly show the advantages and characteristics of the present invention, as well as the specific methods for achieving these advantages and characteristics. However, the present invention is not limited to the embodiments described below, and it can be implemented in a variety of different ways. These embodiments are intended to make the disclosure of the present invention complete and fully disclose the scope of the present invention to ordinary technicians in the field. The scope of protection of the present invention is limited only by the claims. Throughout the specification, the same figure numbers are used to refer to the same elements. The expression "and / or" is used to indicate that the mentioned items can exist alone or in any possible combination.

[0024] Although the terms "first", "second", etc. are used to refer to various elements, components and / or parts, these elements, components and / or parts are not limited by these terms. The use of these terms is only to distinguish one element, component or part from other elements, components or parts. Therefore, in the technical concept of the present invention, the "first element", "first component" or "first part" mentioned below can also refer to the "second element", "second component" or "second part".

[0025] In addition, the identifiers (such as a, b, c, etc.) used in each step are only for the convenience of description, and these identifiers do not indicate the order of execution of the steps. Unless the context clearly indicates a specific order, these steps can be executed in any order. This means that each step can be performed sequentially in the specified order, or can be performed substantially simultaneously, or in a specific case, in the reverse order of the specified order.

[0026] The terms used in this specification are intended to illustrate the embodiments of the present invention and are not intended to limit the scope of application of the present invention. In this specification, unless the context otherwise requires, the singular includes the plural. In this specification, the terms "comprises" and / or "comprising" mean that the components, steps, operations and / or elements mentioned do not exclude the possibility of the existence or addition of one or more other components, steps, operations and / or elements.

[0027] Unless otherwise clearly defined, all terms (including technical and scientific terms) used in this specification should be interpreted according to the meanings commonly understood by ordinary technicians in the field. In addition, for commonly used dictionary-defined terms, unless clear and specific definitions are provided in this specification, they should not be idealized or over-interpreted.

[0028] In addition, when describing the embodiments of the present invention, if it is considered that the detailed description of certain known functions or configurations may unnecessarily cover the core content of the present invention, then these descriptions may be omitted. The terms described below are defined according to the characteristics of the embodiments of the present invention, and the definitions of these terms may vary depending on the intentions of users, operators or industry practices. Therefore, the understanding and definition of these terms should be based on the overall content of this specification.

[0029] Figure 2 is a block diagram of a data matching device according to a preferred embodiment of the present invention.

[0030] Reference Figure 2 The data matching device 200 includes a time point synchronization unit 210, a coordinate synchronization unit 220, a three-dimensional scanning image construction unit 230, a CBCT three-dimensional image construction unit 240 and a control unit 250. The control unit 250 controls the operation and data flow of the time point synchronization unit 210, the coordinate synchronization unit 220, the three-dimensional scanning image construction unit 230 and the CBCT three-dimensional image construction unit 240.

[0031] First, the data matching device 200 is a device for constructing a CBCT three-dimensional image and a three-dimensional scanning image based on cone beam CT (Cone Beam Computed Tomography, CBCT) data and three-dimensional facial scanning data. Preferably, the data matching device 200 can be configured separately with a CBCT imaging device for collecting CBCT data and a three-dimensional scanning imaging device for collecting three-dimensional scanning data, or can be integrated into a CBCT imaging device or a three-dimensional scanning imaging device. When the data matching device 200 is configured separately with a CBCT imaging device or a three-dimensional scanning imaging device, it can be connected to a physically independent CBCT imaging device or a three-dimensional scanning imaging device through a wireless network or a wired connection to collect CBCT data or three-dimensional scanning data, and perform the data matching method described below. In other words, as long as the data matching device 200 according to the present invention can collect CBCT data and three-dimensional scanning data, its form is not limited, and ordinary technicians in the field can easily modify it. In addition, the CBCT imaging device, the three-dimensional scanning device, the CBCT data acquisition method, and the three-dimensional scanning data acquisition method are all known technologies in the technical field to which the present invention belongs, so they are not described in detail here.

[0032] Preferably, the data matching device 200 is a computer that can install and run an application or program for executing the data matching method, and is equipped with a user interface (UserInterface) for controlling data input and output. Here, the so-called computer refers to all types of hardware devices that include at least one processor. According to different embodiments, the concept of a computer can be extended to include software configurations running on these hardware devices. For example, a computer can be understood to include but is not limited to the following devices: smart phones, tablet computers, desktop computers, laptops, and user clients and applications running on these devices.

[0033] Next, combine Figure 3 , detailed description Figure 2 The operations performed by the various components in the data matching device 200 are shown. Figure 3 The various steps described are performed by different components, but this is not limited thereto. According to different embodiments, at least a portion of these steps may be performed by the same or different components.

[0034] Figure 3 is a flow chart of a data matching method according to one embodiment.

[0035] Reference Figure 3, the time point synchronization unit 210 is responsible for synchronizing the acquisition time points of the CBCT data and the three-dimensional scanning data (step S310). Preferably, the time point synchronization unit 210 can match the frame rates of the CBCT imaging device used to acquire CBCT data and the three-dimensional scanning imaging device used to acquire three-dimensional scanning data, and match the time point when the CBCT imaging device starts to detect the CBCT data and the time point when the three-dimensional scanning imaging device starts to capture the three-dimensional scanning data. In other words, the detector of the CBCT imaging device and the camera of the three-dimensional scanning imaging device are operated synchronously to ensure that when the rotator of the CBCT imaging device rotates, the detector can know the time point of acquiring data at each angle and correspond to the corresponding measurement of the three-dimensional scanning device.

[0036] For example, if the frame rate of the CBCT imaging device is 30FPS (Frame Per Second), which means that one frame of CBCT data (i.e., projection data) is collected every 1 / 30 second, the time point synchronization unit 210 will also adjust the frame rate of the three-dimensional scanning imaging device to 30 frames per second to ensure that the time point when the detector of the CBCT imaging device starts to collect CBCT data matches the time point when the three-dimensional scanning imaging device starts to capture three-dimensional scanning data.

[0037] The coordinate synchronization unit 220 is responsible for matching the coordinate systems of the CBCT data and the three-dimensional scanning data (step S320). Here, the coordinate system matching process of the coordinate synchronization unit 220 involves matching the CBCT data and the three-dimensional scanning data to an equivalent coordinate system in three-dimensional space. This process can be completed by simply collecting the CBCT data and the three-dimensional scanning data by performing CBCT scanning and three-dimensional scanning on a stationary object simultaneously or separately, and performing a matching once. This means that the coordinate system matching process does not need to use the data collected on the patient, and is preferably performed before collecting the patient's CBCT three-dimensional image and three-dimensional scanning image, but the execution order is not limited.

[0038] Preferably, the coordinate synchronization unit 220 can use an iterative closest point (ICP) algorithm to calculate the transformation to minimize the matching error between the CBCT data and the three-dimensional scanning data. A person skilled in the art of the present invention can easily implement the ICP algorithm and the method of using the ICP algorithm to calculate the transformation, so it is not described in detail here. The coordinate synchronization unit 220 applies the calculated transformation to the three-dimensional scanning data and moves the transformed three-dimensional scanning data to a coordinate system corresponding to the CBCT data, thereby achieving coordinate system matching of the two data.

[0039] For example, refer to Figure 4 ( Figure 4is an example diagram for explaining the coordinate system matching process), the coordinate synchronization unit 220 collects the three-dimensional scanning data 410 and the CBCT data 420. Assuming that the three-dimensional scanning data 410 is represented by S and the CBCT data 420 is represented by D, the ICP algorithm can be used to calculate the transformation T that minimizes |TS-D|. Then, the calculated transformation T is applied to the three-dimensional scanning data 410. Through this application, the three-dimensional scanning data 410 is moved to a coordinate system that matches the CBCT data 420, and the coordinate system matching of the two data is completed, as shown by the reference numeral 430 in the figure.

[0040] After completing the synchronization setting of step S310 and step S320, the CBCT and three-dimensional scanning data are captured simultaneously and data matching is performed in real time, and the CBCT three-dimensional image and the three-dimensional scanning image can be constructed immediately without performing matching processing after the CBCT data and the three-dimensional scanning data are captured. In other words, without changing the frame rate, steps S310 and S320 only need to be performed once, and then the CBCT three-dimensional image and the three-dimensional scanning image of the patient can be acquired by repeating steps S330 and S340 for each patient.

[0041] The three-dimensional scanning image construction unit 230 is responsible for matching the depth map generated each time the three-dimensional scanning data is collected, so as to construct a motion-corrected three-dimensional scanning image (step S330).

[0042] Preferably, the 3D scanning image construction unit 230 can generate a depth map for each frame of the collected 3D scanning data. A depth map is an image in 3D computer graphics that contains distance information between the object surface and the observation point. For more detailed description, please refer to Figure 5 ( Figure 5 is an example diagram for illustrating the depth map generation process). The three-dimensional scanning imaging device generally includes at least one projector 510 and at least one camera 520. When the projector 510 projects a specific pattern onto the object to be photographed, the camera 520 captures the specific pattern projected onto the object to be photographed, and the three-dimensional scanning image construction unit 230 detects corresponding points between cameras or between the camera and the projector based on the specific pattern captured by the camera. Here, corresponding points can be found between cameras or between the camera and the projector based on the number of cameras or projectors. Next, the three-dimensional scanning image construction unit 230 obtains the depth information of each camera pixel at the corresponding point based on the detected corresponding points, and generates a depth map based on the depth information. A depth map is generated for each frame. For example, if the frame rate is 30FPS, a corresponding depth map is generated for each of the 30 frames in one second.

[0043] Preferably, when the three-dimensional scanning image construction unit 230 detects that there is a difference between the depth maps generated for each frame, the ICP algorithm is used to match the two different depth maps. As the subject being photographed, if the patient moves during the acquisition process, the depth map collected from the three-dimensional scanning data will be different. Therefore, by matching the depth map collected for each frame, a clear three-dimensional scanning image is generated, and the movement of the patient in each frame can be identified.

[0044] For example, refer to Figure 6 ( Figure 6 is an example diagram illustrating the depth map matching process). The depth map generated by the first frame is represented as f1 (610), and the depth map generated by the second frame is represented as f2 (620). This is because the patient moves during the acquisition process, causing the depth map to move from f1 (610) to f2 (620). The three-dimensional scanning image construction unit 230 can match f2 (620) with f1 (610) by obtaining the transformation T using the ICP algorithm. At this time, the inverse transformation T -1 Reflecting the actual movement of the patient, when the transformation T is applied to f2 ( 620 ), f1 ( 610 ) and f2 ( 620 ) will match, as shown by reference numeral 630 .

[0045] In one embodiment, the depth map generated by the first frame can be used to match the depth map generated by each subsequent frame. That is, as shown in [Table 1], based on the depth map f1 of the first frame, the three-dimensional scanning image construction unit 230 will first obtain the transformation T2 required to match the depth map f2 of the second frame to f1, and apply T2 to f2, then obtain the transformation T3 required to match the depth map f3 of the third frame to f1, and apply T3 to f3, and so on, to match the depth map generated by each frame. The matching between depth maps can be performed for all frames relative to the reference frame, or no matching can be performed for frames with the same depth map as the reference frame.

[0046] [Table 1]

[0047] In another embodiment, the depth map generated by each frame can be matched based on frames that meet specific criteria. Here, the specific criteria can be a frame without the largest interval of differences between depth maps, or an interval without differences between depth maps whose size is greater than a set size. In other words, after the depth maps of all frames are generated, the three-dimensional scanning image construction unit 230 detects whether there are differences between these depth maps. If there are intervals without differences, the depth map corresponding to the frame with the largest interval is selected as the matching criterion and matched, or if the size of a certain interval exceeds the set standard interval size, the depth map corresponding to the frame of the interval is used as the matching criterion and matched.

[0048] For example, in each frame between the first frame f1 and the last frame fn, the depth maps between f2~f4 are the same, and the depth maps between f6~f20 are also the same. Since the f6~f20 interval is the largest interval with no difference between the depth maps, the depth map of any frame belonging to the f6~f20 interval (here, f6 is used as the reference) can be used as the matching standard and matched. Alternatively, if the depth maps between f6~f18 are the same, and the interval size has been set to 10, then f6~f18 meets this interval size requirement, so the depth map of any frame belonging to the f6~f18 interval (here, f6 is used as the reference) can be used as the matching standard and matched. As shown in [Table 2], based on the depth map f6 of the sixth frame, the three-dimensional scanning image construction unit 230 first obtains the transformation T1 required to match the depth map f1 of the first frame to f6, and applies T1 to f1, then obtains the transformation T2 required to match the depth map f2 of the second frame to f6, and applies T2 to f2, and so on, matching the depth map generated by each frame. Since the depth maps between f6~f18 are the same, matching can be omitted.

[0049] [Table 2]

[0050] Preferably, the three-dimensional scanning image construction unit 230 can set the transformation calculated by the ICP algorithm as motion information to match the two depth maps. The three-dimensional scanning image construction unit 230 can set matching motion information for each frame. For example, in Table 1, the motion information of frame f2 can be set to T2, the motion information of frame f3 can be set to T3, and the motion information of frame f30 can be set to T30.

[0051] In this way, the 3D scanning image construction unit 230 can collect motion information while matching the depth map to construct the 3D scanning image.

[0052] The CBCT three-dimensional image construction unit 240 uses the motion information obtained by matching the depth map in step S330 to construct a motion-corrected CBCT three-dimensional image based on the CBCT data (step S340). The CBCT data is constructed into a three-dimensional image by backprojection, and when backprojecting each frame of CBCT data, the motion information obtained in step S330 is used to acquire an image without motion blur.

[0053] Preferably, the CBCT three-dimensional image construction unit 240 is capable of searching for CBCT data collected at a time point when the three-dimensional scanning data for which motion information is set is collected. More specifically, the CBCT three-dimensional image construction unit 240 identifies the corresponding frame of the three-dimensional scanning data for which motion information is set based on the motion information set for each frame in step S330, and detects the CBCT data collected at the time point of the frame for collecting the three-dimensional scanning data. Since the acquisition time points of the CBCT data and the three-dimensional scanning data have been synchronized in step S310, the CBCT three-dimensional image construction unit 240 can find the CBCT data at the corresponding time point according to which frame of the three-dimensional scanning data the motion occurs. In this case, the found CBCT data may correspond to a frame collected at the same time point or closest to the same time point as the corresponding frame in the three-dimensional scanning data.

[0054] Next, the CBCT 3D image construction unit 240 may apply the transformation as motion information to perform back-projection on the searched CBCT data. Figure 7 ( Figure 7 , when the CBCT data at position x are back-projected, the CBCT 3D image construction unit 240 can use the motion information of transformation T to map the back-projected value to Tx instead of x, thereby reconstructing a motion-corrected CBCT 3D image. In other words, in the process of constructing the CBCT data into a 3D image, the motion information T obtained in step S330 will be reflected in the back-projection.

[0055] For example, as shown in [Table 1], when the three-dimensional scanning image construction unit 230 collects the transformation of each frame of three-dimensional scanning data and sets it as motion information, since f1 has no motion information, the CBCT three-dimensional image construction unit 240 will directly reversely project the CBCT data f1 corresponding to the first frame, and for f2 with motion information T2, the CBCT data f2 will be reversely projected after T2 is applied. Similarly, for f3 with motion information T3, the CBCT data f3 will be reversely projected after T3 is applied, and so on, until the CBCT data corresponding to the last frame completes the reverse projection, thereby constructing a CBCT three-dimensional image.

[0056] Here, since step S320 has completed the matching of the coordinate systems of the CBCT data and the three-dimensional scanning data, the motion information obtained from the three-dimensional scanning data can be directly applied when constructing the three-dimensional image of the CBCT data.

[0057] In this manner, the CBCT three-dimensional image construction unit 240 performs back projection by applying the motion information, thereby acquiring a CBCT three-dimensional image based on the CBCT data.

[0058] In addition, although step S340 is described as being performed after step S330, in fact, the two steps can also be performed in parallel. In other words, since step S330 processes the three-dimensional scanning data to set the motion information for each frame, and step S340 processes the CBCT data, a CBCT three-dimensional image reflecting the motion information can be constructed in real time and in parallel through step S340 while setting the motion information for each frame in step S330.

[0059] Figure 8 is an example diagram of a CBCT three-dimensional image and a three-dimensional scanning image according to an embodiment.

[0060] Reference Figure 8 , the following three images are shown: a motion-corrected three-dimensional scanning image 810 , a CBCT three-dimensional image 820 without motion correction, and a motion-corrected CBCT three-dimensional image 830 .

[0061] Preferably, the motion-corrected three-dimensional scanning image 810 and the motion-corrected CBCT three-dimensional image 830 are obtained by the data matching method according to the present invention. Figure 3 After step S310 and step S320 described in , depth map matching is performed on all three-dimensional scanning data of the specific patient through step S330 to obtain a three-dimensional scanning image 810, and CBCT data at all angles are back-projected through step S340 to obtain a CBCT three-dimensional image 830.

[0062] Comparing the un-motion-corrected CBCT three-dimensional image 820 with the motion-corrected CBCT three-dimensional image 830, it can be seen that the un-motion-corrected CBCT three-dimensional image 820 has motion blur due to the patient's movement. On the contrary, the motion-corrected CBCT three-dimensional image 830 is motion-corrected by applying the transformation calculated in the depth map matching process of the three-dimensional scanned image, thereby obtaining a clear image.

[0063] Fig. 9 is an exemplary diagram of an imaging device according to an embodiment.

[0064] In the prior art, as indicated by the red dotted line of the imaging device reference numeral 910, in order to capture the CBCT image, a fixing device needs to be installed to prevent the patient's face from moving. On the contrary, according to the present invention, even if the patient moves during the shooting process, the motion-corrected CBCT three-dimensional image and the three-dimensional scanning image can be immediately acquired. Therefore, when designing the structure of the imaging device, the imaging device shown by the reference numeral 920 does not need to install a fixing device. Fig. 9The imaging device structure shown is intended to illustrate whether there is a fixing device, and does not limit the specific structure of the present invention. The present invention can be implemented using any structure that does not require a fixing device.

[0065] In addition, the method or algorithm steps related to the embodiments of the present invention may be implemented directly in hardware, or may be implemented by a software module executed by hardware, or by a combination of hardware and software modules. The software module may be stored in a random access memory (RAM), a read only memory (ROM), an erasable programmable ROM (EPROM), an electronically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, a CD-ROM, or any other type of computer-readable storage medium known in the technical field to which the present invention belongs.

[0066] The various components of the present invention may be implemented in the form of a program (or application) and stored on a medium so as to be used in conjunction with a computer (i.e., hardware) to run. The components of the present invention may be implemented in the form of a software program or software element. Similarly, the embodiments of the present invention may be implemented in a programming language or scripting language such as C, C++, Java, assembler, etc., including data structures, processes, routines, or various algorithms implemented by a combination of other programming elements. Functional aspects may be implemented in the form of an algorithm running on one or more processors.

[0067] Although the preferred embodiments of the data matching device and method according to the present invention are described in detail above, the scope of the present invention is not limited thereto, and the present invention can be modified and implemented in various ways within the scope of the claims, the detailed description of the present invention and the drawings.

Claims

1. A data matching method, performed by a data matching device, include: The acquisition time point of the synchronous cone beam computed tomography (CBCT) data and 3D scanning data; matching the coordinate systems of the CBCT data and the three-dimensional scanning data; Matching the depth map generated each time the three-dimensional scanning data is collected to construct a motion-corrected three-dimensional scanning image; as well as A motion-corrected CBCT three-dimensional image is constructed based on the CBCT data using the motion information obtained by matching the depth map.

2. The data matching method according to claim 1, in, The synchronization steps include: matching the frame rates of a CBCT imaging device for acquiring the CBCT data and a 3D scanning imaging device for acquiring the 3D scanning data; and Matching the time point when the CBCT imaging device starts to detect the CBCT data and the time point when the 3D scanning imaging device starts to capture the 3D scanning data.

3. The data matching method according to claim 1, in, The steps of matching the coordinate system include: An iterative closest point (ICP) algorithm is used to calculate the transformation to minimize the matching error between the CBCT data and the three-dimensional scan data; applying the transformation to the three-dimensional scan data; and The three-dimensional scan data to which the transformation is applied is moved to a position matching the CBCT data.

4. The data matching method according to claim 1, in, The steps of constructing the three-dimensional scanning image include: For each frame of three-dimensional scanning data collected, a corresponding depth map is generated; If a difference is detected in the generated depth maps, an iterative closest point ICP algorithm is used to match the two depth maps with the difference; and The transformation calculated by the ICP algorithm is set as motion information to match the two depth maps.

5. The data matching method according to claim 4, in, The step of generating the depth map comprises: When a camera of a three-dimensional scanning imaging device captures a specific pattern of a photographed object projected by a projector of the three-dimensional scanning imaging device for acquiring the three-dimensional scanning data, detecting corresponding points between the cameras or between the camera and the projector from the specific pattern; Obtaining depth information of each pixel of the camera at the corresponding point; and The depth map is generated according to the depth information.

6. The data matching method according to claim 4, in, The steps of constructing the CBCT three-dimensional image include: Searching for CBCT data acquired at a time point when the three-dimensional scanning data for which the motion information is set is acquired; and Back-projection is performed on the searched CBCT data using the transformation as the motion information.

7. A data matching device, include: A time point synchronization unit, used for synchronizing the acquisition time points of cone beam computed tomography (CBCT) data and three-dimensional scanning data; A coordinate synchronization unit, used for matching the coordinate systems of the CBCT data and the three-dimensional scanning data; A three-dimensional scanning image construction unit, used to match the depth map generated each time the three-dimensional scanning data is collected to construct a motion-corrected three-dimensional scanning image; as well as The CBCT three-dimensional image construction unit is used to construct a motion-corrected CBCT three-dimensional image according to the CBCT data using the motion information obtained by matching the depth map.

8. A computer program stored on a computer readable medium, It is characterized in that When the commands of the computer program are executed, the method according to any one of claims 1 to 6 is performed.