Data compensation method and data compensation system using the same

Abstract

The present invention discloses a data compensation method and a data compensation system using the same. The data compensation method of the present invention comprises: an initial scanning step, scanning and irradiating an object body with a prescribed pattern to obtain a plurality of initial scanning lenses; an unscanned area detection step, detecting the unscanned area based on the plurality of initial scanning lenses; and a compensation scanning step, detecting the unscanned area and additionally scanning at least a part of the object body to obtain at least one compensation scanning lens.

Description

Technical Field

[0001] The present invention relates to a data compensation method and a data compensation system using the same, and more particularly to a data compensation method and a data compensation system using the same, which detects an unscanned area of ​​an initial three-dimensional model representing an object body, and improves the completeness of the three-dimensional model representing the object body by obtaining a compensated three-dimensional model that compensates the above-mentioned initial three-dimensional model. Background Art

[0002] 3D scanning technology is used in a variety of industrial fields such as measurement, inspection, reverse engineering, content generation, CAD / CAM for dental treatment, and medical equipment. As computing technology advances, scanning performance has been improved, thus expanding its practicality. In particular, in the field of dental treatment, 3D scanning technology is used to treat patients, so the 3D model obtained by 3D scanning needs to have high precision.

[0003] When a 3D scanner is used to scan an object (e.g., a plaster model made to mimic a patient's oral cavity), the contour of the object may include a transverse portion and a longitudinal portion. Figure 1 In the sample object body P100 exemplarily shown in FIG, the sample object body P100 may include a tooth portion P110 and a gum portion P120. In addition, in the sample object body P100, the gum lines H1 and H2 where the tooth portion P110 and the gum portion P120 meet and the tooth edge line H3 corresponding to the end of the tooth portion P110 may have the form of a transverse contour line H, and the interdental line (a line between two different teeth) may have the form of a longitudinal contour line (V, V1, V2, V3, V4, and V5).

[0004] In the process of scanning an object with a 3D scanner to generate a 3D model representing the object in three dimensions, the 3D scanner may irradiate light of a predetermined form toward the object. The light may have a specific pattern to obtain depth information for stereoscopically representing the object into a 3D model. For example, the pattern may be a stripe pattern.

[0005] like Figure 2 As shown in the example, when a target is scanned using light of a transverse stripe pattern, the transverse contour line of the target corresponding to the texture direction of the transverse stripe pattern is not fully scanned, and a blank transverse unscanned area HB may be generated in a part of the transverse part of the three-dimensional model (the three-dimensional model may correspond to the initial three-dimensional model 300 described later). As another example, Figure 3As shown in the example, when the object is scanned using the light of the longitudinal stripe pattern, the longitudinal contour line of the object corresponding to the texture direction of the longitudinal stripe pattern is not scanned sufficiently, and a longitudinal unscanned area VB in the form of a blank may be generated in a part of the longitudinal part of the three-dimensional model. There is a problem that the three-dimensional model having the unscanned area has a low degree of completion, and it is difficult to accurately analyze the patient's oral cavity due to the presence of the unscanned area, and the precision of the correction treatment made to treat the patient is reduced.

[0006] In particular, this problem may frequently occur in a certain type of 3D scanner (e.g., a desktop 3D scanner). For example, when an object is placed in a 3D scanner and a limited number of scanning shots are obtained at a predetermined angle and direction, there is a problem of generating an unscanned area in the certain scanning shot. In a certain type of 3D scanner, the direction and angle for scanning the object are set, and even if the scanning process is repeatedly performed, it may not be possible to compensate for the unscanned area. That is, in order to compensate for the unscanned area, it is necessary to set a new direction and angle relative to the object.

[0007] Therefore, a method for obtaining a three-dimensional model minimizing an unscanned area for solving the above-mentioned problem is studied.

[0008] Prior art literature

[0009] Patent Literature

[0010] (Patent Document 1) Korean Patent Publication No. 10-2018-0015093 (published on February 12, 2018) Summary of the invention

[0011] Technical issues

[0012] In order to solve the above problems, the present invention is used to provide a data compensation method for obtaining a compensated three-dimensional model by obtaining an initial three-dimensional model including an unscanned area by compensating a scanning lens.

[0013] Furthermore, the present invention is used to provide a data compensation system for detecting and compensating for an unscanned area by the data compensation method as described above.

[0014] The technical problems of the present invention are not limited to the technical problems mentioned above, and ordinary technicians in the technical field to which the present invention belongs can clearly understand other technical problems not mentioned from the following records.

[0015] Technical Solution

[0016] In order to achieve the above-mentioned purpose, the data compensation method of the present invention includes: an initial scanning step, scanning an object body irradiated with a specified pattern by a three-dimensional scanner to obtain multiple initial scanning lenses; an unscanned area detection step, detecting the unscanned area based on the above-mentioned multiple initial scanning lenses by a control unit; and a compensation scanning step, detecting the above-mentioned unscanned area by the above-mentioned control unit and using the above-mentioned three-dimensional scanner to additionally scan at least a part of the above-mentioned object body to obtain at least one compensation scanning lens.

[0017] Furthermore, the data compensation method of the present invention may further include other additional steps including the above steps, thereby minimizing the unscanned area of ​​the compensated three-dimensional model representing the object.

[0018] On the other hand, a data compensation system for executing the data compensation method of the present invention includes: a three-dimensional scanner, including a light projector and at least one camera arranged on one side of the light projector, the at least one camera scans an object body with a specified pattern illuminated by the light projector to obtain multiple initial scanning lenses and at least one compensation scanning lens; a control unit connected to the three-dimensional scanner, adjusting the direction and angle of the object body relative to the at least one camera by controlling the three-dimensional scanner; and a display unit, displaying a three-dimensional model of the object body generated based on the multiple initial scanning lenses and at least one compensation scanning lens obtained by the three-dimensional scanner.

[0019] Furthermore, the data compensation system of the present invention may further include other additional structures including the above-mentioned structure, thereby making it easy to obtain a compensated three-dimensional model representing the object.

[0020] Technical Effects

[0021] By using the data compensation method of the present invention and the data compensation system using the same, the user can obtain a compensated three-dimensional model by using a compensating scanning lens to scan the unscanned area generated by irradiating a specific pattern with different patterns. The unscanned area in the compensated three-dimensional model is minimized, thereby having the advantage of improving the completeness of the above-mentioned compensated three-dimensional model.

[0022] Furthermore, before obtaining the initial three-dimensional model, when detecting unscanned areas in multiple initial scanning shots, the three-dimensional model is not repeatedly generated, thereby having the advantage of saving system resources and time required when obtaining the initial three-dimensional model.

[0023] Furthermore, multiple patterns can be irradiated onto the object through various configuration relationships of the light projector and the camera, thereby having the advantage of obtaining a compensated three-dimensional model that minimizes the unscanned area. Users can use the accurate compensated three-dimensional model to design corrective treatments and provide the best treatment to patients. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a sample object body used to illustrate the transverse contour line and the longitudinal contour line.

[0025] Figure 2 Used to account for the lateral unscanned areas that result in the 3D model.

[0026] Figure 3 Used to illustrate the longitudinal unscanned areas generated in the 3D model.

[0027] Figure 4 FIG. 4 is a flow chart of a data compensation method according to an embodiment of the present invention.

[0028] Figure 5 It is used to explain the state of irradiating the first pattern onto the object.

[0029] Figure 6 It is used to explain the state where the second pattern is irradiated onto the object.

[0030] Figure 7 Used to illustrate the relationship of the initial scan shots used to generate the initial 3D model.

[0031] Figure 8 The figure is a flowchart of detailed steps of the compensation scanning step in the data compensation method according to an embodiment of the present invention.

[0032] Fig. 9 It is used to illustrate the process of generating a compensated three-dimensional model according to the data compensation method of the first embodiment of the present invention.

[0033] Fig.10 It is used to illustrate the process of generating a compensated three-dimensional model according to the data compensation method of the second embodiment of the present invention.

[0034] Fig.11 It is used to illustrate the process of generating a compensated three-dimensional model according to the data compensation method of the third embodiment of the present invention.

[0035] Fig.12 It is used to illustrate the process of generating a compensated three-dimensional model according to the data compensation method of the fourth embodiment of the present invention.

[0036] Fig.13 It is used to illustrate the process of generating a compensated three-dimensional model according to the data compensation method of the fifth embodiment of the present invention.

[0037] Fig.14 The figure is a simplified structural diagram of a data compensation system for executing the data compensation method of the present invention.

[0038] Fig.15 A portion used to explain the compensation suggestion portion of an object body corresponding to an unscanned area according to the fixture movement of a three-dimensional scanner as one structure of the data compensation system of the present invention.

[0039] Fig.16 It is used to explain the process of adding the compensation suggestion part of the scan object.

[0040] Fig.17 A first configuration relationship between a light projector and a camera of a three-dimensional scanner is used to illustrate one structure of the data compensation system of the present invention.

[0041] Fig.18 A second configuration relationship between a light projector and a camera of a three-dimensional scanner is used to illustrate one structure of the data compensation system of the present invention.

[0042] Fig.19 A third configuration relationship between a light projector and a camera of a three-dimensional scanner is used to illustrate one structure of the data compensation system of the present invention.

[0043] Description of Reference Numerals

[0044] S110: Initial scanning step

[0045] S120: Unscanned area detection step

[0046] S130: Compensation scanning step

[0047] S131: Compensation object initial scanning lens determination step

[0048] S132: Object setting step

[0049] S133: Steps for obtaining a different pattern scanning lens

[0050] S140: Compensation 3D model generation step

[0051] 100: Pattern 200: Initial scanning lens

[0052] 300: Initial 3D model 400: Compensation scanning lens

[0053] 500: Compensation 3D Model

[0054] 900: Data compensation system 910: 3D scanner

[0055] 920: control unit 930: display unit

[0056] HB: Horizontal unscanned area VB: Vertical unscanned area

[0057] O: Object C: Compensation suggestion part DETAILED DESCRIPTION

[0058] Hereinafter, some embodiments of the present invention are described in detail through illustrative figures. It should be noted that in the process of marking the structural elements of each figure with reference numerals, the same structural elements are marked with the same reference numerals as much as possible even if they are shown in other figures. In addition, in the process of describing the embodiments of the present invention, when it is determined that the specific description of the relevant known structure or function hinders the understanding of the embodiments of the present invention, its detailed description is omitted.

[0059] In the process of describing the structural elements of the embodiments of the present invention, the terms such as first, second, A, B, (a), (b) etc. may be used. Such terms are only used to distinguish one structural element from another structural element, and the nature, order or sequence of the structural element is not limited to the terms. Furthermore, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as those commonly understood by ordinary technicians in the technical field to which the present invention belongs. Terms defined in dictionaries as commonly used should be interpreted as having a meaning consistent with the meaning of the context of the relevant technology, and unless clearly defined in this application, they are not interpreted as ideal or overly formal meanings.

[0060] The following is a detailed description of a data compensation method according to an embodiment of the present invention.

[0061] Figure 4 FIG. 4 is a flow chart of a data compensation method according to an embodiment of the present invention.

[0062] Reference Figure 4 , the data compensation method of an embodiment of the present invention may include an initial scanning step S110, an unscanned area detection step S120, a compensation scanning step S130, and a compensated three-dimensional model generation step S140. In the initial scanning step S110, a plurality of initial scanning lenses may be obtained by the three-dimensional scanner 910. In the unscanned area detection step S120, the unscanned area may be detected in the initial three-dimensional model generated from the plurality of initial scanning lenses or the plurality of initial scanning lenses respectively by the control unit 920. Moreover, in the compensation scanning step S130, a compensation scanning lens for minimizing the unscanned area may be obtained by the control unit 920 using the three-dimensional scanner 910. In the compensated three-dimensional model generation step S140, the plurality of initial scanning lenses and the compensation scanning lens may be merged together by the control unit 920 to generate a compensated three-dimensional model that minimizes the unscanned area.

[0063] The following describes each step of the data compensation method of the present invention in more detail.

[0064] Figure 5 It is used to explain the state of irradiating the first pattern 110 to the object O. Figure 6 It is used to explain the state where the second pattern 120 is irradiated onto the object O.

[0065] Reference Figures 4 to 6 In the initial scanning step S110 of the data compensation method of the present invention, the object O irradiated with the prescribed pattern 100 may be scanned by the three-dimensional scanner 910 to obtain a plurality of initial scanning shots. In order to obtain a three-dimensional model representing the object O in a three-dimensional manner, the three-dimensional scanner 910 may irradiate the surface of the object O with light of a prescribed form. Exemplarily, the light irradiated by the three-dimensional scanner 910 to the surface of the object O may be pattern light having a prescribed pattern 100. The prescribed pattern 100 may be a stripe pattern having a prescribed texture direction. Exemplarily, the prescribed pattern 100 may include a first pattern 110. The first pattern 110 may be in a shape in which dark portions 111 and bright portions 112 appear alternately. For example, the first pattern 110 may be a horizontal stripe pattern in which the dark portions 111 and the bright portions 112 face the horizontal direction, and the dark portions 111 and the bright portions 112 are alternately arranged in the vertical direction. As another example, the prescribed pattern 100 may include a second pattern 120. The second pattern 120 may be in a shape in which dark portions 121 and bright portions 122 appear alternately. For example, the second pattern 120 may be a longitudinal stripe pattern in which the dark portions 121 and the bright portions 122 are oriented in a vertical direction, and the dark portions 121 and the bright portions 122 are alternately arranged in a horizontal direction.

[0066] The pattern 100 including the above-mentioned transverse stripe pattern and the above-mentioned longitudinal stripe pattern can be generated by the light projector 911 of the three-dimensional scanner 910. Exemplarily, the light projector 911 may include: a light source that generates light; and a pattern generating unit that is arranged between the above-mentioned light source and the object. The pattern generating unit may be a pattern generating element including a pattern mask and a digital micromirror device (DMD). Thus, the light generated by the light source passes through the pattern generating unit to generate a pattern 100 corresponding to the shape of the pattern generating unit, and the generated pattern 100 is irradiated onto the surface of the object O. At this time, the portion of the surface of the above-mentioned object O that is projected from the pattern generating unit and reaches the above-mentioned object O may appear bright (bright portion), and the portion of the surface of the above-mentioned object O that is not projected from the pattern generating unit and does not reach the above-mentioned object O may appear dark (dark portion).

[0067] According to the above content, the first pattern 110 is described as a horizontal stripe pattern, and the second pattern 120 is described as a vertical stripe pattern, but the present invention is not necessarily limited to the listed examples, and two or more different patterns 100 that can minimize the unscanned area can be irradiated to the surface of the object body O. The depth information of the object body O can be obtained by irradiating the pattern 100 on the surface of the object body O, and a three-dimensional model (including an initial three-dimensional model and a compensated three-dimensional model) that stereoscopically represents the object body O can be obtained.

[0068] Figure 7It is used to explain the relationship of the initial scanning lens 200 for generating the initial three-dimensional model 300.

[0069] Reference Figure 7 In the initial scanning step S110, the three-dimensional scanner 910 may rotate and tilt the object O to scan the object O at various angles to obtain a plurality of initial scanning lenses 200. For example, the three-dimensional scanner may scan a first portion of the object O at a first angle A1 to obtain a first initial scanning lens 201, and may scan a second portion of the object O at a second angle A2 to obtain a second initial scanning lens 202. Furthermore, the three-dimensional scanner may scan a third portion of the object O at a third angle A3 to obtain a third initial scanning lens 203, and may scan a fourth portion of the object O at a fourth angle A4 to obtain a fourth initial scanning lens 204. At this time, at least one of the portions of the object O and the angles relative to the object O represented by the plurality of initial scanning lenses 200 may be different. That is, the plurality of initial scanning lenses 200 may be obtained by scanning the object O at different portions of the object O and / or at different angles relative to the object O, and the plurality of initial scanning lenses 200 may be arranged and merged with each other to generate the initial three-dimensional model 300. The initial three-dimensional model 300 stereoscopically represents the object O, and the initial three-dimensional model 300 may include a tooth model 310 and a gum model 320 .

[0070] On the other hand, the generated initial three-dimensional model 300 may include an unscanned area u. Figure 7 As shown, the initial three-dimensional model 300 may include a transverse unscanned area HB due to the second initial scanning lens 202, and the initial three-dimensional model 300 may include a longitudinal unscanned area VB due to the fourth initial scanning lens 204. Illustratively, the second initial scanning lens 202 may be obtained by the three-dimensional scanner 910 by irradiating the first pattern 110 onto the object body O, and the fourth initial scanning lens 204 may be obtained by the three-dimensional scanner 910 by irradiating the second pattern 120 onto the object body O. That is, the transverse unscanned area HB corresponding to the second initial scanning lens 202 may be formed along the texture direction of the transverse stripe pattern, and the longitudinal unscanned area VB corresponding to the fourth initial scanning lens 204 may be formed along the texture direction of the longitudinal stripe pattern.

[0071] Therefore, it is necessary to compensate for the transverse unscanned area HB of the initial three-dimensional model 300 corresponding to the second initial scanning lens 202 and the longitudinal unscanned area VB of the initial three-dimensional model 300 corresponding to the fourth initial scanning lens 204 .

[0072] After the initial scanning step S110 is performed, the unscanned area detection step S120 may be performed. In the unscanned area detection step S120, the control unit 920 may detect the unscanned area u based on the multiple initial scanning lenses 200. Illustratively, the unscanned area u may be detected in the initial three-dimensional model 300 generated by merging the multiple initial scanning lenses 200 through the unscanned area detection unit 925 in the control unit 920. When the unscanned area u of the initial three-dimensional model 300 is detected, at least one compensation scanning lens as an additional scanning lens for compensating the unscanned area u may be obtained. Thus, through the three-dimensional modeling unit 924 in the control unit 920, the compensation scanning lens may be additionally merged into the initial three-dimensional model 300 to generate a compensated three-dimensional model, and the unscanned area u of the compensated three-dimensional model may be minimized.

[0073] As another example, the unscanned area u can be detected for each of the multiple initial scanning lenses 200. That is, the unscanned area u can be detected before the initial three-dimensional model 300 is generated. When the unscanned area u is detected in the multiple initial scanning lenses 200, the three-dimensional scanner control unit 922 in the control unit 920 controls the three-dimensional scanner 910 to obtain at least one compensation scanning lens as an additional scanning lens for compensating the unscanned area u. Thus, the compensation scanning lens can be combined with the multiple initial scanning lenses 200 to generate a compensated three-dimensional model, and the unscanned area u of the compensated three-dimensional model can be minimized.

[0074] Next, the compensation scanning step S130 will be described.

[0075] Figure 8 Flow chart of detailed steps of the compensation scanning step S130 in the data compensation method according to an embodiment of the present invention.

[0076] Reference Figure 4 , Figure 7 and Figure 8In the data compensation method according to an embodiment of the present invention, in the compensation scanning step S130, the control unit 920 detects the unscanned area u, and the three-dimensional scanner 910 may additionally scan at least a portion of the object body O to obtain at least one compensation scanning lens. In more detail, the compensation scanning step S130 may include a compensation object initial scanning lens determination step S131. In the compensation object initial scanning lens determination step S131, the unscanned area detection unit 925 in the control unit 920 may determine the compensation object initial scanning lens of the image including the compensation suggestion portion corresponding to the unscanned area u. When the compensation object initial scanning lens is determined, the object body setting step S132 may be performed. In the object body setting step S132, the three-dimensional scanner control unit 922 in the control unit 920 controls the three-dimensional scanner 910 to be able to set the object body O in the same direction and angle as the object body O when the compensation object initial scanning lens is obtained. Exemplarily, when the compensation object initial scanning lens is the second scanning lens 202, the three-dimensional scanner 910 may set the object body O so that the second portion of the object body O can be scanned at the second angle A2. As another example, when the compensation object initial scanning lens is the fourth initial scanning lens 204, the 3D scanner may configure the object body O to scan a fourth portion of the object body O at a fourth angle A4.

[0077] As another example, when the initial scanning lens of the compensation object is the second scanning lens 202, the three-dimensional scanner 910 may further set the object body O to be able to scan the second part of the object body O at a new angle different from the second angle A2. In this case, even if the same pattern as that of the initial scanning lens of the compensation object is irradiated to the object body O, a compensation scanning lens that can compensate for the unscanned area u can be obtained.

[0078] On the other hand, the compensation scanning step S130 may further include a different pattern scanning lens obtaining step S133. In the different pattern scanning lens obtaining step S133, the three-dimensional scanner control unit 922 in the control unit 920 controls the three-dimensional scanner 910 to obtain the compensation scanning lens by irradiating a pattern different from the pattern irradiated when obtaining the compensation object initial scanning lens including the unscanned area u to the object body O. Exemplarily, when the compensation object initial scanning lens is obtained by scanning the object body O irradiated with a first pattern 110, the compensation scanning lens may be obtained by scanning the object body O irradiated with a second pattern 120 different from the first pattern 110. Thus, the unscanned area u generated by the first pattern 110 can be compensated by the compensation scanning lens obtained by scanning the object body O irradiated with the second pattern 120.

[0079] When the compensating scanning lens is obtained, the compensating three-dimensional model generating step S140 may be performed. Exemplarily, in the compensating three-dimensional model generating step S140, the compensating three-dimensional model may be generated by adding and merging the compensating scanning lens to the initial three-dimensional model 300 through the parallelization unit 923 and the three-dimensional modeling unit 924 in the control unit 920. As another example, when the unscanned area u is detected in a plurality of initial scanning lenses 200, the compensating three-dimensional model may be generated by merging the compensating scanning lens with the plurality of initial scanning lenses 200. The compensating three-dimensional model compensated by the compensating scanning lens has the advantage of minimizing the unscanned area u, and the user can provide the best treatment to the patient by using the compensating three-dimensional model that accurately represents the object body.

[0080] The following describes the process of obtaining a plurality of initial scanning lenses 200 , the process of obtaining a compensating scanning lens, and the process of generating a compensating three-dimensional model through various embodiments.

[0081] Fig. 9 It is used to illustrate the process of generating the compensated three-dimensional model 500 according to the data compensation method of the first embodiment of the present invention. Fig.10 It is used to illustrate the process of generating the compensated three-dimensional model 500 according to the data compensation method of the second embodiment of the present invention. And, Fig.11 It is used to illustrate the process of generating the compensated three-dimensional model 500 according to the data compensation method of the third embodiment of the present invention. Fig.12 It is used to illustrate the process of generating the compensated three-dimensional model 500 according to the data compensation method of the fourth embodiment of the present invention. Fig.13 It is used to illustrate the process of generating a compensated three-dimensional model 500 by the data compensation method according to the fifth embodiment of the present invention.

[0082] Reference Fig. 9 The process of generating the compensated three-dimensional model 500 according to the data compensation method of the first embodiment is described. First, in the initial scanning step S110, a total of n initial scanning lenses 200 can be obtained by the three-dimensional scanner 910. At this time, n can be an integer greater than 2. Illustratively, the multiple initial scanning lenses 200 obtained in the initial scanning step S110 can be obtained in a state where the light projector 911 in the three-dimensional scanner 910 irradiates the first pattern 110 to the object body O. That is, in a state where the first pattern 110 is irradiated to the object body O, the first initial scanning lens 201 can be obtained by scanning the first part of the object body O at a first angle, the second initial scanning lens 202 can be obtained by scanning the second part of the object body O at a second angle, the third initial scanning lens 203 can be obtained by scanning the third part of the object body O at a third angle, the fourth initial scanning lens 204 can be obtained by scanning the fourth part of the object body O at a fourth angle, and the nth initial scanning lens 220 can be obtained by scanning the nth part of the object body O at an nth angle.

[0083] When n initial scanning lenses 200 are obtained, the comparison unit 923 and the 3D modeling unit 924 in the control unit 920 may compare and merge the initial scanning lenses 200 to generate an initial 3D model 300. For example, the initial 3D model 300 may be generated based on the initial scanning lenses 200 obtained in a state where the first pattern 110 is irradiated to all parts of the object O.

[0084] After that, the unscanned area u may be detected in the initial three-dimensional model 300. And, as the unscanned area u is detected in the initial three-dimensional model 300, the compensation object initial scanning lens in which the unscanned area u exists may be determined. For ease of explanation, it is assumed that the first initial scanning lens 201 is determined as the compensation object initial scanning lens. The three-dimensional scanner 910 is controlled by the three-dimensional scanner control unit 922 in the control unit 920. In order to obtain the compensation scanning lens 400, the three-dimensional scanner 910 can scan the first part of the object body O at the same first angle as when the first initial scanning lens 201 is obtained. When obtaining the compensation scanning lens 400, the object body O can be irradiated with a second pattern 120 different from the first pattern 110 irradiated when the first initial scanning lens 201 is obtained. That is, at least one compensation scanning lens 400 obtained in the compensation scanning step S130 can be obtained by irradiating the second pattern 120 different from the first pattern 110.

[0085] When the compensation scanning lens 400 is obtained, the 3D modeling unit 924 in the control unit 920 can add and merge the compensation scanning lens to the initial 3D model 300 to generate the compensated 3D model 500. The unscanned area u of the initial 3D model 300 generated by the first pattern 110 is minimized by the compensation scanning lens 400, thereby improving the completeness of the compensated 3D model 500. The user can design a corrective treatment based on the accurate compensated 3D model 500, and can provide the best treatment to the patient.

[0086] Reference Fig.10The process of generating the compensated three-dimensional model 500 according to the data compensation method of the second embodiment is described. The multiple initial scanning lenses 200 obtained in the initial scanning step S110 can be obtained in a state where the first pattern 110 and the second pattern 120 are irradiated to the object body O. Illustratively, through the three-dimensional scanner 910, at least a portion of the multiple initial scanning lenses 200 can be obtained in a state where the first pattern 110 is irradiated to the object body O, and the remaining portion of the multiple initial scanning lenses 200 can be obtained in a state where the second pattern 120 having a shape different from the first pattern 110 is irradiated to the object body O. As an example, the first initial scanning lens 201 can be obtained by scanning a first portion of the object body O at a first angle in a state where the first pattern 110 is irradiated to the object body O, and the second initial scanning lens 202 can be obtained by scanning a second portion of the object body O at a second angle in a state where the first pattern 110 is irradiated to the object body O. Furthermore, when the first pattern 110 is irradiated onto the object O, the third portion of the object O can be scanned at a third angle to obtain a third initial scanning lens 203; when the second pattern 120 is irradiated onto the object O, the fourth portion of the object O can be scanned at a fourth angle to obtain a fourth initial scanning lens 204; and when the second pattern 120 is irradiated onto the object O, the nth portion of the object O can be scanned at an nth angle to obtain an nth initial scanning lens 220.

[0087] When the initial three-dimensional model 300 is generated based on the initial scanning lens 200, the unscanned area u of the initial three-dimensional model 300 can be detected by the unscanned area detection unit 925, and the compensation target initial scanning lens of the image including the compensation suggestion portion corresponding to the unscanned area u can be determined. Exemplarily, when it is assumed that the compensation target initial scanning lens is the first initial scanning lens 201, the three-dimensional scanner control unit 922 in the control unit 920 controls the three-dimensional scanner 910, and the three-dimensional scanner 910 can scan the first part of the object body O at the same first angle as when the first initial scanning lens 201 is obtained to obtain the compensation scanning lens 400. When obtaining the compensation scanning lens 400, the object body O can be irradiated with the second pattern 120 different from the first pattern 110 irradiated when the first initial scanning lens 201 is obtained. That is, at least one compensation scanning lens 400 obtained in the compensation scanning step S130 can be obtained by irradiating the second pattern 120 different from the first pattern 110.

[0088] As another example, when it is assumed that the compensation object initial scanning lens is the fourth initial scanning lens 204, the three-dimensional scanner 910 is controlled by the three-dimensional scanner control unit 922 in the control unit 920, and the three-dimensional scanner 910 can scan the fourth part of the object body O at the same fourth angle as when the fourth initial scanning lens 204 is obtained to obtain the compensation scanning lens 400. When obtaining the compensation scanning lens 400, the object body O can be irradiated with a first pattern 110 different from the second pattern 120 irradiated when the fourth initial scanning lens 204 is obtained. That is, at least one compensation scanning lens 400 obtained in the compensation scanning step S130 can be obtained by irradiating the first pattern 110 different from the second pattern 120.

[0089] When the compensation scanning lens 400 is obtained, the compensation scanning lens can be added and merged into the initial three-dimensional model 300 to generate the compensation three-dimensional model 500. The unscanned area u of the initial three-dimensional model 300 generated by the first pattern 110 can be minimized by the compensation scanning lens 400 obtained by scanning the object body O of the second pattern 120, and the unscanned area u of the initial three-dimensional model 300 generated by the second pattern 120 can be minimized by the compensation scanning lens 400 obtained by scanning the object body O of the first pattern 110. Thus, the completeness of the compensation three-dimensional model 500 is improved, and the user can design a corrective treatment based on the accurate compensation three-dimensional model 500, and can provide the best treatment to the patient.

[0090] Reference Fig.11 The process of generating the compensated three-dimensional model 500 according to the data compensation method of the third embodiment is described. Different from the data compensation method of the first embodiment and the data compensation method of the second embodiment, the data compensation method of the third embodiment can obtain 2n initial scanning lenses 200 in the initial scanning step S110. Exemplarily, the first initial scanning lens 201 can scan the first part of the object body O irradiated with the first pattern 110 at a first angle to obtain, and the second initial scanning lens 202 can scan the first part of the object body O irradiated with the second pattern 120 at a first angle to obtain. That is, the first initial scanning lens 201 and the second initial scanning lens 202 scan the same part of the object body O at the same angle, and can irradiate different patterns 100 to obtain. In the same way, the third initial scanning lens 203 can scan the second part of the object body O irradiated with the first pattern 110 at a second angle to obtain, and the fourth initial scanning lens 204 can scan the second part of the object body O irradiated with the second pattern 120 at a second angle to obtain.

[0091] As such, the first initial scanning lens 201 and the second initial scanning lens 202 may form a pair, and the third initial scanning lens 203 and the fourth initial scanning lens 204 may form a pair. In the same manner, the (n+1)th initial scanning lens 221 and the (n+2)th initial scanning lens 222 may form a pair, and the (n+3)th initial scanning lens 223 and the (n+4)th initial scanning lens 224 may form a pair. Thus, n portions of the object O irradiated with the first pattern 110 and the second pattern 120 may be scanned respectively to obtain 2n initial scanning lenses 200. In this embodiment, the above-mentioned initial scanning lenses 200 may be arranged and merged by the parallelization unit 923 and the three-dimensional modeling unit 924 in the control unit 920 to generate the compensated three-dimensional model 500, and the separate unscanned area detection step S120 and the compensation scanning step S130 may be omitted.

[0092] Reference Fig.12 The process of generating the compensated three-dimensional model 500 according to the data compensation method of the fourth embodiment is described. Similar to the third embodiment described above, in the data compensation method of the fourth embodiment, the three-dimensional scanner 910 can obtain 2n initial scanning lenses 200 in the initial scanning step S110. Exemplarily, the first initial scanning lens to the nth initial scanning lens 201, 202, 203, 204, 220 can scan and irradiate n parts of the object body O of the first pattern 110 at n angles to obtain, and the (n+1)th initial scanning lens to the (2n)th initial scanning lens 221, 222, 223, 224, 240 can scan and irradiate n parts of the object body O of the second pattern 120 at n angles to obtain. That is, the first initial scanning lens 201 and the (n+1)th initial scanning lens 221 scan the same part of the object body O at the same angle, and can irradiate different patterns 100 to obtain. In the same manner, the second initial scanning lens 202 can scan and illuminate the second portion of the object O of the first pattern 110 at a second angle to obtain, and the (n+2)th initial scanning lens 222 can scan and illuminate the second portion of the object O of the second pattern 120 at a second angle to obtain.

[0093] As such, the first initial scanning lens 201 and the (n+1)th initial scanning lens 221 may form a pair, and the second initial scanning lens 202 and the (n+2)th initial scanning lens 222 may form a pair. In the same manner, the third initial scanning lens 203 and the (n+3)th initial scanning lens 223 may form a pair, and the fourth initial scanning lens 204 and the (n+4)th initial scanning lens 224 may form a pair. Thus, n portions of the object body O irradiated with the first pattern 110 and the second pattern 120 may be scanned respectively to obtain 2n initial scanning lenses 200. Similar to the third embodiment described above, the present embodiment may be arranged and merged by the comparison unit 923 and the three-dimensional modeling unit 924 in the control unit 920 to generate the compensated three-dimensional model 500, and the separate unscanned area detection step S120 and the compensation scanning step S130 may be omitted.

[0094] Below, refer to Fig.13 The process of generating the compensated three-dimensional model 500 according to the data compensation method of the fifth embodiment is described. In the data compensation method of the fifth embodiment, the initial scanning lens 200 can be obtained in a manner similar to the data compensation method of the second embodiment. Exemplarily, at least a portion of the plurality of initial scanning lenses 200 can be obtained in a state where the first pattern 110 is irradiated to the object O, and the remaining portion of the plurality of initial scanning lenses 200 can be obtained in a state where the second pattern 120 having a shape different from the first pattern 110 is irradiated to the object O.

[0095] On the other hand, in the data compensation method of the fifth embodiment, the unscanned area u can be detected for each of the multiple initial scanning lenses. For example, when the unscanned area detection unit 925 in the control unit 920 obtains the first initial scanning lens 201, it can detect whether there is an unscanned area u in the first initial scanning lens 201. And, when the second initial scanning lens 202 is obtained, it can detect whether there is an unscanned area u in the second initial scanning lens 202.

[0096] As another example, in the data compensation method of the fifth embodiment, when the first to nth initial scanning lenses 201 , 202 , 203 , 204 , 220 are obtained, the unscanned area detection unit 925 can detect whether there is an unscanned area u in the initial scanning lens 200 .

[0097] That is, in the data compensation method of the fifth embodiment, in a state where the initial three-dimensional model 300 is not generated by the three-dimensional modeling unit 924, the unscanned area detection unit 925 can detect the unscanned area from the initial scanning lens 200. Therefore, the system resources and time required when generating the initial three-dimensional model 300 can be saved.

[0098] Illustratively, when the compensation object initial scanning lens of the image including the compensation suggestion portion corresponding to the unscanned area u is determined to be the fourth initial scanning lens 204, the three-dimensional scanner 910 is controlled by the three-dimensional scanner control unit 922 and can scan the fourth portion of the object body O at the same fourth angle as when the fourth initial scanning lens 204 is obtained to obtain the compensation scanning lens 400. When obtaining the compensation scanning lens 400, the object body O can be irradiated with the first pattern 110 different from the second pattern 120 irradiated when the fourth initial scanning lens 204 is obtained. That is, at least one compensation scanning lens 400 obtained in the compensation scanning step S130 can be obtained by irradiating the first pattern 110 different from the second pattern 120.

[0099] When the compensation scanning lens 400 is obtained, the compensation 3D model 500 representing the object O can be generated by merging the plurality of initial scanning lenses 200 and the compensation scanning lens 400 together through the 3D modeling unit 924 in the control unit 920. The unscanned area u generated by the first pattern 110 can be minimized by the compensation scanning lens 400 obtained by scanning the object O irradiated with the second pattern 120, and the unscanned area u of the initial 3D model 300 generated by the second pattern 120 can be minimized by the compensation scanning lens 400 obtained by scanning the object O irradiated with the first pattern 110. Thus, the completeness of the compensation 3D model 500 is improved, and the user can design a corrective treatment based on the accurate compensation 3D model 500, and can provide the best treatment to the patient.

[0100] The following describes a data compensation system for executing the data compensation method of the present invention. In describing the data compensation system, the contents described in the above-mentioned data compensation method may be briefly mentioned or the related description may be omitted.

[0101] Fig.14 FIG. 9 is a simplified structural diagram of a data compensation system 900 for executing the data compensation method of the present invention.

[0102] Reference Fig.14 The data compensation system 900 for executing the data compensation method of the present invention may include a three-dimensional scanner 910 , a control unit 920 and a display unit 930 .

[0103] The three-dimensional scanner 910 may include a desktop scanner, which places the object at a specified position, rotates and / or tilts the object to obtain a stereoscopic three-dimensional model representing the object. The three-dimensional scanner 910 may be set at a specified location, and the distance between the camera 912 of the three-dimensional scanner 910 and the object varies little, so it is easy to combine scanning shots obtained at a uniform distance to generate a three-dimensional model.

[0104] The control unit 920 may be a structure capable of computing data. For example, the control unit 920 may be a computing device including a microprocessor. The control unit 920 may be at least one of the well-known computing devices including a desktop computer, a tablet computer, and a local server. Furthermore, the control unit 920 may be a cloud.

[0105] The control unit 920 may be connected by wire or wirelessly so as to be able to communicate data with the three-dimensional scanner 910. The control unit 920 may be transmitted to the scanning lens scanned from the three-dimensional scanner 910, and may combine the above scanning lenses to generate a three-dimensional model. In addition, the control unit 920 may control the three-dimensional scanner 910 so as to cause the light projector 911 of the three-dimensional scanner 910 to illuminate a pattern, or to cause the camera 912 at a specific position to operate. In addition, the control unit 920 may detect an unscanned area from an initial three-dimensional model or multiple initial scanning lenses, and may control the rotation and tilt of a fixture on which an object is placed in order to obtain a compensating scanning lens. Exemplarily, the control unit 920 may adjust the direction and angle of the object O relative to at least one camera 912 by controlling the three-dimensional scanner 910.

[0106] Hereinafter, each component structure of the data compensation system 900 will be described in detail.

[0107] The 3D scanner 910 may irradiate a predetermined pattern onto the object O, and may obtain a plurality of initial scanning shots and at least one compensation scanning shot representing the object O. Illustratively, the 3D scanner 910 may include a light projector 911 irradiating a pattern onto a surface of the object.

[0108] The light projector 911 may include: a light source for irradiating light; and a pattern generator for forming a predetermined pattern when the light passes through and irradiates the surface of the object. The pattern generator may be at least one of pattern generating elements including a pattern mask and a DMD. The light projector 911 may irradiate at least two patterns onto the surface of the object using the light source and the pattern generator.

[0109] However, in order to irradiate at least two patterns onto the surface of the object, the light projector 911 can generate a single pattern or multiple patterns. That is, even if the light projector 911 generates a single pattern, it can rotate in one direction and generate at least two patterns by deforming the pattern generating unit in a fixed state.

[0110] Furthermore, the three-dimensional scanner 910 may include at least one camera 912. The camera 912 receives light through a lens, and the light may be generated as a scanning lens by a built-in image sensor. The image sensor may be at least one of existing image sensing devices including a charge coupled device (CCD) sensor and a complementary metal oxide semiconductor (CMOS) sensor.

[0111] In more detail, the camera 912 may be disposed on one side of the light projector 911, and the camera 912 may scan the object irradiated with a predetermined pattern by the light projector 911 to obtain a plurality of initial scanning shots and at least one compensation scanning shot. The configuration relationship between the camera 912 and the light projector 911 will be described later.

[0112] Furthermore, the three-dimensional scanner 910 may include a fixture 913 for placing the object O. For example, the fixture 913 may place the object O on a flat tray, and the fixture 913 may move the object O linearly and / or rotationally. For example, the fixture 913 may move the object O linearly in at least one direction of the up-down direction, the left-right direction, and the front-back direction. As another example, the fixture 913 may move the object O unidirectionally with the z-axis direction as the center. As another example, the fixture 913 may tilt the object O unidirectionally. In this way, the fixture 913 on which the object O is placed may move the object O linearly, rotate, and / or tilt, so that the object O may be scanned at various angles to the camera 912, and a three-dimensional model with a high degree of completion may be obtained.

[0113] The following describes a process of additionally scanning the compensation suggestion portion C when scanning the object O by rotating and tilting the fixture 913 of the three-dimensional scanner 910.

[0114] Fig.15 A portion C for explaining compensation suggestion of an object O corresponding to an unscanned area according to the motion of a fixture 913 of a three-dimensional scanner 910 as one structure of a data compensation system 900 of the present invention, Fig.16 It is used to explain the process of adding the compensation suggestion part C of the scanning object O.

[0115] Reference Fig.14 and Fig.15 The fixture 913 of the three-dimensional scanner 910 can move parallel, rotate and tilt the object O so that the object O has various angles to the camera 912. Fig.15 In part (a), the camera 912 can scan a first portion of the object O at a first angle to obtain a first initial scanning shot. Fig.15 In part (b), the camera 912 of the three-dimensional scanner 910 can scan the second part of the object O at a second angle to obtain a second initial scanning lens. Fig.15In part (c), the camera 912 can scan the third part of the object O at a third angle to obtain a third initial scanning lens. At this time, assuming that the unscanned area is generated due to the second scanning lens, the first scanning lens to the third scanning lens are all obtained when the first pattern is irradiated to the object O. Based on the above assumption, the compensation object initial scanning lens is the second scanning lens, and the compensation recommended part of the object O needs to be additionally scanned to compensate for the unscanned area.

[0116] Reference Fig.14 and Fig.16 The control unit 920 may control the fixture 913 on which the object O is placed so as to rotate or tilt the object O, and the three-dimensional scanner 910 may additionally scan the compensation suggested portion C of the object O to obtain a compensation scanning lens.

[0117] Reference Fig.16 The control unit 920 may control the fixture 913 to enable the camera 912 to scan the fourth part of the object O at a fourth angle, so that the compensation suggestion part C of the object O is more clearly displayed relative to the camera 912. At this time, the pattern irradiated to the object O may be one of the first pattern or the second pattern different from the first pattern. Thus, a compensation scanning lens may be obtained, and a compensation three-dimensional model may be generated by the compensation scanning lens to minimize the unscanned area.

[0118] Reference Fig.16 In part (b), in order to scan the compensation suggestion part C of the object body O using another pattern, the control unit 920 can control the fixture 913 so that the camera 912 can scan the second part of the object body O at a second angle. However, the pattern irradiated to the object body O at this time can be a second pattern different from the first pattern. Thus, a compensation scanning lens can be obtained, and a compensation three-dimensional model can be generated by the compensation scanning lens to minimize the unscanned area. Fig.16 As shown in part (b) of FIG. 1 , when obtaining the compensation scanning lens, there is no need to find a new angle for compensating the unscanned area. By controlling the clamp 913 by the control unit 920 so that the second part of the object O is scanned by the camera 912 at the second angle, there is an advantage that the scanned object O can be quickly compensated. In addition, using a plurality of different patterns for the compensation suggestion part C has an advantage that the unscanned area generated by one pattern can be stably compensated for by irradiating another pattern to obtain the compensation scanning lens.

[0119] In particular, the unscanned area can be generated along the texture direction of the pattern, so that the compensation recommendation part corresponding to the initial scanning lens obtained when the first pattern is irradiated to the object body O can be obtained by scanning the object body O in the same direction and angle as the above-mentioned initial scanning lens when the second pattern is irradiated to the object body O to obtain a compensation scanning lens for compensation.

[0120] Various configuration relationships between the light projector 911 and the camera 912 will be described below.

[0121] Fig.17 The first configuration relationship between the light projector 911 and the camera 912 of the three-dimensional scanner 910 as one structure of the data compensation system 900 of the present invention is described. Fig.18 The second configuration relationship between the light projector 911 and the camera 912 of the three-dimensional scanner 910 as one structure of the data compensation system 900 of the present invention is described. Fig.19 A third configuration relationship between the light projector 911 and the camera 912 of the three-dimensional scanner 910 is used to illustrate one structure of the data compensation system 900 of the present invention.

[0122] Reference Fig.14 and Figures 17 to 19 , at least one camera 912 may be at least a pair. For example, the pair of cameras 912 may include: a first camera 912a, which is arranged on one side of the light projector 911 across the light projector 911; and a second camera 912b, which is arranged on the other side of the light projector 911 facing the one side.

[0123] On the other hand, at least one camera 912 may be arranged in a direction perpendicular to the texture direction of the pattern generated by the light projector 911, so as to easily obtain the depth information of the object O through the pattern illumination of the light projector 911. Fig.17 As shown in part (a) of FIG. 1 , the light projector 911 may generate a pattern in the shape of longitudinal stripes. That is, the texture direction of the pattern generated by the light projector 911 is the up-down direction, and the camera 912 may be arranged in the left-right direction perpendicular to the texture direction of the pattern. Fig.17 As shown exemplarily in part (b) of FIG. 1 , when the light projector 911 generates a pattern in the shape of horizontal stripes, the texture direction of the pattern generated by the light projector 911 is the left-right direction, and the camera 912 can be arranged in the up-down direction perpendicular to the texture direction of the pattern. In particular, when the camera 912 is a pair, the above-mentioned pattern for each camera 912 can be accurately arranged by using the cameras arranged in the direction perpendicular to the texture direction of the pattern, thereby having the advantage of being able to easily obtain the depth information of the object O and to obtain an accurate three-dimensional model (initial three-dimensional model, compensated three-dimensional model).

[0124] On the other hand, in the first configuration relationship, the light projector 911 can generate at least two patterns for illumination respectively. Fig.17 As shown in part (a) of FIG. 1 , the light projector 911 may generate a first pattern (eg, a longitudinal stripe pattern) to illuminate, Fig.17As shown in part (b), a second pattern (eg, a transverse stripe pattern) may be generated for irradiation.

[0125] At this time, according to the shape change of the pattern generated by the light projector 911, the pair of cameras 912a and 912b can be rotated at a specified angle so as to be arranged in a direction perpendicular to the texture direction of the above-mentioned pattern. Illustratively, the three-dimensional scanner 910 may also include a rotating plate 914. The rotating plate 914 can make at least one camera 912 rotate in one direction. The rotating plate 914 is arranged on the bottom surface of the first camera 912a and the second camera 912b, and can make the first camera 912a and the second camera 912b rotate in one direction at the same time. Therefore, even if the pattern generated by the light projector 911 changes, the pair of cameras 912a and 912b can be rotated and moved, so that the depth information of the object O can be easily obtained, and an accurate three-dimensional model can be obtained.

[0126] And, if Fig.18 In the second configuration relationship of the light projector 911 and the camera 912 shown, at least one camera 912 may be two pairs. Exemplarily, the at least one camera 912 may include: a first camera 912a, which is configured at a first side with the light projector 911 as the center; a second camera 912b, which is configured at a second side with the light projector 911 as the center; a third camera 912c, which is configured at a third side opposite to the first side with the light projector 911 as the center; and a fourth camera 912d, which is configured at a fourth side opposite to the second side with the light projector 911 as the center. In this case, the first camera 912a and the third camera 912c may form a pair, and the second camera 912b and the fourth camera 912d may form a pair.

[0127] For example, when the light projector 911 generates a first pattern (e.g., a longitudinal stripe pattern) having a first texture direction (e.g., a vertical direction) for illumination, the first camera 912a and the third camera 912c arranged perpendicularly to the texture direction of the first pattern may be activated to scan the object O, and when the light projector 911 generates a second pattern (e.g., a transverse stripe pattern) having a second texture direction (e.g., a horizontal direction) for illumination, the second camera 912b and the fourth camera 912d arranged perpendicularly to the texture direction of the second pattern may be activated to scan the object O. In this way, by activating the camera 912 arranged perpendicularly to the texture direction of the pattern generated by the light projector 911, it is possible to easily obtain a plurality of initial scanning lenses and at least one compensation scanning lens.

[0128] And, in such Fig.19In the third configuration relationship of the light projector 911 and the camera 912 shown, the light projector 911 can generate a single pattern. Even if the light projector 911 generates a single pattern, it is necessary to change the texture direction of the pattern irradiated by the light projector 911 so as to irradiate at least two patterns to the object body O. Therefore, the light projector 911 can irradiate at least two patterns by rotating unidirectionally relative to the object body O. In this way, the light projector 911 that generates a single pattern rotates unidirectionally relative to the object body O, and even if the pattern generated by the light projector 911 is one, at least two patterns can be irradiated to the object body O, and a compensated three-dimensional model that minimizes the unscanned area can be obtained.

[0129] In order to make the light projector 911 rotate unidirectionally relative to the object O, the rotating plate 914 can rotate the light projector 911 and at least one camera 912 together. Exemplarily, when the light projector 911 irradiates a first pattern (e.g., a longitudinal stripe pattern) having a texture direction in the up-down direction, the first camera 912a and the second camera 912b arranged in a direction perpendicular to the texture direction of the first pattern can scan the object O. On the other hand, when a second pattern (e.g., a transverse stripe pattern) different from the first pattern is irradiated relative to the object O, the rotating plate 914 can rotate the light projector 911 and the camera 912 in a clockwise or counterclockwise direction to realize the second pattern. At this time, the first camera 912a and the second camera 912b are arranged in a direction perpendicular to the left-right direction as the texture direction of the second pattern. Thus, in the three-dimensional scanner 910 having a single pattern, at least two different patterns can also be irradiated to the object O by the rotating action of the rotating plate 914, which has the advantage that the user can obtain a highly completed compensated three-dimensional model that minimizes the unscanned area that can be generated along the texture direction of the pattern.

[0130] The following describes the detailed structure of the control unit 920.

[0131] The control unit 920 may include a database unit 921. The database unit 921 may be at least one of the well-known storage devices including a hard disk drive, a solid state drive, and a flash drive. The database unit 921 may store a plurality of initial scanning lenses obtained through the scanning process of the three-dimensional scanner 910, at least one compensation scanning lens, and may store a variety of logics including logic for comparing scanning lenses, logic for detecting unscanned areas, three-dimensional modeling logic, and logic for controlling the three-dimensional scanner 910.

[0132] The control unit 920 may include a 3D scanner control unit 922. The 3D scanner control unit 922 may control the fixture 913 so as to arrange the object O at the angle set in the initial scanning step. Furthermore, the 3D scanner control unit 922 may control the pattern of the light projector 911 irradiated to the object O when a plurality of initial scanning shots are obtained in the initial scanning step. Furthermore, when a plurality of initial scanning shots are obtained in the initial scanning step, the 3D scanner control unit 922 may activate at least one camera 912 to operate it. Furthermore, the 3D scanner control unit 922 may control the operation of the light projector 911, the camera 912, the fixture 913, and the rotating plate 914 for obtaining at least one compensation scanning shot in the compensation scanning step.

[0133] The control unit 920 may include an alignment unit 923. The alignment unit 923 may align multiple initial scanning lenses and / or at least one compensating scanning lens. In order to align multiple initial scanning lenses and / or at least one compensating scanning lens, a well-known data alignment method may be used. Exemplarily, the alignment unit 923 may align multiple initial scanning lenses and / or at least one compensating scanning lens using an iterative closest point (ICP) method, but is not necessarily limited to the disclosed example.

[0134] The control unit 920 may include a 3D modeling unit 924. The 3D modeling unit 924 may combine a whole row of multiple initial scanning lenses and / or at least one compensation scanning lens to generate a 3D model. For example, the 3D modeling unit 924 may combine a whole row of multiple initial scanning lenses to generate an initial 3D model. Furthermore, the 3D modeling unit 924 may combine at least one compensation scanning lens in the generated initial 3D model to generate a compensated 3D model. Furthermore, the 3D modeling unit 924 may combine multiple initial scanning lenses and at least one compensation scanning lens together to generate a compensated 3D model.

[0135] The control unit 920 may include an unscanned area detection unit 925. The unscanned area detection unit 925 may detect the unscanned area from the initial three-dimensional model generated by the three-dimensional modeling unit 924 or the multiple initial scanning lenses obtained by the three-dimensional scanner 910. In addition, the unscanned area detection unit 925 may determine the compensation object initial scanning lens corresponding to the unscanned area. When the compensation object initial scanning lens is determined by the unscanned area detection unit 925, the three-dimensional scanner control unit 922 controls the fixture 913 of the three-dimensional scanner 910 to move, rotate and tilt the object body O in parallel, so as to clearly display the compensation suggestion part of the object body O corresponding to the compensation object initial scanning lens, and the three-dimensional scanner 910 may obtain an additional compensation scanning lens. The three-dimensional modeling unit 924 may generate a compensation three-dimensional model based on the compensation scanning lens obtained by the three-dimensional scanner 910.

[0136] By generating a compensated three-dimensional model in this way, there is an advantage that the user can design a precise corrective treatment using the compensated three-dimensional model in which the unscanned area is minimized, and the patient can receive the optimal treatment.

[0137] The display unit 930 can visually display at least a part of the control process of the control unit 920. Exemplarily, the display unit 930 can be at least one of the well-known visual display devices including a display, a flat screen, a touch screen, and a projection screen. The display unit 930 can visually display a plurality of initial scanning lenses obtained by the three-dimensional scanner 910 and a three-dimensional model of the object body O generated based on at least one compensation scanning lens (the above-mentioned three-dimensional model may include at least one of the initial three-dimensional model and the compensation three-dimensional model). Thus, the user can easily confirm whether the three-dimensional model is accurately obtained, and can use the above-mentioned three-dimensional model to design an orthodontic treatment that will be suitable for the patient's oral cavity, and can provide the best treatment to the patient.

[0138] The above description is only used to illustrate the technical concept of the present invention. Anyone skilled in the art can make various modifications and variations without departing from the essential characteristics of the present invention.

[0139] Therefore, the embodiments disclosed in the present invention are used to illustrate the technical ideas of the present invention, rather than to limit them, and the scope of the technical ideas of the present invention is not limited to such embodiments. The protection scope of the present invention should be interpreted according to the following invention claims, and should be interpreted as all technical ideas within the scope equivalent to it are included in the invention claims of the present invention.

Claims

1. A data compensation method, characterized in that: include: an initial scanning step of scanning an object body irradiated with a prescribed pattern including a stripe pattern having a stripe extension direction by a three-dimensional scanner to obtain a plurality of initial scanning shots; an unscanned area detection step, detecting the unscanned area based on the multiple initial scanning lenses by a control unit; as well as a compensation scanning step, when the control unit detects the unscanned area, scanning at least a portion of the object body by the three-dimensional scanner to obtain at least one compensation scanning lens, The unscanned area is generated by the stripe extension direction of the stripe pattern. When at least one compensation scanning shot is obtained by the above-mentioned three-dimensional scanner, the above-mentioned compensation scanning shot is obtained by irradiating a stripe pattern having a stripe extension direction different from a prescribed pattern irradiated when the above-mentioned multiple initial scanning shots are obtained by the above-mentioned three-dimensional scanner, while the above-mentioned object body is set in the same direction and at the same angle as the initial scanning shot of the compensation object having the above-mentioned unscanned area.

2. The data compensation method according to claim 1, characterized in that: The plurality of initial scanning lenses obtained in the initial scanning step are obtained in a state where a first pattern is irradiated onto the object. The at least one compensation scanning lens obtained in the compensation scanning step is obtained by irradiating a second pattern different from the first pattern.

3. The data compensation method according to claim 1, characterized in that: At least a portion of the plurality of initial scanning shots obtained in the initial scanning step is obtained in a state where a first pattern is irradiated to the object, and the remaining portion of the plurality of initial scanning shots is obtained in a state where a second pattern different from the first pattern is irradiated to the object, The compensation scanning step includes a different pattern scanning lens obtaining step, in which the compensation scanning lens is obtained by irradiating the object with a pattern different from the pattern irradiated when obtaining an initial scanning lens of the compensation object including the unscanned area.

4. The data compensation method according to claim 3, characterized in that: The plurality of initial scanning lenses respectively indicate different portions of the object and different angles relative to the object.

5. The data compensation method according to claim 3, characterized in that: The above compensation scanning step further includes: a compensation object initial scanning lens determining step, wherein the control unit determines an compensation object initial scanning lens of an image including a compensation suggestion portion corresponding to the unscanned area; and The object body setting step is to set the object body in the same direction and angle as the initial scanning lens of the compensation object by means of the action of the three-dimensional scanner through the control unit.

6. The data compensation method according to claim 1, characterized in that: The unscanned area is detected in the initial three-dimensional model generated by combining the multiple initial scanning lenses. The compensated three-dimensional model representing the object is generated by adding and merging the compensated scanning lens to the initial three-dimensional model.

7. The data compensation method according to claim 1, characterized in that: The unscanned areas are detected relative to the multiple initial scanning lenses, respectively. The compensated three-dimensional model representing the object is generated by combining the plurality of initial scanning lenses and the compensated scanning lens.

8. A data compensation system, used to execute the data compensation method according to any one of claims 1 to 7, characterized in that: include: A three-dimensional scanner, comprising a light projector and at least one camera disposed on one side of the light projector, wherein the at least one camera scans an object body irradiated with a prescribed pattern including a stripe pattern having a stripe extension direction by the light projector to obtain a plurality of initial scanning shots and at least one compensation scanning shot; A control unit connected to the three-dimensional scanner, and adjusting the direction and angle of the object relative to the at least one camera by controlling the three-dimensional scanner; as well as A display unit displays a three-dimensional model of the object generated based on the plurality of initial scanning lenses and at least one compensation scanning lens obtained by the three-dimensional scanner, The control unit determines an initial scanning lens of a compensation object having an unscanned area generated by the stripe extension direction of the stripe pattern, When the above-mentioned object body is set in the same direction and angle as the initial scanning lens of the compensation object having the above-mentioned unscanned area, the above-mentioned compensation scanning lens is obtained by irradiating a stripe pattern having a stripe extension direction different from the prescribed pattern irradiated when the above-mentioned multiple initial scanning lenses are obtained by the above-mentioned three-dimensional scanner.

9. The data compensation system according to claim 8, characterized in that: The light projector irradiates at least two patterns with respect to the object.

10. The data compensation system according to claim 9, characterized in that: The light projector generates the at least two patterns respectively for illumination.

11. The data compensation system according to claim 9, characterized in that: The light projector generates a single pattern and illuminates the at least two patterns by unidirectionally rotating relative to the object.

12. The data compensation system according to claim 8, characterized in that: The at least one camera is arranged along a direction perpendicular to a texture direction of the pattern generated by the light projector.

13. The data compensation system according to claim 12, characterized in that: The at least one camera is a pair, A pair of cameras is arranged on one side and on the other side facing the one side across the light projector.

14. The data compensation system according to claim 8, characterized in that: The three-dimensional scanner further comprises a rotating plate, and the rotating plate enables the at least one camera to rotate in one direction.

15. The data compensation system according to claim 14, characterized in that: The rotating plate and the at least one camera together cause the light projector to rotate in one direction.

16. The data compensation system according to claim 12, characterized in that: The at least one camera comprises: A first camera is arranged on a first side with the light projector as the center; A second camera is arranged on a second side with the light projector as the center; a third camera, arranged at a third side facing the first side with the light projector as the center; and a fourth camera, arranged at a fourth side facing the second side with the light projector as the center, When the light projector generates a first pattern with a first texture direction for illumination, the first camera and the third camera are activated; when the light projector generates a second pattern with a second texture direction for illumination, the second camera and the fourth camera are activated.

17. The data compensation system according to claim 8, characterized in that: The control unit controls the fixture on which the object is placed in the three-dimensional scanner to rotate or tilt the object, so that the three-dimensional scanner obtains the multiple initial scanning lenses and the at least one compensation scanning lens.

Images