Apparatus and method for generating and modifying edge lines in real-time

Abstract

Disclosed are an apparatus and method for generating and modifying an edge line in real time. A method performed by an electronic device may include the steps of: determining an initial point on a three-dimensional oral model; determining a first search direction from an initial point based on curvature information related to the three-dimensional oral cavity model; based on the curvature information and the first search direction, multiple first search points on the three-dimensional oral cavity model are sequentially determined, and each first search point in the multiple first search points is determined based on the curvature information and one or more recently determined first search points; and generating an edge line indicating a closed path on the three-dimensional oral cavity model based on the plurality of first search points.

Description

TECHNICAL FIELD

[0001] The technical idea of the present disclosure relates to an apparatus and method for generating and modifying a margin line in real time, and more particularly, to an apparatus and method for generating and modifying a margin line of a tooth in real time based on a three-dimensional image of a mouth received from a three-dimensional scanner (3D scanner). BACKGROUND

[0002] Generally, in order to acquire information of a patient's mouth, a three-dimensional scanner that is inserted into the patient's mouth and collects images of the mouth can be used. For example, a doctor can insert a three-dimensional scanner into the patient's mouth, scan the patient's teeth, gums, and / or soft tissue, thereby acquiring a plurality of two-dimensional images of the patient's mouth, and by applying a three-dimensional modeling technique, a three-dimensional image of the patient's mouth can be constructed using the two-dimensional images (2D) of the patient's mouth.

[0003] Meanwhile, artificial structures such as dental prostheses can be used as a method of treating a patient's teeth. In the process of making a prosthesis, an important pre-treatment operation is to construct a margin line. The margin line serves to define a boundary between a portion (outer surface) exposed to the outside when the prosthesis is inserted into the patient's mouth and the remaining portion (inner surface), and can play a decisive role in whether the prosthesis is in good contact and support with the patient's oral structure. In particular, prostheses such as inlays, veneers, etc. can have many curved surfaces, and thus, the operation of precisely modifying the margin line can require a large amount of time when frequently performed. At present, there is not yet sufficient provision of technology for automatically generating a margin line and modifying the margin line. SUMMARY

[0004] TECHNICAL PROBLEM

[0005] The technical idea of the present disclosure aims to provide an apparatus and method for generating a margin line of a tooth and modifying the margin line in real time.

[0006] TECHNICAL SOLUTION

[0007] According to one aspect of the technical concept of this disclosure, a method performed by an electronic device may include: identifying an initial point on a three-dimensional oral cavity model; determining a first search direction from the initial point based on curvature information of the three-dimensional oral cavity model; sequentially determining a plurality of first search points on the three-dimensional oral cavity model based on the curvature information and the first search direction, wherein each of the plurality of first search points is determined based on the curvature information and at least one most recently determined first search point; and generating a margin line indicating a closed path on the three-dimensional oral cavity model based on the plurality of first search points.

[0008] According to one aspect of the present disclosure, an electronic device may include: one or more processors; and one or more memories storing instructions that are executed by the one or more processors, wherein, when the instructions are executed by the one or more processors, the one or more processors may be configured to perform one of the methods according to one aspect of the present disclosure.

[0009] According to one aspect of the present disclosure, a non-transitory computer-readable recording medium is capable of recording instructions that, when executed by one or more processors, cause the one or more processors to perform an operation, wherein the instructions can be configured to cause the one or more processors to perform one of the methods according to one aspect of the present disclosure.

[0010] Beneficial effects

[0011] According to exemplary embodiments of this disclosure, an apparatus and method can automatically and rapidly generate tooth edge lines based on three-dimensional images of the oral cavity.

[0012] According to an exemplary embodiment of this disclosure, an apparatus and method allow a user to modify edge lines in real time by performing minimal operations while viewing areas where errors occur during the edge line generation process.

[0013] According to exemplary embodiments of this disclosure, an apparatus and method can perform edge line operations for manufacturing restorations quickly and efficiently by automatically generating and modifying edge lines in real time.

[0014] The effects obtainable from the exemplary embodiments of this disclosure are not limited to those mentioned above. Those skilled in the art to which the exemplary embodiments of this disclosure pertain can clearly deduce and understand other unmentioned effects from the following description. That is, those skilled in the art can also deduce from the exemplary embodiments of this disclosure unintended effects resulting from practicing the exemplary embodiments of this disclosure. Attached Figure Description

[0015] Figure 1 This is a schematic diagram illustrating a system for acquiring scan data using a 3D scanner 200 according to an exemplary embodiment of the present disclosure.

[0016] Figure 2 This is a block diagram of an electronic device 100 and a 3D scanner 200 according to exemplary embodiments of the present disclosure.

[0017] Figure 3 This is a perspective view of a 3D scanner 200 according to an exemplary embodiment of the present disclosure.

[0018] Figure 4a and Figure 4b This is a schematic diagram showing maxillary scan data 301, mandibular scan data 302, and bimaxillary scan data 300 of an oral cavity structure according to an exemplary embodiment of the present disclosure.

[0019] Figure 5 This is a schematic diagram illustrating the process of identifying an initial point for edge line generation according to an exemplary embodiment of the present disclosure.

[0020] Figure 6 This is a schematic diagram illustrating curvature information of a three-dimensional oral cavity model according to an exemplary embodiment of the present disclosure.

[0021] Figure 7a , Figure 7b and Figure 7c This is a schematic diagram illustrating a plurality of first search points, a plurality of second search points, and an initial closed path according to an exemplary embodiment of the present disclosure.

[0022] Figure 8a and Figure 8b This is a schematic diagram illustrating the generation of edge lines according to an exemplary embodiment of the present disclosure.

[0023] Figure 9 This is a flowchart illustrating a method for generating edge lines according to an exemplary embodiment of the present disclosure.

[0024] Figure 10 This is a flowchart illustrating a method for sequentially determining search points according to an exemplary embodiment of the present disclosure.

[0025] Figure 11 This is a flowchart illustrating a method for generating edge lines according to an exemplary embodiment of the present disclosure.

[0026] Figure 12 This is a flowchart illustrating a method for generating edge lines indicating closed paths according to an exemplary embodiment of the present disclosure.

[0027] Figure 13a , Figure 13b , Figure 13cand Figure 13d This is a schematic diagram illustrating a method for modifying edge lines according to an exemplary embodiment of the present disclosure.

[0028] Figure 14 This is a flowchart illustrating a method for modifying edge lines according to an exemplary embodiment of the present disclosure.

[0029] Figure 15 This is a flowchart illustrating a method for modifying an edge line based on a target line segment according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0030] The various embodiments described in this disclosure are illustrated in order to illustrate the technical concept of this disclosure and are not intended to limit this disclosure to any particular embodiment. The technical concept of this disclosure includes various modifications, equivalents, and alternatives to each embodiment of this disclosure, and includes embodiments that optionally combine all or part of each embodiment. Furthermore, the scope of the technical concept of this disclosure is not limited to the various embodiments described below and their detailed descriptions.

[0031] The terminology used in this disclosure, including technical and scientific terms, should have the meaning as understood by one of ordinary skill in the art to which this disclosure pertains, unless otherwise defined.

[0032] In this disclosure, expressions such as “comprising,” “including,” “may include,” “configured with,” “may be configured with,” “have,” and “may have” imply the presence of subject features (such as functions, operations, or components) but do not exclude the presence of other additional features. That is, such expressions should be understood as open-ended terms that imply the possibility of including other embodiments.

[0033] The singular form used in this disclosure may include the plural meaning unless otherwise stated. The same applies to the singular expressions set forth in the claims.

[0034] The terms "first," "second," etc., used in this disclosure are used to distinguish different objects when referring to multiple objects, unless the context otherwise requires. Furthermore, these terms do not restrict the order or importance of the respective objects.

[0035] In this disclosure, expressions such as “A, B and C”, “A, B or C”, “A, B and / or C”, “at least one of A, B and C”, “at least one of A, B or C”, “at least one of A, B and / or C”, “at least one selected from A, B and C”, “at least one selected from A, B or C”, “at least one selected from A, B and / or C” can be used to refer to each of the listed items or any possible combination of the listed items. For example, “at least one selected from A and B” can refer to: (1) A; (2) at least one A; (3) B; (4) at least one B; (5) at least one A and at least one B; (6) at least one of A and B; (7) at least one of B and A; (8) both A and B.

[0036] The expressions “based on” or “according to” used in this disclosure are used to describe one or more factors that influence a decision, judgment activity or operation, which are described in phrases or sentences containing the relevant expressions, and the above expressions do not exclude other factors that may influence the decision, judgment activity or operation.

[0037] In this disclosure, expressions such as “connected” or “coupled” to a particular component (e.g., a first component) and another component (e.g., a second component) may mean that the particular component can be directly connected or coupled to the other component, or can be connected or coupled through another intermediate component (e.g., a third component).

[0038] In this disclosure, the phrase "configured to" encompasses various meanings in different contexts, including "set up to," "possess the ability to," "become," "make," "perform," and "enable." This phrase is not limited to the meaning of "specifically designed for hardware." For example, a processor configured to perform a specific operation can be a special-purpose computer designed through programming to perform that specific operation.

[0039] Figure 1 This is a schematic diagram illustrating a system for acquiring scan data using a 3D scanner 200 according to an exemplary embodiment of the present disclosure.

[0040] According to an embodiment, the 3D scanner 200 can be a dental medical device for acquiring scan data of the surface of a target subject 20. Here, the surface of the target subject 20 can be the inner surface of the oral cavity of the target subject 20.

[0041] For example, the 3D scanner 200 may include an intraoral scanner. For example, a user 10 (e.g., a dentist or dental hygienist) can use the 3D scanner 200 to obtain scan data of the intraoral structures of a subject 20 (e.g., a patient).

[0042] For example, user 10 can obtain images of the intraoral structures of subject 20 from a diagnostic model (e.g., a plaster model or an impression model) molded based on the shape of the intraoral structures of subject 20.

[0043] For ease of explanation, the following description describes obtaining scan data of the intraoral structures of subject 20 by scanning the intraoral structures of subject 20, but this disclosure is not limited thereto. Scan data of other parts of subject 20 may also be obtained.

[0044] For example, the 3D scanner 200 may have a shape that can be inserted into and withdrawn from the oral cavity, and may be a handheld scanner that allows the user 10 to freely adjust the scanning distance and scanning angle.

[0045] In one embodiment, the 3D scanner 200 can be inserted into the oral cavity of the subject 20 to scan the oral cavity in a non-contact manner, thereby acquiring scan data of the oral cavity structure.

[0046] For example, scan data of oral structures are presented as images, including a dental region consisting of at least one tooth, a gingival region, and artificial structures that can be inserted into the oral cavity. Here, artificial structures may include orthodontic appliances containing brackets and archwires, restorations such as inlays and veneers, implants, dentures, orthodontic aids inserted into the oral cavity, occlusal plates, etc.

[0047] For example, the 3D scanner 200 may use a light source (or spotlight) to emit light into the oral cavity of the subject 20. As a specific example, the 3D scanner 200 may emit light into at least a portion of the oral cavity (e.g., the tooth area or gingival area) and receive the light reflected from the subject 20's oral cavity via a camera (or image sensor). As another example, the 3D scanner 200 may acquire scan data of intraoral structures by scanning a diagnostic model of the oral cavity. If the diagnostic model of the oral cavity is a diagnostic model based on the intraoral structures of the subject 20, then the scan data of the diagnostic model of the oral cavity may be scan data of the intraoral structures of the subject 20. For ease of illustration, the following description will assume the acquisition of scan data of intraoral structures by scanning the oral cavity of the subject 20, but this disclosure is not limited thereto.

[0048] In one embodiment, the 3D scanner 200 can acquire two-dimensional scan data of the intraoral structures of the subject 20 based on information received via a camera. Here, the two-dimensional scan data of the intraoral structures can be presented as two-dimensional images of the intraoral structures.

[0049] For example, two-dimensional scan data of the intraoral structures of subject 20 can be presented as a two-dimensional image, which includes the dental area, gingival area, artificial structures, tongue, etc. in the oral cavity of subject 20.

[0050] In this embodiment, two-dimensional scan data of the oral cavity structure acquired from the 3D scanner 200 can be transmitted to the electronic device 100 via a wired or wireless communication network.

[0051] For example, electronic device 100 may be a computer device or a portable communication device. Electronic device 100 may generate three-dimensional scan data of the intraoral structure based on two-dimensional scan data of the intraoral structure received from three-dimensional scanner 200, the three-dimensional scan data representing the intraoral structure in a three-dimensional manner. As a specific example, electronic device 100 may generate three-dimensional scan data of the intraoral structure by performing three-dimensional modeling on the received two-dimensional scan data of the intraoral structure.

[0052] In this embodiment, the 3D scanner 200 can scan the intraoral structures of the subject 20 to obtain two-dimensional scan data of the intraoral structures, and generate three-dimensional scan data of the intraoral structures based on the two-dimensional scan data. That is, the 3D scanner 200 can generate three-dimensional scan data of the intraoral structures and transmit it to the electronic device 100.

[0053] In this embodiment, the electronic device 100 may be connected to a cloud server (not shown) or a database (not shown).

[0054] For example, electronic device 100 can transmit two-dimensional or three-dimensional scan data of the intraoral structure of subject 200 to a cloud server or database, and the cloud server or database can store the two-dimensional or three-dimensional scan data of the intraoral structure of subject 200 received from electronic device 100.

[0055] Although the above description of the 3D scanner 200 focuses on a handheld scanner, this disclosure can also be applied to desktop scanners used in a fixed location. That is, the method proposed in this disclosure can also be implemented with a desktop scanner. A desktop scanner can generate 3D scan data of a diagnostic model of the oral cavity by scanning the model. Because the light source (or spotlight) and camera of the desktop scanner are fixed, the user 10 can scan the diagnostic model of the oral cavity while moving the model.

[0056] Figure 2This is a block diagram of an electronic device 100 and a 3D scanner 200 according to exemplary embodiments of the present disclosure.

[0057] In this embodiment, the electronic device 100 and the 3D scanner 200 can communicate with each other via wired or wireless communication networks and can send and receive various data from each other.

[0058] In embodiments, the 3D scanner 200 may include at least one of a processor 201, a memory 202, a communication circuit 203, a light source 204, a camera 205, an input device 206, and a sensor module 207. At least one component included in the 3D scanner 200 may be omitted, or other components may be added to the 3D scanner 200. Alternatively, some components may be integrated and implemented, or implemented as a single or multiple entities. At least some components in the 3D scanner 200 may be interconnected via a bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI) to send and receive data and / or signals.

[0059] In this embodiment, the processor 201 of the 3D scanner 200 corresponds to a component capable of performing calculations or data processing and is operatively connected to the components of the 3D scanner 200, wherein the calculations or data processing are used for the control or communication of each component of the 3D scanner 200. The processor 201 may load commands or data received from other components of the 3D scanner 200 into a memory 202, process the commands or data stored in the memory 202, and store the resulting data.

[0060] In an embodiment, the memory 202 of the 3D scanner 200 may store at least one instruction for operation of the processor 201.

[0061] In an embodiment, the communication circuit 203 of the 3D scanner 200 can establish a wired or wireless communication channel with an external device including the electronic device 100, and send various data to and receive various data from the external device.

[0062] For example, communication circuit 203 may include at least one port for connecting to an external device via a wired cable to communicate with the external device in a wired manner. In this case, communication circuit 203 can communicate with the wired external device through at least one port.

[0063] For example, the communication circuit 203 may include a cellular communication module and may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or WiMAX).

[0064] For example, communication circuit 203 may include a short-range communication module to send and receive data to and from an external device including electronic device 100 using short-range communication (e.g., Wi-Fi, BLE (Bluetooth, Bluetooth Low Energy) or UWB).

[0065] For example, communication circuit 203 may include a contactless communication module for contactless communication. As a specific example, contactless communication may include at least one contactless short-range communication technology, such as near field communication (NFC), radio frequency identification (RFID), or magnetic secure transmission (MST).

[0066] In this embodiment, the light source 204 of the 3D scanner 200 can emit light into the oral cavity of the subject 20. For example, the light emitted from the light source 204 can be structured light with a predetermined pattern. As a specific example, the predetermined pattern can be a stripe pattern of consecutively appearing straight lines of different colors. The pattern of the structured light can be generated using a pattern mask or a digital micro-mirror device (DMD), but is not limited thereto.

[0067] In an embodiment, the camera 205 of the 3D scanner 200 can acquire two-dimensional scan data of the intraoral structure of the subject 20 by receiving reflected light reflected by the intraoral structure of the subject 20.

[0068] For example, camera 205 may include a left camera corresponding to the left eye's field of view and a right camera corresponding to the right eye's field of view to construct three-dimensional scan data according to optical triangulation. For example, camera 205 may include at least one image sensor, such as a CCD sensor or a CMOS sensor.

[0069] In an embodiment, the input device 206 of the 3D scanner 200 may receive user input for controlling the 3D scanner 200. For example, the input device 206 may include at least one of the following: a button for receiving a push operation from the user 10, a touch panel for detecting the user 10's touch, or a voice recognition device including a microphone. For example, the user 10 may use the input device 206 to control the start or stop of the scan.

[0070] In this embodiment, the sensor module 207 of the 3D scanner 200 can detect the operating state of the 3D scanner 200 or the external environmental state (e.g., user movement) and generate an electrical signal corresponding to the detected state. For example, the sensor module 207 may include at least one of a gyroscope sensor, an accelerometer, a gesture sensor, a proximity sensor, or an infrared sensor.

[0071] For example, user 10 can control the start or stop of scanning using sensor module 207. As a specific example, when user 10 holds and moves the 3D scanner 200, the 3D scanner 200 can control processor 201 to start scanning operation when the angular velocity measured by sensor module 207 exceeds a predetermined threshold.

[0072] In an embodiment, the 3D scanner 200 may initiate a scan in response to receiving user input to initiate a scan via the input device 206 of the 3D scanner 200 or the input device 109 of the electronic device 100.

[0073] In an embodiment, the 3D scanner 200 may begin scanning based on the processing of the processor 201 of the 3D scanner 200 or the processor 101 of the electronic device 100.

[0074] In an embodiment, when user 10 scans the intraoral structure of subject 20 using 3D scanner 200, 3D scanner 200 can generate 2D scan data of the intraoral structure of subject 20 and transmit the 2D scan data of the intraoral structure of subject 20 to electronic device 100 in real time.

[0075] For example, the electronic device 100 can display a two-dimensional image of the intraoral structure presented by the received two-dimensional scan data of the intraoral structure of the subject 20 on the display 107.

[0076] For example, electronic device 100 can generate three-dimensional scan data of the intraoral structures of subject 20 based on two-dimensional scan data of the intraoral structures of subject 20. Furthermore, electronic device 100 can display a three-dimensional image of the intraoral structures presented by the received three-dimensional scan data of the intraoral structures of subject 20 on display 107. Electronic device 100 can also display the generation process of the three-dimensional scan data of the intraoral structures in real time on display 107.

[0077] For example, electronic device 100 can generate data on an intraoral fixation device that can be mounted on at least a portion of the intraoral structure based on three-dimensional scan data of the intraoral structure of subject 20. Here, the intraoral fixation device can be a fixation device (equipment) designed for various purposes such as fixing a patient's teeth, orthodontic treatment, and dental protection, and can be installed inside the patient's oral cavity. For example, an intraoral fixation device can be considered as a dental fixation device for fixing a patient's teeth, an orthodontic treatment device for correcting a patient's teeth, a dental protection device for protecting a patient's teeth, etc. However, this disclosure is not limited to this. "Intraoral fixation device" is a term encompassing various devices that can be installed inside the oral cavity, and even if it is referred to by other terms with the same or similar meaning, embodiments of this disclosure can be applied to such devices. The data on the intraoral fixation device can be presented as an image of the shape of the intraoral fixation device.

[0078] The electronic device 100 can display an image of the shape of the intraoral fixation device on the display 107. The electronic device 100 can also display the data generation process of the intraoral fixation device in real time on the display 107. Furthermore, the electronic device 100 can display an image of the shape of the intraoral fixation device on an external display connected by wired or wireless means.

[0079] In embodiments, electronic device 100 may include at least one of one or more processors 101, one or more memories 103, communication circuitry 105, a display 107, and an input device 109. At least one component included in electronic device 100 may be omitted, or other components may be added to electronic device 100. Alternatively, some components may be integrated and implemented, or implemented as a single or multiple entities. At least some components within electronic device 100 may be interconnected via buses, GPIO, SPI, MIPI, etc., and exchange signals or data with each other.

[0080] In an embodiment, one or more processors 101 of the electronic device 100 may be configured to perform operations or data processing related to the control or communication of each component of the electronic device 100.

[0081] For example, one or more processors 101 may be operatively connected to components of electronic device 100. One or more processors 101 may load commands or data received from other components of electronic device 100 into one or more memories 103, process the commands or data stored in one or more memories 103, and store the resulting data.

[0082] In an embodiment, one or more memories 103 of the electronic device 100 may store at least one instruction for operation of one or more processors 101. For example, one or more memories 103 may store data received from the 3D scanner 200 (e.g., two-dimensional or three-dimensional scan data of intraoral structures).

[0083] In this embodiment, the communication circuit 105 of the electronic device 100 can establish a wired or wireless communication channel with an external device, including at least one of a 3D scanner 200, a cloud server (not shown), a printer, etc., and can send and receive various data to and from the external device. For example, the communication circuit 105 may include at least one port for connecting to the external device via a wired cable to communicate with the external device in a wired manner. In this case, the communication circuit 105 can communicate with the wired external device through at least one port.

[0084] For example, the communication circuit 105 may include a cellular communication module and may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or WiMAX).

[0085] For example, the communication circuit 105 may include a short-range communication module to send and receive data from an external device, including at least one of a 3D scanner 200, a cloud server (not shown), a printer, etc., using short-range communication (e.g., Wi-Fi, BLE, UWB).

[0086] For example, the communication circuit 105 may include a contactless communication module for contactless communication. As a specific example, the contactless communication may include at least one contactless short-range communication technology such as NFC communication, RFID communication, or MST communication.

[0087] In embodiments, the display 107 of the electronic device 100 may display various screens based on the control of the processor 101. For example, the processor 101 of the electronic device 100 may control the components of the electronic device 100 to display two-dimensional or three-dimensional scan data of the intraoral structures of the subject 20 via the display 107. For example, the processor 101 may control the components of the electronic device 100 to display data on an intraoral fixation device that can be installed on at least a portion of the oral cavity of the subject 20 via the display 107.

[0088] For example, the display 107 of the electronic device 100 may display an execution screen for a specific application, and this execution screen may display two-dimensional or three-dimensional scan data of intraoral structures. Furthermore, the execution screen may display data of the intraoral fixation device. Here, the electronic device 100 may be equipped with a web browser or application for executing the specific application. The user 10 can edit, save, and delete the two-dimensional or three-dimensional scan data of the intraoral structures displayed on the display 107 using the input device 109. Additionally, the user 10 can use the input device 109 to edit, save, and delete data of the intraoral fixation device displayed on the display 107.

[0089] In an embodiment, the input device 109 of the electronic device 100 may receive commands or data from an external source (e.g., user 10) to be used by components of the electronic device 100 (e.g., one or more processors 101). For example, the input device 109 may be combined with a display 107 and implemented in the form of a touch sensor panel capable of recognizing the touch or proximity of various external objects.

[0090] Figure 3 This is a perspective view of a 3D scanner 200 according to an exemplary embodiment of the present disclosure.

[0091] In an embodiment, the 3D scanner 200 may include a body 210 and a probe tip 220. For example, the body 210 may have a shape that is easy for a user 10 to hold. For example, the probe tip 220 may have a shape that is easy to insert into and withdraw from the mouth of the subject 20. For example, the body 210 may be coupled to and detached from the probe tip 220. For example, the body 210 may have a [missing information - likely a component or feature] disposed therein. Figure 2 The components of the 3D scanner 200 described in section a.

[0092] For example, one end of the main body 210 may have an opening, allowing light emitted from the light source 204 to be emitted into the oral cavity of the subject 20. The light emitted through the opening can be reflected by the intraoral structures of the subject 20 and then enter through the opening again. The reflected light entering through the opening can be captured by the camera 205 to generate two-dimensional scan data of the intraoral structures of the subject 20.

[0093] For example, user 10 can begin scanning by using input device 206 (e.g., a button) of 3D scanner 200. As a specific example, when user 10 touches or presses input device 206, light can be emitted from light source 204 to subject 20.

[0094] In one embodiment, user 10 can scan the intraoral structures of subject 20 while the 3D scanner 200 is in motion, and the 3D scanner 200 can acquire two-dimensional scan data of the intraoral structures of subject 20.

[0095] In this embodiment, the user can scan a diagnostic model inside the oral cavity of the subject 20 while the mobile 3D scanner 200 is in operation, and can acquire two-dimensional scan data of the diagnostic model during this process. Here, the two-dimensional scan data of the diagnostic model can be presented as an image of the shape of the intraoral structures.

[0096] For example, two-dimensional scan data of intraoral structures can be presented as two-dimensional images containing the region of the subject's 20 anterior teeth, two-dimensional images containing the region of the subject's 20 molars, etc.

[0097] For example, the 3D scanner 200 can transmit the acquired 2D scan data to the electronic device 100. In this case, the electronic device 100 can generate 3D scan data of the intraoral structures based on the received 2D scan data. Here, the 3D scan data of the intraoral structures may include at least one of the maxillary scan data, mandibular scan data, or bimaxillary (occlusal) scan data of the intraoral structures.

[0098] Figure 4a and Figure 4b This is a schematic diagram showing maxillary scan data 301, mandibular scan data 302, and bimaxillary scan data 300 of an oral cavity structure according to an exemplary embodiment of the present disclosure.

[0099] In this embodiment, the three-dimensional scan data of the subject 20's surface may include at least one of maxillary scan data 301, mandibular scan data 302, or bimaxillary scan data 300. Here, the surface of the subject 20 may include the surface of the intraoral structures of the subject 20.

[0100] In an embodiment, the maxillary scan data 301 may be three-dimensional scan data of the maxillary surface, which is generated based on two-dimensional scan data obtained by scanning the maxillary surface within the oral cavity. For example, the maxillary scan data 301 may represent the tooth region 311 and the gingival region 321 within the maxilla. For example, based on the maxillary scan data 301, data for an intraoral fixation device that can be installed in the maxilla within the oral cavity can be generated.

[0101] In an embodiment, the mandibular scan data 302 may be three-dimensional scan data of the mandibular surface, generated based on two-dimensional scan data obtained by scanning the mandibular surface within the oral cavity. For example, the mandibular scan data 302 may represent the tooth region 312 and the gingival region 322 within the mandible. For example, based on the mandibular scan data 302, data for an intraoral fixation device that can be installed in the mandible within the oral cavity can be generated.

[0102] In an embodiment, the bimaxillary scan data 300 can be three-dimensional scan data of the bimaxillary surfaces, generated based on two-dimensional scan data obtained by scanning the maxillary and mandibular surfaces within the oral cavity. Alternatively, the bimaxillary scan data 300 can be generated based on maxillary scan data 301 and mandibular scan data 302. That is, the bimaxillary scan data 300 can be scan data representing an image synthesized from the image represented by maxillary scan data 301 and the image represented by mandibular scan data 302. For example, based on this bimaxillary scan data 300, data for an intraoral fixation device that can be simultaneously installed in the maxilla and mandible within the oral cavity can be generated.

[0103] The data processing method proposed in this disclosure will continue to be described below, assuming that the data for the intraoral fixation device is generated based on the mandibular scan data 302. However, this is only for illustrative purposes, and the embodiments of this disclosure are not limited thereto. That is, the following description can also be applied to cases where the data for the intraoral fixation device is generated based on the maxillary scan data 301 or the bimaxillary scan data 300.

[0104] Figure 5 This is a schematic diagram illustrating the process of identifying an initial point for edge line generation according to an exemplary embodiment of the present disclosure.

[0105] Specifically, Figure 5 A first tooth model (Tx) on an exemplary three-dimensional oral cavity model is shown, and this three-dimensional oral cavity model can be displayed on the display 107 of the electronic device 100 or an external display. This three-dimensional oral cavity model can be an example of the aforementioned three-dimensional scan data. The first tooth model (Tx) can represent a portion of the tooth data constituting the aforementioned bimaxillary scan data 300.

[0106] Electronic device 100 can identify an initial point P0 on a dental model. This initial point P0 can be used as the initial position for generating edge lines, as described below. According to an embodiment, electronic device 100 can identify the initial point P0 by receiving input from an externally designated initial point P0. This externally designated initial point P0 can be a point specified by an external user, or it can be a point suitable for generating edge lines derived by an external computing device or the like. Furthermore, electronic device 100 can identify the initial point P0 by internally calculating and deriving a suitable point through a configuration of processor 101 and memory 103, etc. For example, the initial point P0 can be derived using computational operations utilizing artificial intelligence (AI), and the initial point P0 can be identified based on the curvature information of the dental model.

[0107] According to an embodiment, the initial point P0 may be located in the region on the first tooth model Tx where the edge line is to be formed. Here, the edge line may refer to the edge line formed between the artificial structure, such as the restoration, and the tooth. The edge line may indicate the boundary between the inner and outer surfaces of the restoration of a specific tooth in the target oral cavity represented by the three-dimensional oral cavity model. The outer surface of the restoration may be the portion exposed when the restoration is actually inserted into the target oral cavity, and the inner surface of the restoration may be the portion not exposed when the restoration is actually inserted into the target oral cavity. Here, the edge line may refer to a line spaced at a certain distance from the boundary line between the artificial structure and the tooth, taking into account the thickness or step of the artificial structure, such as the restoration. According to an embodiment, the initial point P0 may be located in the region on the first tooth model Tx where the edge line is to be formed, for example, in the region where the artificial structure is to be inserted and has a large curvature on the tooth surface.

[0108] Electronic device 100 can identify an initial point P0 and determine the search direction for generating edge lines. The methods used by electronic device 100 to determine the search direction and search point will be referenced below. Figure 6 Please provide a detailed description.

[0109] Figure 6 This is a schematic diagram of the curvature information of a three-dimensional oral cavity model according to an exemplary embodiment of the present disclosure.

[0110] Specifically, Figure 6 It shows Figure 5 This is a schematic diagram of the curvature information of a portion of the first tooth model Tx. The curvature information can be derived from data about the three-dimensional oral cavity model, or it can be input externally as curvature information corresponding to the three-dimensional oral cavity model. The curvature information about the three-dimensional oral cavity model may include the principal curvature values ​​of the points forming the surfaces of the oral cavity model. According to an embodiment, the curvature information can be displayed via the display 107 of the electronic device 100 or an external display; however, the curvature information does not necessarily need to be displayed, and the process of displaying the curvature information via a display can be omitted. Furthermore, the electronic device 100 can display the curvature information on the display in response to a request received from an external source. According to an embodiment, the display of the curvature information can represent the curvature distribution on the surfaces of the oral cavity model using different colors or shadows.

[0111] The electronic device 100 can determine a search direction from an identified initial point P0 based on the curvature information of a three-dimensional oral cavity model. For example, the electronic device 100 can identify points on the oral cavity model adjacent to the initial point P0, and identify points on the oral cavity model adjacent to the initial point P0 that satisfy a predetermined curvature reference. According to an embodiment, the electronic device 100 can determine the search direction as the direction from the initial point P0 toward the point with the largest curvature among a plurality of points on the oral cavity model adjacent to the initial point P0. Furthermore, according to an embodiment, the electronic device 100 can determine the search direction as the direction from the initial point P0 to the opposite point of the point with the largest curvature among a plurality of points on the oral cavity model adjacent to the initial point P0. Details regarding the determination of the search direction and the search of search points will be referred to below. Figure 7a to Figure 7c Describe it.

[0112] Figure 7a , Figure 7b and Figure 7c This is a schematic diagram illustrating a plurality of first search points, a plurality of second search points, and an initial closed path according to an exemplary embodiment of the present disclosure.

[0113] Specifically, Figure 7a A plurality of first search points located along a first search direction according to an exemplary embodiment of the present disclosure are shown; Figure 7b A plurality of second search points located along a second search direction according to an exemplary embodiment of the present disclosure are shown; Figure 7c An initial closed path according to an exemplary embodiment of this disclosure is shown. Hereinafter, it will be described with reference to the above-described drawings. Figure 7a , Figure 7b and Figure 7c And descriptions that overlap with the above description will be omitted.

[0114] refer to Figure 7a and Figure 7bAccording to an embodiment, the electronic device 100 can determine a first search direction as the direction from the initial point P0 toward the point with the largest curvature among a plurality of points adjacent to the initial point P0 on the oral model. Furthermore, according to an embodiment, the electronic device 100 can determine a second search direction as the direction from the initial point P0 to the opposite point of the point with the largest curvature among a plurality of points adjacent to the initial point P0 on the oral model. In other words, the electronic device 100 can determine a direction opposite to or opposite to the first search direction as the second search direction. Alternatively, the electronic device 100 can determine a second search direction as the direction from the initial point P0 to the point with the second largest curvature among a plurality of points adjacent to the initial point P0 on the oral model. Furthermore, according to an embodiment, the electronic device 100 can determine a second search direction as the direction from the initial point P0 toward the point with the largest curvature among the points adjacent to the initial point P0 on the oral model. The first search direction and the second search direction can be directions of movement from the initial point P0 in different directions. The method for determining the first search direction and the second search direction is exemplary; other methods suitable for generating edge lines can also be used.

[0115] According to an embodiment, the electronic device 100 can sequentially determine a plurality of first search points L1 on a three-dimensional oral cavity model based on curvature information and a first search direction. For example, the electronic device 100 can determine each of the plurality of first search points based on curvature information and one or more recently determined first search points.

[0116] Specifically, according to an embodiment, the electronic device 100 may update the first search direction based on one or more recently determined first search points. For example, the electronic device 100 may update the first search direction based on six points preceding the current search point. These preceding six points are merely exemplary values, and the search direction update may be performed with reference to points (different from six) suitable for updating the first search direction. Furthermore, the update of the first search direction may be performed after a sufficient number of first search points have been initially determined. For example, when updating the first search direction, if the electronic device 100 determines the first search point based on the preceding six points, the first search point may be determined based on an initial search direction derived from the initial point P0 and curvature information before initially determining the six first search points. After determining six or more first search points, the electronic device 100 may update the first search point based on the six most recently determined first search points. It should be noted that the aforementioned number of most recently determined first search points is exemplary, and the search direction may be updated based on different numbers of search points.

[0117] Electronic device 100 can determine the next first search point based on curvature information and an updated first search direction. Electronic device 100 can determine multiple first search points L1 simultaneously. Electronic device 100 can generate edge lines indicating closed paths on the three-dimensional oral cavity model based on the multiple first search points L1.

[0118] According to an embodiment, the electronic device 100 can sequentially determine a plurality of second search points L2 on a three-dimensional oral cavity model based on curvature information and a second search direction. For example, the electronic device 100 can determine each of the plurality of second search points based on curvature information and one or more recently determined second search points. As mentioned above, the second search direction can be the opposite direction of the first search direction.

[0119] Specifically, according to an embodiment, the electronic device 100 may update the second search direction based on two or more recently determined second search points. For example, the electronic device 100 may update the second search direction based on six points preceding the current search point. These six preceding points are exemplary values, and the execution of the second search direction update may refer to a number of points suitable for updating the second search direction. The electronic device 100 may determine the next second search point based on curvature information and the updated second search direction. The electronic device 100 may determine multiple second search points L2 simultaneously while sequentially determining the second search points.

[0120] Electronic device 100 may terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) when a predetermined termination condition is met. Specifically, electronic device 100 may terminate the operation of sequentially determining search points in response to determining that a predetermined termination condition has been met. In this case, determining that the termination condition has been met may be based on various conditions. Exemplary termination conditions may be based on at least one of the following: the number of multiple search points, the length of the path including at least some of the multiple search points, the absence of a point from the most recently determined search point in the current search direction, or the absence of a point adjacent to the most recently determined search point and satisfying a predetermined curvature reference in the current search direction. For example, when the number of consecutive search points reaches a certain number (e.g., 200), electronic device 100 may determine that enough search points have been found and terminate the operation of sequentially determining search points. As another example, electronic device 100 may assume that enough search points have been found and terminate the operation of sequentially determining search points when the path indicated by the multiple search points reaches a certain length (e.g., 20 mm). Furthermore, when there is no point matching the current search direction, or when there are no adjacent points that satisfy the curvature reference, the electronic device 100 may terminate the operation of sequentially determining search points. The above conditions are exemplary, and different conditions may be used depending on the situation.

[0121] refer to Figure 7cThe electronic device 100 can determine an initial closed path L3 comprising a plurality of first search points L1 and a plurality of second search points L2. For example, the electronic device 100 can remove overlapping points among the plurality of first search points L1 and the plurality of second search points L2. Furthermore, the electronic device 100 can connect the search point with the smallest distance to each of the plurality of first search points L1 and the plurality of second search points L2 to that corresponding search point, thereby generating the initial closed path L3. However, this is exemplary; the electronic device 100 can also determine the initial closed path L3 based on additional search points besides the first search points L1 and the plurality of second search points L2. Additionally, the electronic device 100 can generate the initial closed path L3 based solely on one type of the plurality of first search points L1 or the plurality of second search points L2. Furthermore, the electronic device 100 can determine whether the initial closed path L3 is twisted or folded, and can remove the twisted or folded portion of the initial closed path L3 in response to determining that the initial closed path L3 is twisted or folded.

[0122] Electronic device 100 can generate edge lines based on the initial closed path L3. For example, electronic device 100 can generate edge lines by performing post-processing operations on the initial closed path L3. The specific method for finally generating the edge lines will be referred to below. Figure 8a and Figure 8b Detailed description.

[0123] Figure 8a and Figure 8b This is a schematic diagram illustrating the generation of edge lines according to an exemplary embodiment of the present disclosure.

[0124] Specifically, Figure 8a The generation of the edge line MLx corresponding to the first tooth model Tx according to an exemplary embodiment of the present disclosure is shown. Figure 8b The generation of the edge line MLy corresponding to the second tooth model Ty according to an exemplary embodiment of the present disclosure is shown. Hereinafter, it will be described with reference to the above-described figures. Figure 8a and Figure 8b And descriptions that overlap with the above description will be omitted.

[0125] refer to Figure 8a Electronic device 100 can be based on Figure 7a to Figure 7cThe initial closed path L3 shown is used to generate the edge line MLx. For example, the electronic device 100 can generate the edge line MLx by performing at least one post-processing operation (e.g., line smoothing) on ​​the initial closed path L3. Furthermore, the electronic device 100 can generate the edge line MLx by performing at least one projection on the initial closed path L3 onto a 3D oral model. According to an embodiment, the electronic device 100 can generate the edge line MLx configured as a smooth curve by performing line smoothing on the initial closed path L3 and performing multiple projections on the three-dimensional oral model. The generated edge line MLx can be used to generate a restoration corresponding to the first tooth model Tx in the future. Furthermore, the electronic device 100 can perform appropriate modification operations on the edge line used to manufacture the restoration according to the real-time modification method described below.

[0126] refer to Figure 8b The electronic device 100 can generate an edge line MLy corresponding to a second tooth model Ty that is different from the first tooth model Tx. Edge lines MLx and MLy are edge lines generated corresponding to an exemplary embodiment. Furthermore, it should be noted that the electronic device 100 can generate edge lines for different tooth models, and can generate edge lines different from edge lines MLx and MLy.

[0127] According to the above embodiments, tooth margins can be automatically and quickly generated based on three-dimensional images of the oral cavity. Furthermore, the automatic generation of margins allows for rapid and efficient margin line operations used in the fabrication of restorations.

[0128] Figure 9 This is a flowchart illustrating a method for generating edge lines according to an exemplary embodiment of the present disclosure.

[0129] refer to Figure 9 The electronic device 100 can execute a method S100 for generating edge lines, which includes at least some of a plurality of operations (S110 to S140). Hereinafter, it will be described with reference to the above-described figures. Figure 9 And descriptions that overlap with the above description will be omitted.

[0130] In operation S110, the electronic device 100 can identify an initial point P0 on the three-dimensional oral cavity model. According to the embodiment, the electronic device 100 can identify the initial point P0 by receiving input of a specified initial point P0 from an external source. This input of the specified initial point P0 from the external source can be a point specified by an external user, or it can be a point suitable for generating edge lines derived by an external computing device or the like. Furthermore, the electronic device 100 can identify the initial point P0 by internally calculating and deriving a suitable point based on the configuration of the processor 101 and memory 103, etc.

[0131] In operation S120, the electronic device 100 can determine a first search direction from an initial point based on the curvature information of the three-dimensional oral cavity model. For example, the electronic device 100 can identify points on the oral cavity model adjacent to the initial point P0, and identify points on the oral cavity model adjacent to the initial point P0 that satisfy a predetermined curvature reference. According to an embodiment, the electronic device 100 can determine the search direction as the direction from the initial point P0 toward the point on the oral cavity model with the largest curvature among the points adjacent to the initial point P0.

[0132] In operation S130, the electronic device 100 may sequentially determine a plurality of first search points L1 on the three-dimensional oral cavity model based on curvature information and a first search direction. For example, the electronic device 100 may determine each of the plurality of first search points based on curvature information and one or more recently determined first search points. The electronic device 100 may determine the plurality of first search points L1 simultaneously with the sequential determination of the first search points.

[0133] Furthermore, the electronic device 100 can terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) when a predetermined termination condition is met. Specifically, the electronic device 100 can terminate the operation of sequentially determining search points in response to determining that a predetermined termination condition has been met.

[0134] In operation S140, the electronic device 100 may generate an edge line MLx indicating a closed path on a three-dimensional oral cavity model based on a plurality of first search points L1. For example, the electronic device 100 may perform a post-processing operation relative to the plurality of first search points L1 to generate the edge line MLx indicating the closed path. Any content overlapping with the above-described edge line generation will be omitted.

[0135] Figure 10 This is a flowchart illustrating a method for sequentially determining search points according to an exemplary embodiment of the present disclosure.

[0136] refer to Figure 10 The electronic device 100 can perform the above. Figure 9 Operation S130 includes multiple operations (S131 to S132). Hereinafter, it will be described with reference to the above-mentioned figures. Figure 11 And descriptions that overlap with the above description will be omitted.

[0137] In operation S131, electronic device 100 may update the first search direction based on two or more recently determined first search points. For example, electronic device 100 may update the first search direction based on six points preceding the current search point. These six preceding points are exemplary values, and the update of the search direction may also be performed with reference to a number of points suitable for updating the first search direction.

[0138] In operation S132, electronic device 100 can determine the next first search point based on curvature information and the updated first search direction. Electronic device 100 can determine multiple first search points L1 simultaneously.

[0139] According to the above embodiments, tooth edge lines can be automatically and quickly generated based on three-dimensional images of the oral cavity. Furthermore, the automatic generation of edge lines allows for rapid and efficient edge line manipulation for manufacturing restorations.

[0140] Figure 11 This is a flowchart illustrating a method for generating edge lines according to an exemplary embodiment of the present disclosure.

[0141] refer to Figure 11 The electronic device 100 can perform the method for generating edge lines by executing multiple operations (S210 to S250). The following description will refer to the accompanying drawings. Figure 11 And descriptions that overlap with the above description will be omitted.

[0142] In operation S210, the electronic device 100 can identify the initial point P0 on the three-dimensional oral cavity model. Operation S210 can be... Figure 9 Example of operation S110 in the example.

[0143] In operation S220, the electronic device 100 can determine a first search direction from an initial point based on the curvature information of the three-dimensional oral cavity model. For example, the electronic device 100 can identify points on the oral cavity model adjacent to the initial point P0, and identify points on the oral cavity model adjacent to the initial point P0 that satisfy a predetermined curvature reference. Operation S220 can be... Figure 9 Example of operation S120 in the example.

[0144] In operation S230, the electronic device 100 can sequentially determine multiple first search points L1 on the three-dimensional oral cavity model based on curvature information and a first search direction. The electronic device 100 can determine multiple first search points L1 simultaneously with the sequential determination of the first search points. Operation S230 can be... Figure 9 Example of operation S130 in the example.

[0145] In operation S240, the electronic device 100 may sequentially determine a plurality of second search points L2 on the three-dimensional oral cavity model based on curvature information and a second search direction. For example, the electronic device 100 may determine each of the plurality of second search points based on curvature information and one or more recently determined second search points.

[0146] Specifically, the electronic device 100 according to the embodiment can update the second search direction based on two or more recently determined second search points. For example, the electronic device 100 can update the second search direction based on six points preceding the current search point. These six preceding points are exemplary values, and the update of the search direction can also be performed with reference to a number of points suitable for updating the second search direction. The electronic device 100 can determine the next second search point based on curvature information and the updated second search direction. The electronic device 100 can determine multiple second search points L2 simultaneously while sequentially determining the second search points.

[0147] The electronic device 100 can terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) when a predetermined termination condition is met. Specifically, the electronic device 100 can terminate the operation of sequentially determining search points in response to determining that a predetermined termination condition is met.

[0148] In operation S250, the electronic device 100 can generate an edge line MLx indicating a closure path on a three-dimensional oral cavity model based on a plurality of first search points L1 and a plurality of second search points L2. A specific example of operation S250 will be provided below. Figure 12 Detailed description is provided.

[0149] Figure 12 This is a flowchart illustrating a method for generating edge lines indicating closed paths according to an exemplary embodiment of the present disclosure.

[0150] refer to Figure 12 The electronic device 100 can perform the above. Figure 11 Operation S250 includes multiple operations (S251 to S252). The following description will refer to the accompanying drawings. Figure 12 And descriptions that overlap with the above description will be omitted.

[0151] In operation S251, the electronic device 100 may determine an initial closed path L3 comprising a plurality of first search points L1 and a plurality of second search points L2. For example, the electronic device 100 may remove overlapping points among the plurality of first search points L1 and the plurality of second search points L2. Furthermore, for each of the plurality of first search points L1 and the plurality of second search points L2, the electronic device 100 may connect the search point with the smallest distance to the corresponding search point to that corresponding search point, thereby generating the initial closed path L3.

[0152] In operation S252, the electronic device 100 can generate an edge line MLx based on an initial closed path L3. For example, the electronic device 100 can generate the edge line MLx by performing at least one post-processing operation (e.g., line smoothing) on ​​the initial closed path L3. Furthermore, the electronic device 100 can generate the edge line MLx by performing at least one projection of the initial closed path L3 onto a three-dimensional oral cavity model. According to an embodiment, the electronic device 100 can generate an edge line MLx configured as a smooth curve by performing line smoothing on the initial closed path L3 and performing several projections onto the three-dimensional oral cavity model.

[0153] According to the above embodiments, tooth edge lines can be automatically and quickly generated based on three-dimensional images of the oral cavity. Furthermore, the automatic generation of edge lines allows for rapid and efficient edge line manipulation for manufacturing restorations.

[0154] Figure 13a , Figure 13b , Figure 13c and Figure 13d This is a schematic diagram illustrating a method for modifying edge lines according to an exemplary embodiment of the present disclosure.

[0155] Specifically, Figure 13a to Figure 13d A method for modifying an edge line MLy, generated corresponding to a second tooth model Ty, is illustrated according to an exemplary embodiment of this disclosure. The following description will refer to the accompanying drawings. Figure 13a and Figure 13d And descriptions that overlap with the above description will be omitted.

[0156] refer to Figure 13a to Figure 13d The electronic device 100 can modify the generated edge line MLy in real time. Before modification, according to an embodiment, the electronic device 100 can display a three-dimensional oral cavity model and the edge line MLy via a display 107 or an external display. Thereafter, the electronic device 100 can receive input for entering the modification mode of the edge line MLy. For example, the input for entering the modification mode can be a mouse click, a mouse click while holding down a keyboard control key, or touch input to a specific interactive element on the display. The above are exemplary inputs; other different inputs can also be used for entering the modification mode of the edge line MLy. Simultaneously, the input for entering the modification mode can also be used as input for maintaining the modification mode. For example, the modification mode can be maintained by holding down a keyboard control key while maintaining a mouse click.

[0157] Electronic device 100 may initiate a modification mode that continuously receives mobile input in response to an input for entering the modification mode. Electronic device 100 may deactivate the modification mode upon receiving a release input for the modification mode. According to an embodiment, the mobile input may be mouse dragging or touch input on a display. However, this is exemplary, and different inputs may be presented as mobile inputs, and these mobile inputs may change according to configuration.

[0158] While maintaining the modification mode, the electronic device 100 can modify the edge line based on the target line segment Ls indicated by the movement input up to the present, in response to determining that predetermined repetition conditions are met. For example, the predetermined repetition conditions may include the end of a predetermined time interval (lapse), and may also include a predetermined distance interval reaching a movement distance indicated by the movement input. If other predetermined repetition conditions are met while maintaining the modification mode, the electronic device 100 can modify the edge line based on the target line segment Ls indicated by the movement input up to the present. Specifically, the electronic device 100 can select one or more points from the points contained in the edge line MLY based on the target line segment Ls. Thereafter, the electronic device 100 can move each of the selected one or more points in a direction toward the target line segment Ls.

[0159] For example, to select one or more points, electronic device 100 may determine a modification reference point on edge line MLY based on the last point of target line segment Ls, and select one or more points based on the modification reference point. Specifically, to determine the modification reference point, electronic device 100 according to an embodiment may project the last point of target line segment Ls onto the oral cavity surface of a three-dimensional oral cavity model to obtain a first point. Subsequently, electronic device 100 may project this first point onto edge line MLY to obtain a second point located on the edge line. According to an embodiment, electronic device 100 may determine this second point as the modification reference point, but this is exemplary, and other different points on edge line MLY may also be determined as modification reference points.

[0160] According to an embodiment, when the electronic device 100 selects one or more points based on a modified reference point, it can select a point on an edge line MLy that is within a predetermined distance from the modified reference point. In this case, the predetermined distance can be specified as a constant value, or it can be given as a function of the distance between the modified reference point and the target line segment Ls. For example, the value of the predetermined distance can be determined by negative correlation, that is, the closer the distance between the modified reference point and the target line segment Ls, the larger the value of the predetermined distance. Furthermore, the value of the predetermined distance can be a value that can be changed by external input.

[0161] According to an embodiment, the electronic device 100 can move each of one or more selected points in a direction toward a target line segment Ls. The degree to which each selected point moves toward the target line segment Ls can be specified as a constant value, or it can be given as a function of modifying the distance between a reference point and the target line segment Ls. For example, the closer the distance between the modified reference point and the target line segment Ls, the greater the degree to which each selected point moves toward the target line segment Ls. It should be noted that the above embodiments are exemplary cases and are not limited to the above description.

[0162] Electronic device 100 can update the display of an upper edge line in response to an edge line MLy. For example, while maintaining a modification mode, in response to determining that a predetermined repetition condition is met, electronic device 100 can modify the edge line MLy based on a first target line segment indicated by a movement input. Based on the first target line segment, electronic device 100 can modify the edge line MLy to generate a first modified edge line MLy1. Furthermore, electronic device 100 can update the display of the upper edge line MLy to the first modified edge line MLy1.

[0163] Following the first target line segment, a continuous modification mode can be executed. Based on the second target line segment indicated by a movement input while maintaining the modification mode, the electronic device 100 can modify the first modification edge line MLy1. Based on the second target line segment, the electronic device 100 can modify the first modification edge line MLy1 to generate a second modification edge line MLy2. Furthermore, the electronic device 100 can update the display of the first modification edge line MLy1 on the screen to the display of the second modification edge line MLy2.

[0164] Following the second target line segment, a continuous modification mode can be executed. Based on the third target line segment indicated by the movement input while maintaining the modification mode, the electronic device 100 can modify the second modification edge line MLy2. Based on the third target line segment, the electronic device 100 can modify the second modification edge line MLy2 to generate a third modification edge line MLy3. Furthermore, the electronic device 100 can update the display of the second modification edge line MLy2 on the screen to the display of the third modification edge line MLy3.

[0165] Following the third target line segment, a continuous modification mode can be executed. Based on the fourth target line segment indicated by the movement input while maintaining the modification mode, the electronic device 100 can modify the third modification edge line MLy3. Based on the fourth target line segment, the electronic device 100 can modify the third modification edge line MLy3 to generate a fourth modification edge line MLy4. Furthermore, the electronic device 100 can update the display of the third modification edge line MLy3 on the monitor to the display of the fourth modification edge line MLy4.

[0166] The interval for generating each modified edge line can be determined statically or dynamically, allowing the user to perceive that the edge line is modified in real time according to their movement input, while making efficient use of the resources of the electronic device 100.

[0167] According to an embodiment, the electronic device 100 can receive input for exiting the edge line modification mode. The end of the input for entering the modification mode can be used as input for exiting the modification mode. The electronic device 100 can deactivate the modification mode in response to the input for exiting the modification mode. With the deactivation of the modification mode, the electronic device 100 can generate the final modified edge line MLyf after the real-time modification of the edge line is finally completed. That is, the electronic device 100 can generate the final modified edge line MLYf by modifying the edge line MLy multiple times while maintaining the modification mode. Furthermore, the electronic device 100 can display the final modified edge line MLyf on a display.

[0168] Meanwhile, in the edge line MLy generated through the above edge line generation process, some of the points constituting the edge line MLx can be fixed, such as... Figure 8a Those points that form the edge line MLx. For example, some of the points that make up the edge line MLY can be fixed at predetermined intervals. For ease of description, a portion of the fixed points that make up the edge line MLY will be referred to as "fixed points" below.

[0169] In response to an input for entering a modification mode, the electronic device 100 may additionally fix some of the points constituting the edge line MLy. The fixed points maintain their positions even while in modification mode, unless they are released. That is, even if the electronic device 100 enters modification mode and modifies the edge line MLy, the positions of the fixed points are maintained, and the edge line MLy can be modified.

[0170] Here, the electronic device 100 can determine that the aforementioned modified reference point is located between two specific fixed points. That is, the electronic device 100 can determine, based on the modified reference point, two fixed points adjacent to the modified reference point. According to an embodiment, the electronic device 100 can select one or more points from the points located between the modified reference point and two adjacent fixed points, to be moved in the direction toward the target line segment Ls. That is, the electronic device 100 can determine that one or more points to be moved in the direction toward the target line segment Ls are located between two fixed points on the edge line MLY.

[0171] Furthermore, based on movement input received while maintaining the modification mode, the electronic device 100 can de-fix some fixed points. For example, in response to determining that the modification reference point has exceeded a fixed point on the edge line Mly based on the change of the last point of the target line segment Ls, the electronic device 100 can de-fix those points that the modification reference point has exceeded. The positions of the de-fixed points can be modified based on movement input while maintaining the modification mode.

[0172] According to the above embodiments, tooth edge lines can be automatically and quickly generated based on three-dimensional images of the oral cavity. According to the above embodiments, during the edge line generation process, users can view areas of generation errors and modify the edge lines in real time with minimal operations. Furthermore, through automatic generation and real-time modification of edge lines, edge line operations for manufacturing restorations can be performed quickly and efficiently.

[0173] Figure 14 This is a flowchart illustrating a method for modifying edge lines according to an exemplary embodiment of the present disclosure.

[0174] refer to Figure 14 The electronic device 100 can modify the edge line by performing multiple operations (S310 to S350). The following description will refer to the accompanying drawings. Figure 14 And descriptions that overlap with the above description will be omitted.

[0175] Before operating S310, the electronic device 100 may execute the aforementioned edge line generation method S100. Details regarding the edge line generation method S100 will be omitted. Figure 9 The descriptions overlap. Furthermore, the electronic device 100 can also receive the generated edge lines via external input without executing the edge line generation method S100.

[0176] During operation S310, the electronic device 100 can display a three-dimensional oral cavity model and edge lines MLy via a display 107 or an external display.

[0177] In operation S320, the electronic device 100 may receive input for entering the modification mode of the edge line MLY. For example, the input for entering the modification mode may be a mouse click, or pressing and holding a control key while clicking the mouse. This is an exemplary input; other different inputs may be used for entering the modification mode of the edge line MLY.

[0178] In operation S330, the electronic device 100 may initiate a modification mode that continuously receives motion input in response to an input for entering a modification mode. According to an embodiment, the motion input may be mouse dragging or touch input of a display.

[0179] In operation S340, the electronic device 100 can modify the edge line based on the target line segment Ls indicated by the movement input up to the present, in response to determining that a predetermined repetition condition has been met, while maintaining the modification mode. For example, the predetermined repetition condition may include the end of a predetermined time interval, and may also include a predetermined distance interval where a movement distance indicated by the movement input has been reached. If other predetermined repetition conditions are met while maintaining the modification mode, the electronic device 100 can modify the edge line based on the target line segment Ls indicated by the movement input up to the present. Specific examples of operation S340 will be provided below. Figure 15 Detailed description is provided.

[0180] In operation S350, the electronic device 100 can update the display of the edge line on the screen in response to a modification of the edge line MLY. (The details mentioned above will be omitted.) Figure 13a to Figure 13d The description in the document concerns the modification of the edge lines and the updated overlap of the display.

[0181] Figure 15 This is a flowchart illustrating a method for modifying an edge line based on a target line segment according to an exemplary embodiment of the present disclosure.

[0182] refer to Figure 15 The electronic device 100 can perform the above. Figure 14 Operation S340 includes multiple operations (S341 to S342). Hereinafter, it will be described with reference to the above-mentioned figures. Figure 15 And descriptions that overlap with the above description will be omitted.

[0183] In operation S341, electronic device 100 may select one or more points from the points contained in edge line MLY based on target line segment Ls. For example, in order to select one or more points, electronic device 100 may determine a modification reference point on edge line MLY based on the last point of target line segment Ls, and select one or more points based on the modification reference point.

[0184] In operation S342, the electronic device 100 can move each of the selected one or more points toward the target line segment Ls.

[0185] According to the above embodiments, tooth edge lines can be automatically and quickly generated based on three-dimensional images of the oral cavity. According to the above embodiments, during the edge line generation process, the user can view areas of generation errors and modify the edge lines in real time with minimal operations. Furthermore, through automatic generation and real-time modification of edge lines, edge line operations for manufacturing restorations can be performed quickly and efficiently.

[0186] As described above, exemplary embodiments have been disclosed in the specification with reference to the accompanying drawings. Although specific terms are used in the specification to describe embodiments, these terms are used only to explain the technical concept of this disclosure and are not intended to limit the meaning or scope of this disclosure as described in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent embodiments can be implemented based on this. Consequently, the scope of protection of this disclosure should be determined by the technical concept of the appended claims.

Claims

1. A method performed by an electronic device, the method comprising: Identify the initial point on the 3D oral cavity model; Based on the curvature information of the three-dimensional oral cavity model, a first search direction is determined from the initial point; Based on the curvature information and the first search direction, a plurality of first search points on the three-dimensional oral cavity model are determined sequentially, and each of the plurality of first search points is determined based on the curvature information and one or more most recently determined first search points; as well as Based on the plurality of first search points, an edge line indicating a closed path on the three-dimensional oral cavity model is generated.

2. The method according to claim 1, wherein, The process of identifying the initial point includes receiving input that specifies the initial point.

3. The method according to claim 1, wherein, The step of sequentially determining the plurality of first search points includes: Update the first search direction based on two or more recently determined first search points; and Based on the curvature information and the updated first search direction, the next first search point is determined.

4. The method according to claim 1, wherein, In response to determining that a predetermined termination condition is met, the sequential determination of the plurality of first search points is terminated, and The determination that the predetermined termination condition is met is based on at least one of the following: the number of the plurality of first search points, the length of the path including at least some of the plurality of first search points, the absence of a point from the most recently determined first search point in the current search direction, and the absence of a point adjacent to the most recently determined first search point and satisfying a predetermined curvature reference in the current search direction.

5. The method according to claim 1, further comprising: Based on the curvature information and a second search direction starting from the initial point, a plurality of second search points on the three-dimensional oral cavity model are sequentially determined, wherein the second search direction is opposite to the first search direction, and each of the plurality of second search points is determined based on the curvature information and one or more recently determined second search points. The generation of the edge line is further based on the plurality of second search points.

6. The method according to claim 3, wherein, The generation of the edge line includes: Determine an initial closed path including the plurality of first search points and the plurality of second search points; and The edge line is generated based on the initial closed path.

7. The method according to claim 6, wherein, Determining the initial closed path includes: for each of the plurality of first search points and the plurality of second search points, connecting the search point with the smallest distance to the corresponding search point to the corresponding search point.

8. The method according to claim 6, wherein, The step of generating the edge line based on the initial closed path includes: generating the edge line by smoothing the closed path and performing one or more projections on the three-dimensional oral cavity model.

9. The method according to claim 1, wherein, The edge line indicates the boundary between the inner and outer surfaces of the prosthesis of a specific tooth in the target oral cavity presented by the three-dimensional oral model.

10. The method of claim 1, further comprising displaying the three-dimensional oral cavity model and the edge lines on a display.

11. The method of claim 10, further comprising: Receive input for entering the modification mode of the edge line; In response to the input for entering the modification mode, the modification mode of continuously receiving movement input is initiated; While maintaining the modification mode, in response to determining that a predetermined repetition condition is met, the edge line is modified based on the target line segment indicated by the movement input up to the present. as well as In response to the modification of the edge line, the display of the edge line on the display is updated.

12. The method according to claim 11, wherein, The predetermined repetition condition includes the end of a predetermined time interval.

13. The method according to claim 11, wherein, The predetermined repetition condition includes a predetermined distance interval at which the movement distance indicated by the movement input is reached.

14. The method according to claim 11, wherein, The modification of the edge line includes: Based on the target line segment, select one or more points from the points included in the edge line; and Move each of the selected one or more points toward the target line segment.

15. The method according to claim 14, wherein, The selection of one or more points includes: Based on the last point of the target line segment, determine the modification reference point on the edge line; and Based on the modified reference point, select one or more points.

16. The method according to claim 15, wherein, The step of selecting one or more points based on the modified reference point further includes: determining that each of the one or more points is located within a predetermined distance from the modified reference point.

17. The method of claim 15, further comprising: In response to the input for entering the modified mode, some points among the points included in the edge line are fixed. The selection of the one or more points further includes: Based on the modified reference point, two fixed points are determined from the fixed points, the modified reference point being located between the two fixed points on the edge line; and The one or more points are determined to be located between the two fixed points on the edge line.

18. The method of claim 17, further comprising: In response to determining, based on the change of the last point of the target line segment, that the modified reference point has exceeded one of the fixed points on the edge line, the fixing of the point that the modified reference point has exceeded is released.

19. An electronic device comprising: At least one processor; as well as At least one memory storing instructions executed by the at least one processor. When the instructions are executed by the at least one processor, the at least one processor is configured to perform the method according to any one of claims 1 to 18.

20. A non-transitory computer-readable recording medium that records instructions, which, when executed by at least one processor, cause the at least one processor to perform an operation. in, The instructions are configured to cause the at least one processor to perform the method according to any one of claims 1 to 18.

Images