Oral image processing apparatus, oral image processing method, and recording medium

Abstract

Disclosed embodiments relate to an oral image processing apparatus, an oral image processing method, and a recording medium. An oral image processing method of an embodiment includes the steps of: scanning an object to acquire three-dimensional oral data; generating a three-dimensional oral image based on the three-dimensional oral data, the three-dimensional oral image including a scanned surface region and a back region of the scanned surface region; and deleting at least a portion of the back region.

Description

TECHNICAL FIELD

[0001] The disclosed embodiments relate to an oral image processing apparatus and an oral image processing method, and more particularly, to an oral image processing apparatus and method capable of accurately and easily removing unnecessary data measured simultaneously with teeth. BACKGROUND

[0002] As a method of obtaining oral information of a patient, a method of obtaining an intraoral image by inserting an oral scanner into the mouth of the patient is recently being used. The oral cavity of the patient is scanned using the oral scanner, so that three-dimensional data on an object such as teeth, gums, jaw bones, etc. of the patient can be obtained, and the obtained three-dimensional data is used for treatment or correction of teeth, etc. When the oral cavity of the patient is scanned using the oral scanner, in addition to data on teeth, etc., unnecessary data (noise data) such as a tongue, a cheek around the teeth, or a dentist's finger, etc. can be measured simultaneously.

[0003] When the user arbitrarily selects and removes the unnecessary data from the display, in the process of removing the unnecessary data, part of the teeth data adjacent to the unnecessary data can be lost. In this case, there is a problem that the oral scanning must be performed again to obtain the lost teeth data. Alternatively, there is a problem that some of the unnecessary data can not be removed but remain. Therefore, a technology of accurately removing the unnecessary data from the obtained oral data is required. SUMMARY

[0004] Problems to be Solved by the Invention

[0005] The disclosed embodiments aim to provide an oral image processing method for identifying unnecessary data in obtained oral data and capable of accurately and easily removing only the identified unnecessary data, and an apparatus performing a corresponding action.

[0006] Means for Solving the Problems

[0007] An oral image processing method of an embodiment can include the steps of: scanning an object to obtain three-dimensional oral data, generating a three-dimensional oral image based on the three-dimensional oral data, the three-dimensional oral image including a scanned surface area and a back area of the scanned surface area, and removing at least a portion of the back area.

[0008] The three-dimensional oral data of an embodiment includes vertex data; and the step of removing at least a portion of the back area can include the step of removing a first area included in the back area when an angle between a direction vector of vertex data of the first area and a normal vector of an imaginary reference plane has a predetermined range.

[0009] The step of deleting at least a portion of the back surface region in one embodiment can further include the steps of changing the virtual reference surface in a predetermined direction, and deleting a second region included in the back surface region when an angle between a direction vector of vertex data of the second region and a normal vector of the changed virtual reference surface has a predetermined range.

[0010] The predetermined range in one embodiment can be 90 degrees or more and 180 degrees or less.

[0011] The oral image processing method in one embodiment can further include the step of displaying the three-dimensional oral image on a screen, and the step of displaying the three-dimensional oral image on a screen can include the step of displaying the three-dimensional oral image on the screen based on at least one of a viewpoint indicating a direction in which the three-dimensional oral image is observed and the screen on which the three-dimensional oral image is projected in a two-dimensional manner.

[0012] The oral image processing method in one embodiment can further include the step of setting a deletion region in the three-dimensional oral image, and the three-dimensional oral data can include vertex data, and the step of displaying the three-dimensional oral image on a screen can include the step of displaying a first region in the three-dimensional oral image as a back surface region when an angle between a direction vector of vertex data of the first region and a normal vector of the screen has a predetermined range, and the step of deleting at least a portion of the back surface region can include the step of deleting the back surface region included in the deletion region.

[0013] The oral image processing method in one embodiment can further include the step of displaying at least one of an item corresponding to a deletion function and an icon for selecting the deletion region.

[0014] The step of displaying the item corresponding to the deletion function and the icon for selecting the deletion region in one embodiment can further include the steps of displaying the icon for selecting the deletion region when a user input selecting the item corresponding to the deletion function is received, and displaying at least one size setting icon to set a size of the icon for selecting the deletion region.

[0015] The step of setting a deletion region in the three-dimensional oral image in one embodiment can include the steps of receiving the user input for moving the icon for selecting the deletion region, and setting a region through which the icon for selecting the deletion region passes as the deletion region.

[0016] The step of displaying the three-dimensional oral image on a screen in one embodiment can include the steps of displaying the scanned surface region in a first color, and displaying the back surface region in a second color different from the first color.

[0017] The step of displaying the three-dimensional oral image on the screen in an embodiment can include a step of determining a texture of the scanned surface area based on the three-dimensional oral data, and displaying the scanned surface area with the determined texture.

[0018] The step of deleting at least a portion of the back surface area in an embodiment can further include a step of deleting at least a portion of the back surface area spaced apart from the scanned surface area.

[0019] The oral image processing method of an embodiment further includes a step of dividing the oral image into a tooth area and a gum area, and the step of deleting at least a portion of the back surface area can include a step of deleting at least a portion of the back surface area included in the tooth area without deleting at least a portion of the back surface area included in the gum area.

[0020] An oral image processing apparatus of an embodiment includes a display, a memory, one or more instructions stored in the memory, and a processor that can scan an object to acquire three-dimensional oral data, generate a three-dimensional oral image including a scanned surface area and a back surface area of the scanned surface area based on the three-dimensional oral data, and delete at least a portion of the back surface area by executing the one or more instructions stored in the memory.

[0021] Effects of Invention

[0022] According to the oral image processing apparatus and oral image processing method of the disclosed embodiments, noise data adjacent to teeth can be identified from acquired oral data, and only the identified noise data can be accurately and easily deleted.

[0023] Thus, the user does not need to confirm noise data one by one on the display and delete it arbitrarily, nor does the user need to re-perform oral scanning to obtain teeth data lost in the noise data removal process, thereby increasing the user's convenience of use. BRIEF DESCRIPTION OF DRAWINGS

[0024] The present application can be easily understood by the following detailed description in conjunction with the accompanying drawings, in which the same reference numerals indicate the same elements.

[0025] Figure 1 FIG. 1 is a diagram for explaining an oral image processing system according to a disclosed embodiment.

[0026] Figure 2 FIG. 2 is a diagram referred to in order to explain an action of acquiring three-dimensional oral data of an embodiment.

[0027] Figure 3a andFigure 3b FIG. 1 is a diagram referred to for explaining an action of an oral image processing apparatus displaying an oral image according to an embodiment.

[0028] Figures 4a to 4e FIG. 2 is a diagram referred to for explaining an action of an oral image processing apparatus deleting noise data according to an embodiment.

[0029] Figure 5 FIG. 3 is a diagram referred to for explaining an action of an oral image processing apparatus automatically deleting noise data according to an embodiment.

[0030] Figure 6 FIG. 4 is a flowchart of an oral image processing method according to an embodiment.

[0031] Figure 7 FIG. 5 is a block diagram of an oral image processing apparatus according to an embodiment. DETAILED DESCRIPTION

[0032] The principles of the present application are explained in this specification, and embodiments are disclosed to clarify the scope of the present application and to enable those of ordinary skill in the art to which the present application pertains to implement the present application. The disclosed embodiments can be implemented in various forms.

[0033] In the entire specification, the same reference numerals refer to the same constituent elements. The specification does not describe all elements of the embodiments, and the general content or repeated content between the embodiments is omitted in the specification. The term "part" used in the specification can be implemented in software or hardware, and according to the embodiments, a plurality of "parts" can be implemented as one element, or one "part" can include a plurality of elements. The working principles and embodiments of the present application are explained below in conjunction with the accompanying drawings.

[0034] In the specification, the image can include an image showing at least one tooth or an oral cavity including at least one tooth (hereinafter referred to as "oral image").

[0035] Further, the image in the specification can be a two-dimensional image regarding an object body, or a three-dimensional model or a three-dimensional image stereoscopically showing the object body. Further, the image in the specification can refer to data required for two-dimensional or three-dimensional representation of the object body, for example, raw data acquired from at least one image sensor, etc. Specifically, the raw data is data acquired for generation of the oral image, and can be data (for example, two-dimensional data) acquired from at least one image sensor in an intraoral scanner when scanning an intraoral cavity of a patient as the object body using the intraoral scanner.

[0036] In the present specification, an "object" can include a tooth, a gum, at least a part of an area of an oral cavity, and / or a man-made structure (e.g., an orthodontic appliance, an implant, an artificial tooth, an orthodontic auxiliary tool inserted into an oral cavity, etc.) that can be inserted into an oral cavity, a tooth model (e.g., a plaster model, an impression model, etc.). Among them, the orthodontic appliance can include at least one of a bracket, an attachment, an orthodontic screw, a lingual orthodontic appliance, and a removable orthodontic retention device.

[0037] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

[0038] Figure 1 FIG. 1 is a diagram for explaining an oral image processing system according to an embodiment of the disclosure.

[0039] Referring to Figure 1 , the oral image processing system includes an oral scanner 10 and an oral image processing apparatus 100.

[0040] The oral scanner 10 according to an embodiment is a medical device for acquiring an image of an oral cavity. Specifically, the oral scanner 10 can be a device that acquires an image of an oral cavity including at least one tooth by being inserted into the oral cavity and scanning the tooth in a non-contact manner.

[0041] In addition, the oral scanner 10 can have a form capable of being inserted into and withdrawn from the oral cavity, and scan the inside of a patient's oral cavity using at least one image sensor (e.g., an optical camera, etc.). In order to image at least one surface of a tooth model that is an object, a tooth, a gum, and a man-made structure (e.g., an orthodontic appliance including a bracket and a wire, etc., an implant, an artificial tooth, an orthodontic auxiliary tool inserted into an oral cavity, etc.) that can be inserted into an oral cavity, the oral scanner 10 can acquire surface information about the object as raw data.

[0042] Image data acquired from the oral scanner 10 can be transmitted to the oral image processing apparatus 100 connected through a wired or wireless communication network.

[0043] The oral image processing apparatus 100 can be all electronic devices connected with the oral scanner 10 through a wired or wireless network, receiving a two-dimensional image acquired by scanning an oral cavity from the oral scanner 10, and generating, processing, displaying, and / or transmitting an oral image according to the received two-dimensional image.

[0044] The oral image processing apparatus 100 can generate information according to the two-dimensional image data received from the oral scanner 10 by processing the two-dimensional image data, or can generate an oral image by processing the two-dimensional image data. In addition, the oral image processing apparatus 100 can display the generated information and the oral image through the display 130.

[0045] The oral image processing apparatus 100 can be a computing device such as a smart phone, a laptop computer, a desktop computer, a PDA, a tablet PC, etc., without limitation.

[0046] In addition, the oral image processing apparatus 100 can also exist in the form of a server (or server apparatus) for processing an oral image, etc.

[0047] In addition, the oral scanner 10 can transmit raw data acquired by scanning an oral cavity to the oral image processing apparatus 100 as it is. In this case, the oral image processing apparatus 100 can generate a three-dimensional oral image representing an oral cavity in three dimensions based on the received raw data. The oral image processing apparatus 100 according to an embodiment can generate three-dimensional data (e.g., surface data) representing a surface shape of an object in three dimensions based on the received raw data.

[0048] The three-dimensional surface data of an embodiment can be in the form of a point cloud, which can include a plurality of points. The plurality of points respectively include direction vectors. The three-dimensional surface data will be described in detail in Figure 2 .

[0049] In addition, a "three-dimensional oral image" can be generated by three-dimensionally modeling an internal structure of an oral cavity based on received raw data, and thus can be referred to as a "three-dimensional oral model" or a "three-dimensional oral image". Hereinafter, a model or an image displaying an oral cavity in two or three dimensions will be collectively referred to as an "oral image".

[0050] In addition, the oral image processing apparatus 100 can analyze, process, display, and / or transmit the generated oral image to an external device.

[0051] As another example, the oral scanner 10 can acquire raw data by scanning an oral cavity, and process the acquired raw data to generate an image corresponding to the oral cavity as an object, and transmit to the oral image processing apparatus 100. In this case, the oral image processing apparatus 100 can analyze, process, display, and / or transmit the received image.

[0052] In the disclosed embodiment, the oral image processing apparatus 100 is an electronic device capable of generating and displaying an oral image representing an oral cavity including one or more teeth in three dimensions, which will be described in detail below.

[0053] Figure 2 is a diagram referred to in order to explain an action of acquiring three-dimensional oral data of an embodiment.

[0054] For example, using the oral scanner 10 in Figure 1The oral scanner 10 described above can acquire three-dimensional oral data by scanning an oral cavity and / or a dental model. On the other hand, in acquiring the oral data, when scanning at least one tooth, a soft tissue such as a lip, a cheek, a tongue, a dentist's finger, and the like can be scanned together with the tooth because the soft tissue is in close contact with the tooth.

[0055] In Figure 2 In the present embodiment, for convenience of explanation, an example in which the noise substance 220 (a substance to be deleted) is scanned together with the tooth 210 is shown, but the present embodiment is not limited thereto. When the oral scanner 10 scans the inside of an oral cavity and / or a dental model, a noise substance other than the tooth 210 can be scanned at the same time. Here, the noise substance can be a substance to be deleted.

[0056] Referring to Figure 2 The oral scanner 10 according to an embodiment can scan the tooth 210 in a plurality of directions in order to scan all surfaces of the tooth 210 in the inside of an oral cavity. For example, the oral scanner 10 can scan the tooth 210 while moving to be able to scan the front surface, the upper surface, the rear surface, and the like of the tooth 210 as a whole.

[0057] When the oral scanner 10 scans the tooth 210 in the first direction 201, a part of the noise substance 220 (for example, a lip, a finger, a tongue, a cheek close to the tooth, a dentist's finger, and the like) adjacent to the rear side of the tooth 210 can be scanned together with the front surface of the tooth 210. At this time, the oral image processing apparatus 100 can acquire three-dimensional data 231 about the front surface of the tooth 210 and three-dimensional data 240 (hereinafter, referred to as "noise data") about a part of the front surface of the noise substance 220.

[0058] The three-dimensional data according to an embodiment can be in the form of a point cloud representing a surface of an object. The point cloud includes a plurality of points, and the plurality of points can represent position information of the surface of the object. For example, the three-dimensional data 231 about the tooth surface can represent position information about the front surface of the tooth 210. In addition, the plurality of points can respectively include a direction vector, and the direction vector of the point can be determined based on a normal vector of a surface adjacent to the point, but the present embodiment is not limited thereto. At this time, the surface adjacent to the point can refer to a surface including the point.

[0059] In addition, when the oral scanner 10 scans the teeth in the second direction 202, the oral image processing apparatus 100 can acquire three-dimensional data 232 about the upper surface of the teeth 210, and when the oral scanner 10 scans the teeth 210 in the third direction 203, the oral image processing apparatus 100 can acquire three-dimensional data 233 about the rear surface of the teeth 210. When the oral scanner 10 scans the teeth 210 in the second direction 202 and the third direction 203, the noise substance 220 can not be scanned. For example, in the case where the noise substance 220 is a cheek close to the teeth, when the front surface of the teeth is scanned, the scanning direction of the oral scanner 10 and the surface direction of the cheek are in the same direction, and thus the surface of the cheek can be scanned at the same time. However, when the upper surface or the rear surface of the teeth is scanned, since the scanning direction of the oral scanner 10 and the surface direction of the cheek are not in the same direction, the surface of the cheek can not be scanned. In general, a noise substance does not acquire three-dimensional data in all directions like teeth.

[0060] The oral image processing apparatus 100 can scan the teeth 210 in a plurality of directions and acquire three-dimensional data 250, and generate and display an oral image based on the three-dimensional data 250. In this regard, the oral image processing apparatus 100 of an embodiment will be described in detail with reference to Figure 3a and Figure 3b

[0061] Figure 3a and Figure 3b are diagrams referred to in order to explain the action of the oral image processing apparatus of an embodiment to display an oral image.

[0062] The oral image processing apparatus 100 of an embodiment can generate a three-dimensional oral image based on the acquired three-dimensional data. The three-dimensional oral image of an embodiment can be an image representing the surface of an object.

[0063] The oral image processing apparatus 100 of an embodiment can display the three-dimensional oral image on a two-dimensional screen 305, 306. The oral image processing apparatus 100 can determine the screen according to a viewpoint 301, 302. At this time, the viewpoint 301, 302 represents the direction in which an observer (user) observes the three-dimensional oral image, and the screen 305, 306 can represent a projection plane on which the three-dimensional oral image is projected based on the viewpoint 301, 302. The screen 305, 306 of an embodiment can be a screen of the display 130 of the oral image processing apparatus 100. Figure 1

[0064] In the three-dimensional oral image of an embodiment, a surface scanned by the oral scanner 10 and a surface not scanned by the oral scanner 10 (the back of the scanned surface) can be distinguished. For example, the surface scanned by the oral scanner 10 and the surface not scanned by the oral scanner 10 (the back of the scanned surface) can be distinguished by color, but the method of distinguishing is not limited thereto. ​​

[0065] For example, when the three-dimensional oral image is displayed in the screen 305, 306, in a case where an angle between a directional vector of a first point included in the oral data and a normal vector 315, 325 of the screen 305, 306 has a first range, the oral image processing apparatus 100 can determine a surface on which the first point is present as a surface that is scanned. At this time, the first range can be 0 degrees or more and less than 90 degrees. However, the first range is not limited thereto, and can be determined as various angles.

[0066] In contrast, in a case where an angle between a directional vector of a second point included in the oral data and the normal vector 315, 325 of the screen 305, 306 has a second range, the oral image processing apparatus 100 can determine a surface on which the second point is present as a back surface (a surface that is not scanned) of the surface that is scanned. At this time, the second range can be 90 degrees or more and 180 degrees or less, but is not limited thereto, and can be determined as various angles.

[0067] In addition, the surface that is scanned and the surface that is not scanned can be distinguished by various methods other than the above-described method.

[0068] For example, Figure 3a A case in which a three-dimensional oral image observed from a first viewpoint 301 is displayed in a first screen 305 is shown.

[0069] Referring to Figure 3a When the oral image processing apparatus 100 displays the three-dimensional oral image in the first screen 305, since an angle between a directional vector of a point corresponding to the first surface 310 and a normal vector 315 of the first screen 305 has a first range (for example, 0 degrees or more and less than 90), the oral image processing apparatus 100 can display the first surface 310 in the first screen 305 as a surface that is scanned. In addition, since an angle between a directional vector of a point corresponding to the second surface 320 and the normal vector 315 of the first screen 305 also has the first range (for example, 0 degrees or more and less than 90), the oral image processing apparatus 100 can display the second surface 320 in the first screen 305 as a surface that is scanned.

[0070] In addition, Figure 3b A case in which a three-dimensional oral image observed from a second viewpoint 302 is displayed in a second screen 306 is shown.

[0071] Referring to Figure 3bWhen the oral image processing device 100 displays the three-dimensional oral image in the second screen 306, since the angle between the direction vector of the point corresponding to the third surface 330 and the normal vector 325 of the second screen 306 has the first range (for example, 0 degrees or more and less than 90 degrees), the oral image processing device 100 can display the third surface 330 as a scanned surface in the second screen 306. Also, since the angle between the direction vector of the point corresponding to the fourth surface 340 and the normal vector 325 of the second screen 306 has the second range (for example, 90 degrees or more and 180 degrees or less), the oral image processing device 100 can display the fourth surface 340 as an unscanned surface (back surface) in the second screen 306.

[0072] Also, the oral image processing device 100 can display the scanned surface and the unscanned surface distinguished. As an example, the surface scanned by the oral scanner 10 can be displayed in a first color based on the acquired three-dimensional data (for example, point cloud data), and the surface unscanned by the oral scanner 10 can be displayed in a second color (for example, black) since the three-dimensional data is not acquired. However, the method of expressing the scanned surface and the unscanned surface distinguished is not limited thereto. Also, the three-dimensional oral image according to an example can not be distinguished as the scanned surface and the unscanned surface on the screen (or visually).

[0073] Referring to Figure 3a , the oral image processing device 100 can display the first surface 310 and the second surface 320 in the first color in the first screen 305. For example, the oral image processing device 100 can determine the color and / or texture of the first surface 310 and the second surface 320 according to the position information and / or the direction vector of the point corresponding to the first surface 310 and the second surface 320, and display the first surface 310 and the second surface 320 in the determined color and / or texture.

[0074] Also, referring to Figure 3b , the oral image processing device 100 can display the third surface 330 in the first color in the screen 306. For example, the oral image processing device 100 can determine the color and / or texture of the third surface 330 according to the position information and / or the direction vector of the point corresponding to the third surface 330, and display the third surface 330 in the determined color and / or texture.

[0075] On the contrary, the oral image processing device 100 can display the fourth surface 340 in the second color in the screen 306. For example, the oral image processing device 100 can display the fourth surface 340 in black, but is not limited thereto.

[0076] Figures 4a to 4eThe figure is shown for illustrating the operation of a dental image processing apparatus for deleting noise data according to an embodiment.

[0077] Reference Figure 4a One embodiment of the oral cavity image processing apparatus 100 can display a three-dimensional oral cavity image on a two-dimensional display screen. The user of the oral cavity image processing apparatus can retrieve the screen from which data (e.g., noise data) to be deleted by changing the viewpoint of the three-dimensional oral cavity image. The oral cavity image processing apparatus 100 can rotate the three-dimensional oral cavity image and display it on the screen based on user input.

[0078] For example, such as Figure 4a As shown, the screen displays a first oral cavity image 401 corresponding to the first viewpoint and a cursor 405. When the input of moving the cursor 405 is received, the oral cavity image processing device 100 can rotate and display a three-dimensional oral cavity image according to the dragging direction.

[0079] For example, when the input of dragging the cursor 405 in one direction on the screen is received, the oral cavity image processing device 100 can, as follows: Figure 4b As shown, a second oral cavity image 402 corresponding to the changed second viewpoint is displayed. Figure 4b The second oral cavity image 402 shown can be Figure 4a The back side of the first oral cavity image 401 shown.

[0080] At this point, the second oral cavity image 402 may include the surface area scanned by the oral scanner 10 and the back surface area of ​​the scanned surface area. As an example, the scanned surface area may be displayed in a first color, and the back surface area of ​​the scanned surface area may be displayed in a second color (e.g., black). Alternatively, the scanned surface area and the back surface area of ​​the scanned surface area may be distinguished in various ways and may not be distinguishable on the screen. For example, Figure 4a The first surface region 403 is displayed in the first oral cavity image 401 with a first color, but... Figure 4b In the second oral cavity image 402, since the back surface region 404 of the first surface region is shown, the back surface region 404 of the first surface region can be displayed in a second color.

[0081] One embodiment of the oral cavity image processing device 100 can display an oral cavity image and a menu for editing or changing the oral cavity image on a screen. (See also...) Figure 4bThe oral image processing apparatus 100 of one embodiment can display a first item 410 corresponding to the noise data deletion function in the display menu. In addition, when receiving a user input of selecting the first item 410, the oral image processing apparatus 100 can display a brush icon 430 for selecting a region to be deleted and second items 421, 422, 423 for selecting the size of the brush icon. When any of the second items 421, 422, 423 is selected, the oral image processing apparatus 100 can change the size of the brush icon 430 to the selected size.

[0082] Referring to Figure 4c , the oral image processing apparatus 100 can select a region 440 in which noise data is to be deleted and delete the noise data included in the selected region 440, based on a user input of moving the brush icon 430.

[0083] Referring to Figure 4d , the oral image processing apparatus 100 of one embodiment can delete only a portion displayed in a second color (e.g., black) in the selected region 440 in Figure 4c , and not delete a portion displayed in a first color. At this time, the portion displayed in the second color indicates a surface which is not scanned by the oral scanner 10 (a back surface of a surface scanned by the oral scanner 10). For example, the oral image processing apparatus 100 can delete only a back surface region of a surface scanned by the oral scanner 10, and not delete a surface region scanned by the oral scanner 10, in a surface included in the second oral image 402 (a surface observed from the second viewpoint).

[0084] As described in Figure 2 , in the case of an object such as a tooth, since a surface can be scanned in all directions, a scanned surface can be displayed even if the viewpoint is changed. However, in the case of a noise substance, since a surface is not scanned in all directions, when the viewpoint is a direction in which a surface is not scanned, a surface of the noise substance which is not scanned (a back surface of a scanned surface) is displayed. Thus, when a surface which is not scanned (a back surface of a scanned surface) is displayed in a screen, it can be determined that the surface is of a noise substance which is not a tooth.

[0085] Thus, the oral image processing apparatus 100 can delete only noise data, and not delete oral data, by deleting only a portion displayed in a second color in the selected region 440 in Figure 4c .

[0086] Referring again to Figure 4cThe oral image processing apparatus 100 of an embodiment can select the region 450 in which noise data is to be deleted, based on user input of moving the brush icon 430. The oral image processing apparatus 100 can divide the three-dimensional oral image into a tooth region and a gingival region, and the selected region 450 is included in the gingival region, as shown in Figure 4d As shown in , the gingival back region can be displayed in part in the screen, and the gingival back region can be displayed in the second color. Thus, when the noise data deletion function is applied to the gingival region, the gingival back region can be deleted, and thus the oral image processing apparatus 100 of an embodiment can not apply the noise data deletion function to the gingival region.

[0087] Figure 4d On the other hand, referring to , the second oral image 402 can have noise data 460 spaced apart from the tooth after noise data included in the selected region 440 is deleted. For example, the second oral image 402 can have a region displayed in the second color (i.e., noise data 460) spaced apart from a region displayed in the first color by a distance of more than a predetermined distance.

[0088] Figure 4e Referring to Figure 4d , the oral image processing apparatus 100 can delete the region displayed in the second color (noise data 460) in based on user input or automatically. Thus, the oral image processing apparatus 100 of an embodiment can accurately and easily delete noise data adjacent to tooth data using the noise data deletion function.

[0089] Figure 5 is a diagram referred to in order to explain an action of the oral image processing apparatus of an embodiment automatically deleting noise data.

[0090] The oral image processing apparatus 100 of an embodiment can perform an automatic noise deletion function.

[0091] For example, as shown in Figure 5 , the three-dimensional oral image 510 is displayed, and the oral image processing apparatus 100 automatically changes the position of the virtual reference plane and deletes at least a portion of the back region included in the three-dimensional oral image when the automatic noise data deletion function is selected by user input.

[0092] The three-dimensional oral image of an embodiment can include a region of a surface that is scanned and a back region of the region of the surface that is scanned (a region of a surface that is not scanned).

[0093] When the angle between the direction vector of the vertex data of the first region included in the back region and the normal vector of the imaginary reference plane has a preset range, the oral image processing apparatus 100 can delete the first region. Also, when the angle between the normal vector of the position-changed imaginary reference plane and the direction vector of the vertex data of the second region included in the back region of the scanned surface has a preset range, the oral image processing apparatus 100 can delete the second region.

[0094] For example, when the surface of the tooth is scanned as a whole (when three-dimensional data is acquired in various directions), the tooth is displayed only with the scanned surface in the three-dimensional oral image, and the tooth data is not deleted.

[0095] On the contrary, in the case of the noise substance, three-dimensional data is not acquired in various directions, and thus the three-dimensional data of the noise substance is displayed with the scanned surface and the back region of the scanned surface in the three-dimensional oral image. If the automatic noise deletion function is applied, the position of the imaginary reference plane is changed, and at the same time, the back region included in the three-dimensional oral image is deleted. Thus, when the automatic noise deletion function is applied to the oral image 510 of an embodiment, the three-dimensional data 525 of the noise substance can be deleted.

[0096] The oral image of an embodiment images the surface in the oral cavity of the patient as a whole, and thus one or more teeth and gums surrounding the teeth, etc. are simultaneously imaged. At this time, in the case of the gum located in the opposite direction of the normal vector of the imaginary reference plane, the gum back region 515 can be included in the three-dimensional oral image. Thus, when the noise data deletion function is applied to the gum region, the gum back region 515 can be deleted. Thus, the oral image processing apparatus 100 of an embodiment can divide the three-dimensional oral image, distinguish the tooth region and the gum region, and prevent the gum back region 515 from being deleted by applying the noise deletion function only to the tooth region.

[0097] When the automatic noise deletion function is completed, the oral image processing apparatus 100 of an embodiment can display the oral image 520 in which the noise data 525 is deleted in the screen.

[0098] Figure 6 is a flowchart illustrating an oral image processing method of an embodiment.

[0099] Referring to Figure 6 The oral image processing apparatus 100 of an embodiment can acquire three-dimensional oral data (step S610).

[0100] The oral image processing apparatus 100 can acquire three-dimensional oral data when the oral cavity and / or the tooth model is scanned by the oral scanner 10. At this time, in order to scan all surfaces of the tooth, the tooth can be scanned in various directions.

[0101] The three-dimensional oral data of an embodiment can be in a point cloud form representing a surface of an object body. The point cloud includes a plurality of points, which can represent position information of the surface of the object body. The actions regarding acquiring the three-dimensional oral data have been described with reference to Figure 2 The detailed description will therefore be omitted.

[0102] The oral image processing apparatus 100 can generate a three-dimensional oral image including the scanned surface region and the back region of the scanned surface region (step S620).

[0103] For example, the oral image processing apparatus 100 can generate a three-dimensional oral image including a color for distinguishing the scanned surface region and the back region of the scanned surface region. Alternatively, the oral image processing apparatus 100 can generate a three-dimensional oral image such that the scanned surface region includes a texture and the back region does not include the texture. However, the present application is not limited thereto.

[0104] The oral image processing apparatus 100 of an embodiment can display the generated three-dimensional oral image in a screen (step S630).

[0105] The oral image processing apparatus 100 can display the three-dimensional oral image in a two-dimensional screen. For example, the oral image processing apparatus 100 can display the three-dimensional oral image in a screen based on a viewpoint representing a direction of viewing the three-dimensional oral image and the screen.

[0106] The oral image processing apparatus 100 can display the scanned surface region in a first color based on the acquired three-dimensional data in the three-dimensional oral image. In addition, the scanned surface region can include a texture. The oral image processing apparatus 100 can display the back region of the scanned surface region in a second color (e.g., black).

[0107] The oral image processing apparatus 100 of an embodiment can set a deletion region in the oral image displayed in the screen (step S640).

[0108] For example, the oral image processing apparatus 100 can display an item corresponding to a noise data deletion function, and when receiving a user input selecting the item, can display an icon for setting a region (deletion region) in which noise data is to be deleted. The oral image processing apparatus 100 can set a noise region in the oral image based on a user input moving the icon. However, the present application is not limited thereto, and the oral image processing apparatus 100 can set a noise region using various user interfaces.

[0109] The oral image processing apparatus 100 of an embodiment can delete the back region included in the deletion region (step S650).

[0110] For example, the oral image processing apparatus 100 deletes only the back surface region displayed in the second color in the noise region, without deleting the scanned surface region displayed in the first color.

[0111] In addition, the oral image processing apparatus 100 can divide the three-dimensional oral image into a tooth region and a gum region, and in the noise region, delete only the back surface region included in the tooth region, without deleting the back surface region included in the gum region.

[0112] In addition, the oral image processing apparatus 100 can delete the back surface region (region displayed in the second color) separated from the scanned surface region (region displayed in the first color) by more than a preset distance.

[0113] In addition, the oral image processing apparatus 100 of an embodiment can delete the back surface region included in the three-dimensional oral image by performing an automatic noise deletion function without a user input for setting a deletion region. For example, the oral image processing apparatus 100 can automatically set an imaginary reference surface, and while changing a position of the imaginary reference surface, delete at least a portion of the back surface region included in the three-dimensional oral image. When an angle between a direction vector of vertex data of a first region included in the back surface region and a normal vector of the imaginary reference surface has a preset range, the oral image processing apparatus 100 can delete the first region. In addition, the oral image processing apparatus 100 can change the imaginary reference surface in a preset direction, and when an angle between a normal vector of the changed imaginary reference surface and a direction vector of vertex data of a second region included in the back surface region has a preset range, the oral image processing apparatus 100 can delete the second region.

[0114] At this time, the oral image processing apparatus 100 can divide the three-dimensional oral image, distinguish a tooth region and a gum region, and by applying the noise deletion function only to the tooth region, not delete the back surface region included in the gum region.

[0115] Figure 7 FIG. 1 is a block diagram illustrating an oral image processing apparatus according to an embodiment.

[0116] Figure 6 The oral image processing method illustrated in FIG. 8 can be performed by the oral image processing apparatus 100. Accordingly, Figure 6 The oral image processing method illustrated in FIG. 8 can be a flowchart illustrating operations of the oral image processing apparatus 100.

[0117] Referring to Figure 7 The oral image processing apparatus 100 can include a communication interface 110, a user interface 120, a display 130, a storage 140, and a processor 150.

[0118] The communication interface 110 can communicate with at least one external electronic device (e.g., the oral scanner 10, a server, or an external medical device, etc.) through a wired or wireless communication network. The communication interface 110 can communicate with at least one external electronic device through the control of the processor 150.

[0119] Specifically, the communication interface 110 can include at least one short-range communication module that communicates in accordance with a communication standard such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), Near Field Communication / Radio Frequency Identification (NFC / RFID), Wi-Fi Direct, Ultra-Wideband (UWB), or ZigBee, etc.

[0120] Further, the communication interface 110 can further include a long-range communication module that communicates with a server for supporting long-range communication in accordance with a long-range communication standard. Specifically, the communication interface 110 can include a long-range communication module that communicates through a network for Internet communication. Further, the communication interface 110 can include a long-range communication module that communicates through a communication network in accordance with a communication standard such as 3G, 4G, and / or 5G, etc.

[0121] Further, the communication interface 110 can include at least one port that is connected to an external electronic device through a wired cable to communicate with the external electronic device (e.g., an oral scanner, etc.) in a wired manner. Thus, the communication interface 110 can communicate with the external electronic device that is wiredly connected through the at least one port.

[0122] The user interface 120 can receive a user input for controlling the oral image processing device 100. The user interface 120 can include a touch panel for detecting a user's touch, a button for receiving a user's pressing operation, a user input device including a mouse or a keyboard for designating or selecting a point on a user interface screen, etc., but is not limited thereto.

[0123] Further, the user interface 120 can include a voice recognition device for voice recognition. For example, the voice recognition device can be a microphone, and the voice recognition device can receive a user's voice command or voice request. Thus, the processor 150 can control to perform an operation corresponding to the voice command or the voice request.

[0124] The display 130 displays a screen. Specifically, the display 130 can display a predetermined screen according to the control of the processor 150. Specifically, the display 130 can display a user interface screen including a generated oral cavity image based on data acquired by scanning the oral cavity of the patient through the oral cavity scanner 10. Alternatively, the display 130 can display a user interface screen including information related to the dental treatment of the patient.

[0125] The memory 140 can store at least one instruction. Further, the memory 140 can store at least one instruction executed by the processor 150. Further, the memory 140 can store at least one program executed by the processor 150. Further, the memory 140 can store data received from the oral cavity scanner 10 (e.g., raw data acquired by scanning the oral cavity, etc.). Alternatively, the memory 140 can store an oral cavity image representing the oral cavity in three dimensions. The memory 140 according to an embodiment can include one or more instructions for removing noise data in an oral cavity image. The memory 140 according to an embodiment can include one or more instructions for performing the method disclosed in the present specification to remove noise data in an oral cavity image.

[0126] The processor 150 executes at least one instruction stored in the memory 140 to control the execution of an intended operation. Among them, the at least one instruction can be stored in an internal memory in the processor 150, or in the memory 140 included in the data processing apparatus separately from the processor.

[0127] Specifically, the processor 150 executes at least one instruction to control at least one structure inside the data processing apparatus to perform an intended operation. Therefore, even though the case where the processor performs a predetermined operation is exemplarily explained, it also means that the processor controls at least one structure inside the data processing apparatus to perform the predetermined operation.

[0128] The processor 150 of an embodiment acquires three-dimensional oral cavity data based on two-dimensional image data acquired by scanning an oral cavity including teeth, by executing one or more instructions stored in the memory 140. At this time, the three-dimensional oral cavity data can be three-dimensional surface data representing the surface shape of an object in three dimensions, or in the form of a point cloud. The processor 150 generates a three-dimensional oral cavity image to distinguish a scanned surface region and a back region of the surface region based on the three-dimensional oral cavity data, by executing one or more instructions stored in the memory 140, and displays the three-dimensional oral cavity image in a screen. The processor 150 can distinguish the scanned surface region and the back region of the scanned surface region based on the viewpoint of the screen and the direction vector of the point. The processor 150 can display the scanned surface in a first color of mapping and the unscanned surface in a second color based on the acquired three-dimensional data.

[0129] The processor 150 sets a deletion area in the displayed oral cavity image and deletes a back area included in the deletion area by executing one or more instructions stored in the memory 140. When the noise data deletion function is selected, the processor 150 can control the display 130 to display an icon for selecting an area desired to be deleted. The processor 150 can select an area (deletion area) in which noise data is to be deleted based on a user input of moving the displayed icon. The processor 150 deletes only a portion displayed in a second color in the selected area without deleting a portion displayed in a first color by executing one or more instructions stored in the memory 140. At this time, the portion displayed in the second color indicates a surface that is not scanned (a back surface of a scanned surface). For example, the processor 150 can not delete a scanned surface area in a surface included in the oral cavity image and delete only a back surface area of the scanned surface.

[0130] In addition, the processor 150 divides the oral cavity image into a tooth area and a gum area by executing one or more instructions stored in the memory 140 and can not delete a portion displayed in a second color (e.g., a gum back surface area) included in the gum area when the gum area is selected as an area in which noise data is to be deleted. In addition, the processor 150 can delete a back surface area (a portion displayed in a second color) separated by more than a preset distance from a scanned surface area (a portion displayed in a first color) by executing one or more instructions stored in the memory 140.

[0131] The processor 150 according to an example can be embodied in the form of at least one internal processor and a memory device (e.g., a random access memory (RAM), a read only memory (ROM), etc.) for storing at least one of programs, instructions, signals, and data processed or used in the internal processor.

[0132] In addition, the processor 150 can include a graphic processing unit (GPU) for processing graphics corresponding to a video. In addition, the processor can be embodied as a system on chip (SoC) in which a core and a graphic processing unit (GPU) are integrated. In addition, the processor can include a plurality of cores of one or more. For example, the processor can include a dual core, a triple core, a quad core, a hexa core, an octa core, a deca core, a dodeca core, a hexadeca core, etc.

[0133] In the disclosed embodiment, the processor 150 can generate an oral cavity image based on a two-dimensional image received from the oral cavity scanner 10.

[0134] Specifically, the communication interface 110 can receive data acquired from the oral scanner 10, for example, raw data acquired by scanning an oral cavity, by control of the processor 150. Also, the processor 150 can generate a three-dimensional oral image representing a three-dimensional oral cavity based on the raw data received from the communication interface 110. For example, the oral scanner 10 can include an L camera corresponding to a left field of view and an R camera corresponding to a right field of view to reproduce a three-dimensional image according to optical triangulation. Also, the oral scanner can acquire L image data corresponding to the left field of view and R image data corresponding to the right field of view from the L camera and the R camera, respectively. Subsequently, the oral scanner can transmit raw data including the L image data and the R image data to the communication interface 110 of the oral image processing apparatus 100.

[0135] Then, the communication interface 110 can transmit the received raw data to the processor 150, and the processor 150 can generate an oral image representing a three-dimensional oral cavity based on the received raw data.

[0136] In addition, the processor 150 can receive an oral image representing a three-dimensional oral cavity directly from an external server, a medical device, etc. by controlling the communication interface 110. In this case, the processor can acquire the three-dimensional oral image without generating a three-dimensional oral image based on raw data.

[0137] According to the disclosed embodiments, the operations of the processor 150 to "extract", "acquire", "generate", etc. can refer to cases where the operations as described above are directly performed by executing at least one instruction in the processor 150, and cases where other constituent elements are controlled to perform the operations as described above.

[0138] To implement the embodiments disclosed in the present specification, the oral image processing apparatus 100 can include Figure 7 Some of the constituent elements shown can also include Figure 7 More constituent elements than those shown can also be included.

[0139] In addition, the oral image processing apparatus 100 can store and execute a dedicated software linked with the oral scanner. The dedicated software can be referred to as a dedicated program, a dedicated tool, or a dedicated application. In a case where the oral image processing apparatus 100 and the oral scanner 10 are operated in linkage with each other, the dedicated software stored in the oral image processing apparatus 100 is connected to the oral scanner 10 and can receive data acquired by scanning the oral cavity in real time. For example, there is a dedicated software in the i500 product of the oral scanner of the Medit company, which is used to process data acquired by scanning the oral cavity. Specifically, the Medit company has developed and distributed the "Medit Link" software, which is used to process, manage, use, and / or transmit data acquired from the oral scanner (e.g., i500). The "dedicated software" refers to a program, a tool, or an application operable in linkage with the oral scanner, and thus can be used for various oral scanners developed and distributed by various manufacturers. In addition, the dedicated software as described above can be developed and distributed separately from the oral scanner that performs the oral scanning.

[0140] The oral image processing apparatus 100 can store and execute a dedicated software corresponding to the i500 product. The transmission software can perform at least one operation for acquiring, processing, storing, and / or transmitting an oral image. The dedicated software can be stored in a processor. In addition, the dedicated software can provide a user interface to use data acquired from the oral scanner. The user interface screen provided by the dedicated software can include an oral image generated according to the disclosed embodiments.

[0141] The method of processing an oral image according to an embodiment of the disclosure is implemented in the form of a program command executable by various computer mechanisms, and is recorded in a computer readable medium. In addition, in the embodiment of the disclosure, it can be a computer readable storage medium in which one or more programs including at least one instruction for executing the method of processing an oral image are recorded.

[0142] The computer readable storage medium can include program instructions, data files, data structures, etc. alone or in combination. Examples of the computer readable storage medium include magnetic media such as a hard disk, a floppy disk, and a magnetic tape, optical media such as a CD-ROM, a DVD, a floptical disk, and a hardware device for storing and executing program instructions such as a ROM, a RAM, and a flash memory.

[0143] Among them, the device readable storage medium can be provided in the form of a non-transitory storage medium. Among them, the "non-transitory storage medium" can mean a storage medium that is actually tangible. In addition, the "non-transitory storage medium" can include a buffer that temporarily stores data.

[0144] According to an embodiment, the processing method of an oral image according to various embodiments disclosed in the present specification can be provided by being included in a computer program product. The computer program product can be distributed in the form of a device readable storage medium (for example, a compact disc read only memory (CD-ROM)). Alternatively, it is distributed directly, online between two user devices (for example, a smartphone), through an application store (for example, a game store, etc.). Specifically, the computer program product according to the disclosed embodiments can include a storage medium in which a program including at least one instruction to execute the processing method of an oral image according to the disclosed embodiments is recorded.

[0145] The above has been described in detail with respect to the embodiments, but the scope of the present application is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concepts of the present application defined in the claims are also within the scope of the present application.

Claims

1. An oral image processing method, wherein including the steps of: scanning an object to acquire three-dimensional oral data including vertex data, generating a three-dimensional oral image based on the three-dimensional oral data, the three-dimensional oral image including a scanned surface area and a back area of the scanned surface area, displaying the three-dimensional oral image on a screen, and deleting at least a portion of the back area; the step of deleting at least a portion of the back area includes the steps of: deleting a first area included in the back area when an angle between a normal vector of vertex data of the first area and a normal vector of the screen has a predetermined range.

2. The oral image processing method according to claim 1, wherein the step of deleting at least a portion of the back area further includes the steps of: changing a direction in which the three-dimensional oral image is displayed on the screen, and deleting a second area included in the back area when an angle between a normal vector of vertex data of the second area and a normal vector of the screen has the predetermined range.

3. The oral image processing method according to claim 1, wherein the predetermined range is 90 degrees or more and 180 degrees or less.

4. The oral image processing method according to claim 1, wherein the step of displaying the three-dimensional oral image on a screen includes the steps of: displaying the three-dimensional oral image on the screen based on at least one of a viewpoint indicating a direction in which the three-dimensional oral image is observed and the screen in which the three-dimensional oral image is projected in a two-dimensional manner.

5. The oral image processing method according to claim 1, wherein the oral image processing method further includes the steps of: setting a deletion area in the three-dimensional oral image; the step of displaying the three-dimensional oral image on a screen includes the steps of: displaying a second area in the three-dimensional oral image as the back area when an angle between a normal vector of vertex data of the second area and a normal vector of the screen has the predetermined range; the step of deleting at least a portion of the back area further includes the steps of: deleting the back area included in the deletion area.

6. The oral image processing method according to claim 5, wherein the oral image processing method further includes the steps of: displaying at least one of an item corresponding to a deletion function and an icon for selecting the deletion area.

7. The oral image processing method according to claim 6, wherein the step of displaying at least one of an item corresponding to a deletion function and an icon for selecting the deletion area includes the steps of: displaying the icon for selecting the deletion area when a user input selecting the item corresponding to the deletion function is received, and displaying at least one size setting icon to set a size of the icon for selecting the deletion area.

8. The oral image processing method according to claim 6, wherein the step of setting a deletion area in the three-dimensional oral image includes the steps of: displaying the icon for selecting the deletion area when a user input selecting the item corresponding to the deletion function is received, and receiving a user input for selecting an icon movement for the deletion area, and setting an area through which an icon for selecting the deletion area passes as the deletion area.

9. The dental image processing method according to claim 1, wherein the step of displaying the three-dimensional dental image on a screen comprises the steps of: displaying the scanned surface area in a first color, and displaying the back surface area in a second color different from the first color.

10. The dental image processing method according to claim 1, wherein the step of displaying the three-dimensional dental image on a screen comprises the steps of: determining a texture of the scanned surface area based on the three-dimensional dental data, and displaying the scanned surface area with the determined texture.

11. The dental image processing method according to claim 1, wherein the step of deleting at least a portion of the back surface area further comprises the step of: deleting at least a portion of the back surface area spaced apart from the scanned surface area.

12. The dental image processing method according to claim 1, wherein the dental image processing method further comprises the steps of: dividing the dental image into a tooth area and a gum area; the step of deleting at least a portion of the back surface area further comprises the step of: deleting at least a portion of the back surface area included in the tooth area without deleting at least a portion of the back surface area included in the gum area.

13. An oral image processing apparatus, wherein comprises: a display, a memory for storing one or more instructions, and a processor; the processor is configured to perform the following operations by executing the one or more instructions stored in the memory: scanning an object body to acquire three-dimensional dental data including vertex data, generating a three-dimensional dental image including a scanned surface area and a back surface area of the scanned surface area based on the three-dimensional dental data, displaying the three-dimensional dental image on a screen, deleting at least a portion of the back surface area; the processor is further configured to perform the following operations by executing the one or more instructions stored in the memory: deleting a first area included in the back surface area when an angle between a normal vector of vertex data of the first area and a normal vector of the screen has a predetermined range.

14. A computer-readable recording medium, wherein a program including at least one instruction for executing a dental image processing method in a computer is recorded, the dental image processing method comprises the steps of: scanning an object body to acquire three-dimensional dental data including vertex data, generating a three-dimensional dental image including a scanned surface area and a back surface area of the scanned surface area based on the three-dimensional dental data, displaying the three-dimensional dental image on a screen, and deleting at least a portion of the back surface area; the step of deleting at least a portion of the back surface area comprises the steps of: deleting at least a portion of the back surface area spaced apart from the scanned surface area. When an angle between a normal vector of vertex data of a first region included in the back region and a normal vector of the picture has a preset range, the first region is deleted.

Images