System and method for compressing intraoral scanning data

Abstract

An intraoral scanning system (102) includes a handheld intraoral scanning device (104). A handheld intraoral scanning device (104) captures intraoral scan data (110) associated with a user. The intraoral scan data includes texture data (110A) and three-dimensional (3D) data (110B) captured during an intraoral scan procedure of a user. The handheld intraoral scanning device (104) generates compressed texture data (112A) associated with the texture data (110A) based on applying the first compression operation (502) to the texture data (110A). The handheld intraoral scanning device (104) generates compressed 3D data (112B) associated with the 3D data (110B) based on applying the second compression operation (602) to the 3D data (110B). The handheld intraoral scanning device (104) transmits a combination of the compressed texture data (112A) and the compressed 3D data (112B) as compressed intraoral scanning data (112) to one or more client devices (106).

Description

Technical Field

[0001] The exemplary embodiments of this disclosure generally relate to the compression of intraoral images, and more specifically, to an intraoral scanning system and a method for compressing intraoral scanning data. Background Technology

[0002] Intraoral scanning has become an indispensable tool in modern dentistry due to its various advantages. Intraoral scanning provides patients with a non-invasive and comfortable experience, delivers immediate results, and allows for precise measurements and visualization.

[0003] Typically, intraoral scanners are used by users (such as dentists in the dental industry) for intraoral scanning. For example, an intraoral scan of a patient's dental arch captured by an intraoral scanner can be used to generate a digital impression of the patient's mouth. Intraoral scanners include a light source projected onto the dental arch to capture intraoral scan data. Typically, intraoral scan data includes texture data and three-dimensional (3D) data. The intraoral scan data is further processed to generate 3D information about the dental arch (e.g., a 3D model), and this 3D model can be displayed on a user device associated with the dentist for examination.

[0004] Currently, intraoral scan data captured by intraoral scanners is stored as "raw data" and transmitted to the user device. However, this raw data consumes a large amount of storage capacity, and transmitting the raw data from the intraoral scanner to the user device also uses a significant amount of bandwidth. Summary of the Invention

[0005] An intraoral scanning system, a method, and a computer-programmable product are provided for compressing intraoral scanning data.

[0006] In one aspect, an intraoral scanning system is disclosed. The intraoral scanning system includes a handheld intraoral scanning device configured to capture intraoral scanning data associated with a user. The intraoral scanning data includes texture data and three-dimensional (3D) data captured during the user's intraoral scanning process. The handheld intraoral scanning device can also generate compressed texture data associated with the texture data based on applying a first compression operation to the texture data. The handheld intraoral scanning device can also generate compressed 3D data associated with the 3D data based on applying a second compression operation to the 3D data. The second compression operation may differ from the first compression operation. The handheld intraoral scanning device can also transmit a combination of the compressed texture data and the compressed 3D data as compressed intraoral scanning data to one or more client devices.

[0007] In some embodiments, the first compression operation corresponds to a high-efficiency video coding (HEVC) operation. The HEVC compression operation can also be referred to as H.265 and can be a widely used compression standard for encoding and decoding image or video content. In another example, the first compression operation can be based on the Joint Photographic Experts Group (JPEG) compression protocol. JPEG is a lossy compression protocol, but it can be compensated for by increasing the resolution of the captured texture data.

[0008] In some embodiments, the handheld intraoral scanning device further includes a monitoring unit configured to determine bandwidth information associated with one or more wireless full-duplex communication channels between the handheld intraoral scanning device and the one or more client devices. The handheld intraoral scanning device may also be configured to determine a quality factor for the first compression operation based on the determined bandwidth information. The handheld intraoral scanning device may also be configured to generate compressed texture data by applying the first compression operation to the texture data. The texture data may be compressed based on the determined quality factor. The processor unit may be configured to determine a reliability score for the texture data based on the quality factor. The reliability score may also include the accuracy of the texture data and / or the amount of texture data captured in the region of the scanned object.

[0009] In some embodiments, the 3D data associated with the intraoral scan data includes color data, amplitude data, and depth data.

[0010] In some embodiments, in order to apply the second compression operation to the 3D data, the handheld intraoral scanning device can be configured to generate a first intermediate result based on applying a first color transformation matrix to the 3D data. The first color transformation matrix can be applied to convert color components in the 3D data from a first color space to a second color space. The handheld intraoral scanning device can also be configured to generate a second intermediate result based on modifying each pixel value of the generated first intermediate result by predetermined values. The handheld intraoral scanning device can also be configured to generate a third intermediate result based on applying a first transformation operation to the generated second intermediate result. The handheld intraoral scanning device can also be configured to determine one or more transformation coefficients based on applying the first transformation operation to the third intermediate result. The one or more transformation coefficients can be associated with the first transformation operation. The handheld intraoral scanning device can also be configured to quantize the determined one or more transformation coefficients. The handheld intraoral scanning device can also be configured to generate first intermediate data based on applying a first encoding operation to the quantized one or more transformation coefficients. The compressed 3D data may include the first intermediate data.

[0011] In some embodiments, the application of the first color transformation matrix is ​​based on principal component analysis (PCA) associated with the first color space. The first color transformation matrix may be a 3×3 matrix comprising linear transformation coefficients applied to the color data of the matrix. These linear transformation coefficients can be determined by PCA from the 3D data such that the effect of maximizing variance over the one or more transformation coefficients (e.g., transformed color coefficients) is enhanced.

[0012] In some embodiments, the first transformation operation corresponds to a discrete cosine transformation (DCT) operation. DCT can be used to transform the spatial domain of the 3D data to the frequency domain. DCT can be applied to each color channel of the first color transformation matrix. For example, DCT is based on a cosine function, where the contribution of low-frequency cosine colors to the 3D data can be greater than that of high-frequency cosine color channels.

[0013] In some embodiments, the first encoding operation corresponds to an arithmetic encoding operation.

[0014] In some embodiments, in order to apply the second compression operation to the 3D data, the handheld intraoral scanning device can be configured to generate a fourth intermediate result based on applying a second transformation operation to the third intermediate result. The handheld intraoral scanning device can also be configured to apply a second color transformation matrix to the generated fourth intermediate result to convert the color components in the generated fourth intermediate result from the second color space to the first color space, generating a fifth intermediate result. The handheld intraoral scanning device can also be configured to calculate residual data based on the 3D data and the generated fifth intermediate result. The handheld intraoral scanning device can also be configured to generate second intermediate data based on applying the first encoding operation to the calculated residual data. The compressed 3D data includes the second intermediate data.

[0015] In some embodiments, the second transformation operation may be the inverse operation of the first transformation operation.

[0016] In some embodiments, the second color transformation matrix may be the inverse of the first color transformation matrix.

[0017] In some embodiments, the handheld intraoral scanning device may also be configured to transmit the first intermediate data and the second intermediate data as the compressed 3D data to the one or more client devices.

[0018] In some embodiments, the one or more client devices are at least one of a computer, a display screen, a tablet computer, or a smartphone.

[0019] In another aspect, this disclosure provides a method for compressing intraoral scan data. The method may include capturing intraoral scan data associated with a user. The intraoral scan data includes texture data and three-dimensional (3D) data captured during the user's intraoral scan procedure. The method may further include generating compressed texture data associated with the texture data based on applying a first compression operation to the texture data. The method may further include generating compressed 3D data associated with the 3D data based on applying a second compression operation to the 3D data. The second compression operation may differ from the first compression operation. The method may further include transmitting a combination of the compressed texture data and the compressed 3D data as compressed intraoral scan data to one or more client devices.

[0020] In another aspect, this disclosure provides a computer-programmable product including a non-transitory computer-readable medium having computer-executable instructions stored thereon, the instructions causing the processing circuitry to perform operations when executed. The operations may include capturing intraoral scan data associated with a user. The intraoral scan data includes texture data and three-dimensional (3D) data captured during an intraoral scan of the user. The operations may further include generating compressed texture data associated with the texture data based on applying a first compression operation to the texture data. The operations may further include generating compressed 3D data associated with the 3D data based on applying a second compression operation to the 3D data. The second compression operation may differ from the first compression operation. The operations may further include transmitting a combination of the compressed texture data and the compressed 3D data as compressed intraoral scan data to one or more client devices.

[0021] On the other hand, this disclosure provides an intraoral scanning system. The intraoral scanning system may include a handheld intraoral scanning device configured to capture intraoral scanning data associated with a user, the intraoral scanning data including texture data and three-dimensional (3D) data captured during the user's intraoral scanning process. The handheld intraoral scanning device may generate compressed texture data associated with the texture data based on applying a compression operation to the texture data. Furthermore, the handheld intraoral scanning device may generate compressed 3D data associated with the 3D data based on applying the compression operation to the 3D data, and transmit the combination of the compressed texture data and the compressed 3D data as compressed intraoral scanning data (112) to one or more client devices. The compression operation may include either the first compression operation or the second compression operation.

[0022] In another aspect, this disclosure provides an intraoral scanning system. The intraoral scanning system may include a handheld intraoral scanning device configured to capture intraoral scanning data associated with a user and generate compressed intraoral scanning data associated with the intraoral scanning data based on a first compression operation applied to the intraoral scanning data. Furthermore, the handheld intraoral scanning device may be configured to wirelessly transmit the compressed intraoral scanning data to one or more client devices. The compression operation may include either the first compression operation or the second compression operation.

[0023] The above description of the invention is illustrative only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent from the accompanying drawings and the following detailed description.

[0024] Effects (one or more) of the present invention

[0025] According to this disclosure, an intraoral scanning system, a method, and a computer-programmable product are provided. One of the objectives of this disclosure is to compress intraoral scanning data to achieve efficient storage and bandwidth utilization.

[0026] Conventional systems may include intraoral scanners for capturing intraoral scan data of a patient's dental arch. Such conventional intraoral scanners may have limited processing power, potentially only used for capturing intraoral scan data of the dental arch and transmitting the captured intraoral scan data to one or more client devices. However, this leads to inefficient use of computational resources, such as memory (for storage) and bandwidth (for transmission). Therefore, a system is needed that compresses the captured intraoral scan data to ensure efficient use of storage capacity and bandwidth.

[0027] The disclosed intraoral scanning system may include a handheld intraoral scanning device configured to capture intraoral scan data of a user, including texture data and three-dimensional (3D) data captured during the user's intraoral scanning process. The disclosed handheld intraoral scanning device may also be configured to generate compressed texture data and compressed 3D data based on a set of compression operations applied to the captured texture data and 3D data. Compared to the computational resources utilized by the captured raw texture data and 3D data, the compressed texture data and compressed 3D data may require less storage memory and less transmission bandwidth. Therefore, the disclosed handheld intraoral scanning device can reduce data requirements, which will lead to the possibility of wirelessly transmitting intraoral scan data over weak wireless networks such as Wi-Fi networks. Furthermore, the disclosed handheld intraoral scanning device can reduce the storage space occupied by intraoral scan data, thus providing users with the option to store more data streams in the cloud without increasing the price. In addition, due to the low bandwidth requirements, compressed intraoral scan data can be transmitted simultaneously and in real time to multiple client devices. The intraoral scanning system also allows handheld intraoral scanners to simultaneously broadcast compressed intraoral scan data to multiple client devices connected to the handheld intraoral scanner via the same network. Therefore, multiple users can access the intraoral scan data simultaneously.

[0028] An intraoral scanning system may include a handheld intraoral scanning device configured to capture user-associated intraoral scanning data during a scanning sequence. The intraoral scanning data may include a first dataset captured during a first scanning mode of the scanning sequence and a second dataset captured during a second scanning mode of the scanning sequence, wherein a processor unit of the handheld intraoral scanning device is configured to compress the first dataset but not the second dataset. The first dataset may include diagnostic data, such as texture data. The processor unit may be configured to wirelessly transmit a combination of the compressed first dataset and the uncompressed second dataset. Attached Figure Description

[0029] This disclosure is illustrated in the accompanying drawings by way of example rather than limitation, in which the same reference numerals indicate the same elements, and in the accompanying drawings:

[0030] Figure 1 This is a schematic diagram illustrating an exemplary network environment of an intraoral scanning system for compressing intraoral scanning data according to an exemplary embodiment;

[0031] Figure 2 A block diagram of a handheld intraoral scanning device according to an exemplary embodiment is shown;

[0032] Figure 3 A block diagram of one or more client devices according to an exemplary embodiment is shown;

[0033] Figure 4A , Figure 4B , Figure 4C and Figure 4D Different examples of compression of intraoral scan data are shown according to exemplary embodiments;

[0034] Figure 5 This is a schematic diagram depicting a pipeline of a first compression operation according to an exemplary embodiment;

[0035] Figure 6A and Figure 6B This is a schematic diagram depicting a pipeline of a second compression operation according to an exemplary embodiment;

[0036] Figure 7 This is a schematic diagram illustrating an environment for a handheld intraoral scanning device to communicate with one or more client devices according to an exemplary embodiment;

[0037] Figure 8 This is a schematic diagram illustrating the capture of intraoral scan data according to an exemplary embodiment;

[0038] Figure 9 It is a sequence diagram depicting the transmission of compressed intraoral data according to an exemplary embodiment;

[0039] Figure 10 An exemplary flowchart for compression of intraoral scan data is shown according to another exemplary embodiment;

[0040] Figure 11 This is a schematic diagram depicting an exemplary environment for real-time capture of intraoral scan data, compression of intraoral scan data, and rendering of decompressed intraoral scan data, according to an exemplary embodiment; and

[0041] Figure 12 This is a schematic diagram showing the scan sequence. Detailed Implementation

[0042] In the following description, numerous specific details are set forth for purposes of explanation in order to provide a thorough understanding of this disclosure. However, it will be apparent to those skilled in the art that this disclosure may be practiced without these specific details. In other instances, systems and methods are shown only in block diagram form to avoid obscuring this disclosure.

[0043] In this specification, references to "an embodiment" or "a particular embodiment" mean that a specific feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment of this disclosure. The phrase "in one embodiment" appearing throughout the specification does not necessarily refer to all of the same embodiment, nor is it a single or alternative embodiment mutually exclusive with other embodiments. Furthermore, the terms "a" and "an" as used herein do not indicate a limitation on quantity, but rather indicate the presence of at least one of the mentioned items. In addition, various features that may be shown in some embodiments but not in others are described. Similarly, various requirements that may be requirements of some embodiments but not of others are described.

[0044] Some embodiments of the present disclosure will now be described more fully with reference to the accompanying drawings, which illustrate some, but not all, embodiments of the present disclosure. In fact, various embodiments of the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided to enable the present disclosure to meet applicable legal requirements. Throughout the text, the same reference numerals refer to the same elements. As used herein, the terms “data,” “content,” “information,” and similar terms are used interchangeably to refer to data capable of being transmitted, received, and / or stored according to embodiments of the present disclosure. Furthermore, the terms “processor,” “controller,” and “processing circuitry,” and similar terms, are used interchangeably to refer to a processor capable of processing information according to embodiments of the present disclosure. Additionally, the terms “electronic device,” “electronic apparatus,” and “device” are used interchangeably to refer to an electronic device monitored by a system according to embodiments of the present disclosure. Therefore, any use of these terms should not be construed as limiting the spirit and scope of the embodiments of the present disclosure.

[0045] The embodiments described herein are for illustrative purposes and various variations are possible. It should be understood that various omissions and equivalent substitutions are contemplated, as circumstances may suggest or dictate, but are intended to cover the application or implementation of this disclosure without departing from its spirit or scope. Furthermore, it should be understood that the wording and terminology used herein are for descriptive purposes and should not be considered limiting. Any headings used in this specification are for convenience only and have no legal or limiting effect.

[0046] As used in this specification and claims, the terms “for example,” “like,” and “such as,” as well as the verbs “comprising,” “having,” “including,” and other verb forms thereof, when used in conjunction with a list of one or more components or other items, shall each be interpreted as open-ended, meaning that the list should not be considered as excluding other additional components or items. Other terms shall be interpreted in their broadest reasonable sense unless used in a context requiring a different interpretation.

[0047] An intraoral scanning system, a method, and a computer-programmable product are provided for compressing intraoral scanning data using a handheld intraoral scanning device.

[0048] For example, refer to the following Figure 1 An exemplary network environment for an intraoral scanning system for compressing intraoral scanning data is provided.

[0049] Figure 1This is a schematic diagram illustrating an exemplary network environment 100 for an intraoral scanning system 102 for compressing intraoral scan data according to an exemplary embodiment. The intraoral scanning system 102 may include a handheld intraoral scanning device 104. The network environment 100 may also include one or more client devices 106 and a communication channel 108 configured to communicatively couple the handheld intraoral scanning device 104 to the one or more client devices 106. The network environment 100 may also include intraoral scan data 110 and compressed intraoral scan data 112. Furthermore, one or more components may be rearranged, altered, added, and / or removed without departing from the scope of this disclosure.

[0050] The intraoral scanning system 102 can be used for intraoral scanning registration. The intraoral scanning system 102 may include multiple devices, such as a handheld intraoral scanning device 104 and one or more client devices 106, which can communicate with each other to register intraoral scans.

[0051] The handheld intraoral scanning device 104 may include enhanced processing capabilities that may be needed to compress intraoral scan data 110. The handheld intraoral scanning device 104 may be configured to capture intraoral scan data 110 associated with a user, such as a patient. The intraoral scan data 110 may include texture data 110A and three-dimensional (3D) data 110B captured during the user's intraoral scanning process. The intraoral scan data 110 may be captured by a user, such as a dentist, during the user's scanning process using the handheld intraoral scanning device 104.

[0052] In one embodiment, texture data 110A may refer to information relating to surface features and details of at least one of the patient's teeth, gums, and oral cavity. Texture data 110A may primarily include information relating to surface details associated with at least one of the patient's teeth, gums, and oral cavity. 3D data 110B may correspond to a digital representation of the patient's dental arch depicted in 3D space. In one embodiment, 3D data 110B associated with intraoral scan data may include color data, amplitude data, and depth data associated with at least one of the patient's teeth, gums, and oral cavity.

[0053] In one embodiment, the handheld intraoral scanning device 104 may include a web server configured to communicate via a web network and establish a connection to communication channel 108. The handheld intraoral scanning device 104 may be configured to execute the web server to provide compressed intraoral scanning data 112. The handheld intraoral scanning device 104 may also include a processing unit, a memory unit, a communication interface, and additional components. The processing unit, memory unit, communication interface, and additional components may be communicatively coupled to each other. Details of the components of the handheld intraoral scanning device 104 are provided, for example, in... Figure 2 Further details will be provided in China.

[0054] One or more client devices 106 may include the processing capabilities required to decompress and render the compressed intraoral scan data 112. One or more client devices 106 may be configured to establish a connection to one of the communication channels 108. One or more client devices 106 may also receive the compressed intraoral scan data 112 from a handheld intraoral scanner 104. One or more client devices 106 may also decompress the compressed intraoral scan data 112 and render the decompressed intraoral scan data on a display associated with the one or more client devices 106.

[0055] Decompressed intraoral scan data can be rendered on the display screen of one or more client devices 106. The decompressed intraoral scan data can be viewed by a user (such as a dentist) on the display screen of one or more client devices 106. In one embodiment, the view of the decompressed intraoral scan data can be modified by the user based on preferences. For example, the viewing angle of the decompressed intraoral scan data can be changed, or the decompressed intraoral scan data can be zoomed in or out according to the user's preferences. The decompressed intraoral scan data can be rendered independently on one or more client devices 106. Therefore, the decompressed intraoral scan data can be accessed independently by multiple users of the respective one or more client devices 106.

[0056] One or more client devices 106 can be any user-accessible device, such as a display screen, mobile phone, smartphone, tablet computer, computer, augmented reality (XR) device, etc. In some examples, the display screen can be part of one or more client devices 106. The display screen of one or more client devices 106 can be a touch screen display. One or more client devices 106 can include a processing unit, a memory unit, and a communication interface. The processor, memory, and communication interface can be communicatively coupled to each other. Additional, different, or fewer components can be provided. Furthermore, one or more components can be rearranged, changed, added, and / or removed without departing from the scope of this disclosure. Details of the components of one or more client devices 106 are provided, for example, in [examples omitted]. Figure 3 Further details will be provided in China.

[0057] Communication channel 108 can be any combination of wired, wireless, or wired and wireless communication networks, such as cellular networks, wireless fidelity (Wi-Fi), the Internet, local area networks (LANs), etc. According to one embodiment, communication channel 108 can be one or more wireless full-duplex communication channels. In one embodiment, communication channel 108 can include one or more networks, such as data networks, wireless networks, telephone networks, or any combination thereof. It is contemplated that the data network can be any local area network (LAN), metropolitan area network (MAN), wide area network (WAN), public data network (e.g., the Internet), short-range wireless network, or any other suitable packet-switched network, such as a commercially owned proprietary packet-switched network, such as a proprietary cable or fiber optic network, or any combination thereof.Furthermore, wireless networks can be, for example, cellular networks and can employ various technologies, including enhanced data rates for global evolution (EDGE), general packet radio service (GPRS), global system for mobile communications (GSM), Internet protocol multimedia subsystem (IMS), universal mobile telecommunications system (UMTS), and any other suitable wireless medium, such as worldwide interoperability for microwave access (WiMAX), Long Term Evolution (LTE) networks (e.g., LTE-Advanced Pro), 5G New Radio networks, ITU-IMT 2020 networks, code division multiple access (CDMA), wideband code division multiple access (WCDMA), Wi-Fi, wireless LAN (WLAN), Bluetooth, Internet Protocol (IP) data broadcasting, satellite, and mobile ad-hoc networks. The handheld intraoral scanning device 104 can be configured to communicate with one or more client devices 106 via a communication channel 108, such as a network (MANET) or any combination thereof.

[0058] During the procedure, the user may require dental treatment. In this case, the dentist can use the intraoral scanning system 102 to provide dental treatment to the user. In one embodiment, the user may be at a dental clinic. In this case, the intraoral scanning system 102 can be used in the treatment room of the dental clinic. In another embodiment, the user may have requested home dental treatment. In this case, the intraoral scanning system 102 can be used at the user's home. To begin dental treatment, the dentist can use a handheld intraoral scanning device 104 to capture intraoral scan data 110 during the user's intraoral scanning process. The intraoral scan data 110 associated with the user may include, but is not limited to, texture data 110A and 3D data 110B.

[0059] Based on the captured intraoral scan data 110, a handheld intraoral scanning device 104 can be configured to generate compressed intraoral scan data 112. The compressed intraoral scan data 112 may include compressed texture data 112A and compressed 3D data 112B. In one embodiment, the handheld intraoral scanning device 104 can be configured to apply a set of compression operations to the intraoral scan data 110 to generate compressed intraoral scan data 112. Specifically, the handheld intraoral scanning device 104 can be configured to generate compressed texture data 112A based on a first compression operation in a set of compression operations applied to the captured texture data 110A. The handheld intraoral scanning device 104 can be configured to generate compressed 3D data 112B based on a second compression operation in one or more compression operations applied to the captured 3D data 110B. Details of the first and second compression operations are provided, for example, in […]. Figure 5 , Figure 6A and Figure 6B Further details will be provided in China.

[0060] Furthermore, after capturing the intraoral scan data 110, the dentist may need to review the intraoral scan data 110 as part of dental treatment. To review the intraoral scan data 110, the handheld intraoral scanning device 104 and one or more client devices 106 may need to connect to the common communication channel of communication channel 108. Therefore, the web server of the handheld intraoral scanning device 104 can communicate via a web network to establish a connection with one or more wireless full-duplex communication channels. One or more client devices 106 can also establish a connection with one or more wireless full-duplex communication channels. To establish a connection, one or more client devices 106 can forward an identification number to the handheld intraoral scanning device 104 via a web network. Details of the connection between one or more client devices 106 and one or more wireless full-duplex communication channels are as follows: Figure 9 Further details will be provided in China.

[0061] After a handheld intraoral scanning device 104 and one or more client devices 106 are connected via a common communication channel, the one or more client devices 106 can receive compressed intraoral scan data 112. For example, a dentist can use a tablet computer as one of the one or more client devices 106 to receive the compressed intraoral scan data 112. The tablet computer can be configured to decompress the compressed intraoral scan data and render the decompressed intraoral scan data into an interactive 3D graphical representation compatible with the tablet computer's web browser. The interactive 3D graphical representation can be modified, for example, by using gestures provided by the dentist to the tablet computer as input. Details regarding the rendering of the compressed intraoral scan data are provided in [the relevant documentation / details]. Figure 11 Provided by China.

[0062] Figure 2 A block diagram 200 of a handheld intraoral scanning device 104 according to an exemplary embodiment is shown. (In conjunction with...) Figure 1 elements to Figure 2 The handheld intraoral scanning device 104 may include at least one processing unit (hereinafter also referred to as "processing unit 202"), a memory unit 204, a web server 206, a monitoring unit 208, a temporary storage unit 210, a scan feedback unit 212, an input / output (I / O) unit 214, and a communication interface 216.

[0063] As per your request, I extracted the full English name from the original text, maintaining the same capitalization and formatting. Below is the translation with the full English name added:

[0064] The processing unit 202 can be embodied in a variety of different ways. For example, the processing unit 202 can be embodied as one or more of various hardware processing means, such as a coprocessor, microprocessor, controller, digital signal processor (DSP), processing element with or without an accompanying DSP, or various other processing circuits, including integrated circuits, such as application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), microcontroller units (MCUs), hardware accelerators, dedicated computer chips, etc. In one embodiment, the processing unit 202 can be embodied as a high-performance microprocessor with a series of systems on a chip (SOC), including a relatively powerful and energy-efficient graphics processing unit (GPU) and a central processing unit (CPU), and having a small form factor. For example, the form factor of the processing unit 202 can be 70 mm × 45 mm. Therefore, in some embodiments, the processing unit 202 can include one or more processing cores configured to execute independently. Multi-core processors can achieve multiple processing within a single physical package. Additionally or alternatively, the processing unit 202 may include one or more processors configured in series via a bus to enable independent execution, pipelining, and / or multithreading of instructions.

[0065] In some embodiments, processing unit 202 may be configured to capture intraoral scan data 110 during an intraoral scanning procedure for a user (such as a patient requiring dental treatment). Intraoral scan data 110 may include texture data 110A and 3D data 110B. Processing unit 202 may compress intraoral scan data 110 and transmit compressed intraoral scan data 112 to one or more client devices 106.

[0066] Additionally or alternatively, processing unit 202 may include one or more processors capable of handling large workloads and operations to support big data analytics. In an exemplary embodiment, processing unit 202 may communicate with memory unit 204 via a bus to transfer information between components of handheld intraoral scanning device 104.

[0067] Memory unit 204 may be non-transitory and may include, for example, one or more volatile and / or non-volatile memories. In other words, for example, memory unit 204 may be an electronic storage device (e.g., a computer-readable storage medium) including gate circuits configured to store data (e.g., bits) that can be retrieved by a machine (e.g., a computing device like processing unit 202). Memory unit 204 may be configured to store information, data, content, applications, instructions, etc., to enable the device to perform various functions according to exemplary embodiments of this disclosure. For example, memory unit 204 may be configured to store captured intraoral scan data 110. In some cases, memory unit 204 may be configured to store compressed intraoral scan data 112. In some embodiments, memory unit 204 may be configured to store intermediate data generated during the generation of compressed intraoral scan data 112. Figure 2 As executively shown, memory unit 204 may be configured to store instructions for execution by processing unit 202. Therefore, whether configured by hardware, software methods, or a combination thereof, processing unit 202 may represent an entity (e.g., physically embodied in circuitry) capable of performing operations upon appropriate configuration according to embodiments of this disclosure. Thus, for example, when processing unit 202 is embodied as a microprocessor, processing unit 202 may be specially configured hardware for performing the operations described herein. Alternatively, as another example, when processing unit 202 is embodied as an executor of software instructions, the instructions may, at execution time, specifically configure processing unit 202 to perform the algorithms and / or operations described herein. Processing unit 202 may include, among other things, a clock, an arithmetic logic unit (ALU), and logic gates configured to support the operation of processing unit 202.

[0068] Web server 206 can be software, hardware, or a combination thereof, and can be configured to store data and provide data to web browsers on one or more client devices 106. For example, compressed intraoral scan data 112 can be provided to the web browsers of one or more client devices 106 via web server 206. Because web server 206 can be accessed by any web browser, the need for one or more client devices 106 to install additional software to connect to web server 206 is eliminated. Web server 206 can communicate with one of communication channels 108 via a web network. In one example, web server 206 and one or more client devices 106 can communicate with a public wireless full-duplex communication channel via a web network for transmitting and receiving intraoral scan data 110 or compressed intraoral scan data 112. Web server 206 and web browser can communicate via Hypertext Transfer Protocol (HTTP), Simple Mail Transfer Protocol (SMTP), or File Transfer Protocol (FTP). Once web server 206 and web browser are connected, web server 206 can provide web applications on the web browser. Details of the connection between web server 206 and web browser, such as... Figure 6A and Figure 6B Further details will be provided in China.

[0069] The monitoring unit 208 can be software, hardware, or a combination thereof, and can be configured to monitor the bandwidth of one of the communication channels 108 (e.g., a wireless full-duplex communication channel) through which the handheld intraoral scanning device 104 can connect to one or more client devices 106. Furthermore, the monitoring unit 208 can be configured to monitor the connection of the handheld intraoral scanning device 104 to one or more client devices 106 via the communication channels 108. Additionally, the monitoring unit 208 can be configured to transmit status input to one or more client devices 106 based on the monitored bandwidth and connection.

[0070] In one embodiment, based on monitoring, monitoring unit 208 can determine bandwidth information associated with one or more wireless full-duplex communication channels between handheld intraoral scanning device 104 and one or more client devices 106. Processing unit 202 can determine a quality factor for a first compression operation based on the determined bandwidth information. Processing unit 202 can also generate compressed texture data 112A based on applying the first compression operation to texture data 110A. Texture data 110A can be compressed based on the determined quality factor. Details regarding the quality factor are provided, for example, in... Figure 4A and Figure 4B Provided by China.

[0071] Temporary storage unit 210 may be software, hardware, or a combination thereof, and may be configured to store compressed intraoral scan data 112 when the bandwidth of one of the communication channels 108 (such as a wireless full-duplex communication channel) is determined to be below a minimum bandwidth. Temporary storage unit 210 may also transmit the stored compressed intraoral scan data 112 to one or more client devices 106 when the bandwidth is determined to be above or equal to the minimum bandwidth. Examples of temporary storage unit 210 may include, but are not limited to, random-access memory (RAM) or cache memory.

[0072] The scan feedback unit 212 can be software, hardware, or a combination thereof, and can be configured to receive status input from the monitoring unit 208. Based on the received status input, the scan feedback unit 212 can provide scan feedback signals to the user of the handheld intraoral scanning device 104. In one embodiment, the scan feedback signal is used to guide the user to areas in the dental arch where the scanning quality is low or insufficient. For example, the scan feedback signal can be used to provide acoustic feedback, tactile feedback, or visual feedback.

[0073] I / O unit 214 may include circuitry and / or software configured to provide output to a user of the handheld intraoral scanning device 104. I / O unit 214 may include a speaker 214A, a vibrator 214B, and a plurality of emitting diodes (LEDs) 214C. In one embodiment, speaker 214A may be configured to output an acoustic feedback signal to guide the user. Vibrator 214B may be, for example, a transducer configured to convert the scanning feedback signal, which is an electrical signal, into a mechanical output, such as tactile feedback in the form of vibration, to guide the user. The plurality of LEDs 214C may be configured to output the scanning feedback signal in the form of light to guide the user. For example, the plurality of LEDs 214C may be divided into a left group of LEDs and a right group of LEDs to emit flashes.

[0074] Communication interface 216 may include input and output interfaces for supporting communication to and from handheld intraoral scanning device 104. Communication interface 216 may be a device or circuitry embodied in hardware or a combination of hardware and software configured to receive and / or transmit data to / from handheld intraoral scanning device 104. In this regard, communication interface 216 may include, for example, an antenna (or multiple antennas) and supporting hardware and / or software for supporting communication with wireless communication networks. Additionally or alternatively, communication interface 216 may include circuitry for interacting with one or more antennas to induce signal transmission via one or more antennas or to manage reception of signals received via one or more antennas. In some environments, communication interface 216 may alternatively or additionally support wired communication. Thus, for example, communication interface 216 may include a communication modem and / or other hardware and / or software for supporting communication via cable, digital subscriber line (DSL), universal serial bus (USB), or other mechanisms.

[0075] Figure 3 A block diagram 300 illustrates one or more client devices 106 according to an exemplary embodiment. (In conjunction with...) Figure 1 and Figure 2 elements to Figure 3 The following explanation is provided. One or more client devices 106 may include a processing unit 302, a memory unit 304, a display screen 306, and a communication interface 308.

[0076] Processing unit 302 can be embodied in a variety of different ways. For example, processing unit 302 can be embodied as one or more of the following hardware processing means: such as a coprocessor, microprocessor, controller, DSP, processing element with or without an accompanying DSP, or various other processing circuits, including integrated circuits, such as ASICs, MCUs, hardware accelerators, application-specific computer chips, etc. Therefore, in some embodiments, processing unit 302 may include one or more processing cores configured to execute independently. Multi-core processors can implement multiple processing within a single physical package. Additionally or alternatively, processing unit 302 may include one or more processors configured in series via a bus to enable independent execution, pipelining, and / or multithreading of instructions.

[0077] In some embodiments, processing unit 302 may include processing capabilities that might be required to decompress / reconstruct compressed intraoral scan data 112. Processing unit 302 may be configured to establish a connection to one of communication channels 108. Processing unit 302 may also receive compressed intraoral scan data 112 from a handheld intraoral scanning device 104. Processing unit 302 may also decompress the compressed intraoral scan data 112 and render the decompressed intraoral scan data on display 306. Additionally or alternatively, processing unit 302 may include one or more processors capable of handling large workloads and operations to support big data analytics. In an exemplary embodiment, processing unit 302 may communicate with memory unit 304 via a bus to transfer information between components of one or more client devices 106.

[0078] Memory unit 304 may be non-transitory and may include, for example, one or more volatile and / or non-volatile memories. In other words, for example, memory unit 304 may be an electronic storage device (e.g., a computer-readable storage medium) including gate circuits configured to store data (e.g., bits) that can be retrieved by a machine (e.g., a computing device like processing unit 302). Memory unit 304 may be configured to store information, data, content, applications, instructions, etc., to enable the device to perform various functions according to exemplary embodiments of this disclosure. For example, memory unit 304 may be configured to store compressed intraoral scan data 112.

[0079] like Figure 3 As executively shown, memory unit 304 may be configured to store instructions for execution by processing unit 302. Therefore, whether configured by hardware, software methods, or a combination thereof, processing unit 302 may represent an entity (e.g., physically embodied in circuitry) capable of performing operations upon execution of a corresponding configuration according to embodiments of this disclosure. Thus, for example, when processing unit 302 is embodied as a microprocessor, processing unit 302 may be specially configured hardware for performing the operations described herein. Alternatively, as another example, when processing unit 302 is embodied as an executor of software instructions, the instructions may, at execution time, specifically configure processing unit 302 to perform the algorithms and / or operations described herein. Processing unit 302 may include, among other things, a clock, an ALU, and logic gates configured to support the operation of processing unit 302.

[0080] Display screen 306 can be configured to display a web browser, web application, and compressed intraoral scan data 112. In some embodiments, display screen 306 can be externally connected to one or more client devices 106. Examples of display screen 306 include, but are not limited to, liquid crystal displays (LCDs), light-emitting diode (LED) displays, electroluminescent (ELD) displays, plasma displays, or cathode ray tube (CRT) displays. In one embodiment, display screen 306 can be a touchscreen display. Display screen 306 can receive input from a user in the form of gestures to control the rendering of decompressed intraoral scan data.

[0081] Communication interface 308 may include input and output interfaces for supporting communication to and from one or more client devices 106. Communication interface 308 may be a device or circuitry embodied in hardware or a combination of hardware and software, configured to receive and / or transmit data to / from one or more client devices 106. In this regard, communication interface 308 may include, for example, an antenna (or multiple antennas) and supporting hardware and / or software for supporting communication with a wireless communication network. Additionally or alternatively, communication interface 308 may include circuitry for interacting with the antenna(s)(s)(s) to induce signal transmission via the antenna(s)(s)(s)(s)) or managing reception of signals received via the antenna(s). In some environments, communication interface 308 may alternatively or additionally support wired communication. Thus, for example, communication interface 308 may include a communication modem and / or other hardware and / or software for supporting communication via cable, DSL, USB, or other mechanisms.

[0082] Figure 4A , Figure 4B , Figure 4C and Figure 4D This illustration shows a schematic diagram of an exemplary operation for compressing intraoral scan data according to an exemplary embodiment. (Combined with...) Figure 1 , Figure 2 and Figure 3 element pairs Figure 4A , Figure 4B , Figure 4C and Figure 4D Please provide an explanation. (See reference.) Figure 4A Block diagram 400 is shown, illustrating exemplary operations from 402 to 412 as described herein. The exemplary operations illustrated in block diagram 400 may begin at 402 and may be performed by any computing system, device, or apparatus, such as by [unclear text - likely a typo]. Figure 1 Intraoral scanning system 102 or Figure 2The processing unit 202 executes the operation. Although illustrated with discrete blocks, depending on the specific implementation, exemplary operations associated with one or more blocks of block diagram 400 may be divided into additional blocks, combined into fewer blocks, or omitted.

[0083] At 402, a data acquisition operation can be performed. During the data acquisition operation, processing unit 202 can be configured to capture intraoral scan data 110 associated with the user. The intraoral scan data 110 may include texture data 110A associated with the user's dental arch and 3D data 110B associated with the user's dental arch. Texture data 110A and 3D data 110B can be captured during the user's intraoral scanning process.

[0084] Figure 4B , Figure 4C and Figure 4D A simplified example of compression of intraoral scan data is shown. Figure 4B In this context, compression is only provided for texture data. Figure 4C In the middle, only 3D data is compressed. Figure 4D In the second compression operation 406, both 3D data and texture data are compressed.

[0085] Texture data 110A associated with the dental arch may include information relating to the surface properties, appearance, and structure of the patient's teeth, gums, and surrounding oral tissues. 3D data 110B associated with the dental arch may refer to a digital representation of the entire oral structure (including teeth, gums, jawbone, and surrounding tissues) in a 3D format. In one embodiment, 3D data 110B associated with intraoral scan data may include color data, amplitude data, and depth data associated with the dental arch.

[0086] Color data associated with the dental arch can refer to information about the natural hue and tint of the teeth, gums, and surrounding oral tissues. Color information may be necessary to replicate the appearance of a patient's oral anatomy, enabling dental professionals to assess tooth color for restorative procedures, ensure proper color matching of dental restorations, and enhance the visual realism of digital dental models.

[0087] Amplitude data associated with the dental arch can refer to information related to the height or elevation of various points on the arch surface, typically manifested as changes in the surface profile. Amplitude data can provide insights into the relative prominence or recession of teeth, gingiva, and other oral structures, which can be valuable for assessing occlusion, occlusal alignment, and anatomical irregularities.

[0088] Depth data can refer to information related to distance measurements from the surface of the dental arch to specific points inside or around it (such as the depth of a cavity or the thickness of a dental restoration). Depth data can help diagnose dental diseases, plan treatment, and ensure the precise fit of restorative instruments (such as crowns or bridges) in the oral cavity.

[0089] In one embodiment, the intraoral scan data 110 may be in the form of a bitmap image associated with a patient's dental arch. Specifically, the color data in the intraoral scan data 110 may be in the form of a bitmap image. A bitmap image (also known as a raster image) may be a digital graphic that represents an image as a grid of individual pixels. Each pixel in a bitmap image may include information about its color and location, forming a mosaic of tiny dots that together create the entire image.

[0090] At 404, a first compression operation can be performed. In the first compression operation, processing unit 202 can be configured to apply the first compression operation to texture data 110A to generate compressed texture data 112A. In one embodiment, the first compression operation may correspond to a high-efficiency video coding (HEVC) operation. HEVC (also known as H.265) can be a compression standard that can apply one or more coding techniques to achieve compression efficiency. HEVC can reduce the size of texture data 110A while maintaining the quality of texture data 110A. HEVC can achieve this result by dividing each frame into a block grid and employing various techniques such as transform coding and entropy coding to more efficiently represent and compress the data. Details about the first compression operation are as follows: Figure 5 Provided by China.

[0091] In one embodiment, before applying the first compression operation to texture data 110A, monitoring unit 208 may be configured to determine bandwidth information associated with one or more wireless full-duplex communication channels between handheld intraoral scanning device 104 and one or more client devices 106. The bandwidth information associated with the one or more wireless full-duplex communications may indicate the bandwidth of the one or more wireless full-duplex communication channels between handheld intraoral scanning device 104 and one or more client devices 106. Based on the bandwidth information, processing unit 202 may be configured to determine a quality factor for the first compression operation based on the determined bandwidth information, and generate compressed texture data 112A based on applying the first compression operation 502 to texture data 110A, wherein texture data 110A may be compressed based on the determined quality factor. The quality factor may be a parameter that can be used to control the compression level and thus control the perceived quality of the compressed texture data 112A. The quality factor is often referred to as a "quantization parameter (QP)". The QP value determines the trade-off between data compression efficiency and quality. If a higher QP value is used, texture data 110A can be highly compressed, resulting in the loss of more visual details. Conversely, if a lower QP value is used, texture data 110A can be lightly compressed, preserving more visual details. If the bandwidth information indicates low bandwidth, the processing unit 202 can select a higher QP for compressing texture data 110A. Otherwise, the processing unit 202 can select a lighter QP for compressing texture data 110A. Details regarding the first compression operation are as follows... Figure 5 Provided by China.

[0092] At 406, a second compression operation can be performed. In the second compression operation, processing unit 202 can be configured to apply the second compression operation to the 3D data 110B of the intraoral scan data 110. In one embodiment, processing unit 202 can be configured to apply the second compression operation to the color data included in the 3D data 110B. Details regarding the second compression operation are as follows: Figure 6A and Figure 6B Provided by China.

[0093] At 408, a compressed texture data generation operation can be performed. In the compressed texture data generation operation, processing unit 202 can be configured to generate compressed texture data 112A. Compressed texture data 112A can be generated based on applying a first compression operation to texture data 110A. In one embodiment, compressed texture data 112A can be the output of the first compression operation applied to texture data 110A. Details regarding the first compression operation are as follows... Figure 5 Provided by China.

[0094] At 410, a compressed 3D data generation operation can be performed. In the compressed 3D data generation operation, processing unit 202 can be configured to generate compressed 3D data 112B. The compressed 3D data 112B can be generated based on applying a second compression operation to 3D data 110B. In one embodiment, the compressed 3D data 112B can be the output of a second compression operation applied to 3D data 110B. Details regarding the second compression operation are as follows... Figure 6A and Figure 6B Provided by China.

[0095] It should be noted that the first compression operation can be a lossy compression operation, while the second compression operation can be a lossless compression operation. 3D data 110B may be crucial for reconstructing the 3D structure of a patient's dental arch on one or more client devices 106 for diagnostic purposes, and any loss in 3D data 110B could lead to inaccurate dentistry. Therefore, a lossless compression operation (or the second compression operation) can be used to compress 3D data 110B. Texture data 110A may be irrelevant compared to 3D data 110B; therefore, a lossy compression operation (or the first compression operation) can be used to compress texture data 110A.

[0096] At 412, a compressed data transmission operation can be performed. In the compressed transmission operation, processing unit 202 can be configured to transmit compressed intraoral scan data 112 to one or more client devices 106. The compressed intraoral scan data 112 may include compressed texture data 112A and compressed 3D data 112B. In one embodiment, processing unit 202 can be configured to transmit the compressed intraoral scan data 112 to one or more client devices 106 via one or more wireless full-duplex communication channels that can be established between the handheld intraoral scanning device 104 and one or more client devices 106. Details regarding the transmission of the compressed intraoral scan data are provided, for example, in... Figure 7 Provided by China.

[0097] Figure 5 This is a schematic diagram depicting a pipeline of a first compression operation according to an exemplary embodiment. (Combined with...) Figure 1 , Figure 2 , Figure 3 Pairs of elements with those in Figure 4 Figure 5 Please provide an explanation. (See reference.) Figure 5 An exemplary figure 500 is shown, which includes a first compression operation 502, texture data 110A, and compressed texture data 112A. Texture data 110A can be provided as input to the first compression operation 502, and compressed texture data 112A can be generated as output.

[0098] As described above, the first compression operation 502 can correspond to a High Efficiency Video Coding (HEVC) operation. HEVC compression, also known as H.265, is a widely used compression standard for encoding and decoding image or video content. Texture data 110A can be provided as input to the first compression operation 502, and typically consists of one or more texture images of the patient's dental arch. The one or more texture images can be used for 3D rendering of the dental arch and serve as input to the compression pipeline.

[0099] At 502A, transformation and prediction operations can be performed. In one embodiment, the first compression operation 502 pipeline can begin by applying a series of transformation and prediction operations to texture data 110A to generate a first intermediate result 504A. The transformation and prediction operations 502A can be applied to texture data 110A to utilize spatial redundancy within texture data 110A and further reduce the amount of information that needs to be encoded. In one embodiment, the transformation and prediction operations 502A may correspond to applying a discrete cosine transform (DCT) operation or other similar techniques to texture data 110A, which converts spatial domain information into frequency domain information to generate the first intermediate result 504A. After generating the first intermediate result 504A, processing unit 202 can be configured to determine one or more transform coefficients from the generated first intermediate result 504A. Details regarding the one or more transform coefficients are known in the art, and therefore, for brevity, a description of the one or more transform coefficients is omitted.

[0100] In 502B, a quantization operation can be performed. In this quantization operation, processing unit 202 can be configured to perform a quantization operation on one or more transform coefficients to generate a second intermediate result 504B. In one embodiment, a quantization operation can be performed to reduce the precision of one or more transform coefficients. This is done to introduce loss during compression. It should be noted that higher quantization levels may result in more loss, but also a higher compression ratio. In the context of texture data 110A, this means that some fine details in the texture may be lost, but the overall visual quality may still be acceptable.

[0101] In the 502C, entropy coding can be performed. In entropy coding, processing unit 202 can be configured to apply coding operations to quantized coefficients. These coding operations can correspond to entropy coding operations. In one embodiment, the quantized coefficients can be entropy-coded using techniques such as context-adaptive binary arithmetic coding (CABAC) or context-adaptive variable-length coding (CAVLC). This step can be crucial for achieving high compression efficiency. It encodes the quantized coefficients compactly and efficiently. Details regarding entropy coding techniques are known in the art and have therefore been omitted for brevity.

[0102] Based on the encoding operation applied to the generated second intermediate result, the compressed texture data 112A can be packaged into a bitstream, which can be stored, transmitted, or used for rendering. The bitstream contains all the information needed to reconstruct the compressed texture data during decoding at one or more client devices 106. The compressed texture data 112A can also be transmitted to one or more client devices 106 for rendering purposes.

[0103] Figure 6A and Figure 6B This is a schematic diagram depicting a pipeline for a second compression operation according to an exemplary embodiment. (Combined with...) Figure 1 , Figure 2 , Figure 3 Figure 4 and Figure 5 element pairs Figure 6A and Figure 6B Please provide an explanation. (See reference.) Figure 6A and Figure 6B An exemplary figure 600 is shown, which includes a second compression operation 602, 3D data 110B, and compressed 3D data 112B. 3D data 110B can be provided as input to the first compression operation 602A, and compressed 3D data 112A can be generated as output.

[0104] In one embodiment, 3D data 110B associated with the user (i.e., the patient) can be provided as input to the second compression method. As described above, the 3D data 110B associated with the user (specifically, the user's dental arch) may include color data, amplitude data, and depth data associated with the user. In one embodiment, the color data, amplitude data, and depth data may correspond to a bitmap image associated with the user's dental arch. Details regarding the color data, amplitude data, and depth data are provided, for example, in Figure 4.

[0105] At 602A, a color transformation operation can be performed. In the color transformation operation, processing unit 202 can be configured to apply a first color transformation matrix to the 3D data 110B. In one embodiment, processing unit 202 can be configured to group the 3D data 110B into a group of pixel blocks of a first size (e.g., 8×8 pixel blocks). Processing unit 202 can also be configured to apply a first color transformation matrix of a second size (e.g., 3×3) to each pixel block in this group of pixel blocks of the 3D data 110B to generate a first intermediate result 604A.

[0106] In one embodiment, a color transformation matrix (also called a color matrix or color conversion matrix) can be a mathematical matrix used to transform the colors in corresponding pixel blocks from a first color space to a second color space. A color space can correspond to a mathematical model that defines how colors are represented and organized in a corresponding image. In one embodiment, the color transformation matrix can be a square matrix describing a linear transformation between two color spaces (e.g., RGB (Red, Green, Blue), CMY / CMYK (Cyan, Magenta, Yellow, Key / Black), HSV / HSL (Hue, Saturation, Value / Lightness), YCbCr / YUV). Each element of the matrix can represent the contribution of a color component from the source color space to the corresponding color component in the target color space. The transformation can involve adjustments to brightness, contrast, color balance, and other color-related properties.

[0107] In one embodiment, the 3×3 linear color transformation can be based on principal component analysis (PCA) applied to the color space of 3D data 110B. Applying a color transformation matrix to the first color can transform the image into three color components with the largest (average) variance. o The first component explains the highest variance, while the other components (i.e., R1 and R2) explain the lowest variance. Applying the first color transformation matrix to 3D data can be represented by the following equation (1), as shown below:

[0108] (1)

[0109] The linear transformation (T) applied to the color values ​​can be estimated using PCA from a historical dataset (e.g., TRIOS® image data), which enhances the effect of maximizing variance on the first transformed color coefficients. Therefore, processing unit 202 can be configured to generate a first intermediate result 604A based on the application of the first color transformation matrix to the 3D data.

[0110] At 602B, a pixel modification operation can be performed. In the pixel modification operation, processing unit 202 can be configured to generate a second intermediate result 604B from a first intermediate result 604A. In one embodiment, processing unit 202 can be configured to generate the second intermediate result 604B based on modifying each pixel value of the generated first intermediate result 604A by a predetermined value. In one embodiment, processing unit 202 can be configured to offset the pixel color values ​​by a predetermined value "-128", shifting from the normal range of [0, 255] to a pixel value in the range of [-128, 127]. This is done because the embedded cosine functions used in the subsequent first transformation operation may be in the range of [1, -1], i.e., they may be averaged near zero.

[0111] At 602C, a first transformation operation can be performed. In the first transformation operation, processing unit 202 can be configured to perform the first transformation operation on the generated second intermediate result 604B to generate a third intermediate result 604C. In one embodiment, the first transformation operation may correspond to a discrete cosine transform (DCT) operation.

[0112] Discrete Cosine Transform (DCT) can be a mathematical operation that represents an image (or the second intermediate result 604B) as a sum of cosine functions of different frequencies and amplitudes. In the DCT operation, the generated second intermediate result 604B can be divided into small, typically square, pixel blocks. For each block, the DCT algorithm can compute one or more transform coefficients, which can represent the pixel values ​​within the corresponding block. Each of these transform coefficients can represent the intensity of different spatial frequencies within the corresponding block, where lower-frequency coefficients typically capture basic image features, while higher-frequency coefficients encode finer details. As described above, processing unit 202 can be configured to generate a third intermediate result 604C based on applying the DCT operation to the second intermediate result 604B.

[0113] In 602D, a coefficient quantization operation can be performed. In the coefficient quantization operation, processing unit 202 can be configured to determine one or more transform coefficients based on applying a first transform operation to the second intermediate result 604B. As described above, each of the one or more transform coefficients in the DCT can be a numerical value representing the contribution of different cosine basis functions at various spatial frequencies within the image block (e.g., the generated second intermediate result 604B). When applied to the second intermediate result 604B, the DCT operation can generate one or more transform coefficients, each corresponding to a specific cosine function with a different frequency. Each of the one or more transform coefficients can quantify how much of each cosine function is needed to approximate the original pixel value block. For example, lower-frequency coefficients tend to have larger values, representing basic image features, while higher-frequency coefficients may be smaller and encode finer details.

[0114] Based on determining one or more transform coefficients associated with the first transform operation, processing unit 202 can be configured to quantize the determined one or more transform coefficients. During the quantization of the one or more transform coefficients, each of the determined one or more transform coefficients can be divided by a set of quantization values. These quantization values ​​can be represented in a quantization matrix, and the precision to be preserved for each coefficient can be determined. Lower frequency coefficients (which may represent basic image features) among the one or more transform coefficients can be quantized with smaller values ​​to preserve their precision, while higher frequency coefficients (which encode finer details) can be quantized with larger values ​​to reduce their precision. The choice of quantization values ​​can affect the trade-off between image compression and quality. Smaller quantization values ​​result in higher image quality but larger file size, while larger quantization values ​​result in more compression but lower image quality. Adjusting these values ​​can allow for fine-tuning the balance between compression ratio and perceived image fidelity.

[0115] In one embodiment, for quantization, each of one or more transform coefficients may be scaled with a first value before discretization. Discretization may be a numerical operation that rounds a floating-point number to the nearest integer. In one embodiment, each of one or more transform coefficients may be divided by the corresponding quantized value in the quantization table and then rounded to the nearest integer. This can result in high-frequency data being reduced more significantly (closer to zero) than low-frequency data.

[0116] In 602E, a first encoding operation can be performed. In the first encoding operation, processing unit 202 can be configured to generate first intermediate data 606A based on applying the first encoding operation to one or more quantized transform coefficients. Compressed 3D data 112B may include the first intermediate data 606A. In one embodiment, the first encoding operation may correspond to an arithmetic encoding operation. Arithmetic encoding can be a lossless data compression technique that can be used to encode one or more quantized transform coefficients into a single, efficient binary code. Arithmetic encoding can assign variable-length codes to symbols based on their corresponding probabilities. In the context of quantizing one or more transform coefficients, arithmetic encoding can assign shorter codes to frequently occurring coefficients and longer codes to infrequently occurring coefficients, resulting in more efficient compression. This method can encode an entire sequence of coefficients into a single fractional number within a specific range, achieving efficient compression but requiring complex arithmetic operations.

[0117] In one embodiment, one or more encoded coefficients may be considered as first intermediate data 606A, which may be included in compressed 3D data 112B. The one or more encoded coefficients may also be transmitted to one or more client devices 106.

[0118] At 602F, a second transformation operation can be performed. In this second transformation operation, processing unit 202 can also be configured to generate a fourth intermediate result 604D. The fourth intermediate result 604D can be generated based on applying the second transformation operation to the third intermediate result 604C. In one embodiment, the second transformation operation can be the inverse operation of the first transformation operation. Specifically, the second transformation operation can be an inverse cosine transformation operation.

[0119] The inverse discrete cosine transform (IDCT) operation can be used to convert frequency domain information (typically obtained via discrete cosine transform (DCT)) back to the spatial domain. IDCT is often crucial in various image compression algorithms where DCT is initially applied to transform pixel values ​​into a frequency domain representation for efficient compression. IDCT then reverses this process, reconstructing the original image from the frequency domain coefficients.

[0120] At 602G, a second color transformation operation can be performed. In the second color transformation operation, processing unit 202 can be configured to apply a second color transformation matrix to the generated fourth intermediate result to convert the color components in the generated fourth intermediate result from the second color space back to the first color space, generating a fifth intermediate result 604E. In one embodiment, the second color transformation matrix can be of a second size (i.e., 3×3) and can be the inverse of the first color transformation matrix that can be applied to the 3D data at 602A.

[0121] At 602H, a residual data calculation operation can be performed. In this operation, the processing unit can be configured to calculate residual data based on the 3D data 110B and the generated fifth intermediate result 604E. In one embodiment, the residual data may correspond to one or more differences between the 3D data 110B and the generated fifth intermediate result 604E. Such differences can be calculated by subtracting the fifth intermediate result 604E from the original 3D data 110B. The residual data can be used to quantify the errors or distortions introduced during the compression of the 3D data 110B and plays a crucial role in various applications such as image compression and quality assessment.

[0122] In 602I, a first encoding operation can be performed. In this first encoding operation, processing unit 202 can also be configured to generate second intermediate data 606B based on applying the first encoding operation to the calculated residual data. As described above, the first encoding operation can be an arithmetic encoding operation. Processing unit 202 can be configured to encode the calculated residual data and transmit the encoded residual data as second intermediate data 606B within compressed 3D data 112B to one or more client devices 106. Processing unit 202 can also be configured to transmit the generated first intermediate data 606A and second intermediate data 606B as compressed 3D data 112B to one or more client devices 106 for rendering intraoral scan data 110.

[0123] Figure 7 This is a schematic diagram 700 illustrating an environment for communication between a handheld intraoral scanning device 104 and one or more client devices 106 according to an exemplary embodiment. (In conjunction with...) Figure 1 , Figure 2 , Figure 3 Figure 4 Figure 5 , Figure 6A and Figure 6B element pairs Figure 7 The following explanation is provided. Schematic diagram 700 may include a handheld intraoral scanning device 104 and a communication channel 108. Schematic diagram 700 may also include one or more client devices 106.

[0124] One or more client devices 106 may include client device 702, client device 704, and client device 706. According to one embodiment, one or more client devices 106 may be at least one of a display screen, a tablet computer, or a smartphone. For example, client device 702 may be a user's (e.g., a dentist's) smartphone. In another example, client device 704 may be a tablet computer. In some embodiments, one or more client devices 106 may be a computer. For example, client device 706 may be a computer with enhanced processing power (e.g., a PowerPC). Client devices 702, 704, and 706 may be used by one or more users to view compressed intraoral scan data 112.

[0125] In some embodiments, the web server of the handheld intraoral scanner 104 and one or more client devices 106 may be connected to a public web network. The web network can provide access to various web pages and web applications. The public web network may require data transmission via web applications accessible through web browsers on one or more client devices 106, such as compressed intraoral scan data 112. In one example, the web network may be directly hosted on the handheld intraoral scanner 104, and one or more client devices 106 may connect to the web network directly hosted on the handheld intraoral scanner 104.

[0126] Once the handheld intraoral scanner 104 and one or more client devices 106 are connected to a public web network, the one or more client devices 106 can be configured to connect to one or more wireless full-duplex communication channels by forwarding an identification number to the handheld intraoral scanner 104. For example, the identification number could be a unique serial number of the handheld intraoral scanner 104, which could be entered by a user (e.g., a dentist) of a client device (e.g., client device 702) via a web browser on client device 702. The web browser can be rendered on one or more client devices 106 based on the input received from the user. For example, the user can select a web browser on one or more client devices 106 to render the web browser.

[0127] In one example, the multicast domain name system (mDNS) protocol can be used to resolve a hostname (e.g., an identifier) ​​to an Internet Protocol (IP) address to access a web server on the handheld intraoral scanner 104. In some embodiments, an alias can be provided for the identifier of the handheld intraoral scanner 104, which is entered by the user in a web browser to connect to the web server. Similarly, multiple client devices (e.g., client device 704 and client device 706) can further connect to the web server of the handheld intraoral scanner 104 based on the identifier received by the user of the respective client device.

[0128] Once one or more client devices 106 connect to the web server of the handheld intraoral scanner 104, the handheld intraoral scanner 104 can provide a web application to the user of the one or more client devices 106, enabling interaction with the handheld intraoral scanner 104 and providing a view for rendering compressed intraoral scan data 112. In one example, the web server of the handheld intraoral scanner 104 and the web application of the one or more client devices 106 can communicate using different communication protocols, such as the WebSocket protocol. In some embodiments, the web application can be based on different web communication languages, such as Hypertext Markup Language (HTML), JavaScript, and Web Assembly. The Web Assembly module of the web application allows compiled code for accessing the web server to run at near-native speed on the one or more client devices 106, thus reducing the resource requirements on the one or more client devices 106.

[0129] Once the handheld intraoral scanning device 104 is connected to one or more client devices 106, and the web application is rendered via a web browser on one or more client devices 106, a user (such as a dentist) can initiate the scanning process. The captured intraoral scan data 110 can be compressed to generate compressed intraoral scan data 112. Details of the capture of intraoral scan data 110 and compressed intraoral scan data 112 are as follows: Figure 5 Further details will be provided in China.

[0130] Figure 8 This is a schematic diagram 800 illustrating the capture of intraoral scan data 110 according to an exemplary embodiment. (In conjunction with...) Figure 1 , Figure 2 , Figure 3 Figure 4 Figure 5 , Figure 6A , Figure 6B and Figure 7 element pairs Figure 8 The following explanation is provided. Schematic diagram 800 may include users, such as a dentist 802 and a patient 804. A handheld intraoral scanning device 104 may be used by the dentist 802 to capture intraoral scanning data 110 of the patient 804's dental arch 806.

[0131] In an exemplary scenario, dentist 802 and patient 804 may be in a dental clinic. The scanning process of patient 804's dental arch 806 may be initiated by dentist 802 to begin dental treatment for patient 804. A handheld intraoral scanning device 104 may include a built-in camera. The built-in camera of the handheld intraoral scanning device 104 may be placed inside patient 804's mouth and moved around patient 804's teeth and gums to record the oral morphology of patient 804. In one example, the handheld intraoral scanning device 104 may record the size and shape of each tooth, interdental spaces, the appearance of the palatal surface, gums, implants, restorations, and other elements constituting the interior of patient 804's mouth. In one embodiment, the built-in camera of the handheld intraoral scanning device 104 may move multiple times over patient 804's teeth and gums to capture intraoral scan data 110. Specifically, the intraoral scan data 110 may include texture data 110A and 3D data 110B. In one embodiment, 3D data 110B may include depth data 808, amplitude data 810, and color data 812 associated with the dental arch 806 of the patient 804. Details regarding the depth data 808, amplitude data 810, and color data 812 are provided, for example, in... Figure 3 Provided by China.

[0132] Once the scanning process begins, intraoral scan data 110 can be captured. The handheld intraoral scanning device 104 can be configured to generate compressed texture data 112A associated with texture data 110A based on applying a first compression operation 502 to the texture data 110A. The handheld intraoral scanning device 104 can also be configured to generate compressed 3D data 112B associated with 3D data 110B based on applying a second compression operation 602 to the 3D data 110B. The first compression operation 502 may differ from the second compression operation 602. Details regarding the first compression operation 502 and the second compression operation 602 are provided, for example, in […]. Figure 5 , Figure 6A and Figure 6B Provided by China.

[0133] Figure 9 This is a sequence diagram 900 depicting the transmission of compressed intraoral data according to an exemplary embodiment. (In conjunction with...) Figure 1 , Figure 2 , Figure 3 Figure 4 Figure 5 , Figure 6A , Figure 6B , Figure 7 and Figure 8 element pairs Figure 9 The sequence diagram 900 may include a handheld intraoral scanning device 104 and one or more client devices 106. The sequence diagram 900 may depict operations performed by the handheld intraoral scanning device 104 and / or one or more client devices 106.

[0134] In step 902, the web server of the handheld intraoral scanner 104 can establish a connection with one of the communication channels 108. For example, the web server of the handheld intraoral scanner 104 can communicate via a web network to establish a connection with one or more wireless full-duplex communication channels. Details of the connection between the web server and the one or more wireless full-duplex communication channels are as follows: Figure 2 Further details will be provided in China.

[0135] In step 904, the web browser can be rendered on one or more client devices 106. For example, the web browser can be rendered on client device 706 (such as a tablet). In an exemplary scenario, dentist 802 can access client device 706. Client device 706 can be operated by dentist 802 to access the web browser on client device 706.

[0136] In step 906, an identification number may be received. The identification number may be received via a web browser rendered on one or more client devices 106 (e.g., client device 606). For example, dentist 802 may provide the identification number as input on the web browser of client device 606. Details regarding receiving the identification number were previously provided, for example, in [examples omitted]. Figure 7 Provided by China.

[0137] At 908, the identifier can be forwarded to the handheld intraoral scanner 104. One or more client devices 106 can forward the identifier to the handheld intraoral scanner 104. The identifier can be provided as input by a user (e.g., dentist 802). The identifier can be used to establish a connection with the web server of the handheld intraoral scanner 104. Details regarding forwarding the identifier are as follows... Figure 7 Provided by China.

[0138] At 910, a connection can be established with one or more wireless full-duplex communication channels. Based on the identifier forwarded via the web network, one or more client devices 106 can establish a connection with one or more wireless full-duplex communication channels. Details of the connection with one or more wireless full-duplex communication channels are as follows: Figure 7 Further details will be provided in China.

[0139] At 912, texture data 110A can be captured. The handheld intraoral scanning device 104 can be configured to capture texture data 110A of the dental arch 806 of the patient 804 during the scanning process. Details regarding the texture data 110A are as follows... Figure 1 Further details are provided in Figure 4.

[0140] At 914, 3D data 110B can be captured. The handheld intraoral scanning device 104 can be configured to capture 3D data 110B of the dental arch 806 of the patient 804 during the scanning process. Details regarding the 3D data 110B are as follows: Figure 1 Further details are provided in Figure 4.

[0141] In step 916, the captured texture data 110A and the captured 3D data 110B can be compressed to generate compressed intraoral scan data 112 based on applying a first compression operation 502 to the texture data 110A and a second compression operation 602 to the 3D data 110B. Details regarding the first compression operation 502 are as follows: Figure 5 Provided in [the document / reference]. Similarly, details regarding the second compression operation 602 are provided, for example, in [the document / reference]. Figure 6A and Figure 6B Provided by China.

[0142] At 918, compressed texture data 112A and compressed 3D data 112B can be received as compressed intraoral scan data 112. One or more client devices 106 can be configured to receive compressed texture data 112A and compressed 3D data 112B from a handheld intraoral scanning device 104. Compressed texture data 112A and compressed 3D data 112B can be received by one or more client devices 106 using one of the communication channels 108. Details regarding the reception of compressed texture data 112A and compressed 3D data 112B by one or more client devices 106 are provided, for example, in... Figure 7 , Figure 8 and Figure 11 Further details will be provided in China.

[0143] At 918, the received compressed intraoral scan data 112 can be rendered. One or more client devices 106 can be configured to render the compressed intraoral scan data 112. In one embodiment, one or more client devices 106 can be configured to decompress or reconstruct the compressed intraoral scan data 112, and also render the decompressed or reconstructed intraoral scan data on a display associated with one or more client devices 106. In one embodiment, one or more client devices 106 can be configured to perform the opposite operation. Figure 5The operations described herein are used to obtain texture data 110A. Similarly, one or more client devices 106 can be configured to perform the operations in the reverse manner. Figure 6A and Figure 6B The operations described herein are used to obtain 3D data 110B. Furthermore, one or more devices can combine texture data 110A and 3D data 110B to generate a 3D structure of the dental arch of patient 804.

[0144] It should be understood that each step of sequence diagram 900 can be implemented by various means, such as hardware, firmware, processor, circuitry, and / or other communication devices associated with software that executes software including one or more computer program instructions. For example, one or more of the steps described above can be embodied by computer program instructions. In this regard, the computer program instructions embodying the steps described above can be stored in memory unit 204 of a handheld intraoral scanning device 104 employing an embodiment of this disclosure. It should be understood that any such computer program instructions can be loaded onto a computer or other programmable device (e.g., hardware) to produce a machine, such that the resulting computer or other programmable device performs the functions specified in sequence diagram 900. These computer program instructions can also be stored in a computer-readable storage medium that can direct the computer or other programmable device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture that performs the functions specified in sequence diagram 900. The computer program instructions can also be loaded onto a computer or other programmable device to cause a series of operations to be performed on the computer or other programmable device, thereby producing a computer-implemented process, such that the instructions executing on the computer or other programmable device provide operations for implementing the functions specified in sequence diagram 900.

[0145] Therefore, the steps of sequence diagram 900 support combinations of means for performing a specified function and combinations of operations for performing a specified function. It will also be understood that one or more steps of sequence diagram 900, and combinations of steps in sequence diagram 900, can be implemented by a dedicated hardware-based computer system or a combination of dedicated hardware and computer instructions to perform the specified function. Figure 9 The sequence map 900 is used for intraoral scanning compression. Fewer, more, or different steps can be provided.

[0146] Figure 10 An exemplary flowchart 1000 for compressing intraoral scan data 110 according to another exemplary embodiment is shown. (In conjunction with...) Figure 1 , Figure 2 , Figure 3 Figure 4 Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8 and Figure 9 element pairs Figure 10 The following explanation is provided. Flowchart 1000 can depict the operations performed by the handheld intraoral scanning device 104.

[0147] In step 1002, the handheld intraoral scanning device 104 can be configured to capture intraoral scanning data 110 associated with the user (or patient 804). The intraoral scanning data 110 may include texture data 110A and 3D data 110B. The intraoral scanning data 110 can be captured during the user's intraoral scanning process. In at least one embodiment, the processing unit 202 can be configured to capture the user-associated intraoral scanning data 110, which includes texture data 110A and 3D data 110B captured during the user's intraoral scanning process. Details regarding the intraoral scanning data are provided, for example, in Figure 4.

[0148] At 1004, the handheld intraoral scanning device 104 can be configured to generate compressed texture data 112A associated with texture data 110A based on applying a first compression operation 502 to texture data 110A. In at least one embodiment, the processing unit 202 can be configured to generate compressed texture data 112A associated with texture data 110A based on applying the first compression operation 502 to texture data 110A. Details regarding the first compression operation are as follows: Figure 5 Provided by China.

[0149] In step 1006, the handheld intraoral scanning device 104 can be configured to generate compressed 3D data 112B associated with 3D data 110B based on applying a second compression operation 602 to the 3D data 110B. The second compression operation 602 may differ from the first compression operation 502. In at least one embodiment, the processing unit 202 can be configured to generate compressed 3D data 112B associated with 3D data 110B based on applying the second compression operation 602 to the 3D data 110B. Details regarding the second compression operation are provided, for example, in... Figure 6A and Figure 6B Provided by China.

[0150] In step 1008, the handheld intraoral scanning device 104 may be configured to transmit a combination of compressed texture data 112A and compressed 3D data 112B as compressed intraoral scanning data 112 to one or more client devices 106. In at least one embodiment, the processing unit 202 may be configured to transmit a combination of compressed texture data 112A and compressed 3D data 112B as compressed intraoral scanning data 112 to one or more client devices 106.

[0151] It should be understood that each step of flowchart 1000 can be implemented by various means, such as hardware, firmware, processor, circuitry, and / or other communication devices associated with software that executes software including one or more computer program instructions. For example, one or more of the steps described above can be embodied by computer program instructions. In this regard, the computer program instructions embodying the steps described above can be stored in memory unit 204 of a handheld intraoral scanning device 104 employing an embodiment of this disclosure. It should be understood that any such computer program instructions can be loaded onto a computer or other programmable device (e.g., hardware) to produce a machine, such that the resulting computer or other programmable device performs the functions specified in flowchart 1000. These computer program instructions can also be stored in a computer-readable storage medium that can direct the computer or other programmable device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture that performs the functions specified in flowchart 1000. The computer program instructions can also be loaded onto a computer or other programmable device to cause a series of operations to be performed on the computer or other programmable device, thereby producing a computer-implemented process, such that the instructions executing on the computer or other programmable device provide operations for implementing the functions specified in flowchart 1000.

[0152] Therefore, the steps of flowchart 1000 support combinations of means for performing a specified function and combinations of operations for performing a specified function. It will also be understood that one or more steps of flowchart 1000, and combinations of steps in flowchart 1000, can be implemented by a dedicated hardware-based computer system or a combination of dedicated hardware and computer instructions to perform the specified function. Figure 10 Flowchart 1000 is used for compressing intraoral scan data. It can provide fewer, more, or different steps.

[0153] Figure 11 This is a schematic diagram 1100 depicting an exemplary environment for real-time capture of intraoral scan data 110, compression of intraoral scan data 110, and rendering of decompressed intraoral scan data, according to an exemplary embodiment. Combined with... Figure 1 , Figure 2 , Figure 3 Figure 4 Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8 , Figure 9 and Figure 10 element pairs Figure 11 The following explanation is provided. Schematic diagram 1100 may include a dentist 1102 and a patient 1104.

[0154] A handheld intraoral scanner 104 can be used by a dentist 1102 to capture intraoral scan data 110 of the dental arch 1106 of a patient 1104. The handheld intraoral scanner 104 can compress the captured intraoral scan data and generate compressed intraoral scan data 1110 of the dental arch 1106 of the patient 1104.

[0155] The dentist 1102 can enter the identification number of the handheld intraoral scanner 104 into a web browser on a computer 1108 (such as a client device). The handheld intraoral scanner 104 and the computer 1108 can connect to a public web network and via one of the communication channels 108 based on the identification number forwarded to the handheld intraoral scanner 104.

[0156] Once the handheld intraoral scanning device 104 is connected to the computer 1108, compressed intraoral scan data of the dental arch 1106 can be transmitted to the computer 1108. A web application can be rendered on the web browser of the computer 1108. The computer 1108 can decompress the compressed intraoral scan data 1110 and render the decompressed intraoral scan data on the computer 1108.

[0157] Furthermore, the compressed intraoral scan data can be decompressed and rendered in real time on a web application. In one embodiment, the decompressed intraoral scan data 1112 can be manipulated by the dentist 1102 as needed, such as rotating or viewing it from multiple perspectives.

[0158] Therefore, the intraoral scanning system 102 allows the compression processing of intraoral scan data 110 to be independent of any external device. Users (such as dentists) can receive visual feedback during the intraoral scanning process and access a web server on the handheld intraoral scanning device 104 via one or more client devices 106. Furthermore, the compressed intraoral scan data can be broadcast and rendered on one or more client devices 106. Because the compressed intraoral scan data can be stored on the handheld intraoral scanning device 104, users can switch to different client devices during the scan. If the connection between the handheld intraoral scanning device 104 and one or more client devices 106 is lost, the scanning process can be resumed without losing any scan data.

[0159] Figure 12A scanning sequence 50 of an intraoral scanning system 102 is shown. During a first mode (56A, 56B) of the scanning sequence 50, the captured intraoral scanning data includes three-dimensional data, which can be generated by emitted structured light (e.g., white light) and captured by an image sensor in a handheld intraoral scanning device 104. During a second mode (55A, 55B, 55C) of the scanning sequence 50, the captured intraoral scanning data includes texture data, which can be generated by emitted light including at least infrared, blue, and / or white wavelengths. In this example, the scanning sequence in the second mode emits and captures infrared, blue, and white wavelengths. Different wavelengths can be emitted by separate light sources of a projection unit arranged within the handheld intraoral scanning device 104. In this specific example, the handheld intraoral scanning device is configured to generate compressed texture data, i.e., compressed data generated during the second mode, while the 3D data generated during the first mode is not compressed before being wirelessly transmitted to one or more client devices 106.

[0160] Since compression and rendering no longer rely on high-performance computers (such as PowerPCs), PowerPCs or servers can be used only for heavy-duty computing. Furthermore, the intraoral scanning system 102 is capable of processing multiple intraoral scan data in parallel. Therefore, the number of scans that can be post-processed simultaneously can depend solely on the processing power of a single server, thus not necessarily requiring multiple high-performance computers. Moreover, post-processing can be delegated to servers in the cloud. Therefore, the intraoral scanning system 102 provides intraoral scan compression by bringing processing to the handheld intraoral scanning device 104, utilizing edge computing technology.

[0161] Many modifications and other embodiments of this disclosure will occur to those skilled in the art upon which this disclosure pertains, thanks to the teachings presented in the foregoing description and the accompanying drawings. Therefore, it should be understood that this disclosure is not limited to the specific embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the appended claims. Furthermore, although exemplary embodiments have been described in the context of specific combinations of elements and / or functions in the foregoing description and the accompanying drawings, it should be understood that alternative embodiments may provide different combinations of elements and / or functions without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and / or functions different from those explicitly described above are also contemplated as being set forth in some of the appended claims. Although specific terminology is used herein, it is used only in a general and descriptive sense and not for limiting purposes.

[0162] Project List

[0163] 1. An intraoral scanning system (102), comprising:

[0164] A handheld intraoral scanning device (104), the handheld intraoral scanning device (104) being configured to:

[0165] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0166] Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated; and

[0167] ○ The compressed texture data (112A) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

[0168] 2. The intraoral scanning system (102) according to Project 1, wherein the first compression operation (502) corresponds to the High-Efficiency Video Coding (HEVC) operation.

[0169] 3. The intraoral scanning system (102) according to any one of the preceding items, wherein the handheld intraoral scanning device (104) further includes:

[0170] ○ Monitoring unit (208), configured to determine bandwidth information associated with one or more wireless full-duplex communication channels between the handheld intraoral scanning device (104) and the one or more client devices (106),

[0171] Furthermore, the handheld intraoral scanning device (104) is also configured to:

[0172] Based on the determined bandwidth information, the quality factor for the first compression operation (502) is determined; and

[0173] Based on applying the first compression operation (502) to the texture data (110A), the compressed texture data (112A) is generated, wherein the texture data (110A) is compressed based on a determined quality factor.

[0174] 4. The intraoral scanning system (102) according to any one of the preceding items, wherein the one or more client devices (106) are at least one of the following: a computer, a display screen, a tablet computer, or a smartphone.

[0175] 5. A method for compressing intraoral scan data (110), comprising:

[0176] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0177] Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated; and

[0178] ○ The combination of the compressed texture data (112A) and the compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

[0179] 6. A computer-programmable product comprising a non-transitory computer-readable medium having stored thereon computer-executable instructions, the instructions, when executed by processing circuitry, causing the processing circuitry to perform an operation, the operation including:

[0180] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0181] Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated; and

[0182] ○ The compressed texture data (112A) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

[0183] Project List

[0184] 1. An intraoral scanning system (102), comprising:

[0185] A handheld intraoral scanning device (104), the handheld intraoral scanning device (104) being configured to:

[0186] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0187] Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and

[0188] ○ The compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

[0189] 2. The intraoral scanning system (102) according to any one of the preceding items, wherein the 3D data (110B) associated with the intraoral scanning data (110) includes: depth data (808), amplitude data (810) and color data (812).

[0190] 3. The intraoral scanning system (102) according to any one of the preceding items, wherein, in order to apply the second compression operation (602) to the 3D data (110B), the handheld intraoral scanning device (104) is configured as follows:

[0191] ○ Based on the application of a first color transformation matrix to the 3D data (110B), a first intermediate result (604A) is generated, wherein the first color transformation matrix is ​​applied to convert the color components in the 3D data (110B) from a first color space to a second color space;

[0192] ○ Based on the modification of each pixel value of the first intermediate result (604A) generated according to the predetermined value, a second intermediate result (604B) is generated.

[0193] ○ Based on the first transformation operation applied to the generated second intermediate result, a third intermediate result (604C) is generated.

[0194] Based on the application of the first transformation operation to the third intermediate result, one or more transformation coefficients are determined, wherein the one or more transformation coefficients are associated with the first transformation operation;

[0195] ○ One or more transformation coefficients determined by quantization; and

[0196] ○ Based on applying a first encoding operation to one or more quantized transform coefficients, first intermediate data (606A) is generated, wherein the compressed 3D data (112B) includes the first intermediate data (606A).

[0197] 4. The intraoral scanning system (102) according to Project 3, wherein the application of the first color transformation matrix is ​​based on principal component analysis (PCA) associated with the first color space.

[0198] 5. The intraoral scanning system (102) according to Project 3, wherein the first transformation operation corresponds to the discrete cosine transform (DCT) operation.

[0199] 6. The intraoral scanning system (102) according to Project 3, wherein the first coding operation corresponds to an arithmetic coding operation.

[0200] 7. The intraoral scanning system (102) according to any one of the preceding items, wherein the handheld intraoral scanning device (104) is configured as follows:

[0201] ○ Based on the application of the second transformation operation to the third intermediate result, a fourth intermediate result (604D) is generated.

[0202] ○ Based on the second color transformation matrix applied to the generated fourth intermediate result (604D), the color components in the generated fourth intermediate result (604D) are converted from the second color space to the first color space to generate a fifth intermediate result (604E).

[0203] Based on the 3D data (110B) and the generated fifth intermediate result (604E), calculate the residual data; and

[0204] Based on the first encoding operation applied to the calculated residual data, second intermediate data (606B) is generated, wherein the compressed 3D data (112B) includes the second intermediate data (606B).

[0205] 8. The intraoral scanning system (102) according to Item 7, wherein the second transformation operation is the inverse operation of the first transformation operation.

[0206] 9. The intraoral scanning system (102) according to any one of items 7 to 8, wherein the second color transformation matrix is ​​the inverse of the first color transformation matrix.

[0207] 10. The intraoral scanning system (102) according to any one of items 7 to 9, wherein the handheld intraoral scanning device (104) is further configured to transmit the first intermediate data (606A) and the second intermediate data (606B) as the compressed 3D data (112B) to the one or more client devices (106).

[0208] 11. The intraoral scanning system (102) according to any one of the preceding items, wherein the one or more client devices (106) are at least one of the following: a computer, a display screen, a tablet computer, or a smartphone.

[0209] 12. A method for compressing intraoral scan data (110), comprising:

[0210] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0211] Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and

[0212] ○ The compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

[0213] 13. A computer-programmable product comprising a non-transitory computer-readable medium having stored thereon computer-executable instructions, the instructions, when executed by processing circuitry, causing the processing circuitry to perform an operation, the operation including:

[0214] ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data and three-dimensional (3D) data (110B) captured during the intraoral scan of the user.

[0215] Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and

[0216] ○ The compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

Claims

1. An intraoral scanning system (102), comprising: A handheld intraoral scanning device (104), the handheld intraoral scanning device (104) being configured to: ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user. Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated. Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and ○ The combination of the compressed texture data (112A) and the compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

2. The intraoral scanning system (102) according to claim 1, wherein, The first compression operation (502) corresponds to the High Efficiency Video Coding (HEVC) operation.

3. The intraoral scanning system (102) according to any one of the preceding claims, wherein, The handheld intraoral scanning device (104) also includes: ○ Monitoring unit (208), configured to determine bandwidth information associated with one or more wireless full-duplex communication channels between the handheld intraoral scanning device (104) and the one or more client devices (106), Furthermore, the handheld intraoral scanning device (104) is also configured to: Based on the determined bandwidth information, determine the quality factor for the first compression operation (502); and Based on applying the first compression operation (502) to the texture data (110A), the compressed texture data (112A) is generated, wherein the texture data (110A) is compressed based on a determined quality factor.

4. The intraoral scanning system (102) according to any one of the preceding claims, wherein, The 3D data (110B) associated with the intraoral scan data (110) includes: depth data (808), amplitude data (810), and color data (812).

5. The intraoral scanning system (102) according to any one of the preceding claims, wherein, In order to apply the second compression operation (602) to the 3D data (110B), the handheld intraoral scanning device (104) is configured to: ○ Based on the application of a first color transformation matrix to the 3D data (110B), a first intermediate result (604A) is generated, wherein the first color transformation matrix is ​​applied to convert the color components in the 3D data (110B) from a first color space to a second color space; ○ Based on the modification of each pixel value of the first intermediate result (604A) generated according to the predetermined value, a second intermediate result (604B) is generated. ○ Based on the first transformation operation applied to the generated second intermediate result, a third intermediate result (604C) is generated. Based on the application of the first transformation operation to the third intermediate result, one or more transformation coefficients are determined, wherein the one or more transformation coefficients are associated with the first transformation operation; ○ One or more transformation coefficients determined by quantization; and ○ Based on applying a first encoding operation to one or more quantized transform coefficients, first intermediate data (606A) is generated, wherein the compressed 3D data (112B) includes the first intermediate data (606A).

6. The intraoral scanning system (102) according to claim 5, wherein, The application of the first color transformation matrix is ​​based on principal component analysis (PCA) associated with the first color space.

7. The intraoral scanning system (102) according to claim 5, wherein, The first transformation operation corresponds to the Discrete Cosine Transform (DCT) operation.

8. The intraoral scanning system (102) according to claim 5, wherein, The first encoding operation corresponds to an arithmetic encoding operation.

9. The intraoral scanning system (102) according to any one of claims 5 to 8, wherein, The handheld intraoral scanning device (104) is configured as follows: ○ Based on the application of the second transformation operation to the third intermediate result, a fourth intermediate result (604D) is generated. ○ Based on the second color transformation matrix applied to the generated fourth intermediate result (604D), the color components in the generated fourth intermediate result (604D) are converted from the second color space to the first color space to generate a fifth intermediate result (604E). Based on the 3D data (110B) and the generated fifth intermediate result (604E), calculate the residual data; as well as Based on the first encoding operation applied to the calculated residual data, second intermediate data (606B) is generated, wherein the compressed 3D data (112B) includes the second intermediate data (606B).

10. The intraoral scanning system (102) according to claim 9, wherein, The second transformation operation is the inverse operation of the first transformation operation.

11. The intraoral scanning system (102) according to any one of claims 9 to 10, wherein, The second color transformation matrix is ​​the inverse of the first color transformation matrix.

12. The intraoral scanning system (102) according to any one of claims 9 to 11, wherein, The handheld intraoral scanning device (104) is also configured to transmit the first intermediate data (606A) and the second intermediate data (606B) as the compressed 3D data (112B) to the one or more client devices (106).

13. The intraoral scanning system (102) according to any one of the preceding claims, wherein, The one or more client devices (106) are at least one of the following: a computer, a display screen, a tablet computer, or a smartphone.

14. A method for compressing intraoral scan data (110), comprising: ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data (110A) and three-dimensional (3D) data (110B) captured during the intraoral scan of the user. Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated. Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and ○ The combination of the compressed texture data (112A) and the compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

15. A computer-programmable product comprising a non-transitory computer-readable medium having stored thereon computer-executable instructions, the instructions, when executed by processing circuitry, causing the processing circuitry to perform an operation, the operation comprising: ○ Capture intraoral scan data (110) associated with the user, the intraoral scan data (110) including texture data and three-dimensional (3D) data (110B) captured during the intraoral scan of the user. Based on applying a first compression operation (502) to the texture data (110A), compressed texture data (112A) associated with the texture data (110A) is generated. Based on applying a second compression operation (602) to the 3D data (110B), compressed 3D data (112B) associated with the 3D data (110B) is generated, wherein the second compression operation (602) is different from the first compression operation (502); and ○ The combination of the compressed texture data (112A) and the compressed 3D data (112B) is transmitted as compressed intraoral scan data (112) to one or more client devices (106).

Images