Wireless Scanning Devices
By switching modes in the wireless scanning device to adjust the data rate and operation time, the power consumption and heat generation issues of the wireless scanning device are solved, achieving more efficient power management and heat control while maintaining the quality of 3D model generation.
Patent Information
- Application Number
- CN201980094126.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-01-15
- Filing Date
- 2019-12-13
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-12-13
AI Technical Summary
Existing wireless scanning devices have shortcomings in power consumption and heat management, especially since more power is required during wireless transmission and there is a lack of effective power management solutions.
A wireless scanning device is provided that adjusts the data rate to optimize power and thermal management by switching between standard and non-standard modes. Specific measures include adjusting or shutting down the 2D frame rate, image detector, and wireless module's operating time to reduce data processing and transmission in non-standard mode.
It effectively reduces the heat and power consumption of the wireless module, extends battery life, and can still generate 3D models with sufficient detail in non-standard modes.
Smart Images

Figure CN113573623B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to a wireless scanning device. More specifically, the present disclosure relates to a wireless scanning device that manages power consumption and / or heat generation. Most specifically, the present disclosure relates to a wireless scanning device for intra-oral scanning and / or intra-ear scanning. Background Art
[0002] The management of power consumption and / or heat generation is well known in the field of computing devices, such as in computers and / or 3D scanning devices. For example, it is well known that in laptop computers, battery power is saved by a technique called central processing unit (CPU) throttling or dynamic frequency scaling, in which the clock speed of the CPU is automatically adjusted. In other words, the laptop computer slows down to save battery power. It is well known that the clock speed of the CPU can be adjusted based on the heat generated by the CPU. For example, if the CPU is too hot, i.e., overheated, the clock speed will be reduced so that the CPU is cooled. This technique may be called thermal throttling and is a specific technique within the field of CPU throttling.
[0003] Various other techniques within CPU throttling and even within thermal throttling are known. For example, in thermal throttling, it is well known that processes run by a CPU or a graphics processing unit (GPU) can be organized based on the temperature of the CPU. Other techniques besides throttling a processor for reducing power consumption are also known. Examples are by reducing the power or process of a light projector, and / or by reducing the duty cycle of a light projector or image detector. Thus, power management of battery powered devices is already known in great detail.
[0004] However, for wireless devices that transmit images wirelessly, such as wireless cameras, it is well known that wireless transmission requires more power than wired transmission. The typical solution to provide more power to wireless devices is to switch the power source, such as by switching from a battery to a wired power source. Therefore, there is a need for better power management of wireless devices, especially wireless scanning devices. Summary of the invention
[0005] It is an object of the present disclosure to provide a wireless scanning device that better manages power and / or heat so that no cables need to be provided.
[0006] In one aspect of the present invention, a wireless scanning device for providing data for a 3D model of an object is provided, comprising: a scanning housing, the scanning housing comprising: an image detector, the image detector being configured to acquire 2D images at a first 2D frame rate; and one or more processors connected to the image detector so that the 2D images can be processed by the processors to form processed data; a wireless module, the wireless module being connected to the processors so that the wireless module receives the processed data from the processors and wirelessly transmits the processed data, wherein the processed data is data for the 3D model of the object.
[0007] The scanning device is preferably configured to switch between two predefined scanning operation modes: a standard mode; and a non-standard mode, in which the wireless module receives processed data at a first data rate defined by the processor, and in which the wireless module receives processed data at a second data rate defined by the processor.
[0008] Advantageously, the wireless module in a preferred embodiment receives processed data at two different data rates as described above, because once in the non-standard mode, the wireless module can in a further preferred embodiment receive less processed data than in the standard mode, thereby generating much less heat within the wireless module itself than in the standard mode.
[0009] The inventors of the present scanning device have realized that the wireless module is responsible for generating a lot of heat in the wireless scanning device, so by limiting the processed data to the wireless module, the inventors have seen a dramatic drop in temperature. Using the present invention, i.e. by switching from standard mode to non-standard mode, a temperature reduction of about 10% has been observed.
[0010] Thus, in one embodiment, the scanning device disclosed herein provides for less heat generation and uses less power, thereby saving power.
[0011] Another object of the present disclosure is to provide a wireless scanning device that better manages power and / or heat, thereby providing more details of the scanned object.
[0012] This may also be achieved using the scanning device disclosed herein.In another embodiment, the wireless module may receive more processed data than in standard mode, whereby the wireless module transmits more processed data than in standard mode and thus enables the generation of a more accurate 3D model.
[0013] Thus, the inventors have appreciated that the wireless module is suitable for a given scanning operation situation. In other words, in some embodiments, and if conditions allow the scanner to generate data, the scanning device can switch from a standard mode to a non-standard mode.
[0014] Scanning devices according to the present invention and used in other embodiments provide more scanning details.
[0015] In summary, the present invention provides a wireless scanning device with greatly improved power and / or heat management. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The above and / or other objects, features and advantages of the present disclosure will be further described by the following illustrative and non-limiting detailed description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
[0017] Figure 1 An example of a wireless scanning device according to the present invention is shown.
[0018] Figure 2 An example of heating in a scanning device 1 with two predefined scanning operation modes is shown.
[0019] Figure 3 An example of power consumption in a scanning device 1 with two predefined scanning operation modes is shown.
[0020] Figure 4 An example of data transmission in a scanning device 1 with two predefined scanning operation modes is shown. DETAILED DESCRIPTION
[0021] Scanning devices are different from simple cameras. Scanning devices are also used as disclosed in the present invention to provide data for a 3D model of an object. A camera provides a 2D image, usually unprocessed data, which has nothing to do with the 3D model of the object. Scanning can be active or passive, which means that in active scanning, light is usually projected onto the object using a light source so that the scanning device can derive surface data from the light. Several techniques for active scanning are known in the scanning field, for example:
[0022] - triangularization scanning: in which a projection pattern is projected onto the object and imaged onto an image detector, thereby deriving depth information based on the triangulation principle,
[0023] -confocal scanning, where one or more point sources are focused onto the object and imaged onto an image detector so that depth information is derived based on the intensity of the imaging focus,
[0024] - structured light illumination scanning, where a projection pattern is projected onto the object and imaged to an image detector so that depth information is derived based on the pattern information,
[0025] - Interferometric scanning, where a pattern is projected onto the object and imaged onto an image detector by another pattern, so that depth information is derived based on the interference between the two patterns.
[0026] Passive scanning techniques are also known, in which no light source is used. Such scanning techniques rely on information that can be derived from the image itself. In some passive scanning devices, the image detector is not a standard image detector, but may include, for example, a microlens array.
[0027] However, a camera, also called a static camera, provides a 2D image to display 2D information of an object photographed at a certain moment from one position in space, whereas a scanning device provides data for displaying 3D information of an object photographed at several moments in time and / or at several spatial positions.
[0028] Therefore, scanning devices require much more power than cameras, and therefore scanning devices also generate more heat than cameras.
[0029] Furthermore, as mentioned above, scanning devices also provide more data than cameras, and in order to construct a 3D model, for example on an external computer, data needs to be transferred from the scanning device.
[0030] Typically with scanners, this data transfer is provided via wired data transfer, such as a USB cable or an Ethernet cable.
[0031] However, the scanning device according to the present invention includes a wireless module coupled to the processor such that the wireless module receives processed data from the processor and wirelessly transmits the processed data, wherein the processed data is data for a 3D model of an object.
[0032] This allows the scanning device to be wireless and in some embodiments the scanning device according to the invention is also battery powered. This means that the scanning device can be operated completely without cables. This is advantageous for scanning, for example, the teeth or ears of a patient. In one embodiment, the scanning device according to the invention is a handheld scanning device for the dental scanning field and / or the hearing aid scanning field. Handheld scanning devices in the dental field are often called intraoral scanners. Handheld scanning devices in the hearing aid field are often called in-ear scanners.
[0033] According to a preferred embodiment of the present invention, the scanning device is configured to switch between the following two predefined scanning operation modes: a standard mode; and a non-standard mode, in which the wireless module receives processed data at a first data rate defined by the processor; in the non-standard mode, the wireless module receives processed data at a second data rate defined by the processor.
[0034] The two predefined scanning operation modes are, according to their meaning, two modes that have been defined before use, i.e. the scanning operation modes have been programmed into the scanning device. Therefore, there is a significant difference between the two scanning operation modes, and the difference between the standard mode and the non-standard mode is not only a consequence of the processor getting hot and / or the processor slowing down due to heat. In a preferred embodiment, the scanning device actively switches between the two scanning operation modes, for example in an automatic manner. However, switching can also be performed manually, for example using a switch located on the scanning device and / or in software associated with the scanning device (e.g. on an external computer).
[0035] With regard to switching from standard mode to non-standard mode, one embodiment relates to the case where the second data rate is defined to be lower than the first data rate, i.e., predefined. There are a variety of ways to provide this lower second data rate, and these embodiments, which will be referred to as wireless throttling modes, will be described below. Various other embodiments of the scanning device will be described thereafter.
[0036] Wireless Throttling Mode
[0037] In one embodiment, the non-standard mode is provided by switching the first 2D frame rate to a second 2D frame rate, wherein the second 2D frame rate becomes lower than the first 2D frame rate, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode. In this embodiment, the first 2D frame rate corresponds to the first of the two predefined scanning operation modes, and the second 2D frame rate corresponds to the first of the two predefined scanning operation modes. The non-standard mode is defined as a wireless throttling mode because it is a wireless module that is effectively throttled, i.e., the wireless module is changed to perform less than in the standard mode. The wireless throttling mode, i.e., the non-standard mode, is by definition a scanning operation mode, in particular because the scanning device acquires images at a predefined 2D frame rate. Therefore, by definition, the standard mode is also a scanning operation mode. When the scanning device is changed to scan at the predefined second 2D frame rate (i.e., acquire multiple images over time), the scanning device does not acquire as many 2D images as in the standard mode. In other words, the scanning device scans slower, so less data is acquired over time, less data is processed over time, and then the wireless module receives less processed data over time. This has the following effect: the wireless module is selected to use less power over time and is selected to generate less heat over time. In this embodiment, because less data is acquired over time, the details of the generated 3D model are not as many as in the standard mode. However, the inventors have realized that when operating in a non-standard mode, a 3D model with sufficient details is still generated. For example, compared with a typical CPU throttling in which one or more processors are slowed down, an advantage of this embodiment is that one or more processors are prevented from receiving some 2D images that they would receive in the standard mode. Therefore, unlike providing the same amount of data in the form of 2D images to (one or more) processors as done in a typical CPU throttling, less data is provided to the (one or more) processors according to this embodiment to be processed. This effectively provides thermal cooling or throttling of the wireless module.
[0038] In another embodiment, the non-standard mode is provided by maintaining a first 2D frame rate and turning off the image detector for a specific time, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode. In this embodiment, the scanning device is not changed to scan at a predefined second 2D frame rate (i.e., acquiring multiple images over time). However, the result is the same as in the previous embodiment-the scanning device does not acquire as many 2D images as in the standard mode. In other words, the scanning device scans slower, so less data is acquired over time, less data is processed over time, and then the wireless module receives less processed data over time. This has the following effect: the wireless module is selected to use less power over time and is selected to generate less heat over time. In this embodiment, because less data is acquired over time, the amount of data of the generated 3D model is not as much as in the standard mode. However, the inventors have realized that when operating in the non-standard mode, a 3D model with sufficient data is still generated. For example, compared with typical CPU throttling where one or more processors are slowed down, the advantage of this embodiment is to prevent one or more processors from receiving some 2D images that they will receive in the standard mode. Therefore, instead of providing the same amount of data in the form of a 2D image to the processor(s) as is done in typical CPU throttling, the processor(s) according to this embodiment are provided with less data to process. This effectively provides thermal cooling or throttling of the wireless module.
[0039] In yet another embodiment, a non-standard mode is provided by maintaining a first 2D frame rate and reducing the spatial resolution of the image detector for a specific time, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode. In this embodiment, the scanning device is not changed to scan at a predefined second 2D frame rate (i.e., acquiring multiple images over time). However, the result is the same as in the previous embodiment - less data is acquired over time, less data is processed over time, and then the wireless module receives less processed data over time. This has the following effect: the wireless module is selected to use less power over time and is selected to generate less heat over time. In this embodiment, because less data is acquired over time, the amount of data of the generated 3D model is not as much as in the standard mode. However, the inventors have realized that when operating in a non-standard mode, a 3D model with sufficient data is still generated. For example, compared with a typical CPU throttling in which one or more processors are slowed down, the advantage of this embodiment is to prevent one or more processors from receiving some 2D images that they would receive in the standard mode. Therefore, instead of providing the same amount of data in the form of a 2D image to the processor(s) as is done in typical CPU throttling, the processor(s) according to this embodiment are provided with less data to process. This effectively provides thermal cooling or throttling of the wireless module.
[0040] In a further embodiment, the non-standard mode is provided by maintaining a first 2D frame rate and turning off the wireless module for a specific time, whereby the wireless module receives processed data at a second data rate by the processor (or processors), thereby defining the non-standard mode as a wireless throttling mode. In this embodiment, the scanning device does not change to scan at a predefined second 2D frame rate (i.e., acquire multiple images over time). In addition, the result will be different from the previous embodiment - the scanning device can obtain as many 2D images as in the standard mode, but the processed data received by the wireless module is not as much as in the standard mode. In other words, in this embodiment, the scanning device can scan indistinguishably with the standard mode, so the same data is acquired over time and the same data is processed over time. However, the wireless module receives less processed data over time. This also has the effect that the wireless module is selected to use less power over time and is selected to generate less heat over time. In this embodiment, because less data is received over time, the amount of data of the generated 3D model is not as much as in the standard mode. However, the inventors have realized that when operating in the non-standard mode, a 3D model with sufficient data is still generated. For example, compared to typical CPU throttling where one or more processors are slowed down, an advantage of this embodiment is that the wireless module is prevented from receiving some 2D images that it would receive in standard mode. This effectively provides thermal cooling or throttling of the wireless module.
[0041] In a further embodiment, the non-standard mode is provided by maintaining a first 2D frame rate and directing the processed data to another module for a specific time, whereby the wireless module receives the processed data at a second data rate defined by the processor, thereby defining the non-standard mode as a wireless throttling mode. In a related embodiment, the other module may be a memory module or a storage module, for example, configured to operate as a buffer, wherein the processed data is buffered for a specific time. In this embodiment, the scanning device is not changed to scan at a predefined second 2D frame rate (i.e., to acquire multiple images over time). However, the result is the same as in the previous embodiment - the scanning device can acquire as many 2D images as in the standard mode, but the processed data received by the wireless module is not as much as in the standard mode. In other words, in this embodiment, the scanning device can scan indistinguishably with the standard mode, so the same data is acquired over time and the same data is processed over time. However, the wireless module receives less processed data over time. This also has the effect that the wireless module is selected to use less power over time and is selected to generate less heat over time. In this embodiment, because less data is received over time, the amount of data in the generated 3D model is not as much as in the standard mode. However, the inventors have realized that when operating in the non-standard mode, a 3D model with sufficient data is still generated. For example, compared to typical CPU throttling where one or more processors are slowed down, an advantage of this embodiment is that the wireless module is prevented from receiving some 2D images that it would receive in the standard mode. This effectively provides thermal cooling or throttling of the wireless module.
[0042] Hyper-mode
[0043] In some embodiments, a non-standard mode is provided by switching the first 2D frame rate to a second 2D frame rate, wherein the second 2D frame rate becomes higher than the first 2D frame rate, thereby the second data rate becomes higher than the first data rate, thereby defining the non-standard mode as a wireless super mode. The technical effect of this mode is to provide more details of the scanned object.
[0044] Conditional / automatic switching between two predefined scanning operation modes
[0045] As mentioned above, the switching between the two predefined scanning operation modes is preferably performed in an automatic manner. In most embodiments, the switching is based on conditions, for example. Several such conditions are described below.
[0046] Temperature-based conditions
[0047] In one embodiment, the switching between at least two predefined scanning operation modes is based on a condition of the processor and / or a part connected to the processor. For example, the condition can be related to the temperature of the processor. The temperature can be provided by the processor, for example, by requesting the temperature through a command to the processor. Therefore, the processor can be configured to provide the condition of the processor. In addition, and / or alternatively, the condition can be related to a part of the processor (e.g., a wireless module). Therefore, in some embodiments, the condition can be related to the temperature of the wireless module.
[0048] In another embodiment, the scanning device further comprises a power supply unit coupled to the processor. The power supply unit is preferably a battery. By supplying power from the battery, the wireless scanning device becomes completely wireless, i.e. no wires are required for data transmission and no wires are required for power transmission. This allows scanning without the scanning device being physically restricted by the movement of wires. Thus, a completely wireless scanning device is provided, and this allows better intra-oral and / or intra-ear scanning in some embodiments. When the power supply unit is coupled to the processor, the condition may be related to the temperature of the power supply unit.
[0049] In yet another embodiment, the scanning device further comprises a light source, for example a light source configured to project light onto the object being scanned. As previously mentioned, known scanning devices having a light source rely on active scanning techniques. In a related embodiment, the light source is turned off for at least a period of time. This has the effect of saving power and generating less heat.
[0050] As mentioned above, the temperature may be related to the processor, and / or to the wireless module, and / or to the scanning housing, and / or to the power supply unit, and / or to the light source.
[0051] In a preferred embodiment, the condition is a measure of the temperature relative to a predefined temperature. For example, a condition can be defined as a situation where the measure of the temperature relative to a predefined temperature defines that the measure of the temperature exceeds a predefined temperature, where the predefined temperature is a threshold value.
[0052] In a related embodiment, the threshold value is greater than 60 degrees, preferably greater than 70 degrees, and more preferably about 78 degrees.
[0053] Conditions based on power level
[0054] In one embodiment, the condition is a measure of the power level of the power supply unit relative to a predefined power level.
[0055] In another embodiment, the power level is an absolute measure and / or a first derivative of the power level with respect to time, and / or a second derivative of the power level with respect to time.
[0056] Image-based conditions
[0057] In one embodiment, the condition is based on a 2D image received by the processor. For example, a quality parameter may be applied to the 2D image, and if a certain image quality is present, the scanning operation mode may be changed. For example, if the image quality exceeds a desired image quality, the scanning operation mode may not need to be in a standard mode. The scanning device may then change the standard mode to a non-standard mode, such that when switching to the non-standard mode, the first 2D frame rate is switched to a second 2D frame rate, wherein the second 2D frame rate becomes lower than the first 2D frame rate.
[0058] In one example, when generating a 3D model, feedback can be provided to the scanning device regarding the data density of the model in the apparent field of view of the scanning device. If the data density is above a certain threshold associated with data density and / or data quality, the scanning device can switch to a non-standard mode, such as providing a low 2D frame rate. Alternatively, if the data density is below a certain threshold associated with data density and / or data quality, the scanning device can switch to a non-standard mode, such as providing a high 2D frame rate.
[0059] Processor-based, image detector-based, and sensor-based conditions
[0060] In one embodiment, one or more external processors are configured to provide conditions of the processors. For example, the external processor may perform a computer-implemented method for managing a frame rate of a scanning device, comprising the steps of: transmitting instructions to notify an image detector to acquire a 2D image at a first 2D frame rate, so that the scanning device operates in a standard mode; receiving conditions of one or more processors of the scanning device, and / or receiving conditions of a portion of the processors connected to the scanning device; monitoring the conditions to check whether the conditions are met, such that: if the conditions are not met, transmitting instructions to notify the image detector to operate in a manner that prevents a wireless module in the scanning device from receiving 2D images at the first 2D frame rate, so that the scanning device switches to operate in a non-standard mode; and if the conditions are met, continuing to transmit instructions to notify the image detector to acquire a 2D image at the first 2D frame rate, so that the scanning device continues to operate in the standard mode.
[0061] In another embodiment, the scanning device further comprises a sensor configured to provide the condition. Such a sensor may be a temperature sensor.
[0062] Data Transfer
[0063] In one embodiment, the scanning device is further configured such that when in the standard mode, the wireless module transmits the processed data at a first data rate, and when in the non-standard mode, the wireless module transmits the processed data at a second data rate.
[0064] Processed data and processing rate
[0065] In a preferred embodiment, the ratio between the first data rate and the first 2D frame rate is between 1:50 and 1:150, preferably between 1:80 and 1:120, most preferably about 1:90. For example, the first data rate may be similar to the 3D frame rate, i.e. a collection of temporal 2D frames that together form a collection of temporal 3D frames. For example, in one embodiment, the image detector may acquire 2000 frames per second. Thus, in one second, the image detector acquires 2000 images. Of these 2000 images, there may be blocks of 20 images, each such block forming a 3D image. This corresponds to a situation where the 2D first frame rate is 2000 frames / image per second, and the corresponding 3D frame rate, here equal to the first data rate, is 20 frames / image per second.
[0066] In a most preferred embodiment, the first data rate is the same as the 3D frame rate, which is more than 10 frames per second, more preferably between 10 and 30 frames per second, preferably more than 16 frames per second, most preferably about 20 frames per second.
[0067] In one embodiment, one or more processors are configured to process data at the same rate as the rate provided by the image processor. For example, in another or related embodiment, the first data rate and / or the second data rate corresponds to processing 2D images provided to the processor at an effective 2D frame rate of between 1000 and 5000 frames per second, preferably between 1500 and 2500 frames per second, preferably between 1700 and 1900 frames per second, and most preferably about 1800 frames per second. This can be provided, for example, by configuring the processor to process data at the same data rate as the rate provided by the image detector. In addition, the image detector can be correspondingly configured to acquire 2D images at a frame rate that matches the data rate of the processor.
[0068] In a preferred embodiment, the second data rate is less than 90% of the first data rate, preferably less than 80% of the first data rate, and more preferably about 75% of the first data rate. The effect of switching the data rate to such a rate is a significant reduction in power and / or heat generation. It not only reduces the power consumption and / or heat generation of the processor, but also reduces the power consumption and / or heat generation of the wireless module. Since the wireless module is coupled to the processor, this effect is a combined effect.
[0069] As previously mentioned, in most embodiments, the processed data may be in the form of 3D data, such as a 3D image. In some embodiments, the 3D data may be a point cloud, such as with or without texture information. Thus, when in standard mode, the processor generates 3D data at a first data rate, and when in non-standard mode, the processor generates 3D data at a second data rate.
[0070] In order to process the data into processed data, the processor must be configured to do so. In most scanning devices, data processing is performed on an external processor, which is located on a remote computer, for example. The scanning device then transmits only the data to be processed. Therefore, most scanning devices do not have a processor that processes the data into processed data. As mentioned at the beginning of the detailed description, depth information can be derived by a variety of techniques. Therefore, each of these techniques derives depth information by processing data. Some techniques are more demanding on processing than other techniques. For example, it is quite simple to derive depth information from confocal scanning data compared to structured light illumination scanning data. Depth information from confocal scanning only requires comparison of intensity, no or little additional processing, while depth information from structured light illumination requires processing of detected images and projected patterns. However, if data processing can be performed on the scanning device, for example to derive depth information and / or generate 3D data, the scanning device itself needs to transmit less data. Therefore, in order to reduce the load on the wireless module, it is advantageous to process as much data as possible on the scanning device. Various processors are known for processing data, but for fairly simple processing, such as comparing intensities or more generally performing operations such as multiplication and / or addition, a field programmable gate array (FPGA) processor is desired. Therefore, in a preferred embodiment, the processor includes an FPGA processor. In a more preferred embodiment, the processor is configured to derive depth information and / or to generate 3D data. The 3D data may not need to be distributed in the spatial domain. For example, the 3D data may be partially in the spatial domain and partially in the time domain. Further processing can then be applied to the 3D data to convert the 3D data into pure spatial domain data. According to the present invention, the processed data is data for a 3D model of an object, and as explained herein, this can be 3D data in the spatial domain or the time domain, or a mixture thereof. Depth information is generally understood to be relevant to the case where the 3D data is only in the spatial domain.
[0071] In order to provide a wireless scanning device that can save power, the scanning device is preferably configured so that the wireless module transmits as little data as possible. As just explained, the implementation of a processor, such as an FPGA processor, wherein the processor is configured to derive depth information and / or to generate 3D data, means that the wireless module will transmit a small amount of data.
[0072] In a most preferred embodiment, the processor is further configured to compress the processed data, so that the wireless module receives the processed data in the form of compressed data from the processor and wirelessly transmits the processed data in the form of compressed data. Therefore, in some embodiments, the FPGA processor both processes the data and compresses the data.
[0073] According to the present invention, the wireless module receives processed data from the processor and transmits the processed data wirelessly. In order for the wireless module to receive processed data from the processor, the processor must be configured to transfer the processed data to the wireless module. In one embodiment, the data transmission to the wireless module is performed by the processor, preferably a central processing unit (CPU) including a reduced instruction set computer (RISC) architecture. For example, in order to transmit data to the wireless module, the processor can be in the form of an advanced RISC machine (ARM) processor such as one based on 32-bit or 64-bit instructions. In other words, the processor can include an ARM processor. The ARM processor is different from an FPGA processor, and these two processors are designed for different tasks. Therefore, in a most preferred embodiment, the processor includes an FPGA processor and an ARM processor.
[0074] However, the inventors have realized that in a wireless scanning device using both an FPGA processor and an ARM processor and a wireless module, power is consumed quickly and a large amount of heat is generated.
[0075] Therefore, in one embodiment it is desirable to further limit the heat generated by and the power consumed by both the processor and the wireless module. In one embodiment, the processor and the wireless module are integrated in a programmable system on a chip (PSoC) such that a first portion of the chip is adapted to have hardware programmability and a second portion of the chip is adapted to have software programmability, wherein the first portion is configured to form processed data, and wherein the second portion is configured to send the processed data to the wireless module.
[0076] In other words, the inventors have realized that in order to limit the heat generated by the processor and wireless module and limit the power consumed by them, a PSoC can be implemented in the scanning device, which is capable of performing tasks defined by the FPGA processor and the ARM processor. PSoC integrates the software programmability of an ARM-based processor and the hardware programmability of an FPGA.
[0077] In a related embodiment, the first portion is further configured to form the processed data in the form of compressed data.
[0078] Example 1 – Wireless Scanning for Devices
[0079] Figure 1An example of a wireless scanning device 1 according to the present invention is shown.
[0080] A wireless scanning device 1 for providing data for a 3D model of an object comprises a scanning housing 2, which comprises: an image detector 3, which is configured to acquire 2D images at a first 2D frame rate; one or more processors 4, which are coupled to the image detector 3, here through a main printed circuit board (PCB) 5, so that the 2D images can be processed by the processor 4 to form processed data. The scanning device also includes a wireless module 6 coupled to the processor, here again through the main PCB 5, so that the wireless module 6 receives processed data from the processor 4 and wirelessly transmits the processed data, wherein the processed data is data for the 3D model of the object. In addition, the scanning device 1 is configured to switch between the following two predefined scanning operation modes: a standard mode, in which the wireless module 6 receives processed data at a first data rate defined by the processor 4; and a non-standard mode, in which the wireless module 6 receives processed data at a second data rate defined by the processor 4. The scanning device 1 also includes a power supply unit 7 coupled to the processor 4, here again through the main PCB 5. In this example, the power supply unit 7 is a battery. Therefore, the wireless scanning device is completely wireless and does not require power from an external power source. As also shown in this example, this provides a handheld scanning device. The scanning device shown here also includes a light source 8, shown here projecting light (in various fields of view) onto an object through a scanning tip 9. In this example, the scanning device is configured as an intraoral scanning device - the scanning tip 9 can be inserted into the patient's mouth so that, for example, teeth can be scanned. During scanning, a lens 10 within the scanning housing 2 moves back and forth.
[0081] Example 2 – Heating in a Scanning Device with Two Predefined Scanning Operation Modes
[0082] Figure 2 An example of heating in a scanning device 1 with two predefined scanning operation modes is shown. Figure 1 In the device shown, the scanning device 1 is arranged as a completely wireless scanning device 1, i.e. having a battery 7. The scanning device is configured to switch between two predefined scanning operation modes: a standard mode, in which the wireless module receives processed data at a first data rate defined by the processor; and a non-standard mode, in which the wireless module receives processed data at a second data rate defined by the processor.
[0083] In standard mode, Figure 21, the wireless module 6 receives processed data at a first data rate defined by the processor 4. More specifically, the first data rate corresponds to processing 2D images provided to the processor 4 at an effective 2D frame rate of approximately 1800 frames per second. In other words, the one or more processors are configured to process data at the same rate as provided by the image processor, which is configured to operate at a speed of approximately 1800 frames per second. Figure 1 The lens 10 mentioned in the figure moves back and forth at 10 Hz (20 sweeps per second). A single sweep is equal to one 3D image. In order for the processor 4 to process a 3D scan (composed of several 2D images), a trigger on the image detector 3 must be armed. This arming is done continuously by a data service running on an external computer. In other words, the arming of the trigger on the image detector 3 defines a first data rate, which is set to 1800 frames per second in this example. Therefore, in this example, the first data rate defined by the processor 4 is defined via the image detector 3, where the image detector is triggered by an external processor running on an external computer.
[0084] In nonstandard mode, Figure 2 4, the wireless module 6 receives processed data at a second data rate defined by the processor 4. More specifically, the second data rate corresponds to processing 2D images provided to the processor 4 at an effective 2D frame rate that is lower than the first 2D frame rate, whereby the second data rate becomes lower than the first data rate. In other words, the one or more processors are configured to process data at the same rate as provided by the image processor, here configured to operate at a rate of approximately 1350 frames per second. Figure 1 The lens 10 mentioned in the figure still moves back and forth at 10 Hz (20 sweeps per second). For the standard mode, a single sweep is equal to one 3D image. In order for the processor 4 to process a 3D scan (composed of several 2D images), a trigger must be equipped on the image detector 3, similar to the standard mode. Similar to the standard mode, this equipment is continuously completed by a data service running on an external computer. In other words, the equipment of the trigger on the image detector 3 defines a second data rate, which is set to 1350 frames per second in this example. Therefore, in this example, the second data rate defined by the processor 4 is defined via the image detector 3, where the image detector is triggered by an external processor running on an external computer.
[0085] From this example it can be inferred that the second data rate is predefined to be 75% of the first data rate. As described above, the arming only occurs 75% of the time. In this way, the image detector 3 is paused or turned off. In other words, and with respect to the lens movement, the image detector 3 is turned off every fourth sweep, meaning that the entire sweep is not processed and sent to the computer. When the image detector 3 is off, the processor(s) do not perform calculations on the image, and when the processor does not provide an output, no data is transmitted to the wireless module. As shown in FIG. Figure 2 This is the reason for the reduced heat on the wireless module over time, as shown in Figure 1. The normalized scan time is about 30 minutes. The scanning device scans first in standard mode and then in non-standard mode, measuring the temperature of the different scanner components simultaneously, and then aligning the measurements in time.
[0086] Figure 2 Not only is the heating of the wireless module 6 shown, but also the heating of various other internal scanner components. Figure 2 The other scanner components shown in the figure are two processors, called an ARM processor and an FPGA processor, both of which are located on the PCB.
[0087] As for the heat generation of all components, it can be seen that in two predefined modes, the WI-FI module generates more heat than the ARM processor, the ARM processor generates more heat than the FPGA processor, and the FPGA processor generates more heat than the PCB (printed circuit board).
[0088] from Figure 2 It can be clearly seen that the heating of all components is much lower in the non-standard mode (called "Scanner #2") compared to the standard mode called "Scanner #1".
[0089] in other words, Figure 2 The effect on the heating of all components by operating the scanner in two modes according to the invention is illustrated. The quantified thermal impact from the standard mode to the non-standard mode described according to the invention is a 3.2% reduction in the temperature development of the PCB and FPGA processor, and a 5.1% reduction in the temperature development of the ARM processor and the WI-FI module.
[0090] Example 3 – Power consumption in a scanning device with two predefined scanning operation modes
[0091] Figure 3 An example of power consumption in a scanning device 1 with two predefined scanning operation modes is shown. Figure 1In the device shown, the scanning device 1 is arranged as a completely wireless scanning device 1, i.e. having a battery 7. The scanning device is configured to switch between two predefined scanning operation modes: a standard mode, in which the wireless module receives processed data at a first data rate defined by the processor; and a non-standard mode, in which the wireless module receives processed data at a second data rate defined by the processor.
[0092] exist Figure 3 In the graph, the left y-axis shows the normalized power consumption of the scanner as a function of the scanning time (along the x-axis). Two scanning operation modes are shown in the graph. The red points represent the standard mode, called "Scanner #1", and the blue data points represent the non-standard mode, called "Scanner #2". The scanning device scans first in the standard mode and then in the non-standard mode, while measuring the power consumption, and then aligning the measurements in time. Looking at the power distribution of the two scanning modes, these modes start with the same power consumption rate, but after a short period of time, Scanner #2 affects the power distribution through a sudden drop in power consumption, resulting in a parallel displacement relative to Scanner 1#. The power consumption when in the non-standard mode is 16.7% lower than that in the standard mode.
[0093] exist Figure 3 , the right y-axis shows the normalized power level of the battery with respect to the voltage provided by the battery 7. The battery life in the non-standard mode is increased by 15.5% compared to the standard mode.
[0094] Example 4 – Data transfer in a scanning device with two predefined scanning operation modes
[0095] Figure 4 An example of data transmission in a scanning device 1 with two predefined scanning operation modes is shown. Figure 1 In the device shown, the scanning device 1 is arranged as a completely wireless scanning device 1, i.e. with a battery 7. The scanning device is configured to switch between two predefined scanning operation modes: a standard mode, in which the wireless module receives processed data at a first data rate defined by the processor, and a non-standard mode, in which the wireless module receives processed data at a second data rate defined by the processor.
[0096] exist Figure 4In the graph, the left y-axis shows the standardized data transmission operation of the wireless module in the scanner as a function of the scanning time (along the x-axis). Two scanning operation modes are shown in the graph. The red points represent the standard mode, called "Scanner #1", and the blue data points represent the non-standard mode, called "Scanner #2". The scanning device scans first in the standard mode and then in the non-standard mode, while measuring the data transmission, and then aligning the measurement results in time. Looking at the data transmission distribution of the two scanning modes, these modes start with the same data transmission rate, but after a short period of time, scanner #2 affects the data transmission distribution through a sudden drop in transmission, resulting in a parallel displacement relative to scanner #1. The data transmission when in the non-standard mode is 57.2% lower than the data transmission in the standard mode.
[0097] Example 5 – Scanning device with two predefined scanning operation modes
[0098] In this example, the scanning device according to the present invention is configured to switch between two predefined scanning operation modes: a standard mode, in which the wireless module receives processed data at a first data rate defined by the processor; and a non-standard mode, in which the wireless module receives processed data at a second data rate defined by the processor. The scanning device described in this example includes a moving lens 10 that moves back and forth during scanning.
[0099] During the focus lens scan, the lens 10 accelerates from its initial position to its maximum speed and decelerates when it stops at its end position. This movement repeats as the lens moves back and forth. Each time the lens 10 travels a full length is called a "sweep". During the focus lens sweep, the image detector 3 acquires a 2D image at a constant frame rate of, for example, 1800 frames per second (fps). This defines a first data rate.
[0100] As the lens travels at varying speeds, the image density, i.e. the number of 2D images per mm depth of field, is not uniform. During a sweep, a relatively large number of 2D images are acquired in a narrow depth interval near the end position of the focusing lens.
[0101] In this case, a second data rate can be obtained by discarding the 2D image near the end position of the focus lens movement span. This will not affect the overall 3D image frame rate, but each sub-scan will contain slightly less 3D information.
[0102] By applying encoder feedback from the lens position system to control the image detector's software, the image detector is turned off at the end position, thereby reducing the duty cycle of the image detector, processor, and wireless module.
[0103] If the focusing lens is considered as a simple harmonic oscillator, 20% more images are acquired within 6% of the focus sweep length. Therefore, by reducing the focus sweep length by 6%, the image detector needs to record 20% fewer images, and the processor needs to process 20% fewer images, so that the wireless module receives less processed data.
[0104] Example 6 – Scanning device with two predefined scanning operation modes
[0105] In this example, the scanning device according to the present invention is configured to switch between two predefined scanning operation modes: a standard mode, in which the wireless module receives processed data at a first data rate defined by the processor; and a non-standard mode, in which the wireless module receives processed data at a second data rate defined by the processor. The scanning device acquires 3D data and / or color information based on projecting a sequence of projection patterns and capturing reflected light through one or more image detectors.
[0106] In this example, the second data rate is achieved by varying the number of projected patterns and / or the illumination period (exposure time) of each pattern within the sequence used to generate the 3D frames.
[0107] By skipping some coded patterns to reduce the number of projected patterns, the entire 3D frame of the capture sequence becomes shorter, resulting in a reduction in the data rate of at least the processor.
[0108] The following items provide more details.
[0109] project:
[0110] 1. A wireless scanning device for providing data for a 3D model of an object, comprising:
[0111] - Scan housing, including:
[0112] o an image detector configured to acquire 2D images at a first 2D frame rate;
[0113] o one or more processors coupled to the image detector such that the 2D image can be processed by the processors to form processed data;
[0114] o a wireless module coupled to the processor such that the wireless module receives processed data from the processor and wirelessly transmits the processed data,
[0115] The processed data is data of a 3D model of the object.
[0116] The scanning device is configured to switch between the following two predefined scanning operation modes:
[0117] o a standard mode, wherein the wireless module receives processed data at a first data rate defined by the processor; and
[0118] o A non-standard mode, wherein the wireless module receives processed data at a second data rate defined by the processor.
[0119] 2. A wireless scanning device according to item 1, wherein a non-standard mode is provided by switching a first 2D frame rate to a second 2D frame rate, wherein the second 2D frame rate becomes lower than the first 2D frame rate, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode.
[0120] 3. A wireless scanning device according to item 1, wherein the non-standard mode is provided by maintaining the first 2D frame rate and turning off the image detector for a specific time, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode.
[0121] 4. A wireless scanning device according to item 1, wherein a non-standard mode is provided by maintaining a first 2D frame rate and reducing a spatial resolution of an image detector for a specific time, whereby the second data rate is lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode.
[0122] 5. A wireless scanning device according to item 1, wherein a non-standard mode is provided by maintaining a first 2D frame rate and turning off a wireless module for a specific time, whereby the wireless module receives processed data at a second data rate defined by the processor, thereby defining the non-standard mode as a wireless throttling mode.
[0123] 6. A wireless scanning device according to item 1, wherein a non-standard mode is provided by maintaining a first 2D frame rate and directing processed data to another module for a specific time, whereby the wireless module receives processed data at a second data rate defined by the processor, thereby defining the non-standard mode as a wireless throttling mode.
[0124] 7. A wireless scanning device according to any of the preceding items, wherein the first data rate and / or the second data rate corresponds to processing a 2D image provided to a processor at an effective 2D frame rate of between 1000 and 5000 frames per second, preferably between 1500 and 2500 frames per second, preferably between 1700 and 1900 frames per second, and most preferably about 1800 frames per second.
[0125] 8. A wireless scanning device according to any of the preceding items, wherein the second data rate is less than 90% of the first data rate, preferably less than 80% of the first data rate, more preferably about 75% of the first data rate.
[0126] 9. A wireless scanning device according to any of the preceding items, wherein the processed data is in the form of 3D data, such that when in standard mode, the processor generates 3D data at a first data rate, and when in non-standard mode, the processor generates 3D data at a second data rate.
[0127] 10. A wireless scanning device according to item 1, wherein a non-standard mode is provided by switching a first 2D frame rate to a second 2D frame rate, wherein the second 2D frame rate becomes higher than the first 2D frame rate, thereby the second data rate becomes higher than the first data rate, thereby defining the non-standard mode as a wireless super mode.
[0128] 11. A wireless scanning device according to any of the preceding items, wherein said switching between at least two predefined operating modes is based on a condition of said processor and / or a part coupled to said processor.
[0129] 12. The wireless scanning device of clause 11, wherein the condition is a measure of temperature relative to a predefined temperature.
[0130] 13. A wireless scanning device according to item 12, wherein the temperature is related to the processor, and / or to the wireless module, and / or to the scanning housing, and / or to the power supply unit, and / or to the light source.
[0131] 14. The wireless scanning device according to item 12, wherein the condition is defined as a situation where a measure of temperature relative to a predefined temperature defines that the measure of temperature exceeds the predefined temperature, wherein the predefined temperature is a threshold value.
[0132] 15. The wireless scanning device according to item 12, wherein the threshold is greater than 60 degrees, preferably greater than 70 degrees, and more preferably about 78 degrees.
[0133] 16. The wireless scanning device of clause 11, wherein the condition is a measure of a power level of the power supply unit relative to a predefined power level.
[0134] 17. The wireless scanning device of item 16, wherein the power level is an absolute measure and / or a first derivative of the power level with respect to time, and / or a second derivative of the power level with respect to time.
[0135] 18. The wireless scanning device of clause 11, wherein the condition is based on a 2D image received by the processor.
[0136] 19. The wireless scanning device of clause 11, wherein the one or more processors are configured to provide a condition of the processor.
[0137] 20. The wireless scanning device of clause 11, wherein one or more external processors are configured to provide the condition of said processor.
[0138] 21. The wireless scanning device of item 11, wherein the scanning device further comprises a sensor configured to provide the condition.
[0139] 22. A wireless scanning device according to any of the preceding items, wherein the scanning device is further configured such that when in standard mode, the wireless module transmits processed data at a first data rate, and when in non-standard mode, the wireless module transmits processed data at a second data rate.
[0140] 23. A wireless scanning device according to any of the preceding items, wherein the processor and the wireless module are integrated in a programmable system on a chip, so that a first part of the chip is suitable for having hardware programmability and a second part of the chip is suitable for having software programmability, wherein the first part is configured to form processed data and wherein the second part is configured to send the processed data to the wireless module.
[0141] 24. The wireless scanning device according to item 22, wherein the first part is further configured to form the processed data in the form of compressed data.
[0142] 25. A wireless scanning device according to any of the preceding items, wherein the scanning device is an intra-oral scanning device and / or an intra-ear scanning device.
Claims
1. A wireless scanning device for providing data for a 3D model of an object, comprising: - a scanning housing, the scanning housing comprising: an image detector configured to acquire 2D images at a first 2D frame rate; one or more processors coupled to the image detector such that the 2D image can be processed by the processors to form processed data; a wireless module coupled to the processor such that the wireless module receives processed data from the processor and wirelessly transmits the processed data, wherein the processed data is data for a 3D model of the object, The scanning device is configured to switch between the following two predefined scanning operation modes: a standard mode, wherein the wireless module receives processed data at a first data rate defined by the processor; and a non-standard mode, wherein the wireless module receives processed data at a second data rate defined by the processor, The non-standard mode is provided by maintaining the first 2D frame rate and turning off the image detector for a specific time, whereby the second data rate becomes lower than the first data rate, thereby defining the non-standard mode as a wireless throttling mode.
2. The wireless scanning device according to claim 1, wherein: The first data rate and / or the second data rate corresponds to processing 2D images provided to the processor at an effective 2D frame rate of between 1000 and 5000 frames per second.
3. The wireless scanning device according to claim 1 or 2, wherein: The second data rate is less than 90% of the first data rate.
4. The wireless scanning device according to claim 1 or 2, wherein: The processed data is in the form of 3D data such that when in the standard mode the processor generates 3D data at the first data rate and when in the non-standard mode the processor generates 3D data at the second data rate.
5. The wireless scanning device according to claim 1 or 2, wherein: The scanning device is configured to switch between two predefined operating modes based on a condition of the processor and / or a portion coupled to the processor.
6. The wireless scanning device according to claim 5, wherein: The condition is a measure of the temperature relative to a predefined temperature.
7. The wireless scanning device according to claim 6, wherein: The temperature is related to the processor, and / or to the wireless module, and / or to the scanning housing, and / or to the power supply unit, and / or to the light source.
8. The wireless scanning device according to claim 6, wherein: The condition is defined as a situation wherein the measure of the temperature relative to the predefined temperature defines that the measure of the temperature exceeds the predefined temperature, wherein the predefined temperature is a threshold value.
9. The wireless scanning device according to claim 5, wherein: The condition is based on the 2D image received by the processor.
10. The wireless scanning device according to claim 1 or 2, wherein: The scanning device is further configured such that when in the standard mode, the wireless module transmits the processed data at the first data rate, and when in the non-standard mode, the wireless module transmits the processed data at the second data rate.
11. The wireless scanning device according to claim 1 or 2, wherein: The processor and the wireless module are integrated in a programmable system on a chip, such that a first portion of the chip is adapted to have hardware programmability and a second portion of the chip is adapted to have software programmability, wherein the first portion is configured to form the processed data, and wherein the second portion is configured to send the processed data to the wireless module.
12. The wireless scanning device according to claim 11, wherein: The first portion is further configured to form the processed data in the form of compressed data.
13. The wireless scanning device according to claim 1 or 2, wherein: The scanning device is an intra-oral scanning device and / or an intra-ear scanning device.
14. The wireless scanning device according to claim 1 or 2, wherein: The image detector comprises a trigger configured to be armed, wherein the arming of the trigger defines the first data rate and / or the second data rate.
15. The wireless scanning device according to claim 1 or 2, wherein: The second data rate is defined via the image detector, wherein the image detector is configured to be triggered by an external processor.
16. The wireless scanning device according to claim 1, wherein: The first data rate and / or the second data rate corresponds to processing 2D images provided to the processor at an effective 2D frame rate of between 1500 and 2500 frames per second.
17. The wireless scanning device of claim 1, wherein: The first data rate and / or the second data rate corresponds to processing 2D images provided to the processor at an effective 2D frame rate of between 1700 and 1900 frames per second.
18. The wireless scanning device of claim 1, wherein: The first data rate and / or the second data rate corresponds to processing 2D images provided to the processor at an effective 2D frame rate of 1800 frames per second.
19. The wireless scanning device according to claim 1 or 2, wherein: The second data rate is less than 80% of the first data rate.
20. The wireless scanning device according to claim 1 or 2, wherein: The second data rate is 75% of the first data rate.
