Systems, devices, and methods for performing 3D surface scanning and / or texture acquisition using rolling shutter camera

By delaying the projection of structured light patterns and the exposure time of the rolling shutter camera in a handheld 3D scanner, combined with infrared light sources and liquid crystal device shutters, the problem of insufficient time delay and contrast in image acquisition of the rolling shutter camera is solved, and the problem of insufficient contrast in image acquisition is achieved. Efficient and low-cost 3D scanning effect.

CN119013530APending Publication Date: 2024-11-22CREAFORM INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202280094399.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-05-20
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In existing handheld 3D scanners, the scroll shutter camera has problems of time delay and insufficient contrast between ambient light and structured light during image acquisition, resulting in poor image quality and difficult to be suitable for high-end applications.

Method used

By using a scroll shutter camera in a handheld scanner and delay processing between activation and deactivation of the structured light pattern projector, ensuring camera pixels are simultaneously exposed to light for a specific time period, reducing time delay and leveraging infrared Light source and LCD device shutters improve contrast.

Benefits of technology

Effectively reduces the impact of rolling shutter camera time delay, improves image quality, reduces costs, is suitable for geometric shapes and positioning data acquisition on multiple frames, and is suitable for low-cost and efficient 3D scanning applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119013530A_ABST
    Figure CN119013530A_ABST
Patent Text Reader

Abstract

A 3D scanner and a method of operating the same are provided. The scanner includes a light projector unit for projecting a structured light pattern onto a surface of a target object and a camera group. The group of cameras includes one or more rolling shutter cameras for capturing data for transferring the group of images, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines. One or more processors are provided for sending control signals to the light projector unit to intermittently project the structured light pattern. Specifically, when respective ones of the plurality of pixel lines are simultaneously exposed, a structured light pattern is projected, otherwise attenuated or turned off. In some embodiments, a rolling shutter geometry camera is included, and the light projector unit includes a light source configured to emit light having a wavelength within a particular wavelength range. The rolling shutter geometry camera may allow light of wavelengths within a particular range to pass through, and may significantly attenuate other wavelength ranges. Optionally, a rolling shutter color camera may be included with an LCD shutter configured to intermittently allow light to pass through the sensor when the structured light pattern is projected onto the surface of the object. The rolling shutter color camera may also at least partially block light having a wavelength within a particular wavelength range.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates generally to the field of three-dimensional (3D) metrology, and more particularly to handheld 3D scanning systems and scanners. The scanners, systems and methods described in this document can be used in a variety of practical applications, including but not limited to manufacturing, quality control of manufactured parts and reverse engineering. Background Art

[0002] Three-dimensional (3D) scanning and digitization of the surface geometry of an object is commonly used in many industries and services. The shape of an object is scanned and digitized using an optical sensor that measures the distance between the sensor and a set of points on the surface.

[0003] Traditionally, in handheld 3D scanners, the optical sensor comprises one, two or more "positioning" or "geometry" cameras, which are arranged side by side with each other and configured to acquire geometric and positioning data, enabling the measurement of surface points to be derived. In some scanners, in order to have some texture (also called color) information related to the same surface, a texture (color) camera may be arranged on the scanner side by side with one, two or more "geometry" cameras.

[0004] In high-end metrology graded 3D handheld scanners, since the scanner shifts during the scanning process, it is desirable to capture an image when all pixels of one (or more) cameras are exposed simultaneously while a structured light pattern is projected onto the surface being scanned. For this reason, global shutter cameras are typically used for one, two or more "geometry measurement" cameras and for one or more texture cameras. The key feature of a global shutter camera is that all pixels start and stop integrating light at the same time, and therefore the handheld scanner can obtain more accurate surface measurements even in the presence of movement of the scanner. The disadvantage of global shutter cameras is that they are typically complex devices to manufacture and are more expensive than some alternatives. While the cost may be acceptable for some high-end applications, this is not the case for other applications, which creates a barrier to the adoption of such scanners.

[0005] Another type of camera that can be used for one, two, or more "geometry" cameras and texture cameras is a rolling shutter camera. Rolling shutters are found in image capture devices that use complementary metal oxide semiconductor (CMOS) sensors, such as digital still and video cameras, cell phone cameras, CCTV cameras, and barcode readers. With a rolling shutter, a picture is captured by quickly scanning across a scene, either vertically, horizontally, or rotationally. In contrast to a global shutter that captures the entire frame at the same moment, not all parts of the scene image are recorded at the same moment with a rolling shutter. Although there is a time lag in the capture, the entire image of the scene is displayed at once, as if it represented a single moment in time.

[0006] Rolling shutter cameras have the advantage of being cheaper than global shutter cameras, but are only suitable for applications where the camera remains essentially fixed in position while the image is acquired. In particular, since the pixels are only acquired sequentially by a rolling shutter camera, rolling shutter cameras are not ideal in situations where there is camera movement during image acquisition, such as in the case of handheld scanners where the background and objects move compared to the common coordinate system of the scanner's (multiple) cameras. For this reason, this type of camera is not suitable for high-end handheld scanners. The delay in data acquisition caused by the use of rolling shutter cameras leads to temporal distortions in the image. In addition, due to the relatively long duration of exposure of the pixels to light, the use of such cameras generally results in a low contrast between the ambient light and the illumination pattern of the light emitted by the scanner.

[0007] Against the foregoing background, it is apparent that there remains a need in the industry to provide improved solutions for low-cost handheld 3D scanners that mitigate at least some of the deficiencies of rolling shutter cameras as applied to handheld 3D scanners. Summary of the invention

[0008] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify all key and / or essential aspects of the claimed subject matter.

[0009] The present disclosure proposes a handheld scanner and associated methods and systems that use rolling shutter cameras as one, two, three or more "geometry" cameras for metrology measurements. In order to reduce the impact of the time delay of the rolling shutter camera, the handheld scanner is configured so that the activation of the projector of the structured light pattern is delayed until the pixels of the camera are simultaneously active and exposed to light. After this, after a certain period of time, the structured light pattern is deactivated. This process is repeated multiple times during the scan to acquire texture, geometry and positioning data over multiple frames.

[0010] In some embodiments, an infrared (IR) light source can be used by the projector to project the light pattern, and an IR light emitting diode (LED) can be used to illuminate a positioning target on or near the surface being scanned. The use of IR light can help solve the problem of insufficient contrast between the projected pattern and ambient light, which occurs due to the long integration of light for rolling shutter cameras (when compared to global shutter cameras). In some embodiments, an IR bandpass or longpass filter is used in front of the rolling shutter geometry camera lens to reject wavelengths of light other than IR. The use of IR projected light advantageously does not conflict with the use of a color camera as part of the scanner.

[0011] In some embodiments, the handheld scanner may include a color camera positioned side by side with one, two, three or more "geometry" cameras. Like the geometry camera, the color camera is also configured as a rolling shutter camera. In addition, in some embodiments, the color camera may be equipped with a liquid crystal device (LCD) shutter configured to allow light to pass through and be captured by the camera sensor at certain specific time intervals and to block light during other time intervals. A short pass filter (or a band-stop filter or a band-pass filter designed to transmit only about 400-700nm of the visible spectrum) used with the color camera may allow white light to be incident on the LCD shutter while blocking light in the IR spectrum range. The LCD shutter may be configured to transmit white light to acquire a color texture image that is synchronized with the geometry camera or has a delay with the acquisition of the geometry camera. In a specific embodiment, the LCD shutter may include a single optical unit covering the entire display area and is capable of switching between an open state (a clear state that allows light to pass) and a closed state (an opaque state that partially or completely blocks light from passing). The different states can be achieved in different ways known in the art, such as by applying a square wave drive voltage to open and close the LCD shutters.

[0012] According to one aspect of the present disclosure, a scanner for generating 3D data related to the surface of a target object is provided, comprising: a) a scanner frame structure, on which an imaging module group is installed, including: i. a light projector unit for projecting a structured light pattern onto the surface of the target object; ii. a camera group, the camera group being positioned next to the light projector unit, the camera group comprising one or more rolling shutter cameras for capturing data transmitting an image group, the image group comprising reflections of the light pattern projected onto the surface of the target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines; and b) one or more processors communicating with the imaging module group, for receiving and processing data transmitting the image group, wherein the one or more processors are further configured to send a control signal to the light projector unit to intermittently project the structured light pattern according to a specific sequence.

[0013] Some specific embodiments may include one or more of the following features: The one or more processors may be configured to send a control signal to the light projector unit to intermittently project the structured light pattern according to the specific sequence to cause the light projector unit to switch between the following states: i. an active mode state during which the light projector unit projects the structured light pattern onto the surface of the target object; ii. a deactivated mode state during which the light projector unit: 1) omits projecting the structured light pattern onto the surface of the target object; or 2) projects a generally attenuated version of the structured light pattern. The sensor surface of one or more rolling shutter cameras may be activated according to an operating mode as part of a capture cycle, the operating mode being characterized by: a. a specific time period in a current specific capture cycle during which individual pixel lines of a plurality of pixel lines are simultaneously exposed; and b. a specific subset of individual pixel lines of the plurality of pixel lines, different from the specific time period, during which individual pixel lines of the plurality of pixel lines cease to be exposed for the current specific capture cycle, wherein the specific subset of individual pixel lines omits at least one of the individual pixel lines of the plurality of pixel lines. The specific subset of the individual pixel lines may omit at least some of the individual pixel lines in the plurality of pixel lines. The activation mode state of the light projector unit may at least partially coincide with the specific time period during which the individual pixel lines in the plurality of pixel lines are simultaneously exposed. The deactivation mode state of the light projector unit may at least partially coincide with the time period during which the subset of the individual pixel lines in the plurality of pixel lines stops being exposed for the current specific capture cycle. The one or more processors may be configured to: a. send a reset signal to the one or more rolling shutter cameras to restart a new specific capture cycle in the plurality of specific capture cycles, during which different pixel lines in the plurality of pixel lines are sequentially exposed for the new specific capture cycle; b. after a first delay period after sending the reset signal, send an activation control signal to the light projector unit to switch the light projector unit to the activation mode state; c. after a second delay period after sending the activation signal to the light projector unit, send a deactivation control signal to the light projector unit to switch the light projector unit to the deactivation mode state. In some embodiments, the light projector unit may include a light source configured to emit light with a wavelength within a specific wavelength range. The one or more rolling shutter cameras may include at least one rolling shutter geometric camera for generating image data to derive 3D measurements of the surface of the object, the at least one rolling shutter geometric camera being configured to: a. allow light with a wavelength within the specific wavelength range to pass through to the sensor surface; b. generally attenuate light in the spectrum outside the specific wavelength range.The light source may be configured to emit at least one of white light, infrared light, and blue light. In a very specific embodiment, the specific wavelength range may be an infrared wavelength range. The light source may be configured to emit light having a wavelength between 405 nm and 1100 nm. The light source may be embodied in a variety of different devices, including, for example, but not limited to, a laser and one or more light emitting diodes (LEDs). The one or more rolling shutter cameras may include at least one rolling shutter geometric camera for generating image data to derive 3D measurements of the surface of the object. The at least one rolling shutter geometric camera may include at least two rolling shutter geometric cameras. The rolling shutter geometric camera may include a near infrared camera and / or may include an infrared filter configured to pass infrared light and generally attenuate light in a spectrum outside of the infrared.

[0014] In some embodiments, the one or more rolling shutter cameras may further include a rolling shutter color camera for generating image data to derive texture information associated with the surface of the object. The rolling shutter color camera may include a liquid crystal device (LCD) shutter. For example, the color rolling shutter camera includes: a. a sensor; b. a lens; and c. wherein the liquid crystal device (LCD) shutter is positioned between the sensor and the lens. The one or more processors may be configured to send a control signal to the LCD shutter to switch the LCD shutter between an open state and a closed state, wherein in the open state, the LCD shutter is translucent, and in the closed state, the LCD shutter is at least partially opaque. In some specific embodiments, in the closed state, the LCD shutter may be completely opaque, so that light incident on the LCD shutter is generally blocked from passing through the LCD shutter. The switching of the LCD shutter between the open state and the closed state may at least partially coincide with the switching of the light projector unit between the active mode state and the deactivated mode state, such that: a. when the light projector unit is in the active mode state, the LCD shutter is at least partially in the open state at the same time; b. when the light projector unit is in the deactivated mode state, the LCD shutter is at least partially in the closed state at the same time. The light projector unit may be a first light projector unit that projects a first type of light including the structured light pattern, and wherein the scanner may include a second light projector unit that includes a second projector light source configured to project a second type of light onto the surface of the object. The second projector light source is a white light source, and wherein the second type of light is white light. For example, the second projector light source may include one or more LEDs and / or lasers. The rolling shutter color camera may include a filter for at least partially blocking a wavelength of light corresponding to the wavelength of light projected by the first light projector unit, for example, the filter may be configured to block light in the infrared spectrum. One or more rolling shutter cameras in the camera group can be mounted to have fields of view that at least partially overlap each other. The one or more rolling shutter cameras can include two rolling shutter cameras, three rolling shutter cameras, or more cameras. In some very specific embodiments, the rolling shutter cameras can include at least two rolling shutter geometric cameras and at least one rolling shutter color camera.

[0015] In some embodiments, the one or more processors may also be configured to send a control signal to a type crusher light projector unit to intermittently project a structured light pattern according to a specific sequence, wherein the specific sequence is a periodic sequence, so that the light projector unit intermittently projects the structured light pattern onto the surface of the object at regular time intervals. In some embodiments, the one or more processors may be configured to process the image group including the reflection of the structured light pattern to perform a 3D reconstruction process of the surface of the target object. In some alternative embodiments, the one or more processors are configured to transmit data of the image group including the reflection of the structured light pattern to a remote computing system different from the scanner, and the remote computing system is configured to use the data of the image group including the reflection of the light pattern to perform a 3D reconstruction process of the surface of the target object. In some specific practical embodiments, for example, the scanner may be a handheld scanner or a fixedly mounted scanner.

[0016] According to another aspect of the present disclosure, a scanning system for generating 3D data related to a surface of a target object, the scanning system comprising: a. a scanner as described above; b. a computing system communicating with the scanner, the computing system being configured to: i. perform a 3D reconstruction process of the surface of the target object using data transmitting an image group including reflections of a structured light pattern captured by the scanner; ii. render a visual representation of at least a portion of the surface of the target object generated by the 3D reconstruction process on a graphical user interface displayed on a display device.

[0017] According to another aspect of the present disclosure, a method for generating 3D data related to a surface of a target object using a 3D scanner is provided, wherein the 3D scanner has an imaging module group, including a light projector and a camera group, wherein the light projector is configured to project a structured light pattern onto the surface of the target object, wherein the camera group includes one or more rolling shutter cameras for capturing data transmitting an image group, wherein the image group includes reflections of the structured light pattern projected onto the surface of the target object, wherein the one or more rolling shutter cameras have a sensor surface defining a plurality of pixel lines, wherein the method comprises: a. sending a control signal to a light projector unit so that it switches the light projector between the following states; A unit is used to intermittently project a structured light pattern according to a specific sequence: i. an activated mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object; ii. a deactivated mode state, during which the light projector unit: 1) omits projecting the structured light pattern onto the surface of the target object; or 2) projects a generally attenuated version of the structured light pattern; b. wherein the occurrence of the activated mode state of the light projector unit at least partially coincides with a time period during which the multiple pixel lines are simultaneously exposed in the same capture cycle; c. processing the image group to perform a 3D reconstruction process of the surface of the target object.

[0018] Some specific embodiments may include one or more of the following features: activating the sensor surface of one or more rolling shutter cameras according to an operating mode as part of a current specific capture cycle, the operating mode being characterized by: a. a specific time period during which the individual pixel lines of the plurality of pixel lines are simultaneously exposed in the current specific capture cycle; and b. other time periods different from the specific time period during which a specific subset of the individual pixel lines of the plurality of pixel lines stops being exposed in the current specific capture cycle, wherein the specific subset of the individual pixel lines omits at least one of the individual pixel lines of the plurality of pixel lines. The specific subset of the individual pixel lines may omit at least some of the individual pixel lines of the plurality of pixel lines. The activated mode state of the light projector unit may at least partially coincide with the specific time period during which the individual pixel lines of the plurality of pixel lines are simultaneously exposed. The deactivated mode state of the light projector unit at least partially coincides with the time period during which the subset of the individual pixel lines of the plurality of pixel lines stops being exposed in the current specific capture cycle. In some embodiments, the method may further include: a. sending a reset signal to one or more rolling shutter cameras to start a new specific capture cycle of the multiple pixel lines, during which pixel lines among the multiple pixel lines begin to be exposed sequentially for the new specific capture cycle; b. sending an activation control signal to the light projector unit after a first delay period after sending the reset signal to switch it to an activation mode state; c. sending a deactivation control signal to the light projector unit after a second delay period after sending the activation signal to the light projector unit to switch it to a deactivation mode state.

[0019] In some specific embodiments, the one or more rolling shutter cameras may include a rolling shutter color camera for generating image data to derive texture information associated with the surface of the object, and in some cases the rolling shutter color camera may include a liquid crystal device (LCD) shutter. The method may include sending a control signal to the LCD shutter for switching the LCD shutter between an open state and a closed state, wherein in the open state, the LCD shutter is translucent, and wherein in the closed state, the LCD shutter is at least partially opaque. The switching of the LCD shutter between the open state and the closed state may at least partially coincide with the switching of the light projector unit between the active mode state and the deactivated mode state, such that: a. when the light projector unit is in the active mode state, the LCD shutter is at least partially in the open state at the same time; b. when the light projector unit is in the deactivated mode state, the LCD shutter is at least partially in the closed state at the same time.

[0020] In some embodiments, the one or more processors may also be configured to send a control signal to the light projector unit to intermittently project the structured light pattern according to a specific sequence, wherein the specific sequence is a periodic sequence such that the light projector unit intermittently projects the structured light pattern onto the surface of the object at regular time intervals. In some embodiments, the method may include processing an image group including reflections of the structured light pattern to perform a 3D reconstruction process of the surface of the target object. In some alternative embodiments, the method may include transmitting data of the image group including reflections of the structured light pattern to a remote computing system different from the scanner, the remote computing system being configured to use the data of the image group including reflections of the light pattern to perform a 3D reconstruction process of the surface of the target object.

[0021] According to another aspect of the present disclosure, a computer program product is provided, comprising program instructions tangibly stored on one or more tangible computer-readable storage media, wherein when executed by one or more processors, the instructions of the computer program product cause a 3D scanner to perform operations to generate 3D data associated with a surface of a target object, wherein the 3D scanner has an imaging module group, including a light projector and a camera group, wherein the light projector is configured to project a structured light pattern onto the surface of the target object, wherein the camera group includes one or more rolling shutter cameras for capturing data transmitting an image group, wherein the image group includes reflections of the structured light pattern projected onto the surface of the target object, wherein the one or more rolling shutter cameras have a sensor surface defining a plurality of pixel lines, and wherein the operations implement the above method.

[0022] According to another aspect of the present disclosure, a scanner for generating 3D data related to a surface of a target object is provided. The scanner includes a scanner frame structure, the scanner frame structure is installed with an imaging module group, the imaging module includes: (i) a light projector unit for projecting a structured light pattern onto the surface of the target object, the light projector unit having a light source, the light source being configured to emit light with a wavelength within a specific wavelength range; and (ii) a camera group, the camera group being positioned next to the light projector unit, the camera group including one or more rolling shutter cameras for capturing data of a transmission image group, the image group including reflections of the structured light pattern projected onto the surface of the target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, the at least one rolling shutter geometric camera being configured to (1) allow light with a wavelength within a specific wavelength range to pass through to the target object; sensor surface; (2) generally attenuating light in the spectrum outside a specific wavelength range; the scanner also includes one or more processors in communication with the imaging module group for receiving and processing data transmitting the image group, wherein the one or more processors are further configured to send a control signal to a light projector unit to intermittently project a structured light pattern according to a specific sequence, thereby switching the light projector unit between an active mode state and a deactivated mode state: an active mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object; and a deactivated mode state, during which the light projector unit omits projecting the structured light pattern onto the surface of the target object, or projects a generally attenuated version of the structured light pattern.

[0023] According to another aspect of the present disclosure, a scanner for generating 3D data associated with a surface of a target object is described, the scanner comprising (a) a scanner frame structure having an imaging module group mounted thereon, including (i) a light projector unit for projecting a structured light pattern onto the surface of the target object, (ii) a camera group positioned adjacent to the light projector unit, the camera group comprising one or more rolling shutter cameras for capturing data of a transmitted image group, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, wherein the one or more rolling shutter cameras comprise at least: 1) a rolling shutter geometry camera; and 2) a shutter color camera comprising a rolling liquid crystal device (LCD) shutter for generating image data to derive texture information associated with the surface of the object. The scanner also includes one or more processors in communication with the imaging module group for receiving and processing data transmitting the image group, wherein the one or more processors are further configured to send a control signal to a light projector unit to intermittently project a structured light pattern according to a specific sequence, thereby switching the light projector unit between: (i) an active mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object, and (ii) a deactivated mode state, during which the light projector unit (1) omits projecting the structured light pattern onto the surface of the target object, or (2) projects a generally attenuated version of the structured light pattern.

[0024] All features of the exemplary embodiments described in this disclosure and not mutually exclusive can be combined with each other. The elements of one embodiment or aspect can be used in other embodiments / aspects without further mentioning. By reading the description of the following specific embodiments in conjunction with the accompanying drawings, other aspects and features of the present invention will become clear to those of ordinary skill in the art. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above features and objects of the present disclosure will become more apparent with reference to the following description in conjunction with the accompanying drawings, wherein like reference numerals designate like elements, and wherein:

[0026] Figure 1A and 1B is a diagram of a 3D imaging system configuration according to a specific example of an embodiment of the present invention;

[0027] Figure 2 is a perspective view of a handheld 3D scanner according to a specific example of an embodiment;

[0028] Figure 3A and 3B is a diagram showing a global shutter camera ( Figure 3A ) and a typical rolling shutter camera ( Figure 3B )'s pixel captured image;

[0029] Figure 4 is a diagram showing a specific example according to an embodiment of the present invention. Figure 2 A graph of the pixel line behavior over time using a handheld 3D scanner combined with a rolling shutter camera;

[0030] Figure 5 is a functional block diagram of components of a 3D handheld scanner including two (2) rolling shutter cameras according to a first specific example of an implementation;

[0031] Figure 6 is a diagram showing a specific example of an embodiment of the present invention. Figure 5 A flow chart of a method for using one of two (2) rolling shutter cameras of a 3D handheld scanner as shown in;

[0032] Figure 7 is a functional block diagram of components of a 3D scanner including two (2) rolling shutter cameras and a color rolling shutter camera according to a second specific example of an embodiment;

[0033] Figure 8 is a diagram showing a specific example of an embodiment of the present invention. Figure 7 A flow chart of a method of using two (2) rolling shutter cameras and one of rolling shutter color cameras of a 3D handheld scanner as shown in;

[0034] Fig. 9 According to a specific example of the embodiment Figure 2 A functional block diagram of a handheld 3D scanner of the type depicted.

[0035] Fig.10 A specific example of an embodiment is shown. Figure 2 Functional block diagram of the scanner's processing system.

[0036] In the accompanying drawings, exemplary embodiments are shown by way of example. It should be clearly understood that the description and drawings are only for the purpose of illustrating certain embodiments and to aid understanding. They are not intended to be a definition of the limitations of the present invention. DETAILED DESCRIPTION

[0037] A detailed description of one or more specific embodiments of the present invention and drawings illustrating the principles of the present invention are provided below. The present invention is described in conjunction with these embodiments, but the present invention is not limited to any specific embodiment described. The scope of the present invention is limited only by the claims. Many specific details are set forth in the following description in order to provide a thorough understanding of the present invention. These details are provided for the purpose of describing non-limiting examples, and the present invention can be practiced according to the claims without some or all of these specific details. For the sake of clarity, technical materials known in the technical field related to the present invention are not described in great detail so as not to unnecessarily obscure the present invention.

[0038] The present invention proposes a handheld scanner and associated methods and systems that use rolling shutter cameras for metrological measurements as one, two, three or more "geometry" cameras. In order to reduce the impact of the time delay of the rolling shutter camera, the handheld scanner is configured so that the intermittent activation of the projector of the structured light pattern is delayed until the pixels of the camera are simultaneously active and exposed to light. After this, after a certain period of time, the structured light pattern is deactivated. This process is repeated multiple times during the scan to acquire geometry and positioning data over multiple frames.

[0039] An infrared (IR) light source can be used by the projector to project the light pattern, and an IR light emitting diode (LED) can be used to illuminate a positioning target on or near the scanned surface. The use of infrared (IR) light can help solve the problem of insufficient contrast between the projected pattern and the ambient light, which occurs due to the long integration of light and longer exposure (when compared to a global shutter camera) of the rolling shutter camera. In some applications, an IR filter can be used in front of the rolling shutter camera lens to better select the reflected IR light.

[0040] In some embodiments, the handheld scanner may include a color camera positioned side by side with one, two, three or more "geometry" cameras, the color camera also being configured as a rolling shutter camera. The color camera may be equipped with a liquid crystal device (LCD) shutter configured to allow light to pass through and be captured by the rolling shutter camera sensor at certain specific time intervals, and to block light during other time intervals. A short pass filter may allow white light to be incident on the LCD shutter, but largely exclude IR radiation. The LCD shutter may be configured to transmit incident white light to acquire a color texture image that is synchronized with the geometry measurement camera or with a delay in the acquisition of the geometry measurement camera. In a specific embodiment, the LCD shutter may include a single optical unit covering the entire display area and is capable of switching between an open state (a clear state that allows light to pass through) and a closed state (an opaque state that partially or completely blocks light from passing through). The different states may be achieved in different ways known in the art, such as by applying a square wave drive voltage to open and close the LCD shutter.

[0041] definition

[0042] In this document, "pixel line" refers to a single linear array of connected pixels within a pixel array. A pixel array is composed of a group of pixel lines, wherein a group of pixel lines includes two, three or more pixel lines.

[0043] 3D Measurement

[0044] Figure 1A 1 is a functional block diagram showing components of an imaging module group of a scanner. As shown, the imaging module group may include a light projector unit P and a camera group, for example two cameras, wherein the light projector unit P is mounted between two cameras C1, C2, which are in turn separated by a baseline distance 150. Camera C1 has a field of view 120, and camera C2 has a field of view 122. The light projector unit P projects a pattern within a corresponding projection field 140. The fields of view 120, 122 and the projection field 140 have an overlapping field 123, in which the object 110 to be scanned is placed. In FIG. 1 , the light projector unit P includes a single light projector, but two or more light projector units are also possible (as with respect to Figure 1B. described). The light projector can have a single light source configured to emit one of infrared light, white light, green light, red light or blue light, for example, light having a wavelength in a specific wavelength range. In some other embodiments, the light projector unit P is configured to emit light having a wavelength between 405nm and 1100nm. In actual implementations, for example, the light projector unit P may include one or more light sources consisting of a laser (such as a vertical cavity surface emitting laser (VCSEL), a solid-state laser, and a semiconductor laser) and / or one or more LEDs. The light projector unit P can include a programmable light projector unit capable of projecting more than one light pattern. The light projector unit P can be configured or programmed to project many light sheets that appear to be a collection of parallel light strips, nearly parallel light strips, or crossed curves or other patterns.

[0045] Using a 3D scanner 100 with at least one processor 160, 3D points can be obtained after applying a suitable computer-implemented method, wherein two images of a frame are captured using two cameras C1, C2. In metrology, with a handheld scanner, the two images are captured almost simultaneously, typically less than 1 ms, which means that there is no relative displacement between the scene and the 3D scanner 100 during the acquisition of the images, or the relative displacement is negligible. The cameras are synchronized to capture images simultaneously or sequentially during a time period in which the relative position of the 3D scanner 100 with respect to the scene remains the same or varies in a predetermined negligible range. This simultaneous capture is typically performed using a camera with a global shutter, which takes an image when all pixels of each camera are exposed to incident light while a light pattern is projected from a light projector unit P.

[0046] The 3D scanner 100 is configured to obtain distance measurements between the 3D scanner 100 and a set of points on a surface of an object of interest 110. Since from a given viewpoint the 3D scanner 100 is only able to obtain distance measurements on visible or nearby portions of the surface, the 3D scanner 100 is moved to multiple viewpoints to obtain a set of distance measurements covering portions of the surface of the object of interest 110. Using the 3D scanner 100, a model of the surface geometry of the object can be constructed from a set of distance measurements and rendered in the coordinate system of the object 110. The object 110 has a number of object vision targets 117 fixed to its surface and / or fixed to a rigid surface adjacent to the object 110, which are still referenced to the object 110. In some specific practical embodiments, the object vision targets 117 are fixed to the object 110 by the user in order to properly position the scanner 100 in space, although the object vision targets 117 may also be omitted.

[0047] exist Figure 1BIn an embodiment, the imaging module of another embodiment of the 3D scanner 100' has two light projector units P1, P2, which are used to generate different light patterns (e.g., different light sources or types of light, and / or different patterns) on the surface of the object 110. In some embodiments, the light projector unit P1 is an IR light projector configured to emit IR light within the corresponding projection field 140a, and the IR light is a structured light pattern. The light projector unit P2 is a white light projector configured to emit white (visible) light within the corresponding projection field 140b. The white light emitted by the projector unit P2 can be a structured light pattern, or a single light cone that fills the projection field 140b. In some embodiments, the system can alternately project light from each light projector unit P1, P2, or can simultaneously project light from each light projector unit P1, P2.

[0048] The cameras C1, C2 and the light projector unit P or light projector units P1, P2 are calibrated in a common coordinate system using methods known in the art. In some practical embodiments, a film performing a bandpass filter function may be fixed on the camera lens to match the wavelength(s) of the projector P. Such a film performing a bandpass filter function may help reduce interference from ambient light and other sources.

[0049] Figure 2 Show Figure 1A 3D Scanner 100 or Figure 1B The 3D scanner 100' in the embodiment is implemented as an embodiment of a handheld 3D scanner 10. The handheld 3D scanner 10 includes an imaging module group 30, which is mounted to the frame structure 20 of the scanner, and the imaging module group 30 is arranged side by side with each other so that the field of view of the modules at least partially overlaps (e.g. Figure 1A and 1B In the embodiment shown, the imaging module group 30 includes three cameras, namely, a first camera 31 (equivalent to Figure 1A and 1B The camera C1 in FIG. 1 ), the second camera 32 (equivalent to Figure 1A and 1B The imaging module group 30 also includes a projector unit 36, which includes a light source (equivalent to Figure 1A The light projector unit P and Figure 1B The projector unit 36 ​​may include a second projector unit (equivalent to P1) on the main member 52. Figure 1BIn some embodiments, the projector unit 36 ​​can include two different light sources, for example, a light source capable of emitting IR and white light, respectively. The two different light sources can be part of the same projector unit 36, or can be implemented as separate units.

[0050] In the handheld 3D scanner, one or more LEDs 38 can also be included. The LEDs 38 can be configured to all emit the same type of light as each other, or to emit different types of light. For example, some LEDs 38 can emit white light (e.g., the LEDs 38 closest to the third camera 34), while other LEDs 38 can emit IR light (e.g., the LEDs 38 closest to the first camera 31 and the second camera 32). In one embodiment, the LEDs 38 are configured to emit IR radiation of the same or similar wavelength as the light projector unit 36.

[0051] In some embodiments, the type of camera used for the first camera 31 and the second camera 32 is a monochrome camera and will depend on the type of light source of the projector unit 36. In some embodiments, the first camera 31 and the second camera 32 are monochrome or color visible spectrum and near infrared cameras, and the projector unit 36 ​​is an infrared light generator or a near infrared light generator. The first camera 31 and the second camera 32 can implement any suitable shutter technology, including but not limited to: rolling shutter, full frame shutter, electronic shutter, etc. Specific embodiments of shutters used with the first camera 31 and the second camera 32 are discussed in detail below.

[0052] In some embodiments, the third camera 34 may be a color camera (also referred to as a texture camera). The texture camera may implement any suitable shutter technology, including but not limited to a rolling shutter, a global shutter, etc. Specific embodiments of shutters used with the third camera 34 are discussed in detail below.

[0053] The first camera 31 is located on the main member 52 of the frame structure 20 and is located beside the projector unit 36. The first camera 31 is generally oriented in the first camera direction and is configured to have a ( Figure 1A and 1B The first camera field of view ( Figure 1A and 1B The second camera 32 is also located on the main member 52 of the frame structure 20 and can be spaced apart from the first camera 31 (baseline distance 150) and spaced apart from the projector unit 36. The second camera 32 faces the second camera direction and is configured to have a second camera field of view (FOV) that at least partially overlaps the projection field of the projector unit 36 ​​and at least partially overlaps the first field of view 120. Figure 1A and Figure 1B 122 in the above).

[0054] The third camera 34 (e.g., a texture camera or a color camera) is also located on the main member 52 of the frame structure 20, and as shown, can be positioned side by side with the first camera 31, the second camera 32, and the projector unit 36. The third camera 34 (e.g., a texture camera) faces the third camera direction and is configured to have a third camera field of view that at least partially overlaps the projection field, the first field of view 120, and the second field of view 122.

[0055] The data connection 45 (such as a USB connection) can transmit the data collected by the first camera 31, the second camera 32 and the third camera 34 for processing by a computer processor and memory remote from the handheld 3D scanner 10. Such a remote computer processor and memory is connected to the processor 160 ( Figure 1A and 1B (shown in) communication.

[0056] Rolling Shutter

[0057] The first camera 31 and the second camera 32 and the third camera 34 as a texture camera use a rolling shutter. Figure 3A and 3B The behavior of a global shutter and a rolling shutter camera are shown respectively.In such a camera, a sensing surface such as sensor surface 300 is organized in an array of individual sensing elements or pixels 305. The sensor surface 300 can be a CMOS sensor.

[0058] exist Figure 3A In FIG. 3 , a global shutter is used to allow or prevent the entire sensor surface 300 from being exposed to light signals reflected from the sample. Thus, all sensor pixels start and end exposure at the same time, and the sensor switches between a closed position 310 and an open position 315. The global shutter can be thought of as a snapshot exposure mode, where all pixels 305 of the array are exposed at the same time, thereby achieving a freeze-frame capture of the scene.

[0059] exist Figure 3BIn the embodiment of the present invention, a rolling shutter is used to expose a sensor surface 300 (e.g., a CMOS sensor) to a light signal reflected from a sample. The rolling shutter collects data from the sensor surface one pixel line at a time. As shown in the figure, at a first time T1, a new capture cycle begins, in which the sensor surface 300 begins to acquire a new frame or image. The first pixel line PL1 of the sensor surface 300 begins (or is reset to start from the previous cycle) a new acquisition signal, followed by the second pixel line PL2 at time T2, and continues in sequence until all pixels begin to acquire new signals as part of the same capture cycle at time TN. The pixel lines are shown as traveling from top to bottom, but can travel from bottom to top or from left to right or from right to left. Therefore, there are specific time periods and other time periods different from the specific time periods, during which all individual pixel lines are exposed simultaneously in the same capture cycle, and during other time periods, a specific subset of individual pixel lines is read in the current capture cycle and stops being exposed simultaneously. A specific subset of individual pixel lines omits at least one or some of the individual pixel lines.

[0060] Rolling shutter cameras have simpler electronic components than global shutter cameras and are therefore cheaper. However, such cameras are not typically used in metrology applications. In a rolling shutter camera, there is a time delay between the exposure of each pixel line of the camera. Although the time delay between each adjacent pixel line is very small, the time delay between the first and last rows (e.g., TN-T1) can be significant. Although this delay may not cause problems in a completely static setting (where the camera, background, and object in the scanner are all fixed and stationary relative to each other), in a mobile handheld scanner, the background and object are moving compared to the common coordinate system of the scanner camera. The time delay between the capture of the first and last rows of the rolling shutter can cause distortion, resulting in unacceptably large measurement errors. In addition, the long exposure time as each pixel line starts to acquire the signal in turn can cause problems due to the reduced contrast of the pattern of light emitted on the ambient light.

[0061] Figure 4 4 is a diagram 400 showing a method of controlling the behavior of a handheld 3D scanner 10, wherein the first camera 31, the second camera 32, and the third camera 34 are rolling shutter cameras. The method includes controlling the light signal capture pixel by pixel line within the first camera 31, the second camera 32, and the third camera 34, thereby avoiding the problem of temporal distortion caused by rolling shutter cameras. Implementation of the method causes the cameras to perform in a similar manner to a global shutter camera, wherein all camera pixels are exposed simultaneously within the same capture cycle. The method allows the handheld 3D scanner 10 to perform as if it included a global shutter camera, but at the price of a rolling shutter camera.

[0062] exist Figure 44, the graph 400 has an X-axis 405 representing time and a Y-axis 410 being the pixel line position within the first camera 31 and the second camera 32 or the third camera 34. Seven pixel lines are shown, but the reader will understand that many more than seven pixel lines, such as 1944 pixel lines or more, may be controlled by the method shown in the graph 400.

[0063] The diagram 400 shows two different capture cycles 415, 425. The capture cycles 415, 425 are generally identical to one another. Each capture cycle 415, 425 represents the acquisition of a frame or image. In each capture cycle, a pixel line is set or reset to begin capturing data for a new image, the captured data is then read out, and any delay between cycles is allowed to pass before the next cycle begins.

[0064] The first capture cycle 415 is started, and a first signal S1 is sent (e.g., by a processor or a processor within the camera itself) to reset the data of the first pixel line PL1. The first pixel line PL1 then begins a new integration of the light signal incident on the first pixel line PL1 starting from T1 to form the first row of a new image or frame. Next, a second signal S2 is sent to reset the second pixel line PL2. The second signal S2 can be sent at T1 at the same time as PL1 starts the capture of the current capture cycle, or immediately before or after that time. After the second signal S2, the second pixel line PL2 resets and begins a new acquisition and integration of the light signal incident on the second pixel line PL2 at T2. A series of signals are sent that trigger the reset of consecutive pixel lines and the start of a new capture until a signal SN triggers the reset of the final pixel line PLN, and the final pixel line begins to integrate light to form the last image row of the new cycle TN. The signals S1 to SN are sent in a timing sequence, for example, at regular intervals. The interval between S1 and S2 can be 0.0073 ms, the interval between S1 and SN can be 14.2 ms (for an array with 1944 pixel lines). The time between S1 and E1 can be 17.7 ms, and E1 to EN (which is equivalent to S1 to SN) is 14.2 ms.

[0065] At this point, all pixels in the pixel lines PL1 to PLN are reset and simultaneously acquire data belonging to the current capture cycle 415. Only when all pixel lines PL1 to PLN simultaneously acquire data for the current capture cycle is the projector unit 36 ​​(and optionally any LEDs) triggered to switch from a deactivated mode state, during which the projector unit 36 ​​does not project a structured light pattern onto the surface of the target object (or projects a generally attenuated version of the structured light pattern), to an activated mode state, during which the light projector unit 36 ​​projects a structured light pattern onto the surface of the target object. For example, one or more processors send a control signal to the light projector unit to cause it to switch to the activated mode state when all pixel lines are simultaneously exposed to the light of the current frame / image (and also to switch to the deactivated mode state when one or more pixel lines have stopped being exposed to the light of the current frame / image). In another example, one or more processors send a control signal to the light projector unit to cause it to switch to the activated mode state after sufficient time has passed since S1 to allow all pixel lines to be exposed simultaneously.

[0066] Light projected from the projector unit is reflected from the object and is received during a projection structured light pattern time period LP. The projection structured light pattern time period LP is shown to be nearly simultaneous with time TN, where all pixels are reset and simultaneously acquire data for the current capture cycle, and actually occurs just after time TN (e.g., immediately after time TN, in response to detecting that all pixel lines are simultaneously exposed, or in response to detecting that a required time period has passed). Therefore, during the projection light pattern time period LP, all pixels will simultaneously detect the projected structured light pattern reflected back from the object. The time period LP associated with the activation mode state coincides with the time period in which the pixel lines have been reset and simultaneously exposed in the same capture cycle, and the time period associated with the deactivation mode state of the projector unit coincides with all other time periods. The time period LP associated with the activation mode state may be, for example, 3.5ms.

[0067] The structured light pattern projection is then turned off in conjunction with the stop signal sent to read out the data captured by the camera's pixels for the current frame by the processor or a processor within the camera itself. First, the end signal E1 reads out the data just detected by the first pixel line PL1 (e.g., from time T1). Subsequent end signals are sent to sequentially read out all pixel lines until the final end signal EN. At this point, the data of the pixels in the pixel lines PL1 to PLN have been read. A new capture cycle 425 is then started, in which the previous signal sequence and pixel reset and readout are repeated. A cycle delay time can elapse between the end of one cycle and the beginning of the next cycle (e.g., the cycle delay time between the time of the EN signal of cycle 415 and the time of the S1 signal of cycle 425). The cycle delay time can be selected to determine the number of cycles per second. These capture cycles can occur multiple times per second during metrological measurements, such as 15, 30, 60 or more times per second.

[0068] Typically, high-resolution rolling shutter cameras have enough memory to contain only a few pixel lines of the image, and transfer data immediately as they are exposed to a new cycle of light. For portability, it is desirable to perform the data transfer using a single USB connection. Figures 1A to 4 With the described 3D scanner (which uses two or more high-resolution (e.g., 5 megapixel) cameras with a minimum exposure time of 17.7 ms that capture images at the same (or nearly the same) moment), the data would saturate a single USB 3.0 connection which typically does not have sufficient bandwidth. Therefore, the rolling shutter cameras embodied as the first camera 31, the second camera 32, and the third camera 34 are equipped with a storage buffer large enough to contain the entire camera image, so as not to saturate a single USB connection. The cameras are equipped with sufficient memory so that the entire image (taken during a cycle) can be stored on the camera before the data is transmitted from the camera (e.g., sent to the system's processor). The first camera 31, the second camera 32, and the third camera 34 can transmit data simultaneously or sequentially.

[0069] IR Projection Light

[0070] like Figure 4 The method shown results in each pixel line being exposed to a relatively long period of time (e.g., the period of E1-S1) during a single cycle. The projected structured light pattern period LP of the emitted projection light is relatively short compared to this relatively long duration of the exposure time of each pixel line. If the projected and detected light is in the visible spectrum, the result is a very low signal-to-noise ratio. In order to overcome the noise, the contrast of the emitted light pattern relative to the ambient light is maximized by utilizing IR light. IR light can be used because there are relatively few IR ambient sources in a typical environment.

[0071] Figure 5An example image capture scene 500 is shown using an exemplary IR rolling shutter scanner 505. The IR rolling shutter scanner 505 is Figure 2 A variation of the handheld 3D scanner 10 , wherein the imaging module includes a first camera 31 and a second camera 32 , wherein the third camera 34 is omitted.

[0072] The IR rolling shutter scanner 505 has two rolling shutter cameras 515, 520 (equivalent to Figure 2 Each of the rolling shutter cameras 515, 520 has a rolling shutter sensor 525, 530 (each having an array of pixels 305, such as Figure 3A and Figure 3B 1 , the rolling shutter sensors 525, 530 are exposed to the object 110 scanned by the rolling shutter mechanism. IR filters 545, 550 (e.g., bandpass or longpass filters) are placed in front of the rolling shutter sensors 525, 530 and limit the wavelength of light incident on the lenses 547, 549 of the rolling shutter cameras 515, 520, which is transmitted to the rolling shutter sensors 525, 530. As is known in the art, the IR filters 545, 550 block most of the wavelengths of light in the light 570 received by the rolling shutter cameras 515, 520, leaving only the desired portion of the infrared spectrum to be captured by the rolling shutter sensors 525, 530. Suitable lenses 547, 549 can be placed in front of or behind the IR longpass filters 545, 550. Thus, the rolling shutter cameras 515, 520 allow light with wavelengths within a specific wavelength range (IR range) to pass onto the sensor surface, while generally attenuating light outside the specific wavelength range.

[0073] In the IR rolling shutter scanner 505, the IR projector 555 is used as ( Figure 2 ) projector unit 36 ​​and emits a pattern of IR wavelength light 565. The IR filters 545, 550 ensure that the pattern of light 565 emitted by the IR projector 555 corresponds to a majority of the received light 570 reflected by the object 110 and incident on the rolling shutter cameras 515, 520, thereby increasing the contrast in the received light 570 between the desired signal corresponding to the pattern of emitted light 565 and the ambient light. The use of IR light and the IR projector 555 makes it possible to use the rolling shutter cameras 515, 520 in the context of a handheld 3D scanner by solving the problems of low pattern to ambient light contrast and temporal distortion.

[0074] In the IR rolling shutter scanner 505, one or more IR LEDs 560 are used which are also configured to emit IR light 575 towards the object 110. The IR light from the IR LEDs 560 is used to illuminate the object visual target 117 on or near the object 110. The IR light 575 from the IR LEDs 560 is emitted simultaneously with the light of the pattern of light 565 emitted by the IR projector 555 to simultaneously obtain data from the object visual target 177 and the object itself.

[0075] In the IR rolling shutter scanner 505 , one or more processors 160 control signals and process data. Data is transmitted from the IR rolling shutter scanner 505 along the data communication line 562 .

[0076] In some embodiments, IR projector 455 emits light at a wavelength of 850 nm. Other wavelengths are possible between 405 nm and 1100 nm. IR LED 560 can also emit light at a wavelength of 850 nm. Other wavelengths are possible between 405 nm and 1100 nm.

[0077] Figure 6 Show use Figure 5 The steps of the IR rolling shutter scanner 505 take into account the Figure 4The rolling shutter behavior discussed. At step 615, a signal is sent (e.g., by one or more processors 160) to cause the rolling shutter cameras 515, 520 to begin a new cycle of capturing light. Within the camera, a signal is sent to reset the pixel lines and begin a new cycle of exposure in both rolling shutter cameras 515, 520 (step 620). The time period required to reset all pixel lines of the rolling shutter cameras 515, 520 is allowed to pass (step 625). The IR projector 555 is then switched to an active mode state such that IR light is projected by the IR projector 555 (and in some embodiments, also by the IR LED 560); the projected IR light is reflected from the object during the structured light pattern time period (LP) and received at the rolling shutter cameras 515, 520 (step 635). A signal is sent to then cause the IR projector 555 to switch to a deactivated mode state and stop projecting IR light (and the IR LED 560) (step 639). Thus, the activated mode state of the light projector unit at least partially coincides with a specific time period during which the pixel lines in the (multiple) rolling shutter cameras are simultaneously exposed, and the deactivated mode state of the light projector unit at least partially coincides with a time period during which a subset of the pixel lines are read and stop being exposed within the current capture cycle. A signal is sent, and then the rolling shutter cameras 515, 520 read out the data captured since each pixel line was reset (step 640). The data readout from the pixels to the memory of the camera continues until completed (step 645). Data representing the entire image is transmitted from the camera to the processor 160 (step 649). The captured image is then processed (step 650). In the processing step, one or more processors process the image group including the reflection of the IR light pattern to perform a 3D reconstruction process of the surface of the target object. The processing includes determining measurements related to the surface of the object based on the correspondence between the signals received from the first camera and the second camera using triangulation and stereo principles. After the step 649 of transmitting the data, the system determines whether enough time has passed to restart the image capture cycle. When the cycle delay time expires, the image capture cycle restarts at step 615 (step 655).

[0078] LCD-Color Capture

[0079] IR Rolling Shutter Scanner 505 is Figure 2 A variation of the handheld 3D scanner 10 is provided, wherein in the imaging module, the first camera 31 and the second camera 32 are implemented as monochrome cameras, color visible spectrum cameras or near infrared cameras, and the third camera 34 is omitted. However, in order to acquire the color of the object, the scanner needs to acquire data in the visible spectrum. Figure 7 Shown as Figure 2An embodiment of a color scanner 705 of a variation of the handheld 3D scanner 10, wherein the imaging module includes a first camera and a second camera implemented as rolling shutter cameras 515, 520 and a third camera as a color camera 720. Two types of light projector units, an IR projector and a white light projector, are also included in the imaging module.

[0080] Similar to the IR rolling shutter scanner 505, the color scanner 705 includes rolling shutter cameras 515, 520 and an IR projector 555, which are described with reference to FIG. Figure 5 and Figure 6 The color scanner 705 may also include the IR LED 560 as described above, or the IR LED may be omitted.

[0081] Also integrated into the color scanner 705 is a rolling shutter color camera 720 (equivalent to the third camera 34). The color camera includes a rolling shutter color sensor 730 (eg, a CMOS sensor having an array of pixels configured as a rolling shutter camera as described above).

[0082] In the rolling shutter color camera 720, the LCD shutter 743 is placed in front of the color sensor 730 and behind the lens 751 of the rolling shutter color camera 720. The LCD shutter (such as the LCD shutter 743 implemented herein) includes two polarizers arranged at 90 degrees relative to each other with a liquid crystal liquid in between. As is known in the art, such an LCD shutter transmits light based on the angle of the incident light and allows the exposure of the rolling shutter color camera 720 to be switched between open and closed. The arrangement of the LCD shutter 743 behind the lens 751 (rather than in front of the lens or embedded in the lens) allows the LCD shutter to be smaller in size when located behind the lens than if located in front of the lens. The light transmitted through the lens is more parallel, so the position of the LCD shutter has less effect on the detected color. This positioning also relaxes the tolerance of the optical quality of the LCD shutter.

[0083] Placing the LCD shutter 743 behind the lens 751 also protects the shutter from the external environment and contaminants such as dust. In addition, since the LCD shutter is sensitive to temperature, placing the LCD shutter 743 behind the lens 751 enables easier temperature control.

[0084] Unlike the IR projector 555, which emits a structured light pattern, the white light projector 755 of the color scanner 705 emits a single "spotlight" of visible light. In some embodiments, the white light projector 755 is in the form of a white light LED. In some embodiments, the white light projector 755 can be omitted and the rolling shutter color camera 720 utilizes white light in the surrounding environment.

[0085] The rolling shutter color camera 720 includes a filter for at least partially blocking wavelengths of light corresponding to the wavelengths of light projected by the IR light projector unit 555. Thus, a short pass filter 753 is included in the rolling shutter color camera 720 so that most of the incident light (e.g., IR radiation) having a longer wavelength is not transmitted to the lens 751, the LCD shutter 743, and the rolling shutter color sensor 730. The incident light 770 reflected back from the object 110 includes light 765 emitted by the color scanner 705, which can include IR light from the IR projector 555 (and IR LED 560, if used) and visible light from the white light projector 755 (if used) and from the surrounding environment. The use of the rolling shutter color camera 720 advantageously uses white light and excludes the IR projected light. Thus, the color scanner 705 is able to acquire the color (from the received white light) of the object 110 simultaneously with the geometry and position (from the received IR light). Rather than alternating between visible projected light (e.g., from white light projector 755) and IR projected light (from IR projector 555), both types of light can be projected and / or captured simultaneously. IR filters 545, 550 in front of rolling shutter cameras 515, 520 filter out white light, and thus the projected (and ambient) white light does not dilute the signal falling on rolling shutter sensors 525, 530 that determine the 3D position of the surface of object 110. The two types of light do not need to be acquired alternately with changing patterns of projected light.

[0086] One or more processors (e.g., processor 160) are configured to send a control signal to the LCD shutter for switching the LCD shutter between an open state and a closed state, wherein in the open state, the LCD shutter is translucent, and wherein in the closed state, the LCD shutter is opaque. In the closed state, the LCD shutter is at least partially opaque (e.g., blocks at least 40%, more preferably at least 50%, or most preferably at least 65%), and in some embodiments, may be completely opaque such that most light is blocked from passing through (e.g., blocks at least 75%, more preferably at least 80%, more preferably at least 85%, and most preferably at least 95% of the light). In some embodiments, switching the LCD shutter between the open state and the closed state is timed to be interleaved with a time period during which the light projector unit switches between an active mode state (in which P1 emits a structured IR light pattern) and a deactivated mode state. This can occur such that when the light projector unit switches to the active mode state, the LCD shutter also switches to the open state, and when the light projector unit switches to the deactivated mode state, the LCD shutter switches to the closed state. This arrangement advantageously allows the geometrical data (obtained from the IR structured light pattern) to be acquired at the same time as the texture data.

[0087] Figure 8 Show use Figure 7 Method 800 for color scanner 705 of the present invention. At step 805, a signal is sent to control the behavior of a rolling shutter camera (rolling shutter camera 515, 520) that receives IR light through an IR filter. At step 810, IR light is projected and timed so that all pixels of the rolling shutter camera receive reflections of the projected IR light. The IR signal is captured and processed (step 815). These steps are as described above with respect to Figure 6 The structured light patterns are repeated and overlapped as discussed, wherein the processor sends control signals to the light projector unit to intermittently project the structured light pattern according to a specific sequence.

[0088] At the same time, at step 820, a signal is sent to control the behavior of the rolling shutter camera that is receiving the white light. While the white light is being projected (step 827), the LCD shutter is controlled to enter an open state (step 825). The white light is projected and timed so that all pixels of the rolling shutter camera receive reflections of the projected white light, as allowed by both the rolling shutter and the LCD shutter. Thus, when the light projector unit is in the active mode state, the LCD shutter is at least partially simultaneously in the open state, and when the light projector unit is in the deactivated mode state, the LCD shutter is at least partially simultaneously in the closed state.

[0089] At step 830, the captured white light signal is processed. These steps are repeated. Both the processed IR signal indicating the 3D surface configuration of the imaged object and the processed white light signal indicating the color and appearance of the imaged object are output to the user (step 840). All steps of method 800 are repeated multiple times to fully characterize the object. Note that in embodiments where the projector unit does not include a white light projector, step 827 can be omitted; in such embodiments, white light from the environment is received at the LCD shutter. Steps 820 and 825 are repeated over multiple cycles.

[0090] hardware

[0091] Fig. 91 is a block diagram showing an example major component of the system 980. The sensor 982 (e.g., the 3D scanner 100 of FIG. 1 ) includes a first camera 984 and a second camera 986 and a light projector unit 988, which includes at least one light projector capable of projecting light, which light can be white or a specific wavelength such as infrared. In some embodiments, the sensor 982 also includes a third camera 987. The light projector unit 988 is capable of projecting IR and / or white light. The frame generator 990 can be used to assemble the images captured by the camera in a single frame. The sensor 982 communicates with at least one computer processor 992 (e.g., the processor 160 of FIG. 1 ) for implementing processing steps to match points between images of the frames. The computer processor 992 communicates electronically with an output device 994 to output matching points and / or any additional or intermediate outputs. As will be readily understood, input data will be required for use by the computer processor 992 and / or the sensor 982. For this purpose, (multiple) input devices 996 can be provided.

[0092] In a non-limiting example, a computer processor 992 (e.g., Figure 1A and 1B Some or all of the functions of the processor 160 may be performed Fig.10 1200 is implemented on a suitable microprocessor 1200 of the type depicted in . Such a microprocessor 1200 typically includes a processing unit 1202 and a memory 1204 connected by a communication bus 1208. The memory 1204 includes program instructions 1206 and data 1210. The processing unit 1202 is suitable for processing the data 1210 and the program instructions 1206 so as to implement the functions described and depicted in the accompanying drawings with reference to the 3D imaging system. The microprocessor 1200 may also include one or more I / O interfaces for receiving data elements or sending data elements to external modules. In particular, the microprocessor 1200 may include an I / O interface 1212 with a sensor (camera), an I / O interface 1214 for exchanging signals with an output device (such as a display device), and an I / O interface 1216 for exchanging signals with a control interface (not shown). The output device and the control interface may be shown on the same interface.

[0093] Those skilled in the art should understand that in some non-limiting embodiments, pre-programmed hardware or firmware elements (e.g., a microprocessor, FPGA, application specific integrated circuit (ASIC), electrically erasable programmable read-only memory (EEPROM), etc.) or other related components may be used to implement all or part of the functionality previously described herein with respect to the processing system.

[0094] In other non-limiting embodiments, all or part of the functionality described herein previously with respect to the processor 160 of the 3D scanner 100 or 100' may be implemented as software consisting of a series of program instructions for execution by one or more computing units. The series of program instructions can be tangibly stored on one or more tangible computer-readable storage media, or the instructions can be tangibly stored remotely but sent to one or more computing units via a modem or other interface device (e.g., a communications adapter) connected to a computer network via a transmission medium. The transmission medium may be a tangible medium (e.g., an optical or analog communication line) or a medium implemented using wireless technology (e.g., microwave, infrared, or other transmission schemes).

[0095] The techniques described above may be implemented, for example, in hardware, software tangibly stored on a computer-readable medium, firmware, or any combination thereof. The techniques described above may be implemented in one or more computer programs executed on a programmable computer, the programmable computer comprising a processor, a storage medium readable by the processor (including, for example, volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device. The program code may be applied to input entered using the input device to perform the described functions and generate output. The output may be provided to one or more output devices.

[0096] Those skilled in the art will also appreciate that program instructions can be written in a number of suitable programming languages ​​for use with many computer architectures or operating systems.

[0097] Note that titles or subtitles may be used throughout this disclosure for the convenience of the reader, but these should in no way limit the scope of the invention. In addition, certain theories may be proposed and disclosed herein; however, whether they are correct or incorrect, they should in no way limit the scope of the invention, as long as the invention is practiced according to this disclosure without considering any particular theory or scheme of action.

[0098] All references cited throughout this specification are herein incorporated by reference in their entirety for all purposes.

[0099] Those skilled in the art will understand that throughout this specification, the term "a" used before an item encompasses one or more embodiments referred to by the item. Those skilled in the art will also understand that throughout this specification, the term "comprising" which is synonymous with "consisting of," "comprising," or "characterized by" is inclusive or open-ended and does not exclude additional unlisted elements or method steps.

[0100] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. In the event of a conflict, the present document, including definitions, will control.

[0101] As used in this disclosure, the terms "about," "approximately," or "approximately" should generally mean within the error tolerance generally accepted in the art. Therefore, the numerical amounts given herein generally include such error tolerances, so that if not explicitly stated, the terms "about," "approximately," or "approximately" can be inferred.

[0102] Although various embodiments of the present disclosure have been described and illustrated, it will be apparent to those skilled in the art from this specification that numerous modifications and variations are possible. The scope of the present invention is more particularly defined in the appended claims.

Claims

1. A scanner for generating 3D data associated with a surface of a target object, the scanner comprising: a. A scanner frame structure, on which an imaging module group is mounted, including: i. a light projector unit for projecting a structured light pattern onto a surface of a target object; ii. a camera group positioned beside the light projector unit, the camera group comprising one or more rolling shutter cameras for capturing data conveying a set of images comprising reflections of a light pattern projected onto a surface of a target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines; and b. One or more processors in communication with the imaging module group for receiving and processing data conveying the image group, wherein the one or more processors are further configured to send control signals to the light projector unit to intermittently project the structured light pattern according to a specific sequence.

2. The scanner according to claim 1, wherein: The one or more processors are configured to send a control signal to the light projector unit to intermittently project the structured light pattern according to the specific sequence to switch the light projector unit between the following states: i. an active mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object; ii. a deactivated mode state, during which the light projector unit: 1) omitting projecting the structured light pattern onto the surface of the target object; or 2) Projecting a generally attenuated version of the structured light pattern.

3. The scanner according to claim 2, wherein: The sensor surface of one or more rolling shutter cameras is activated according to an operating mode as part of a capture cycle, the operating mode being characterized by: a. a specific time period in the current specific capture cycle during which each of the plurality of pixel lines is simultaneously exposed; and b. A specific subset of the plurality of pixel lines during which, different from the specific time period, stops being exposed for the current specific capture cycle, wherein the specific subset of the plurality of pixel lines omits at least one of the plurality of pixel lines.

4. The scanner according to claim 3, wherein: The particular subset of respective pixel lines omits at least some of the respective pixel lines of the plurality of pixel lines.

5. The scanner according to any one of claims 3 to 4, wherein: The active mode state of the light projector unit at least partially coincides with the specific time period during which the respective pixel lines of the plurality of pixel lines are simultaneously exposed.

6. The scanner according to any one of claims 3 to 5, wherein: The deactivated mode state of the light projector unit at least partially coincides with a time period during which a subset of individual pixel lines of the plurality of pixel lines ceases to be exposed for the current particular capture cycle.

7. A scanner according to any one of claims 3 to 6, wherein: The one or more processors are configured to: a. sending a reset signal to the one or more rolling shutter cameras to restart a new specific capture cycle in the plurality of specific capture cycles, during which different pixel lines in the plurality of pixel lines are sequentially exposed for the new specific capture cycle; b. after a first delay period after sending the reset signal, sending an activation control signal to the light projector unit to switch the light projector unit to an activation mode state; c. After a second delay period after the activation signal is sent to the light projector unit, sending a deactivation control signal to the light projector unit to switch the light projector unit to a deactivation mode state.

8. The scanner according to any one of claims 2 to 7, wherein: The light projector unit includes a light source configured to emit light having a wavelength within a specific wavelength range.

9. The scanner according to claim 8, wherein: The one or more rolling shutter cameras include at least one rolling shutter geometric camera for generating image data to derive 3D measurements of a surface of an object, the at least one rolling shutter geometric camera being configured to: a. Allow light with a wavelength within a specific wavelength range to pass through to the sensor surface; b. Generally attenuates light in the spectrum outside a specific wavelength range.

10. The scanner according to any one of claims 8 and 9, wherein: The light source is configured to emit at least one of white light, infrared light, and blue light.

11. A scanner according to any one of claims 8 to 10, wherein: The specific wavelength range is the infrared wavelength range.

12. A scanner according to any one of claims 8 to 11, wherein: The light source is configured to emit light having a wavelength between 405 nm and 1100 nm.

13. A scanner according to any one of claims 8 to 12, wherein: The light source includes a laser.

14. The scanner according to claim 13, wherein: The laser is a vertical cavity surface emitting laser.

15. A scanner according to any one of claims 8 to 12, wherein: The light source includes one or more light emitting diodes (LEDs).

16. A scanner according to any one of claims 2 to 15, wherein: The one or more rolling shutter cameras include at least one rolling shutter geometric camera for generating image data to derive 3D measurements of a surface of an object.

17. The scanner according to claim 16, wherein: The at least one rolling shutter geometry camera includes at least two rolling shutter geometry cameras.

18. A scanner according to any one of claims 16 and 17, wherein: The at least one rolling shutter geometry camera comprises a near infrared camera.

19. The scanner according to claim 7, wherein: The infrared camera includes an infrared filter configured to pass infrared light and generally attenuate light in a spectrum outside of the infrared.

20. A scanner according to any one of claims 2 to 19, wherein: The one or more rolling shutter cameras include a rolling shutter color camera for generating image data to derive texture information associated with a surface of an object.

21. The scanner of claim 20, wherein: The rolling shutter color camera includes a liquid crystal device (LCD) shutter.

22. The scanner of claim 20, wherein: The color rolling shutter camera comprises: a. Sensor; b. Lens; and c. Wherein a liquid crystal device (LCD) shutter is positioned between the sensor and the lens.

23. A scanner according to any one of claims 21 and 22, wherein: The one or more processors are configured to send a control signal to the LCD shutter to switch the LCD shutter between an open state and a closed state, wherein in the open state, the LCD shutter is translucent and in the closed state, the LCD shutter is at least partially opaque.

24. The scanner of claim 23, wherein: In the closed state, the LCD shutter is completely opaque, so that light incident on the LCD shutter is generally blocked from passing through the LCD shutter.

25. A scanner according to any one of claims 23 and 24, wherein: The switching of the LCD shutter between the open state and the closed state at least partially coincides with the switching of the light projector unit between the active mode state and the deactivated mode state, such that: a. When the light projector unit is in the activation mode state, the LCD shutter is at least partially in the open state at the same time; b. When the light projector unit is in the deactivation mode state, the LCD shutter is at least partially in the closed state simultaneously.

26. A scanner according to any one of claims 20 to 25, wherein: The light projector unit is a first light projector unit that projects a first type of light including the structured light pattern, and wherein the scanner includes a second light projector unit, which includes a second projector light source configured to project a second type of light onto the surface of the object.

27. The scanner of claim 26, wherein: The second projector light source is a white light source, and wherein the second type of light is white light.

28. A scanner according to any one of claims 26 and 27, wherein: The second projector light source includes one or more light emitting diodes.

29. A scanner according to any one of claims 26 to 28, wherein: The rolling shutter color camera includes an optical filter for at least partially blocking a wavelength of light corresponding to a wavelength of light projected by the first light projector unit.

30. A scanner according to any one of claims 1 to 29, wherein: One or more rolling shutter cameras in the camera set are mounted to have fields of view that at least partially overlap one another.

31. A scanner according to any one of claims 1 to 30, wherein: The one or more rolling shutter cameras include at least two rolling shutter cameras.

32. The scanner of claim 31, wherein: The one or more rolling shutter cameras include at least three rolling shutter cameras.

33. The scanner of claim 32, wherein: The at least three rolling shutter cameras include at least two rolling shutter geometry cameras and at least one rolling shutter color camera.

34. A scanner according to any one of claims 1 to 33, wherein: The specific sequence is a periodic sequence, such that the light projector unit intermittently projects the structured light pattern onto the surface of the object at regular time intervals.

35. A scanner according to any one of claims 1 to 34, wherein: The one or more processors are configured to process the set of images including reflections of the structured light pattern to perform a 3D reconstruction process of the surface of the target object.

36. A scanner according to any one of claims 1 to 34, wherein: The one or more processors are configured to transmit data conveying an image set including reflections of the structured light pattern to a remote computing system different from the scanner, and the remote computing system is configured to use the data conveying the image set including reflections of the light pattern to perform a 3D reconstruction process of the surface of the target object.

37. A scanner according to any one of claims 1 to 36, wherein: The scanner is a handheld scanner.

38. A scanning system for generating 3D data associated with a surface of a target object, the scanning system comprising: a. A scanner according to any one of claims 1 to 37; b. A computing system in communication with the scanner, the computing system being configured to: i. performing a 3D reconstruction process of a surface of a target object using data conveying a set of images comprising reflections of a structured light pattern captured by a scanner; ii. Rendering a visual representation of at least a portion of the surface of the target object resulting from the 3D reconstruction process on a graphical user interface displayed on a display device.

39. A method for generating 3D data associated with a surface of a target object using a 3D scanner, the 3D scanner having an imaging module set including a light projector and a camera set, the light projector being configured to project a structured light pattern onto the surface of the target object, the camera set including one or more rolling shutter cameras for capturing data conveying a set of images including reflections of the structured light pattern projected onto the surface of the target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, the method comprising: a. Sending a control signal to the light projector unit so that it intermittently projects a structured light pattern according to a specific sequence by switching the light projector unit between the following states: i. an active mode state, during which the light projector unit projects a structured light pattern onto a surface of a target object; ii. a deactivated mode state, during which the light projector unit: 1) omitting projecting the structured light pattern onto the surface of the target object; or 2) projecting a generally attenuated version of the structured light pattern; b. wherein the occurrence of the active mode state of the light projector unit at least partially coincides with a time period during which the plurality of pixel lines are simultaneously exposed in the same capture cycle; c. Processing the set of images to perform a 3D reconstruction process of the surface of the target object.

40. The method of claim 39, wherein: The sensor surface of one or more rolling shutter cameras is activated according to an operating mode that is part of a current specific capture cycle, the operating mode being characterized by: a. a specific time period during which each of the plurality of pixel lines is simultaneously exposed in a current specific capture cycle; and b. other time periods different from the specific time period, during which a specific subset of each of the multiple pixel lines stops being exposed in a current specific capture cycle, wherein the specific subset of each of the multiple pixel lines omits at least one of the multiple pixel lines.

41. The method of claim 40, wherein: The particular subset of respective pixel lines omits at least some of the respective pixel lines of the plurality of pixel lines.

42. The method according to any one of claims 40 to 41, wherein: The active mode state of the light projector unit at least partially coincides with a specific time period during which respective ones of the plurality of pixel lines are simultaneously exposed to light.

43. A method according to any one of claims 40 to 42, wherein: The deactivated mode state of the light projector unit at least partially coincides with a time period during which a subset of individual pixel lines of the plurality of pixel lines ceases to be exposed in a current particular capture cycle.

44. A method according to any one of claims 40 to 43, comprising: a. sending a reset signal to one or more rolling shutter cameras to start a new specific capture cycle of the plurality of pixel lines, during which pixel lines in the plurality of pixel lines sequentially begin to be exposed for the new specific capture cycle; b. after a first delay period after sending the reset signal, sending an activation control signal to the light projector unit to switch it to an activation mode state; c. After a second delay period after sending the activation signal to the light projector unit, sending a deactivation control signal to the light projector unit to switch it to a deactivation mode state.

45. The method according to any one of claims 40 to 44, wherein: The one or more rolling shutter cameras include a rolling shutter color camera for generating image data to derive texture information associated with a surface of an object, and wherein the rolling shutter color camera includes a liquid crystal device (LCD) shutter, and the method includes sending a control signal to the LCD shutter to switch the LCD shutter between an open state and a closed state, wherein in the open state, the LCD shutter is translucent, and wherein in the closed state, the LCD shutter is at least partially opaque.

46. ​​The method of claim 45, wherein: The switching of the LCD shutter between the open state and the closed state at least partially coincides with the switching of the light projector unit between the active mode state and the deactivated mode state, such that: a. When the light projector unit is in the activation mode state, the LCD shutter is at least partially in the open state at the same time; b. When the light projector unit is in the deactivation mode state, the LCD shutter is at least partially in the closed state simultaneously.

47. A method according to any one of claims 39 to 46, wherein: The specific sequence is a periodic sequence such that the light projector unit intermittently projects the structured light pattern onto the surface of the object at regular time intervals.

48. A method according to any one of claims 39 to 47, comprising processing the set of images comprising reflections of the structured light pattern to perform a 3D reconstruction process of a surface of a target object.

49. A method according to any one of claims 39 to 47, comprising transmitting data of a group of images including reflections of a structured light pattern to a remote computing system different from the scanner, wherein the remote computing system is configured to use the data of the group of images including reflections of the light pattern to perform a 3D reconstruction process of the surface of the target object.

50. A computer program product comprising program instructions tangibly stored on one or more tangible computer-readable storage media, wherein when executed by one or more processors, the instructions of the computer program product cause a 3D scanner to perform operations to generate 3D data associated with a surface of a target object, the 3D scanner having an imaging module group including a light projector and a camera group, the light projector being configured to project a structured light pattern onto the surface of the target object, the camera group including one or more rolling shutter cameras for capturing data transmitting an image group including reflections of the structured light pattern projected onto the surface of the target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, the operations implementing a method according to any one of claims 39 to 49.

51. A scanner for generating 3D data associated with a surface of a target object, the scanner comprising: a. A scanner frame structure, wherein the scanner frame structure is equipped with an imaging module group, wherein the imaging module comprises: i. a light projector unit for projecting a structured light pattern onto a surface of a target object, the light projector unit having a light source configured to emit light having a wavelength within a specific wavelength range; ii. a camera group positioned next to the light projector unit, the camera group comprising one or more rolling shutter cameras for capturing data conveying a set of images comprising reflections of a structured light pattern projected onto a surface of a target object, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, the at least one rolling shutter geometric camera being configured to: 1) Allow light with a wavelength within a specific wavelength range to pass through to the sensor surface; 2) generally attenuate light in the spectrum outside of a specific wavelength range; b. One or more processors in communication with the imaging module group, for receiving and processing data conveying the image group, wherein the one or more processors are further configured to send a control signal to a light projector unit to intermittently project a structured light pattern according to a specific sequence, thereby switching the light projector unit between the following states: i. an active mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object; ii. a deactivated mode state, during which the light projector unit: 1) omitting projecting the structured light pattern onto the surface of the target object; or 2) Projecting a generally attenuated version of the structured light pattern.

52. A scanner for generating 3D data associated with a surface of a target object, the scanner comprising: a. A scanner frame structure, wherein the scanner frame structure is equipped with an imaging module group, including: i. a light projector unit for projecting a structured light pattern onto a surface of a target object; ii. A camera group, the camera group being positioned next to the light projector unit, the camera group comprising one or more rolling shutter cameras for capturing data conveying the image group, the one or more rolling shutter cameras having a sensor surface defining a plurality of pixel lines, wherein the one or more rolling shutter cameras comprises at least: 1) rolling shutter geometry camera; and 2) a shutter color camera including a rolling liquid crystal device (LCD) shutter for generating image data to derive texture information associated with a surface of an object; b. One or more processors in communication with the imaging module group, for receiving and processing data conveying the image group, wherein the one or more processors are further configured to send a control signal to a light projector unit to intermittently project a structured light pattern according to a specific sequence, thereby switching the light projector unit between the following states: i. an active mode state, during which the light projector unit projects the structured light pattern onto the surface of the target object; ii. a deactivated mode state, during which the light projector unit: 1) omitting projecting the structured light pattern onto the surface of the target object; or 2) Projecting a generally attenuated version of the structured light pattern.