Structured light scanning system and method, and image projector thereof

The programmable light source in the image projector improves decoding rates and dynamic range by switching light patterns, enabling accurate depth and surface information acquisition in structured light scanning systems.

JP7581442B2Active Publication Date: 2024-11-12HIMAX TECH LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023126231
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-09-01
Filing Date
2023-08-02
Publication Date
2024-11-12
Estimated Expiration
2043-08-02

AI Technical Summary

Technical Problem

Conventional structured light scanning systems have a fixed light source that emits a single light pattern, leading to low decoding rates and a narrow dynamic range, limiting accurate depth and surface information acquisition.

Method used

An image projector with a programmable light source that switches between different light patterns using a laser array and a beam shaper, combined with a camera to capture and analyze reflected light patterns for depth and surface information.

Benefits of technology

Enhances decoding rates and provides a wider dynamic range for accurate depth and surface information acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581442000001
    Figure 0007581442000001
  • Figure 0007581442000002
    Figure 0007581442000002
  • Figure 0007581442000003
    Figure 0007581442000003
Patent Text Reader

Abstract

To provide an image projector.SOLUTION: A structured light scanning system is provided, comprising a light source for emitting light while switching between different light patterns, and a beam shaper for projecting an image on an object within a scene, configured to shape a beam emitted by the light source to generate shaped light patterns.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to image projectors, and more particularly to image projectors with programmable light sources that can be switched to emit different light patterns. [Background technology]

[0002] An image projector (short for projector) is an optical device that projects a (still) image or a series of images (or video signals) onto the surface of a projection screen.

[0003] The projector can be applied to a structured light scanning system, which projects a known pattern (e.g., a grid or stripes) onto objects in the scene. The structured light 3D scanner analyzes the deformations induced by the reflected light and calculates the depth and surface information of the objects in the scene. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional structured light scanning system, the light source of the projector has a fixed structure and emits the same light pattern to the object, so the conventional structured light scanning system has the disadvantages of low decoding rate and narrow dynamic range, and cannot accurately obtain the depth and surface information of the object.

[0005] Therefore, the inventors believed that the shortcomings of conventional projectors and structured light scanning systems could be improved, and after extensive research, they came up with the proposal of the present invention, which effectively improves the above-mentioned problems through a rational design.

[0006] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image projector having a programmable light source that can generate different light patterns to obtain a preferable structured light scanning decode rate. [Means for solving the problem]

[0007] According to one embodiment of the present invention, there is provided an image projector, comprising a light source and a beam shaper, the light source emitting different light patterns while switching between them, the beam shaper being used to shape the beam emitted by the light source to generate a shaped light pattern, which is projected onto an object in a scene.

[0008] According to another embodiment of the present invention, there is provided a structured light scanning system. The structured light scanning system of the present invention includes a light source, a controller, and a camera. The light source is used to emit a beam, the light source comprising a laser array composed of a plurality of laser diodes. The controller individually programs the plurality of laser diodes to turn on or off and switch between emitting different light patterns to project onto objects in the scene. The camera is used to capture the reflected light patterns reflected from the objects in the scene and feed them back to the controller to determine depth and surface information.

[0009] According to yet another embodiment of the present invention, there is provided a method for structured light scanning, the method for structured light scanning according to the present invention includes the following steps: providing a light source and emitting different light patterns while switching between them; emitting a beam having the light pattern from the light source to an object in a scene; determining depth and surface information based on a deformation of the reflected light pattern reflected from the object in the scene; determining whether a decode rate obtained in the step of determining depth and surface information is greater than a predetermined critical value; if the decode rate is not greater than the predetermined critical value, modifying the light pattern and emitting a beam having the modified light pattern to the object in the scene.

[0010] Other objects, configurations and effects of the present invention will become apparent from the following detailed description of the preferred embodiments of the present invention. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a schematic configuration of an image projector according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of the vertical-cavity surface-emitting laser (VCSEL) shown in FIG. 1 (the light source). [Diagram 3] (FIG. 3A) (Different) light patterns emitted at different times by the (programmable) VCSEL of the light source of FIG. 1. (FIG. 3B) (Different) light patterns emitted at different times by the (programmable) VCSEL of the light source of FIG. 1. (FIG. 3C) (Different) light patterns emitted at different times by the (programmable) VCSEL of the light source of FIG. 1. (FIG. 3D) Light patterns of a programmable vertical cavity surface emitting laser without the present embodiment. [Figure 4](FIG. 4A) An example of directly shaping a beam emitted from a light source using a diffractive optical element, a microlens array, and a multifocal diffractive lens is described. (FIG. 4B) An example of indirectly shaping a beam emitted from a light source via a lens using a diffractive optical element, a microlens array, and a multifocal diffractive lens is described. (FIG. 4C) An example of directly shaping a beam emitted from a light source using a liquid crystal lens is described. [Diagram 5] 1 is a block diagram showing a structured light scanning system according to one embodiment of the present invention. [Figure 6] 4 is a flowchart illustrating a structured light scanning method according to an embodiment of the present invention. [Figure 7] (FIG. 7A) Applied to the light pattern of the flow chart shown in FIG. 6. (FIG. 7B) Applied to the light pattern of the flow chart shown in FIG. 6. (FIG. 7C) Applied to the light pattern of the flow chart shown in FIG. 6. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present invention will be described in detail. However, the present invention is not limited to these, and various modifications are possible within the scope of the description. The technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments.

[0013] First, the image projector 100 according to the present invention will be described in more detail with reference to the drawings. Fig. 1 is a block diagram showing a schematic configuration of an image projector 100 according to an embodiment of the present invention. The image projector 100 according to this embodiment projects an image onto a surface of an object in a scene, and can be applied to smartphones, optical scanning, face recognition, directional display, and LiDAR, but the present invention is not limited thereto.

[0014] The image projector 100 according to this embodiment comprises a light source 11 used to emit a (visible or invisible) beam. In this embodiment, the light source 11 comprises a laser array for emitting a laser beam, and emits the laser beam based on an optical amplification process (i.e., amplification of light by triggering emission by radiation) triggered by electromagnetic radiation. In one embodiment, the laser array (of the light source 11) comprises a vertical cavity surface emitting laser (VCSEL) made up of an array of semiconductor laser diodes, and the laser beam is emitted vertically from its top surface.

[0015] Figure 2 is a schematic diagram of the vertical cavity surface emitting laser (VCSEL) (light source 11) shown in Figure 1. As shown in Figure 2, the (programmable) vertical cavity surface emitting laser includes a number of laser diodes 111 arranged in rows and columns. According to one feature of this embodiment, a control device 12 (e.g., a central processing unit) turns on or off each individual laser diode 111 via a corresponding signal line 112, which is attached to a substrate 110, which is used to mount the laser diode 111. Thus, the laser diodes 111 of the (programmable) vertical cavity surface emitting laser emit light in a switched manner to form different light patterns.

[0016] Figures 3A-3C are (different) light patterns emitted at different times by the (programmable) VCSEL of the light source of Figure 1. The solid dots indicate emitted light corresponding to the laser diode 111 and the hollow dots indicate un-emitted light corresponding to the laser diode 111. Figure 3D shows the light pattern of a programmable vertical cavity surface emitting laser without this embodiment. In the example of Figure 3D, all the laser diodes of the vertical cavity surface emitting laser emit light at the same time. In other words, the light pattern emitted by the vertical cavity surface emitting laser is fixed or unchangeable.

[0017] Returning to FIG. 1, the image projector 100 according to this embodiment includes a beam shaper 13 for generating a shaped light pattern by shaping the beam emitted by the light source 11 and projecting it onto an object in a scene.

[0018] In one embodiment, the beam shaper 13 includes a diffractive optical element (DOE), a micro lens array (MLA), or a multifocal diffractive lens (MDL) to shape and split the beam emitted from the light source 11 and simultaneously focus a single incident beam in multiple places to generate a shaped light pattern to project onto an object in the scene. Figure 4A illustrates an example of using a diffractive optical element, a micro lens array, and a multifocal diffractive lens to directly shape the beam emitted from the light source.

[0019] In one embodiment, no lens is placed between the light source 11 and the beam shaper 13, forming no lens system. In another embodiment, the image projector 100 includes at least one lens 14 placed between the light source 11 and the beam shaper 13. The lens 14 is a light-transmitting optical element that refracts light to focus, collimate, or diverge the beam (from the light source 11). In one embodiment, a compound lens is used that includes multiple lenses 14 and is placed along a common axis.

[0020] In other embodiments, the lens 14 is a light-transmitting optical element that refracts the beam (from the light source 11) to focus, collimate, or diverge. In one embodiment, a Fresnel lens or a Meta lens 14 is used, but the invention is not limited thereto. Figure 4B illustrates an example of using a diffractive optical element, a microlens array, or a multifocal diffractive lens to indirectly shape the beam emitted from the light source via a lens.

[0021] In another embodiment, the beam shaper 13 includes a liquid crystal (LC) lens that shapes and splits the beam emitted by the light source 11 to generate a shaped light pattern to project onto an object in the scene. Figure 4C illustrates an example of using a liquid crystal lens to directly shape the beam emitted by the light source.

[0022] 5 is a block diagram showing a structured light scanning system 500 according to an embodiment of the present invention. The structured light scanning system 500 according to this embodiment includes the image projector 100 of FIG. 1, the description of which will not be repeated.

[0023] In this embodiment, the structured light scanning system 500 includes a camera 101 for capturing a reflected light pattern (of a shaped light pattern) reflected from an object in a scene. The captured reflected light pattern is fed back to a controller 12 (e.g., a digital image processor) to determine depth and surface information based on the deformation of the light pattern that the reflected light pattern generates relative to the light source 11.

[0024] 6 is a flow chart illustrating a method 600 for structured light scanning according to one embodiment of the present invention. In step 61, the light source 11 (e.g., a laser array such as a vertical cavity surface emitting laser in the embodiment) emits a beam having a (first or current) light pattern, which is programmed and controlled by the controller 12. In step 62, the controller 12 determines depth and surface information based on the deformation of the (first) light pattern that the light source 11 emits.

[0025] Then, in step 63, the controller 12 determines whether the decode rate obtained in the step of determining depth and surface information (step 62) is greater than a predefined critical value. If the decode rate is not greater than the predefined critical value, the controller 12 modifies (or programs) the current light pattern (step 64). Then, returning to the flowchart of step 61, the light source 11 emits a beam having a (second) modified light pattern (referred to as the current light pattern), programmed and controlled by the controller 12. The above flowchart is executed continuously until the decode rate is greater than the predefined critical value. Figures 7A to 7C show the light patterns used sequentially in the flowchart shown in Figure 6.

[0026] Based on the above embodiment, different light patterns (generated by the programmable vertical cavity surface emitting laser) are applied to different objects in the scene, or to objects having different distances to the light source 11 / camera 101. In this way, the structured light scanning system 500 and method 600 obtains a better decoding rate (and more accurate depth and surface information) and a wider dynamic range.

[0027] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention. [Explanation of symbols]

[0028] 100 image projector 500 Structured Light Scanning System 11 Light source 12 Control device 13 Beam Shaper 14 Lenses 101 Camera 110 Substrate 111 Laser Diode 112 Signal Line 600 Structured Light Scanning 61 Emitting a patterned beam 62 Depth Determination 63 Determine if the decoding rate is greater than a critical value 64 Pattern Change DOE Diffractive Optical Element MLA Microlens Array MDL Multifocal Diffractive Lens

Claims

1. a light source adapted to emit a beam, said light source comprising a laser array composed of a plurality of laser diodes; a beam shaper adapted to shape a beam emitted by the light source to generate a shaped light pattern for projection onto an object in a scene; a controller that is individually programmed to turn the laser diodes on or off to alternately emit different light patterns and project them onto the object in the scene; a camera that captures a reflected light pattern reflected from the object in the scene and feeds back the captured reflected light pattern to the controller; the beam shaper includes a liquid crystal lens; the control device determines depth and surface information based on the deformation of the reflected light pattern from the camera, and modifies the light pattern if a decode rate obtained in the step of determining the depth and surface information is not greater than a predetermined threshold value. Structured light scanning system.

2. providing a light source and switchingly emitting different light patterns; the light source emitting a beam having a light pattern toward an object in a scene; determining depth and surface information based on deformations in reflected light patterns reflected from objects in the scene; determining whether a decode rate obtained in the step of determining depth and surface information is greater than a predetermined threshold value; and if the decoding rate is not greater than a predetermined critical value, modifying the light pattern and emitting a beam having the modified light pattern to an object in the scene. Structured light scanning method.

Citation Information

Patent Citations

  • Three-dimensional coordinate scanner and operation method

    JP2016516993A

  • Coding Pattern Projector

    JP2018534592A

  • Light projection device

    JP2022122258A

  • Device and method for measuring depth of object

    KR1020220047035A