Parallax correction and method for illumination system

By measuring distance and adjusting the angular offset of the lighting field, the parallax problem caused by lateral offset between the camera and the lighting system is solved, uniform illumination of close-range objects is achieved, and image quality is improved.

CN118975226APending Publication Date: 2024-11-15LUMILEDS LLC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380032905.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-02-04
Filing Date
2023-01-31
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

When the existing camera lighting system captures images of close-range objects, the parallax problem caused by the lateral offset between the camera and the lighting system causes the object to receive too much illumination on one side and insufficient on the other side, affecting the image quality.

Method used

By measuring the distance of the object, adjusting the angular offset between the central axis of the lighting field and the longitudinal axis of the illuminator to at least partially compensate for the parallax caused by the lateral offset between the camera and the lighting system, dynamically adjusting the illuminance of the lighting field, Use light emitting diode arrays and lenses to form an appropriate lighting field to ensure even illumination of the object.

Benefits of technology

It effectively reduces the uneven lighting problem caused by parallax, ensures the uniformity of the images of close-range objects in the light, and improves the image quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118975226A_ABST
    Figure CN118975226A_ABST
Patent Text Reader

Abstract

An imaging system may automatically measure a distance to an object. A camera having a field of view containing the object may define a camera longitudinal axis extending to a center of the field of view. A luminaire defining a luminaire longitudinal axis that is substantially parallel to and laterally offset from the camera longitudinal axis may illuminate the object with the illumination field. The illumination field may have an illumination field central axis angularly offset from the illuminator longitudinal axis by an angle to at least partially compensate for parallax caused by lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angularly offset angle depends at least in part on the measured distance to the object. The camera may capture an image of the object while the object is illuminated with the illumination field.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 306,700, filed on February 4, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a lighting system, such as for a camera. Background Art

[0004] Efforts are underway to improve things like lighting systems for cameras. Summary of the invention

[0005] In one example, an imaging system may include a camera having a field of view that includes an object. The camera may define a camera longitudinal axis that extends to the center of the field of view. The imaging system may include an illuminator defining an illuminator longitudinal axis that is substantially parallel to the camera longitudinal axis and laterally offset from the camera longitudinal axis. The illuminator may be configured to illuminate the object with an illumination field. The illumination field may have an illumination field central axis that is angularly offset from the illuminator longitudinal axis by an angle to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angle of the angular offset being at least partially dependent on a measured distance to the object. The camera may be configured to capture an image of the object when the illuminator illuminates the object with the illumination field.

[0006] In one example, a method for capturing an image may include automatically measuring a distance from a housing to an object. The method may include illuminating the object with an illumination field by an illuminator disposed on or in the housing. The illuminator may define an illuminator longitudinal axis. The method may include capturing an image of the object with a camera disposed on or in the housing while the illuminator illuminates the object with the illumination field. The camera may have a field of view that includes the object. The camera may define a camera longitudinal axis that extends to a center of the field of view. The camera longitudinal axis may be parallel to the illuminator longitudinal axis and may be laterally offset from the camera longitudinal axis. The illumination field may have an illumination field central axis that is angularly offset from the illuminator longitudinal axis by an angle to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angular offset angle at least partially depending on the measured distance to the object.

[0007] In one example, an imaging system may include a housing defining a plane. The imaging system may include a camera disposed in or on the housing. The camera may have a field of view that includes an object. The camera may define a camera longitudinal axis extending to the center of the field of view. The camera longitudinal axis may be orthogonal to the plane. The imaging system may include a light emitting diode (LED) array disposed in the housing and substantially parallel to the plane. The LED array may be configured to emit light. The imaging system may include an illuminator lens configured to at least partially focus the emitted light to form an illumination field and direct the illumination field toward the object. The illuminator may define an illuminator longitudinal axis extending from the center of the LED array through the center of the lens. The illuminator longitudinal axis may be orthogonal to the plane and laterally offset from the camera longitudinal axis. The imaging system may include a controller configured to determine a lateral offset depending on the measured distance to the object. The controller may be configured to cause the LED array to be powered in a specified pattern that is laterally offset across the LED array by a determined lateral offset to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 A side view of an example of an imaging system according to some examples is shown.

[0009] Figure 2 A flow chart of an example of a method for capturing an image according to some examples is shown.

[0010] Throughout the several views, corresponding reference numerals indicate corresponding parts. The elements in the drawings are not necessarily drawn to scale. The configurations shown in the drawings are merely examples and should not be construed as limiting in any way. DETAILED DESCRIPTION

[0011] Some lighting systems, such as for camera flashes or for vehicle headlights, can vary the illuminance across a lighting field. For example, a camera flash can direct more light to objects in a scene that are relatively far from the camera, and less light to objects in the scene that are relatively close to the camera, so that both distant and near objects can have appropriate illumination for a captured image of the scene. As another example, vehicle headlights can dim a portion of an angled lighting field to avoid dazzling drivers of oncoming vehicles. Other suitable examples and applications can also be used.

[0012] In some examples of lighting systems that can vary the illuminance over a lighting field, a lens can collimate (or at least partially focus) light from a light emitting diode (LED) array (e.g., a segmented LED having individually addressable segments that can be powered independently of other segments). For purposes of this document, the terms "LED array" and "segmented LED" are interchangeable, and the terms "LED" and "LED segment" are interchangeable.

[0013] The lens can direct light toward the scene so that a specific location on the LED array can be directed toward the scene at a specific angle. By changing the electrical power sent to the LEDs of the LED array, the lighting system can dynamically adjust the illumination on the lighting field. For the illumination of a specific scene, light propagating in a specific direction can correspond to a specific location in the scene. In other words, in order to dynamically adjust the illumination intensity of a location within the scene, the lighting system can dynamically adjust the electrical power sent to each LED in the LED array.

[0014] Many camera-based illumination systems are aligned so that the longitudinal axis of the camera and the longitudinal axis of the illumination system are parallel, or nearly parallel, within typical manufacturing and alignment tolerances. For example, for a smartphone camera system, the longitudinal axis of the camera and the longitudinal axis of the illumination system may be laterally offset from each other by about 2 mm, about 3 mm, about 4 mm, about 5 mm, about 6 mm, about 8 mm, about 10 mm, or another suitable value. This lateral offset between the camera and the illumination system may produce a corresponding lateral offset between the camera's field of view and the illumination field of the illuminator. This lateral offset is referred to as "parallax."

[0015] When capturing images of relatively distant objects (e.g., objects separated from the camera by a distance that is significantly greater than the lateral offset between the longitudinal axis of the camera and the longitudinal axis of the illumination system), parallax is relatively insignificant. For relatively distant objects, such as objects separated from the camera by more than 100 mm, more than 200 mm, more than 300 mm, more than 400 mm, more than 500 mm, more than 1 m, or more than another suitable value, a lateral offset of a few millimeters between the camera field of view and the illumination field may be neglected because the lateral offset is very small compared to the size of the illumination beam at the distant object.

[0016] Parallax can create undesirable effects when capturing images of relatively close objects (e.g., objects separated from the camera by a distance that is less than about ten times the lateral offset between the longitudinal axis of the camera and the longitudinal axis of the illumination system). For relatively close objects, such as objects separated from the camera by less than 100 mm, less than 200 mm, less than 300 mm, less than 400 mm, less than 500 mm, less than 1 m, or less than another suitable value, a lateral offset of a few millimeters between the camera field of view and the illumination field can create problems in the illumination of the objects. For example, parallax can cause a relatively close object to receive excessive illumination on one edge of the object and insufficient illumination on an opposite edge of the object.

[0017] In order to at least partially compensate for parallax in an imaging system (such as between a camera and a corresponding lighting system), the imaging system can measure the distance to an object in the field of view of the camera and can cause the lighting system to angularly redirect a specified lighting pattern at an angle that depends on the measured distance.

[0018] Figure 1 A side view of an example of an imaging system 100 is shown, according to some examples.

[0019] Camera 102 may have a field of view 106 that includes object 104. Figure 1 1 , object 104 is shown as a happy cat; other suitable objects may also be used. Camera 102 may define a camera longitudinal axis 108 extending to the center of field of view 106.

[0020] The illuminator 110 may define an illuminator longitudinal axis 112 that is substantially parallel to the camera longitudinal axis 108 and laterally offset from the camera longitudinal axis 108. The illuminator 110 may illuminate the object 104 with an illumination field 114. The illumination field 114 may have an illumination field central axis 116 that is angularly offset from the illuminator longitudinal axis 112 by an angle that depends at least in part on a measured distance (Z) to the object 104 to at least partially compensate for parallax caused by a lateral offset (X) between the illuminator longitudinal axis 112 and the camera longitudinal axis 108. In some examples, the illumination field central axis 116 may extend from a center of the illuminator lens 118 to a peak illumination in the illumination field 114. The camera 102 may capture an image of the object 104 when the illuminator 110 illuminates the object 104 with the illumination field 114.

[0021] In some examples, the illuminator 110 may include an illuminator lens 118 and a light emitting diode (LED) array 120 arranged at or near a focal plane of the illuminator lens 118. An arrangement at the focal plane may result in minimal angular expansion of the illumination field 114 in the far field (e.g., far enough from the illuminator 110 that the size of the illumination field 114 grows with distance from the illuminator 110), but may allow defects or dark areas in the LED array 120 to be clearly visible in the illumination field 114. An arrangement close to the focal plane may still allow a relatively small angular expansion of the illumination field 114 in the far field, but may produce a small amount of blur (in angular space) such that defects or dark areas in the LED array 120 may be blurred out in the illumination field 114. The illuminator longitudinal axis 112 may extend from the center of the LED array 120 through the center of the illuminator lens 118. The LED array 120 may emit light 122 through the illuminator lens 118 to form the illumination field 114. Because the LED array 120 can be disposed at or near the focal plane of the illuminator lens 118, the illuminator lens 118 can collimate, substantially collimate, or at least partially focus the light 122 emitted from the LED array 120. For such collimated or nearly collimated light, features in translational space on the LED array 120 can correspond to features in angular space in the illumination field 114. For example, bright and dark regions of the LED array 120 can correspond to bright and dark regions in angular space produced by the illuminator 110. For an object 104 that is relatively far from the imaging system 100, the bright and dark regions in angular space can correspond to bright and dark regions in an illumination pattern projected onto the object 104 by the imaging system 100, as compared to the distance and size of elements in the imaging system 100. For an object 104 that is relatively proximate to the imaging system 100, the imaging system 100 can angularly redirect the illumination pattern toward the object 104 to at least partially compensate for parallax caused by a lateral offset (X) between the illuminator longitudinal axis 112 and the camera longitudinal axis 108, as compared to the distance and size of elements in the imaging system 100. The angular redirection can pivot the illuminator field of view from a first position 124, where the illuminator field of view is centered about the illuminator longitudinal axis 112, to a second position 126, where the illuminator field of view is centered about an illumination field central axis 116 that is angularly offset from the illuminator longitudinal axis 112 by an angle that depends at least in part on the measured distance (Z) to the object 104. It should be noted that, optionally, the angular redirection or pivoting may be less than the angular range of the lighting field 114 so that the redirection transforms the characteristics of the lighting field 114 within the full angular range of the lighting field 114, rather than angularly transforming it to an angle outside the full angular range of the lighting field 114.

[0022] In some examples, the illuminator 110 may include a controller 128. The controller 128 may cause the LED array 120 to be powered so that a specified illumination pattern on the LED array 120 is laterally offset on the LED array 120 by an offset to at least partially compensate for parallax, the offset being at least partially dependent on the measured distance (Z) to the object 104. In some examples, the controller 128 may calculate the offset as an offset angle multiplied by a focal length of the illuminator lens 118. In some examples, the controller 128 may calculate the offset angle as an inverse tangent of a ratio, the ratio being a lateral offset (X) between the illuminator longitudinal axis 112 and the camera longitudinal axis 108 divided by the measured distance (Z) to the object 104. In some examples, the controller 128 may calculate the offset for each image captured by the imaging system 100, such that the offset may include a value selected from a continuous (e.g., infinite) range of values. In other examples, the controller 128 may round the offset and select the offset from one of a specified (e.g., finite) range of values. For example, the controller 128 may determine the offset by selecting one of a plurality of predetermined offsets. Other configurations may also be used. For angular offsets implemented in software (e.g., by transforming a specified lighting pattern on the LED array 120), the pattern may be transformed by an amount that includes a portion of the pixels on the LED array 120. In some examples, the specified lighting pattern may additionally be stretched or compressed in the lateral direction accompanying the lateral transformation.

[0023] As an alternative to transforming a specified illumination pattern on the LED array 120, the imaging system 100 can mechanically translate and / or tilt the LED array 120 and / or the illuminator lens 118 to angularly redirect the illumination field 114. For example, the actuator 130 can translate and / or tilt the illuminator lens 118, the LED array 120, or both the illuminator lens 118 and the LED array 120. The translation can be performed in a direction orthogonal or substantially orthogonal to the illuminator longitudinal axis 112. The controller 128 can cause the actuator 130 to translate the illuminator lens 118, the LED array 120, or both the illuminator lens 118 and the LED array 120 by an offset that depends at least in part on the measured distance (Z) to the object 104. In some examples, the controller 128 can calculate the offset as the offset angle multiplied by the focal length of the illuminator lens 118. In some examples, controller 128 can calculate the offset angle as the arc tangent of a ratio that is the lateral offset between illuminator longitudinal axis 112 and camera longitudinal axis 108 divided by the measured distance (Z) to object 104. In some examples, controller 128 can determine the offset as one of a plurality of predetermined offsets. In some examples, in addition to changing a specified lighting pattern on LED array 120, actuator 130 can also be used.

[0024] To determine the measured distance (Z) to the object 104, the imaging system 100 may include a distance sensor 132 that may dynamically measure the distance. The distance sensor 132 may include an electrical connection to the controller 128, through which the distance sensor 132 may transmit data 134 representing the measured distance (Z) to the controller 128. In some examples, the distance sensor 132 may measure the time of flight between the distance sensor 132 and the object 104, such as by emitting a light pulse from a housing and measuring the time for the reflected light to return to the housing or other LIDAR-based techniques to determine the measured distance (Z) to the object 104. In some examples, the distance sensor 132 may form a depth map that includes the object 104 to determine the measured distance (Z) to the object 104.

[0025] As an alternative to or in addition to the distance sensor 132, the camera 102 may include an autofocus mechanism that can determine the measured distance (Z) to the object 104. For example, the lens 136 in the camera 102 can focus the light 138 reflected from the object 104 onto the multi-pixel sensor 140. The controller 128 or another suitable controller can measure the sharpness of the image of the object 104 at the multi-pixel sensor 140 to determine the measured distance (Z) to the object 104. Note that for an autofocus mechanism that relies on sharpness, the distance (Z) can be calculated by the controller 128 or another suitable controller; because the distance (Z) is obtained from the measured value, for purposes of this document, the distance (Z) is referred to as the measured distance (Z). Other suitable autofocus mechanisms can also be used.

[0026] In some examples, camera 102 and illuminator 110 can be arranged on or in housing 142. In some examples, housing 142 can be a smart phone, laptop computer, or other suitable user device. In some examples, housing 142 can define a plane. In some examples, illuminator longitudinal axis 112 and camera longitudinal axis 108 can be substantially orthogonal to the plane.

[0027] Figure 2 A flowchart of an example of a method 200 for capturing an image according to some examples is shown. The method 200 may be performed by the imaging system 100 or another imaging system. The method 200 for capturing an image is only one method for capturing an image, and other suitable methods may also be used.

[0028] At operation 202, a system such as imaging system 100 may automatically measure the distance from a housing such as housing 142 to an object such as object 104. The system may perform the measurement using dedicated hardware such as distance sensor 132 or by using an autofocus mechanism in a camera such as camera 102.

[0029] At operation 204 , a luminaire disposed on or in the housing, such as luminaire 110 , may illuminate the subject with an illumination field, such as illumination field 114 . The luminaire may define a luminaire longitudinal axis, such as luminaire longitudinal axis 112 .

[0030] At operation 206, a camera (such as camera 102) disposed on or in the housing may capture an image of the object while the illuminator illuminates the object with the illumination field. The camera may have a field of view (such as field of view 106) that includes the object. The camera may define a camera longitudinal axis (such as camera longitudinal axis 108) that extends to the center of the field of view. The camera longitudinal axis may be parallel to the illuminator longitudinal axis and may be laterally offset from the camera longitudinal axis. The illumination field may have an illumination field central axis, such as illumination field central axis 116, that is angularly offset from the illuminator longitudinal axis by an angle to at least partially compensate for parallax caused by the lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angularly offset angle being at least partially dependent on the measured distance to the object.

[0031] In some examples, the illuminator may include an illuminator lens (e.g., illuminator lens 118) and an LED array (e.g., LED array 120) disposed at or near a focal plane of the illuminator lens. The illuminator longitudinal axis may extend from a center of the LED array through a center of the illuminator lens. The LED array may emit light through the illuminator lens to form an illumination field.

[0032] In some examples, method 200 may optionally further include powering the LED array such that a specified illumination pattern on the LED array is laterally offset on the LED array by an offset to at least partially compensate for parallax, the offset being at least partially dependent on the measured distance to the object.

[0033] Although only certain features of the system and method are shown and described herein, many modifications and variations will occur to those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and variations. The method operations may be performed substantially simultaneously or in different orders.

Claims

1. An imaging system, comprising: a camera having a field of view including the object, the camera defining a camera longitudinal axis extending to a center of the field of view; as well as an illuminator defining an illuminator longitudinal axis, the illuminator longitudinal axis being substantially parallel to the camera longitudinal axis and laterally offset from the camera longitudinal axis, the illuminator being configured to illuminate the object with an illumination field having an illumination field central axis, the illumination field central axis being angularly offset from the illuminator longitudinal axis by an angle to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angular offset being at least partially dependent on a measured distance to the object, The camera is configured to capture an image of the object when the illuminator illuminates the object with the illumination field.

2. The imaging system according to claim 1, wherein: The illuminator includes an illuminator lens and a light emitting diode (LED) array arranged at or near a focal plane of the illuminator lens, wherein the illuminator longitudinal axis extends from a center of the LED array through a center of the illuminator lens, and the LED array is configured to emit light through the illuminator lens to form the illumination field.

3. The imaging system of claim 2, further comprising: A controller is configured to cause the LED array to be powered so that a designated illumination pattern on the LED array is laterally shifted on the LED array by an offset to at least partially compensate for the parallax, the offset amount being at least partially dependent on the measured distance to the object.

4. The imaging system according to claim 3, wherein: The controller is configured to calculate the offset as an offset angle multiplied by a focal length of the illuminator lens.

5. The imaging system according to claim 4, wherein: The controller is configured to calculate the offset angle as an inverse tangent of a ratio, wherein the ratio is a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis divided by the measured distance to the object.

6. The imaging system according to claim 4, wherein: The controller is configured to determine the offset by selecting one of a plurality of predetermined offsets.

7. The imaging system of claim 2, further comprising: an actuator configured to translate the illuminator lens; as well as A controller is configured to cause the actuator to translate the illuminator lens by an offset that depends at least in part on the measured distance to the object.

8. The imaging system according to claim 7, wherein: The controller is configured to calculate the offset as an offset angle multiplied by a focal length of the illuminator lens.

9. The imaging system of claim 8, wherein: The controller is configured to calculate the offset angle as an inverse tangent of a ratio, wherein the ratio is a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis divided by the measured distance to the object.

10. The imaging system according to claim 8, wherein: The controller is configured to determine the offset as one of a plurality of predetermined offsets.

11. The imaging system of claim 1 , further comprising: A distance sensor is configured to measure a time of flight between the distance sensor and the object to determine a measured distance to the object.

12. The imaging system of claim 1 , further comprising: A distance sensor is configured to form a depth map including the object to determine the measured distance to the object.

13. The imaging system of claim 1, wherein: The camera includes an autofocus mechanism configured to determine the measured distance to the object.

14. The imaging system of claim 1, wherein: The camera and the illuminator are arranged on or in the housing; The housing defines a plane; and The illuminator longitudinal axis and the camera longitudinal axis are substantially orthogonal to the plane.

15. A method for capturing an image, the method comprising: Automatically measure the distance from the housing to the object; illuminating the object with an illumination field by a luminaire disposed on or in the housing, the luminaire defining a luminaire longitudinal axis; capturing an image of the object with a camera disposed on or within the housing while the illuminator illuminates the object with the illumination field, the camera having a field of view that includes the object, the camera defining a camera longitudinal axis extending to a center of the field of view, the camera longitudinal axis being parallel to the illuminator longitudinal axis and laterally offset from the camera longitudinal axis, The illumination field has an illumination field central axis which is angularly offset from the illuminator longitudinal axis by an angle so as to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis, the angle of the angular offset being at least partially dependent on the measured distance to the object.

16. The method according to claim 15, wherein: The illuminator comprises an illuminator lens and a light emitting diode (LED) array disposed at or near a focal plane of the illuminator lens, the illuminator longitudinal axis extending from a center of the LED array through a center of the illuminator lens, the method further comprising: Light is emitted by the LED array through the illuminator lens to form the illumination field.

17. The method according to claim 16, further comprising: The LED array is powered such that a designated illumination pattern on the LED array is shifted laterally on the LED array by an offset amount to at least partially compensate for the parallax, the offset amount being at least partially dependent on the measured distance to the object.

18. An imaging system comprising: a housing defining a plane; a camera disposed in or on the housing, the camera having a field of view that includes the object, the camera defining a camera longitudinal axis extending to a center of the field of view, the camera longitudinal axis being orthogonal to the plane; a light emitting diode (LED) array disposed in the housing and substantially parallel to the plane, the LED array being configured to emit light; an illuminator lens configured to at least partially focus the emitted light to form an illumination field and direct the illumination field toward the subject, the illuminator defining an illuminator longitudinal axis extending from a center of the LED array through a center of the lens, the illuminator longitudinal axis being orthogonal to the plane and laterally offset from the camera longitudinal axis; A controller, wherein the controller is configured as: determining a lateral offset dependent on the measured distance to the object; as well as The LED array is powered in a specified pattern that is laterally offset on the LED array by a determined lateral offset to at least partially compensate for parallax caused by a lateral offset between the illuminator longitudinal axis and the camera longitudinal axis.

19. The imaging system of claim 18, further comprising: A distance sensor is configured to measure a time of flight between the distance sensor and the object to determine a measured distance to the object.

20. The imaging system of claim 18, wherein: The camera includes an autofocus mechanism configured to determine the measured distance to the object.