Detection system with a single-mode laser for a vehicle

Abstract

Detection system for a vehicle, comprising: an imaging device configured to capture an image of an interior surface of the vehicle; a lighting arrangement comprising: an array of laser diodes each configured to project illumination, each laser diode being configured as at least one of a single-mode laser and a surface-emitting laser (“VCSEL”); an optical element near the array of laser diodes and having a collimating element for directing the illumination to form at least one light spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit a signal for operating the array of laser diodes, process the image of the inner surface to detect at least one of a change in a position and a speckle content of the at least one spot.

Description

AREA OF REVELATION

[0001] The present disclosure relates generally to a sensing system having an array of lasers for monitoring an interior of a vehicle, and more particularly to a structured light device using an array of single-mode lasers for monitoring an interior of a vehicle. SUMMARY OF REVELATION

[0002] According to one aspect of the present disclosure, a sensing system for a vehicle includes an imaging device configured to capture an image of an interior surface of the vehicle. An illumination assembly includes an array of laser diodes each configured to project illumination, each laser diode configured as at least one of a single-mode laser and a vertical cavity surface-emitting laser ("VCSEL"). An optical element is disposed proximate the array of laser diodes and includes a collimating element for directing the illumination to form at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the array of laser diodes and to process the image of the inner surface to detect at least one of a change in a position and a speckle content of the at least one point.

[0003] According to another aspect of the present disclosure, a capture system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view with a dot array pattern. The illumination assembly includes a plurality of vertical cavity surface-emitting laser diodes ("VCSELs") arranged in a laser diode array and configured to project a plurality of illuminations. An optical element is configured to collimate the plurality of illuminations into at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the laser diode array, process the image of the interior to determine a position of the at least one point in the point array pattern, and extract a depth of the surface based on the position of the at least one point.

[0004] According to yet another aspect of the present disclosure, a capture system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view with a dot array pattern. The illumination assembly includes a plurality of single-mode lasers arranged in a laser diode array and configured to project a plurality of illuminations. An optical element is configured to collimate the plurality of illuminations into at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the laser diode array, process the image of the interior to detect a change in a speckle content of the at least one dot in the dot array pattern, and detect a condition in the interior based on the detected change in speckle content.

[0005] These and other features, advantages, and purposes of the present disclosure will be further understood and appreciated by those skilled in the art with reference to the following description, claims, and accompanying drawings. SHORT DESCRIPTION OF THE DRAWING

[0006] In the drawings: Fig. 1, according to one aspect of the present disclosure, is a side elevation view of a portion of a vehicle including a sensing system; Fig. 2, according to one aspect of the present disclosure, is an exemplary image captured by an imaging device showing a dot array pattern projected by an illumination assembly of the sensing system onto an occupant of a vehicle; Fig. 3, according to one aspect of the present disclosure, an image captured by an imaging device of the sensing system illustrating a single point of light of a point array pattern projected onto a surface in a cabin of a vehicle; Fig. 4, according to one aspect of the present disclosure, an image of the light spot captured by the imaging device after a micro-movement of the Fig. 3 shown surface; Fig. 5 is a side cross-sectional elevation view of a lighting assembly according to one aspect of the present disclosure; and Fig. 6 is a block diagram of a detection system according to one aspect of the present disclosure.

[0007] The components in the figures are not necessarily to scale; rather, the emphasis is on illustrating the principles described herein. DETAILED DESCRIPTION

[0008] The presently illustrated embodiments are essentially combinations of device components relating to a detection system for a vehicle.

[0009] For the purpose of description, the terms “upper,” “lower,” “right,” “left,” “rear,” “front,” “vertical,” “horizontal,” and derivatives thereof herein refer to the disclosure as set forth in Fig. 1. Unless otherwise indicated, the term "front" shall refer to the surface of the element that is closer to an intended viewer of the mirror element, and the term "rear" shall refer to the surface of the element that is farther from the intended viewer of the mirror element. It is to be understood, however, that the disclosure may assume various alternative orientations unless expressly stated otherwise. It is also to be understood that the specific devices illustrated in the accompanying drawings and described in the following description are merely exemplary embodiments of the inventive concepts defined in the appended claims.Therefore, specific dimensions and other physical characteristics associated with the embodiments disclosed herein should not be considered limiting unless the claims expressly state otherwise.

[0010] The terms "including," "comprises," "comprising," or any other variations thereof, are intended to be non-exclusive in that an article or device comprising a list of elements is not necessarily limited to those elements, but may also include other elements not expressly listed or that are inherent in such an article or device. An element preceded by "comprises a..." does not preclude, without further limitation, the existence of additional identical elements in the article or device comprising the element.

[0011] The term "substantially" and variations thereof are understood by those skilled in the art to describe a characteristic that is equal to or approximately equal to a value or description. For example, a "substantially flat" surface is intended to mean a surface that is flat or approximately flat. Furthermore, "substantially" is intended to mean that two values ​​are equal or approximately equal. In uses of the term that are not clear to those of ordinary skill in the art, "substantially" can mean values ​​within about 10% of each other, such as within 5% of each other, or within about 2% of each other, depending on the context in which it is used.

[0012] The term "approximately," the expression "approximately equal to," and other similar expressions as used in the specification and claims (e.g., "X has a value approximately equal to Y" or "X is approximately equal to Y") are to be understood to mean that one value (X) is within a predetermined range of another value (Y). The predetermined range may be plus or minus 20%; 10%; 5%; 3%; 1%; 0.1%; or less than 0.1%, unless otherwise specified.

[0013] With reference to Fig. 1-6, reference numeral 10 generally designates a detection system 10 for a vehicle 12. The detection system 10 includes an imaging device 14 configured to generate an image 16 ( Fig. 2-4) of an interior 18 of the vehicle 12. An illumination assembly 20 is configured to illuminate the interior 18 with a light pattern 22 structured with a point array. The illumination assembly 20 includes an array 24 of laser diodes 26, each configured to project an illumination 28 (e.g., at least one beam 36). The illumination assembly 20 further includes an optical element 30 (i.e., a lens) proximate the array 24. The optical element 30 includes a collimating element 32 and a diffractive element 34 for directing the illumination 28 to at least one light spot 56. A processor 38 (e.g., one or more processors) is in communication with the imaging device 14 and the illumination assembly 20. The processor 38 is configured to transmit a signal to operate the array 24 of laser diodes 26.The processor 38 is further configured to process the image 16 of the interior 18 to detect a change in at least one of a light distribution 40 (i.e., the positioning of at least one point 56) and a speckle content of the at least one light point 56. The processor 38 is further configured to determine the presence of an occupant in the interior 18 based on the change in at least one of the light distribution 40 and the speckle content.

[0014] Now referring to Fig. 1, the lighting assembly 20 and the imaging device 14 are arranged in the interior 18 of the vehicle. In particular, the imaging device 14 and the lighting assembly 20 may be coupled to a rearview assembly, such as a rearview mirror assembly 42, that includes an electro-optical device (not shown). For example, the electro-optical device may be a single-layer component, a single-phase component, a multi-layer component, and / or a multi-phase component switchable between a partially transmissive state and a partially reflective state. In other examples, the imaging device 14 and the lighting assembly 20 are coupled to an instrument panel 44 of the vehicle 12, an overhead console 46 of the vehicle 12, or another part of the vehicle 12. The imaging device 14 may be packaged with the lighting assembly 20 (i.e.adjacent in a static relationship). The imaging device 14 is positioned to produce images 16 (. Fig. 2-4) of the interior 18 of the vehicle 12. The laser diodes 26 may be designed as one or more single-mode lasers, for example one or more surface-emitting lasers 68 (“VCSELs”), as shown in Fig. 5. However, it should be understood that other types of light sources, such as other types of single-mode lasers, a photonic crystal surface emitting laser ("PCSEL") as an example, may also be used. The illumination 28 of the laser diodes 26 may be within a wavelength spectrum, such as the infrared (IR) spectrum. Accordingly, in some examples, the imaging device 14 is a camera operable within the IR spectrum (or other spectra corresponding to the illumination 28) to enable the dot array pattern 22 to be captured. The imaging device 14 may be a stereoscopic imager, a light detector, a camera, and / or the like. In general, the imaging device 14 may have a field of view 48 covering either a front portion 50 and / or a rear portion 52 of the interior space 18.In this way, an imaging device 14 of the present disclosure may be configured to capture images 16 of at least one surface 54a-54f within the interior 18, such as a seating surface 54a, a floor surface 54b, a trim surface 54c, or the like. In some examples, the surface 54a-54f within the interior 18 corresponds to an occupant of the vehicle 12, such as a surface of a covering 54d (e.g., clothing or a blanket), a body surface 54e, a car seat surface 54f, and / or the like.

[0015] With reference now to Fig. 1 and Fig. 2, the imaging device 14 is configured to capture images 16 of the dot array pattern 22 that are projected into the interior 18 of the vehicle 12. The dot array pattern 22 may, for example, include a plurality of light points 56, and each light point 56 may define a variety of shapes, such as circles, dots, line segments, or other geometric shapes, projected into the dot array pattern 22. Each point 56 may have an intensity, luminescence, and / or the like. The distribution of the light points 56 in the dot array pattern 22 may be uniform (e.g., rows and columns, concentric shapes, and / or the like) or non-uniform, e.g., pseudorandom. The dot array pattern 22 corresponds to the surface 54a-54f in the interior space 18, where the light spots 56 are reflected back from the surface 54a-54f and captured by the imaging device 14. In some embodiments, the light sources (e.g.,The laser diodes 26 are distributed in an array, for example, an array with a rectangular perimeter defined by rows and columns of light sources. In other embodiments, the array of light sources may be distributed in other uniform or irregular patterns.

[0016] Regardless of the shape and distribution of the light spots 56, if the surface 54a-54f reflects the movements of the light spots 56, the light spots 56 also move, and this movement is detected by the imaging device 14. In a first mode of operation, the processor 38 may process the images 16 acquired by the imaging device 14 and extrapolate the movement of light spots 56 into a depth of the surface 54a-54f based on the principles of triangulation and known geometries between the imaging device 14, the illumination assembly 20, and the distribution of the light spot array 22. The processor 38 may, for example, be configured to determine movement based on an outer perimeter or centroid of each light spot 56. In the first mode of operation, the imaging device 14 and the illumination assembly 20 may be closely and rigidly mounted on a common optical bench structure (e.g.,in the rearview mirror or at another common location), and, based on the known distance between the imaging device 14 and the illumination assembly 20 (e.g., the laser diodes 26) and the distribution of the light spot array 22, the position of the reflected light spot 56 can be detected along an epipolar line, which in turn can be triangulated to extract a depth of the surface 54a-54f. The depth of the surface 54a-54f at each light spot 56 can then be used to extrapolate a contour of the surface 54a-54f. Likewise, depth changes can be used to extrapolate the current position of the surface 54a-54f and the movement of the surface 54a-54f as a function of time.

[0017] In the illustrated example of Fig. 1 and Fig. 2, the light spots 56 cover a rear seating structure of the vehicle 12 and may reflect off the body surface 54e of a child, the car seat bottom 54f in which the child is seated, the surface of a covering 54d (e.g., clothing), and the seat surface 54a. Thus, these particular light spots 56 may be segmented into a closer portion or a farther portion of the imaging device 14 and / or the illumination assembly 20 based on the first operating mode. Due to this varying depth, the light spots 56 move within the dot array pattern 22 to conform to the surface 54, which in turn is captured as movement along epipolar lines of the image 16. The processor 38 detects the position of the plurality of light spots 56 and extrapolates the current position of the various surfaces 54a, 54e, and 54f to monitor various conditions within the vehicle 12.For example, the presence and shape (or change in shape as a function of time) of the body surface 54e or the surface of an overlay 54d relative to the dot array pattern 22. It is contemplated that the processor 38 may include one or more occupancy detection algorithms, object detection algorithms, or the like to distinguish the identity of various objects believed to be within the interior space 18. In this manner, in the first mode of operation, a spatial map of the interior space 18 may be used to identify the presence, three-dimensional ("3D") positioning, and 3D shape of the object, such as the occupant. It is contemplated that the method illustrated in . Fig. 2 visibly depicts the dot array pattern 22, but as previously described, the illumination 28 may be within a visible or non-visible wavelength spectrum, such as the IR spectrum. If the illumination is within the IR spectrum, the image 16 illustrates the image that can be captured by an imaging device (e.g., an IR imager).

[0018] A speckle content of each reflected light point 56 can, now with reference to the Fig. 3 and Fig. 4, in a second mode of operation, to detect changes in the internal intensity distribution of the surface 54a-54f according to the principles of speckle interferometry, such as tilts or other movements on a microscale (e.g., a micrometer or microradian scale). For example, if a surface 54a-54f has roughness, microradial changes in the tilt influence the reflection of the light spot 56 and thus also the speckle content. The imaging device 14 and the illumination assembly 20 may be spaced apart from each other according to the second mode of operation. The illumination assembly 20 and the imaging device 14 may, for example, be located at different positions around the interior space 18. However, it is understood that a single imaging device 14 may be packaged with the illumination assembly 20 and used for both the first and second modes of operation.The illumination 28 according to the second operating mode may be in a non-visible wavelength spectrum, e.g., the IR spectrum. Thus, a single illumination arrangement 20 may be configured to project illumination within a spectrum that is detectable in both the first and second operating modes.

[0019] With continued reference to Fig. 3 and Fig. 4, micro-scale detection can be used to monitor a physiological condition of an occupant, which can be difficult in the first mode of operation. For example, various vital parameters of the occupant can be monitored by detecting micro-movement of the occupant (e.g., the body surface 54e), the surface of a covering 54d, and the car seat surface 54f. In this way, even if the light spots 56 are not directly reflected from the body surface 54e, micro-scale movements of the occupant are transmitted to surfaces 54a-54f surrounding the occupant (e.g., the surface of the covering 54d and the surface of the car seat 54f), which can be detected, enabling occupant monitoring without a direct line of sight to the occupant's body. This can be particularly advantageous in cases where a child is in a rear-facing child seat and / or covered with a blanket.In particular, the speckle content of each light spot 56 is captured by the imaging device 14 in the image data 60. In particular, FIG. Fig. 3 image data 60 of one of the reflected light spots 56 projected onto a surface 54, and Fig. Fig. 4 shows image data 60 of the reflected light spot 56 after the surface 54a-54f has changed its position. It is intended that a time period between the Fig. 3 and Fig. 4 is within one second, one millisecond, one microsecond, or any time interval that allows for the detection of small positional changes (e.g., on a microscale) of the surface 54a-54f. The speckle content in the image data 60 comprises a pixel array 62 with corresponding values ​​associated with each pixel. For example, the pixel array 62 may include pixel data that includes at least one value corresponding to a grayscale intensity value that corresponds to the strength of the light reflected toward the imaging device 14. Generally, under constant illumination conditions and without changes in the position of the surface 54, the intensity values ​​or the pixel values ​​for each of the pixels in the pixel array 62 remain relatively constant or within a threshold range / profile of grayscale intensity.For example, because the imaging device 16 may be configured to capture changes in position at a microscale, some degree of "noise" may be present in the image data 60, thereby affecting the pixel values. The processor 38 of the present disclosure may be configured to distinguish between the noise and the actual movement of the object within the interior 18 of the vehicle 12. In some embodiments, for example, the processor 38 may be configured to determine a base amount (e.g., engine vibration, road conditions, or other external factors affecting the relative movement between the lighting assembly 20, the imaging device 14, and the surface 54). This base amount may be determined by comparing and / or profiling changes in the position of light spots 56 (i.e., in the first mode of operation) or changes in the speckle content of a light spot 56 (i.e.,in the second operating mode).

[0020] With continued reference to the Fig. 3 and Fig. 4, the pixel array 62 may include a first portion 64 corresponding to an area surrounding the light spot 56, and a second portion 66 corresponding to the light spot 56. The second portion 66 may approximate the shape of the light spot 56, which in this case has a circular Gaussian shape within the second portion 66. Minor changes other than noise are detected by the processor 38. For example, the minor change or modification of pixel values ​​resulting from position changes (e.g., on the micrometer scale) of the surface 54a-54f (e.g., Fig. 3 and Fig. 4) correspond to a redistribution of the black or dark pixels.

[0021] As previously explained, the slight changes in position of surface 54a-54f may correspond to vital signs of an occupant. These vital signs may include the presence, rate, and amplitude of respiration and / or other vital signs or physiological conditions of the occupant within the vehicle 12. It is contemplated that other small-scale movements toward, away from, or laterally relative to the imaging device 14 and / or the lighting assembly 20 may correspond to sources other than vital signs of an occupant within the vehicle 12, such as simply the presence of the occupant. In general, the processor 38 of the present disclosure may be configured to execute respiration, pulse, or other detection algorithms to determine the presence of an occupant (i.e., a person or animal).As will be described, the processor 38 may communicate with peripheral or remote devices to generate an average regarding the occupancy of the vehicle 12. Although not shown in detail, the processor 38 may evaluate some or all of the plurality of light spots 56 projected by the lighting assembly 20 and combine the image data 60 corresponding to each of the plurality of light spots 56 to further refine the determination of the occupancy of the vehicle 12 and / or the condition of the interior 18. For example, the processor 38 may use one or more statistical modeling techniques to combine or otherwise average the change in pixel values ​​of each light spot 56 to enable discrimination against noise and / or vibrations from the movement of the vehicle 12 due to operational factors (e.g., gear shifting, braking, engine vibrations, road conditions, and / or the like).

[0022] It is also envisaged that the Fig. 3 and Fig. 4 may have a lower or higher resolution than the illustrated resolution. For example, each light spot 56 may include any number of pixels corresponding to the particular point array pattern 22 used and the particular resolution of the imaging device 14. In general, the processor 38 may be configured to apply the principles of speckle interferometry in the second mode of operation and thus evaluate the point array pattern 22 based on changes in the speckle content of each of the plurality of light spots 56. Therefore, the illumination assembly 20, as further described herein, may generate a sharply imaged speckle distribution within the point array pattern 22. The second mode of operation is performed point by point based on the individual reflections of the light spots 56.

[0023] With reference now to Fig. 5, the illumination assembly 20 is shown with the laser diode 26, and the optical element 30 is aligned with the laser diode 26 (e.g., in the rearview mirror of the vehicle). The laser diode 26 may comprise a single laser diode 26 or a plurality of laser diodes 26 (as illustrated in phantom lines) arranged in an array 24. Each laser diode 26 projects an illumination 28 (e.g., a plurality of beams 36). The laser diode 26 may be formed as the VCSEL 68, which is formed with or operatively coupled to a carrier 70, such as a circuit board, and is generally orthogonally aligned relative to the carrier 70. The carrier 70 may also include a driver circuit 71 ( Fig. 6) controlled or regulated by the processor 38 to generate electrical potentials for the VCSELs 68. The VCSELs 68 may be one of a plurality of VCSELs 68 arranged in the array 24 and may include a housing 72 in which the various layers of the VCSELs 68 are disposed. For example, the VCSEL 68 may include a pair of electrodes 74 sandwiching a pair of reflective layers 76. Between the reflective layers 76 is a cavity 78 formed by a pair of oxide layers 80 defining an active region 82 in which the illumination 28 is amplified. The housing 72 defines an opening 84 generally aligned with the optical element 30 to allow the illumination 28 to be emitted from the VCSEL 68. The illumination 28 is then directed through the optical element 30 into one or more of the plurality of light spots 56.In some embodiments, the optical element 30 directs the illumination 28 from each VCSEL 68 (or other light source). In some embodiments, the optical element 30 includes a plurality of optical elements 30 (i.e., an array), each directing the illumination 28 from two or more VCSELs 68 or a single VCSEL 68. In particular, the illumination 28 may be collimated by the collimating element 32, which may narrow the illumination 28 in a particular direction (e.g., generally perpendicular to the diffractive element 34). The diffractive element 34 may direct and replicate the collimated illumination 28 into the array 24. It is understood that the collimating element 32 and the diffractive element 34 may be separate or integrally formed within the one or more optical elements 30 (i.e., lenses).It is contemplated that the above-mentioned structure of laser diode 26 may be one of a variety of arrangements that produce illumination 28. For example, the various layers of VCSEL 68 may include additional or fewer layers than described to produce a laser beam or laser illumination 28 to be directed through optical element 30.

[0024] In general, providing an array 24 of VCSELs 68 (or, for example, other single-mode lasers) as opposed to a single or multiple edge-emitting laser diodes 26 may provide greater reliability and allow a large area in the field of view 48 of the imaging device 14 to be covered by the dot array pattern 22. For example, to improve eye safety, zero-order suppression that may be used in the optical element 30 with respect to the edge distribution may be reduced. In addition, a single-mode configuration for the VCSELs 68 may provide the greater granularity of the pixel data, as discussed above with respect to Fig. 3 and Fig. 4. With further reference to Fig. 5, for example, a width B and / or a depth T of the cavity 78 may be configured to produce a single spatial mode of the illumination 28. For example, a m2- Value for the illumination 28 projected by each of the VCSELs 68 may be approximately one or, in some examples, less than 1.3.

[0025] It is contemplated that the use of a single-mode VCSEL 68 (or, for example, other single-mode lasers, such as a PCSEL) may result in lower power consumption relative to the requirements of a multi-mode illumination source. The lower power consumption may allow for detection areas suitable for the interior 18 of the vehicle 12. In general, the granularity of the light spot 56, in combination with the resolution of the imaging device 14, may enable the processor 38 to detect micro-oscillations associated with one or more vital signs related to the interior 18, as previously described.

[0026] With reference now to Fig.6, the lighting assembly 20, the imaging device 14, and the processor 38 may be included as a single sensing module 88, which may comprise a central location or may have separate components within the vehicle 12. The sensing module 88 may be in communication with a network 90, such as a wireless or wired network operable to communicate using short-wave and / or long-wave communication protocols. The network 90 may use, for example, SMS, Wi-Fi, Ethernet, TCP / IP, 3G, 4G, 5G, or any other communication protocol to transmit instructions or signals between the sensing module 88 and one or more other devices. For example, the network 90 may provide communication between the sensing module 88 and one or more of a human-machine interface (HMI) 92 within the vehicle 12 and a mobile device 94 having an interface.Furthermore, the detection module 88 may have direct communication (e.g., a wired connection within the vehicle 12) with various vehicle systems 96. The detection module 88 may be configured to transmit one or more instructions to the vehicle systems 96, such as a door lock control system 98, a window control system 100, an ignition control system 102, a heating, ventilation, and air conditioning (HVAC) control system 104, or the like, to control the particular vehicle system 96 in response to determining one or more alarm conditions. The one or more alarm conditions may be determined based on an analysis of the image data 60 as previously described. For example, upon detecting an abandoned condition (e.g.,A person or animal trapped within the interior 18 of the vehicle 12 that is otherwise unoccupied may communicate with one of the vehicle systems 96 directly and / or via the network 90 to effect one or more responses. In the described example, in response to the abandoned condition, the door lock control system 98 may unlock the door, transmit a door opening control signal to an actuator associated with the vehicle 12, or the like. Additionally or alternatively, the window control system 100 may, in response to receiving the abandoned condition, control a window activation device to lower or otherwise adjust one or more of the windows in the vehicle 12 between an open position and a closed position.Specifically, in some examples, the window control or regulation system 100 may open at least one window of the vehicle 12 in an abandoned condition. In other examples, the ignition control or regulation system 102 may transmit an instruction to start the engine of the vehicle 12 and to control the HVAC system 104 to deliver hot or cool air to the interior 18 in response to the abandoned condition. In some embodiments, the processor 38, upon detecting the one or more alarm conditions, may be configured to generate a visual and / or audible alarm in the vehicle and / or the mobile device 94.

[0027] In some embodiments, processor 38 may receive instructions from memory 106. Memory 106 may comprise a single hard disk or a plurality of hard disks (e.g., hard disk drives) and includes a memory management module that manages one or more partitions within memory 106. In some embodiments, memory 106 may comprise flash memory, semiconductor (solid-state) memory, or the like. Memory 106 may comprise random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or a combination thereof. Memory 106 may include instructions that, when executed by processor 38, cause processor 38 to perform at least the functions associated with the components of sensing system 10.It is contemplated that other subsystems of the vehicle 12 may be in communication with the sensing module 88 and configured to operate in response to a condition determined by the processor 38 of the present disclosure. For example, speakers or a display within the vehicle 12 may be used to generate an alarm.

[0028] Additionally, an alarm signal or other notification may be transmitted to the mobile device 94 and / or the HMI 92 in response to detecting an alarm condition. Although described with respect to the abandoned condition, it is contemplated that other conditions may be determined based on the analysis of the image data 60 and the detection of micro-vibrations of the vehicle 12. For example, the present sensing module 88 may function as an optical microphone and utilize the processor 38 to analyze an occupant's mouth area. Patterns associated with speech, volume, or intensity of an audible signal may be applied to image / video data and analyzed by the processor 38 to determine an occupant distress condition within the cabin 18. In some embodiments, the sensing module 88 may include a temperature module 95 for detecting a current temperature within the vehicle.In this way, when an abandoned condition is detected, the processor 38 may receive the current temperature from the temperature module 95 to determine whether the current temperature is within a threshold (e.g., too hot or too cold) that requires intervention via the vehicle systems 96 (e.g., lowering a window, heating, or cooling).

[0029] In some embodiments, the processor 38 may be configured to generate a notification before a transmission of the vehicle 12 is placed in a drive mode or after the transmission of a vehicle is placed in a park mode. In some embodiments, the processor 38 may be configured to generate a notification (e.g., to the mobile device 94 or a display in the vehicle 12) when an occupant is detected in the interior 18 (e.g., the rear portion 52) and a driver is not detected for a predetermined period of time. In some embodiments, the processor 38 may be configured to generate a notification (e.g., to the mobile device 94 or a display in the vehicle 12) when an occupant is detected in the interior 18 (e.g., the rear portion 52) and the vehicle has reached a destination.For example, if a vehicle reaches a destination but a door providing access to the interior 18 has not been opened for a predetermined period of time, the processor 38 may be configured to generate the notification. In some embodiments, the processor 38 may be configured to use the first mode of operation to detect an occupant. If an occupant is not detected by the first mode of operation, the processor 38 may be further configured to use the second mode of operation. In general, under the principles of the first and / or second modes of operation, the processor 38 may be configured to generate a notification corresponding to detecting an occupant, not detecting an occupant, no longer detecting an occupant that was previously detected, and other scenarios.

[0030] Incorporating single-mode VCSELs 68 (or, for example, other single-mode lasers such as a PCSEL) for interior monitoring may be an unexpected or seemingly counterintuitive solution for interior monitoring, however, the sensing system 10 of the present disclosure may utilize such a system to detect micro-scale motion or other small movements within the vehicle 12. Typically, multi-mode lasers are preferred for such sensing due to the uniformity of the illumination areas and higher powers. However, the sensing system 10 of the present disclosure may utilize the granularity of the speckle distribution produced by the single mode. VCSELs 68 are used to track the micro-oscillations within the interior 18 in a cost-effective and more compact manner. In addition, VCSELs 68 have smaller packaging requirements and exhibit smaller divergence angles.Thus, packaging the array 24 of VCSELs 68 with the optical element 30 of the present disclosure may provide a more efficient and effective detection system 10. Furthermore, because the VCSELs 68 (or, for example, other single-mode lasers such as a PCSEL) may be packaged in arrays 24, fewer replications of the illumination 28 may be required for optimized performance, and the diffractive element 34 may be simplified or omitted.

[0031] It should be understood that embodiments of the disclosure described herein may include one or more conventional processors and unique stored program instructions that control or regulate one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of a display mirror assembly as described herein. The non-processor circuits may include, but are not limited to, signal drivers, clock circuits, power source circuits, and / or user input devices. In a more general sense, these functions may be interpreted as steps used in using or creating a classification system.Alternatively, some or all of the functions could be implemented by a state machine that has no stored program instructions, or in one or more application-specific integrated circuits (ASICs), with each function or some combination of certain of the functions implemented as custom logic. Of course, a combination of the two approaches could be used. Therefore, the means for these functions have been described herein. Furthermore, it is expected that, notwithstanding the potentially considerable effort and many design possibilities motivated by, for example, available time, current technology, and economic considerations, those of ordinary skill in the art will readily be able to generate such software instructions and programs, as well as ICs, with little experimentation when guided by the concepts and principles disclosed herein.

[0032] The disclosure herein is further summarized in the following sections and is further characterized by combinations of any and all of the various aspects described therein.

[0033] According to one aspect of the present disclosure, a sensing system for a vehicle includes an imaging device configured to capture an image of an interior surface of the vehicle. An illumination assembly includes an array of laser diodes each configured to project illumination, wherein each laser diode is configured as at least one of a single-mode laser and a surface-emitting laser ("VCSEL"). An optical element is disposed proximate the array of laser diodes and includes a collimating element for directing the illumination to form at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the array of laser diodes and to process the image of the inner surface to detect at least one of a change in a position and a speckle content of the at least one point.

[0034] According to another aspect, a processor is further configured to determine a presence of a vehicle occupant by a change in a position or speckle content of at least one point.

[0035] According to another aspect, a processor is further configured to detect a vital parameter of a vehicle occupant through changes in a speckle content due to movement on a micrometer or microradian scale.

[0036] According to yet another aspect, the vital parameter comprises at least one of a frequency and amplitude of respiration or a pulse.

[0037] According to another aspect, determining a change in speckle content of the at least one point comprises comparing first pixel data of the at least one point acquired at a first time with second pixel data of the at least one point acquired at a second time subsequent to the first time.

[0038] According to another aspect, a processor is further configured to detect movement of a vehicle occupant by detecting a change in a position of the at least one point and extrapolating a depth and contour of the interior surface based on the change in the position of the at least one point.

[0039] In yet another aspect, a processor is further configured to detect a left-behind condition when a vehicle occupant is located in a rear portion of a vehicle and a driver is not detected.

[0040] According to yet another aspect, the processor is configured to generate an alarm after an abandoned condition is detected.

[0041] In another aspect, a temperature sensing module communicates a current temperature in a vehicle to a processor, and the processor is configured to generate a signal to a vehicle system to at least one of open a window and control an HVAC system after an abandoned condition is detected and the current temperature is within a threshold.

[0042] According to another aspect, at least one light point comprises a plurality of light points in a point array.

[0043] According to yet another aspect, each laser diode in an array of laser diodes is a VCSEL.

[0044] In yet another aspect, each of a plurality of laser diodes is evenly spaced on a common carrier.

[0045] In another aspect, each laser diode in an array of laser diodes is a single-mode laser.

[0046] According to another aspect of the present disclosure, a capture system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view with a dot array pattern. The illumination assembly includes a plurality of surface-emitting laser diodes ("VCSELs") arranged in a laser diode array and configured to project a plurality of illuminations. An optical element is configured to collimate the plurality of illuminations into at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the laser diode array, process the image of the interior to determine a position of the at least one point in the point array pattern, and extract a depth of the surface based on the position of the at least one point.

[0047] According to another aspect, a diffractive element is configured to direct and replicate illumination from a collimating element.

[0048] According to yet another aspect, each of a plurality of VCSELs is configured as a single-mode laser diode.

[0049] According to yet another aspect, a processor is further configured to determine a presence of a vehicle occupant by extrapolating a contour of an interior surface based on an extracted depth.

[0050] According to another aspect, a processor is configured to detect a presence of a vehicle occupant and to sense a vital parameter of the vehicle occupant through changes in a speckle content due to movement on a micrometer or microradian scale.

[0051] According to yet another aspect of the present disclosure, a capture system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view with a dot array pattern. The illumination assembly includes a plurality of single-mode lasers arranged in a laser diode array and configured to project a plurality of illuminations. An optical element is configured to collimate the plurality of illuminations into at least one spot of light. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal for operating the laser diode array, process the image of the interior to detect a change in a speckle content of the at least one dot in the dot array pattern, and detect a condition in the interior based on the detected change in the speckle content.

[0052] According to another aspect, the interior condition is a vital parameter of a vehicle occupant, which is detected by changes in the speckle content due to movement on the micrometer or microradian scale.

[0053] According to one aspect of the present disclosure, a sensing system for a vehicle includes an imaging device configured to capture an image of an interior of the vehicle. An illumination assembly includes an array of laser diodes, each configured to project illumination. An optical element is disposed proximate the array of laser diodes and includes a collimating element for directing the illumination to form at least one spot of light. A processor is in communication with the imaging device and the illumination assembly. The processor is configured to transmit a signal for operating the array of laser diodes and process the image of the interior to detect at least one of a position and a change in speckle content of the at least one spot.

[0054] According to another aspect of the present disclosure, an illumination assembly of a detection system for a vehicle includes an array of light sources coupled to at least one support, each of the light sources configured to project illumination forming a dot array pattern. The dot array pattern is directed toward a vehicle interior. An optical element is disposed proximate the array and includes a collimating element for collimating the illumination and a diffractive element that bends the illumination to form at least one dot of light.

[0055] According to another aspect of the present disclosure, an illumination assembly of a detection system for a vehicle includes an array of light sources coupled to at least one support, each of the light sources configured to project illumination forming a dot array pattern. The dot array pattern is directed toward a vehicle interior. An optical element is disposed proximate the array and includes a collimating element for collimating the illumination to form at least one dot of light.

[0056] According to another aspect of the present disclosure, a detection system includes an array of single-mode surface-emitting lasers ("VCSELs") and an optical element for directing light into a dot array pattern emitted by the array of VCSELs. The dot array pattern includes a plurality of light spots projected onto a surface in the interior, each spot having a speckle content. An imaging device is provided for capturing images of at least one of the plurality of light spots that include changes in speckle content in pixel data. At least one processor is in communication with the imaging device and the array of VCSELs and is configured to transmit an instruction to project the dot array pattern.The at least one processor is further configured to detect changes in the pixel data of at least one light point and to determine a micro-change in a position of the surface based on the detection.

[0057] According to another aspect of the present disclosure, a capture system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view with a dot array pattern. The illumination assembly includes a plurality of surface-emitting lasers ("VCSELs") arranged in an array of VCSELs configured to project a plurality of illuminations. An optical element is configured to collimate the plurality of illuminations and diffract each of the plurality of illuminations into at least one spot of light projected onto a surface of an interior of a vehicle. A processor is in communication with the imaging device and the illumination assembly.The processor is configured to transmit a signal to operate the array of VCELs, process the image of the interior to determine a position of the at least one point in the point array pattern, and determine a depth of the surface based on the position of the at least one point.

[0058] Those of ordinary skill in the art will recognize that the construction of the described disclosure, as well as other components, is not limited to any particular material. Other exemplary embodiments of the disclosure may be formed from a wide variety of materials, unless otherwise noted herein.

[0059] For the purposes of this disclosure, the term "coupled" (in all its forms, coupling, coupled, etc.) generally means the connecting of two components together (electrically or mechanically) directly or indirectly. Such connecting may be stationary or movable in nature. Such connecting may be achieved with the two components (electrically or mechanically) and any additional intervening elements integrally formed as a single unitary body with each other or with the two components. Such connecting may be permanent or removable or detachable in nature, unless otherwise specified.

Claims

[1] Detection system for a vehicle, comprising: an imaging device configured to capture an image of an interior surface of the vehicle; a lighting arrangement comprising: an array of laser diodes each configured to project illumination, each laser diode being configured as at least one of a single-mode laser and a surface-emitting laser (“VCSEL”); an optical element near the array of laser diodes and having a collimating element for directing the illumination to form at least one light spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit a signal for operating the array of laser diodes, process the image of the inner surface to detect at least one of a change in a position and a speckle content of the at least one spot. [2] The detection system of claim 1, wherein the processor is further configured to determine a presence of a vehicle occupant with the change in the position or speckle content of the at least one point. [3] The sensing system of claim 1 or 2, wherein the processor is further configured to detect a vital parameter of the vehicle occupant by changes in speckle content due to movement on a micrometer or microradian scale. [4] The detection system of claim 3, wherein the vital parameter comprises at least one of a frequency and an amplitude of respiration and a pulse. [5] The detection system of claim 2, wherein determining the change in speckle content of the at least one point comprises comparing first pixel data of the at least one point detected at a first time with second pixel data of the at least one point detected at a second time subsequent to the first time. [6] A detection system according to any preceding claim, wherein the processor is further configured to detect movement of the vehicle occupant by detecting the change in position of the at least one point and extrapolating a depth and contour of the interior surface based on the change in position of the at least one point. [7] The detection system of claim 2 to 6, wherein the processor is further configured to detect a left-behind condition when the vehicle occupant is located in a rear portion of the vehicle and a driver is not detected. [8] The detection system of claim 7, wherein the processor is configured to generate an alarm after an abandoned condition is detected. [9] The sensing system of claim 7 or 8, further comprising a temperature sensing module that communicates a current temperature in the vehicle to the processor, the processor being configured to generate a signal to a vehicle system to at least one of open a window and control or regulate an HVAC system after the abandoned condition is detected and the current temperature is within a threshold. [10] A detection system according to any preceding claim, wherein the at least one light spot comprises a plurality of light spots in a spot array. [11] A detection system according to any preceding claim, wherein each laser diode in the array of laser diodes is formed as the VCSEL. [12] A detection system according to any preceding claim, wherein each laser diode is evenly spaced on a common support. [13] A detection system according to any preceding claim, wherein each laser diode in the array of laser diodes is configured as the single-mode laser. [14] Recording system comprising: an imaging device configured to capture an image in a field of view; an illumination arrangement configured to illuminate the field of view with a dot array pattern, the illumination arrangement comprising: a plurality of vertical cavity surface-emitting laser diodes (“VCSELs”) arranged in a laser diode array and configured to project a plurality of illuminations; and an optical element configured to collimate the plurality of illuminations into at least one light spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit a signal to operate the laser diode array, process the image of the interior to determine a position of the at least one point in the point array pattern, and extract a depth of the surface based on the position of the at least one point. [15] The detection system of claim 14, further comprising a diffractive element configured to direct and replicate illumination from a collimating element. [16] A detection system according to claim 14 or 15, wherein each VCSEL is formed as a single-mode laser diode. [17] The detection system of claim 14 or 15, wherein the processor is further configured to determine a presence of a vehicle occupant by extrapolating a contour of a surface of the interior based on the extracted depth. [18] The detection system of claim 14 or 15, wherein the processor is further configured to detect a presence of a vehicle occupant and a vital parameter of the vehicle occupant by changes in a speckle content due to movement on a micrometer or microradian scale. [19] Recording system comprising: an imaging device configured to capture an image in a field of view; an illumination arrangement configured to illuminate the field of view with a dot array pattern, the illumination arrangement comprising: a plurality of single-mode lasers arranged in a laser diode array and configured to project a plurality of illuminations; and an optical element configured to collimate the plurality of illuminations into at least one light spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit a signal to operate the laser diode array, process the image of the interior to detect a change in a speckle content of the at least one dot in the dot array pattern, and identify a condition in the interior based on the detected change in speckle content. [20] The sensing system of claim 19, wherein the interior condition is a vital sign of a vehicle occupant detected by changes in speckle content due to movement on a micrometer or microradian scale.

Images