Detection system with single mode laser or vertical cavity surface emitting laser for vehicle

Abstract

A detection system for a vehicle includes an imaging device configured to capture an image of an interior surface of the vehicle. The illumination assembly includes an array of laser diodes, each configured to project illumination, each configured as at least one of a single mode laser or a vertical cavity surface emitting laser ("VCSEL"). An optical element is proximate to the laser diode array and includes a collimating element for directing illumination to form at least one spot of light. A processor is in communication with the imaging device and the illumination assembly. The processor is configured to transmit a signal to operate the laser diode array and process an image of the interior surface to detect at least one of a change in position of the at least one point or a change in speckle content.

Description

Technical Field

[0001] This disclosure relates generally to a detection system with a laser array for monitoring the interior of a vehicle, and more specifically to a structured light device for monitoring the interior of a vehicle using an array of single-mode lasers or vertical-cavity surface-emitting lasers. Background Technology

[0002] Existing technologies include known detection systems for vehicles using single-mode lasers or vertical-cavity surface-emitting lasers. However, developing improved detection systems for vehicles using single-mode lasers or vertical-cavity surface-emitting lasers has been a goal in this field. Utility Model Content

[0003] According to one aspect of this disclosure, a detection system for a vehicle includes an imaging device configured to capture an image of the interior surface of the vehicle. An illumination assembly includes an array of laser diodes, each laser diode configured to project illumination, and each laser diode being configured as at least one of a single-mode laser or a vertical-cavity surface-emitting laser (“VCSEL”). Optical elements are located proximal to the laser diode array and include a collimating element for guiding the illumination to form at least one spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array and process the image of the interior surface to detect at least one of a change in the position of at least one point or a change in the speckle content.

[0004] According to another aspect of this disclosure, the detection system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view using a dot array pattern. The illumination assembly includes a plurality of vertical-cavity surface-emitting laser diodes (“VCSELs”) arranged in a laser diode array and configured to project a plurality of illuminations. Optical elements are configured to collimate the plurality of illuminations into at least one spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array, process the internal image to determine the location of at least one point in the dot array pattern, and extract the depth of the surface based on the location of the at least one point.

[0005] According to another aspect of this disclosure, the detection system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view using a dot array pattern. The illumination assembly includes a plurality of single-mode lasers arranged in a laser diode array and configured to project a plurality of illuminations. Optical elements are configured to collimate the plurality of illuminations into at least one light spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array, process the internal image to detect changes in the speckle content of at least one point in the dot array pattern, and identify the internal condition based on the detected changes in the speckle content.

[0006] These and other features, advantages and objectives of this disclosure will be further understood and appreciated by those skilled in the art upon reference to the following description, claims and drawings. Attached Figure Description

[0007] In each diagram:

[0008] Figure 1 This is a side view of a vehicle with a detection system integrated into it, according to one aspect of this disclosure;

[0009] Figure 2 The exemplary image captured by the imaging device according to one aspect of this disclosure shows a dot array pattern projected from the illumination components of the detection system onto the occupants of a vehicle.

[0010] Figure 3 It is an image captured by the imaging device of the detection system according to one aspect of this disclosure, the image illustrating a single light spot of a dot array pattern projected onto a surface in the passenger compartment of a vehicle;

[0011] Figure 4 It is based on one aspect of this disclosure. Figure 3 The image of light spots captured by the imaging device after the micro-motion of the surface depicted in the image has occurred;

[0012] Figure 5 This is a cross-sectional side view of a lighting assembly according to one aspect of this disclosure; and

[0013] Figure 6 This is a block diagram of a detection system according to one aspect of this disclosure.

[0014] The components in the diagram are not necessarily drawn to scale, but rather to emphasize the principles described in this article. Detailed Implementation

[0015] The embodiments described in this utility model mainly involve the combination of equipment components related to a vehicle detection system.

[0016] For the purposes described herein, the terms “up,” “down,” “right,” “left,” “back,” “front,” “vertical,” “horizontal,” and their derivatives should be used interchangeably with those used in this document. Figure 1 The orientation of the disclosure is not specified in the appended claims. Unless otherwise stated, the term "front" refers to the element surface closer to the intended observer of the mirror element, and the term "rear" refers to the element surface farther from the intended observer of the mirror element. However, it should be understood that various alternative orientations may be used in this disclosure, except where explicitly specified otherwise. It should also be understood that the specific devices and processes shown in the accompanying drawings and described in the following description are merely exemplary embodiments of the inventive concept defined in the appended claims. Therefore, specific dimensions and other physical characteristics relating to the embodiments disclosed herein should not be considered limiting unless expressly stated otherwise in the claims.

[0017] The terms "including," "comprises," "comprising," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but may also include other elements not expressly listed or not inherent to such process, method, article, or apparatus. Without further constraints, an element preceded by "including..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0018] Those skilled in the art will understand the term "substantially" and its variations to describe values ​​that are equal to or approximately equal to, or to describe a characteristic. For example, "substantially plane" is intended to mean a planar or generally planar surface. Furthermore, "substantially" is intended to indicate that two values ​​are equal or approximately equal. Where there is a use of terminology that is not readily apparent to those skilled in the art, given the context in which the term is used, "substantially" may mean values ​​that differ from each other by about 10%, such as by about 5%, or by about 2%.

[0019] The terms “approximately,” “approximately equal to,” and other similar phrases (e.g., “X has a value of approximately Y” or “X is approximately equal to Y”) used in the specification and claims shall be understood to mean that a value (X) is within a predetermined range of another value (Y). Unless otherwise stated, the predetermined range may be ±20%, ±10%, ±5%, ±3%, ±1%, ±0.1%, or less than ±0.1%.

[0020] refer to Figures 1 to 6 Reference numeral 10 generally refers to a detection system 10 for a vehicle 12. The detection system 10 includes images 16 configured to capture the interior 18 of the vehicle 12. Figures 2 to 4The imaging device 14 is equipped with an illumination assembly 20 configured to illuminate the interior 18 using a dot array structured light pattern 22. The illumination assembly 20 includes an array 24 of laser diodes 26, each configured to project illumination 28 (e.g., at least one beam 36). The illumination assembly 20 also includes optical elements 30 (i.e., lenses) adjacent to the array 24. The optical elements 30 include a collimating element 32 and a diffraction element 34 for guiding the illumination 28 to form at least one spot 56. A processor 38 (e.g., one or more processors) communicates with the imaging device 14 and the illumination assembly 20. The processor 38 is configured to transmit signals to operate the array 24 of laser diodes 26. The processor 38 is further configured to process an image 16 of the interior 18 to detect changes in at least one of the light distribution 40 (i.e., the location of at least one spot 56) or the speckle content of at least one spot 56. The processor 38 is further configured to determine the presence of an occupant in the interior 18 based on changes in at least one of the light distribution 40 and the speckle content.

[0021] Now for reference Figure 1 The lighting assembly 20 and the imaging device 14 are located inside the vehicle 18. More specifically, the imaging device 14 and the lighting assembly 20 may be coupled to a rearview assembly, such as a rearview mirror assembly 42 including an electro-optical device (not shown). For example, the electro-optical device may be a single-layer component, a single-phase component, a multi-layer component, and / or a multi-phase component that can switch between a partially transmissive state and a partially reflective state. In other examples, the imaging device 14 and the lighting assembly 20 are coupled to the dashboard 44 of the vehicle 12, the overhead console 46 of the vehicle 12, or another part of the vehicle 12. The imaging device 14 may be packaged together with the lighting assembly 20 (i.e., positioned adjacent to it in a static relationship). The imaging device 14 is positioned to capture an image 16 of the interior 18 of the vehicle 12. Figures 2 to 4 The laser diode 26 can be configured as one or more single-mode lasers, such as... Figure 5One or more vertical-cavity surface-emitting lasers 68 (“VCSELs”) are described herein. However, it should be understood that other types of light sources can be used, such as other types of single-mode lasers, with photonic crystal surface-emitting lasers (“PCSELs”) being one example. Illumination 28 from laser diode 26 can be within the wavelength spectrum, such as the infrared (IR) spectrum. Thus, in some examples, imaging device 14 is a camera that can operate within the IR spectrum (or other spectra corresponding to illumination 28) to allow the capture of dot array pattern 22. Imaging device 14 can be a stereo imager, a photodetector, a camera, etc. Generally, imaging device 14 can have a field of view 48 covering one or both of the front cabin 50 and the rear cabin 52 of the interior 18. In this way, imaging device 14 of this disclosure can be configured to capture images 16 of at least one surface 54a to 54f in the interior 18, such as seat surface 54a, floor surface 54b, panel surface 54c, etc. In some examples, surfaces 54a to 54f in the interior 18 correspond to the occupants of the vehicle 12, such as covering surface 54d (e.g., clothing or blanket), body surface 54e, car seat surface 54f, etc.

[0022] Now for reference Figure 1 and Figure 2 Imaging device 14 is configured to capture an image 16 projected onto a dot array pattern 22 within the interior 18 of vehicle 12. For example, the dot array pattern 22 may include a plurality of light spots 56, and each light spot 56 may define various shapes, such as circles, dots, line segments, or other geometries projected onto the dot array pattern 22. Each spot 56 may have intensity, brightness, etc. The distribution of the light spots 56 in the dot array pattern 22 may be uniform (e.g., rows and columns, concentric shapes, etc.) or non-uniform, such as a pseudo-random distribution. The dot array pattern 22 conforms to surfaces 54a to 54f in the interior 18, wherein the light spots 56 are reflected back from surfaces 54a to 54f and captured by imaging device 14. In some embodiments, light sources (e.g., laser diodes 26) are distributed in an array, for example, in an array having a rectangular perimeter defined by rows and columns of light sources. In other embodiments, the light source array may be distributed in other uniform or non-uniform patterns.

[0023] Regardless of the shape and distribution of the light spot 56, as the surfaces 54a to 54f of the reflected light spot 56 move, the light spot 56 also moves, and this movement is captured by the imaging device 14. In the first operating mode, the processor 38 can process the image 16 captured by the imaging device 14 and infer a certain depth to which the light spot 56 has moved to the surfaces 54a to 54f based on the principles of triangulation and the known geometry between the imaging device 14, the illumination assembly 20, and the distribution of the light spot array 22. For example, the processor 38 can be configured to determine the movement based on the periphery or center of gravity of each light spot 56. In the first operating mode, the imaging device 14 and the illumination assembly 20 can be tightly and rigidly fixed to a common optical base structure (e.g., within a rearview mirror or other shared location), and based on the known spacing between the imaging device 14 and the illumination assembly 20 (e.g., laser diode 26) and the distribution of the light spot array 22, the position of the reflected light spot 56 can be captured along a core line, which can also be triangulated to extract the depth of the surfaces 54a to 54f. The depth of surfaces 54a to 54f at each light spot 56 can then be used to infer the contours of surfaces 54a to 54f. Similarly, changes in depth can be used to infer the current position of surfaces 54a to 54f and their movement over time.

[0024] exist Figure 1 and Figure 2 In the illustrated example, light spots 56 cover the rear seat structure of vehicle 12 and can be reflected from the child's body surface 54e, the car seat surface 54f where the child sits, the covering surface 54d (e.g., clothing), and the seat surface 54a. Therefore, based on the first operating mode, these specific light spots 56 can be categorized as portions closer to or farther from the imaging device 14 and / or the illumination assembly 20. Based on this varying depth, the light spots 56 in the dot array pattern 22 will move to conform to the surface 54, which will then be captured as movement along the epipolar lines of image 16. Processor 38 detects the positioning of the plurality of light spots 56 and infers the current positioning of the respective surfaces 54a, 54e, and 54f to monitor various conditions within vehicle 12. For example, the presence and shape (or changes in shape over time) of the main body surface 54e or the covering surface 54d relative to the dot array pattern 22. It is conceivable that processor 38 may have one or more occupant detection algorithms, object detection algorithms, etc., for distinguishing the identification of various objects within the interior 18. In this way, in the first operating mode, the spatial mapping of the internal 18 can be used to identify the presence, three-dimensional (“3D”) positioning, and 3D shape of objects (such as occupants). It is conceivable that... Figure 2The image 16 illustrated herein visually presents the dot array pattern 22, but as previously described, the illumination 28 can be a visible or invisible wavelength spectrum, such as the IR spectrum. When the illumination is in the IR spectrum, image 16 illustrates an image that can be captured by an imaging device (e.g., an IR imager).

[0025] Now for reference Figure 3 and Figure 4 In the second operating mode, based on the principle of speckle interferometry, the speckle content of each reflected light spot 56 can be monitored to detect changes in the internal intensity distribution of surfaces 54a to 54f, such as tilting or other movements at the microscale (e.g., micrometer or microradian scale). For example, when surfaces 54a to 54f exhibit roughness, changes in tilting microradian will affect the reflection of light spot 56, and thus also affect the speckle content. The imaging device 14 and the illumination assembly 20 can be spaced apart from each other according to the second operating mode. For example, the illumination assembly 20 and the imaging device 14 can be located in different positions around the interior 18. However, it should be understood that a single imaging device 14 can be packaged together with the illumination assembly 20 and used in both the first and second operating modes. The illumination 28 according to the second operating mode can be in the form of an invisible wavelength spectrum, such as the IR spectrum. In this way, a single illumination assembly 20 can be configured to project illumination within a spectrum detectable in both the first and second operating modes.

[0026] Continue to refer to Figure 3 and Figure 4 Microscale detection can be used to monitor the physiological condition of an occupant, which may be difficult in the first mode of operation. For example, various vital signs of an occupant can be monitored by detecting micro-movements of the occupant (e.g., body surface 54e), covering surface 54d, and car seat surface 54f. In this way, even if the light spot 56 is not directly reflected from the body surface 54e, microscale movements from the occupant are applied to the surfaces 54a to 54f (e.g., covering surface 54d and car seat surface 54f) around the occupant, and these microscale movements can be detected, thus allowing occupant presence detection without direct line of sight to the occupant's body. This is particularly advantageous when a child is sitting in a rear-facing car seat and / or covered by a blanket. More specifically, the imaging device 14 captures the speckle content of each light spot 56 in the image data 60. More specifically, Figure 3 Image data 60 of a reflected light spot 56 projected onto surface 54 is shown, and Figure 4 Image data 60 shows the reflected light spot 56 after its positioning has been changed on surfaces 54a to 54f. It can be envisioned that... Figure 3 and Figure 4The timing between captured image data 60 can be within a second, a millisecond, a microsecond, or any time interval that allows for the detection of small changes (e.g., microscale) in the positioning of surfaces 54a to 54f. The speckle content in the image data 60 comprises a pixel array 62 having corresponding values ​​associated with each pixel. For example, the pixel array 62 may have pixel data including at least one value corresponding to a grayscale intensity value that corresponds to the level of reflected light toward the imaging device 14. Generally, under constant illumination conditions and without change in the positioning of surface 54, the intensity value or pixel value of each pixel in the pixel array 62 remains relatively constant or within a threshold range / characteristic of grayscale intensity. For example, because the imaging device 16 can be configured to capture microscale changes in positioning, there may be some "noise" in the image data 60, affecting the pixel values. The processor 38 of this disclosure can be configured to distinguish noise from actual movement of objects inside the interior 18 of the vehicle 12. For example, in some embodiments, processor 38 may be configured to determine a baseline amount of noise (e.g., engine vibration, road conditions, or other external factors affecting the relative movement between lighting assembly 20, imaging device 14, and surface 54). This baseline can be determined by comparing and / or mapping changes in the positioning of spot 56 (i.e., in a first operating mode) or changes in the speckle content of spot 56 (i.e., in a second operating mode).

[0027] Still referencing Figure 3 and Figure 4 The pixel array 62 may include a first portion 64 corresponding to the area surrounding the light spot 56 and a second portion 66 corresponding to the light spot 56. The second portion 66 may approximate the shape of the light spot 56, in which case the light spot has a circular Gaussian shape within the second portion 66. Minute changes, distinct from any noise, are detected by the processor 38. For example, as a result of the positioning variation (e.g., on a micrometer scale) of the surfaces 54a to 54f. Figure 3 and Figure 4 Small changes or alterations in pixel values ​​can correspond to a redistribution of black or dark pixels.

[0028] As previously explained, minute positional changes on surfaces 54a to 54f can correspond to the vital signs of an occupant. These vital signs can include the presence, rate, and amplitude of breathing, pulse, and / or other vital signs or physiological conditions of the occupants in vehicle 12. It is conceivable that other small-scale movements toward, away from, or laterally relative to imaging device 14 and / or illumination assembly 20 can correspond to sources other than the vital signs of the occupants within vehicle 12, such as simply the presence of an occupant. Generally, the processor 38 of this disclosure can be configured to execute breathing, pulse, or other detection algorithms to determine the presence of an occupant (i.e., a human or animal). As will be further described, processor 38 can communicate with peripheral devices or remote devices to generate communications of the occupants of vehicle 12. Although not described in detail, processor 38 can evaluate some or all of the multiple light spots 56 projected by lighting component 20 and merge image data 60 corresponding to each of the multiple light spots 56 to further refine the determination of occupancy and / or interior 18 conditions of vehicle 12. For example, processor 38 can employ one or more statistical modeling techniques to merge or otherwise average the variations in pixel values ​​of each light spot 56 to distinguish noise and / or vibration caused by movement and operational factors of vehicle 12 (e.g., gear shifting, braking, engine vibration, road conditions, etc.).

[0029] We can further imagine, Figure 3 and Figure 4 The pixel data presented can have a resolution lower or higher than the depicted resolution. For example, each light spot 56 may include any number of pixels corresponding to the specific dot array pattern 22 employed and the specific resolution of the imaging device 14. Generally, the processor 38 can be configured to employ the principle of speckle interferometry in a second operating mode, thus evaluating the dot array pattern 22 based on the variation in the speckle content of each of the plurality of light spots 56. Therefore, and as will be further described herein, the illumination assembly 20 can generate a sharp speckle distribution within the dot array pattern 22. The second operating mode is performed on a point-by-point basis of individual reflections of the light spots 56.

[0030] Now for reference Figure 5The illumination assembly 20 is depicted having a laser diode 26, and an optical element 30 aligned with the laser diode 26 (e.g., within a vehicle's rearview mirror). The laser diode 26 may comprise a single laser diode 26 or multiple laser diodes 26 arranged in an array 24 (as illustrated by dashed lines). Each laser diode 26 projects illumination 28 (e.g., multiple beams 36). The laser diode 26 may be configured as a VCSEL 68, which is formed together with or operatively coupled to a substrate 70, such as a printed circuit board, and oriented substantially orthogonally to the substrate 70. The substrate 70 may also include a drive circuit 71 controlled via a processor 38 for generating a potential for the VCSEL 68. Figure 6 VCSEL 68 may be one of a plurality of VCSELs 68 arranged in array 24 and includes a housing 72 in which the various layers of VCSEL 68 are disposed. For example, VCSEL 68 may have a pair of electrodes 74 sandwiching a pair of reflective layers 76. Between the reflective layers 76 is a cavity 78 formed by a pair of oxide layers 80, which defines an active region 82 in which illumination 28 is amplified. Housing 72 defines an opening 84 generally aligned with optical element 30 to allow illumination 28 to be emitted from VCSEL 68. Illumination 28 is then guided by optical element 30 to one or more of a plurality of light spots 56. In some embodiments, optical element 30 guides illumination 28 from each VCSEL 68 (or other light source). In some embodiments, optical element 30 includes a plurality of optical elements 30 (i.e., an array) that each guides illumination 28 from two or more VCSELs 68 or a single VCSEL 68. Specifically, illumination 28 can be collimated by collimating element 32, which can narrow illumination 28 in a specific direction (e.g., generally perpendicular to diffraction element 34). Diffraction element 34 can guide and replicate the collimated illumination 28 into array 24. It should be understood that collimating element 32 and diffraction element 34 can be separate or integrally formed in one or more optical elements 30 (i.e., lenses). It is conceivable that the above-described structure of laser diode 26 can be one of a variety of arrangements for generating illumination 28. For example, the various layers of VCSEL 68 may include more or fewer layers than described in order to generate a laser beam or laser illumination 28 to be guided by optical element 30.

[0031] Generally, in contrast to single or multiple edge-emitting laser diodes 26, an array 24 providing VCSEL 68 (e.g., or other single-mode lasers) can provide greater reliability and allow a larger area within the field of view 48 of the imaging device 14 to be covered by the dot array pattern 22. For example, zero-order suppression that can be employed relative to the periphery of the optical element 30 can be reduced to improve eye safety. Additionally, the single-mode configuration of the VCSEL 68 allows for a larger granularity of pixel data, as described above regarding... Figure 3 and Figure 4 As described. For example, return to reference. Figure 5 The width W and / or depth D of cavity 78 can be configured to produce a single spatial pattern of illumination 28. For example, m for illumination 28 projected from each VCSEL in VCSEL 68 2 The value can be approximately one or less than 1.3 in some examples.

[0032] It is conceivable that using a single-mode VCSEL 68 (e.g., or other single-mode lasers, such as PCSELs) can produce lower power consumption compared to the requirements of multimode illumination sources. Lower power consumption can allow for a wider detection range suitable for the interior 18 of the vehicle 12. Generally, the granularity of the spot 56 combined with the resolution of the imaging device 14 can allow the processor 38 to detect micro-vibrations associated with one or more vital signs within the interior 18, as previously described.

[0033] Now for reference Figure 6The lighting assembly 20, imaging device 14, and processor 38 may be incorporated as a single sensing module 88, which may include a central assembly or may have separate components within the vehicle 12. The sensing module 88 can communicate with a network 90 operable using shortwave and / or longwave communication protocols, such as wireless or wired networks. For example, the network 90 may employ SMS, Wi-Fi, Ethernet, TCP / IP, 3G, 4G, 5G, or any other communication protocol to transmit instructions or signals between the sensing module 88 and one or more other devices. For example, the network 90 may provide communication between the sensing module 88 and one or more human-machine interfaces (HMIs) 92 within the vehicle 12, as well as mobile devices 94 with interfaces. Furthermore, the sensing module 88 may have direct communication with various vehicle systems 96 (e.g., wired connections within the vehicle 12). The sensing module 88 can be configured to transmit one or more commands to vehicle systems 96, such as door lock control system 98, window control system 100, ignition control system 102, heating, ventilation, and air conditioning (HVAC) control system 104, etc., to control a specific vehicle system 96 in response to the determination of one or more alarm conditions. As previously described, one or more alarm conditions can be determined based on the analysis of image data 60. For example, once an abandoned condition (e.g., a person or animal locked inside the interior 18 of vehicle 12, which is otherwise unoccupied) is detected, the sensing module 88 can communicate directly and / or via network 90 with one of the vehicle systems 96 to elicit one or more responses. In the described example, the door lock control system 98 can unlock a door in response to an abandoned condition, transmit an opening control signal to an actuator associated with vehicle 12, etc. Alternatively or additionally, the window control system 100 can control a window activation device to swing down or otherwise adjust one or more windows in vehicle 12 between an open and closed position in response to receiving an abandoned condition. More specifically, in legacy conditions, in some examples, the window control system 100 can open at least one window of the vehicle 12. In other examples, the ignition control system 102 can transmit commands to start the engine of the vehicle 12 and control the HVAC system 104 to inject hot or cold air into the interior 18 in response to a legacy condition. In some embodiments, the processor 38 can be configured to generate visual and / or auditory alarms within the vehicle and / or mobility device 94 upon detection of one or more alarm conditions.

[0034] In some embodiments, processor 38 may receive instructions from memory 106. Memory 106 may include a single disk or multiple disks (e.g., a hard disk drive) and include a storage management module that manages one or more partitions within memory 106. In some embodiments, memory 106 may include flash memory, semiconductor (solid-state) memory, etc. Memory 106 may include random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or combinations thereof. Memory 106 may include instructions that, when executed by processor 38, cause processor 38 to perform at least the functions associated with components of detection system 10. It is contemplated that other vehicle 12 subsystems may communicate with sensing module 88 and be configured to operate in response to conditions determined by processor 38 of this disclosure. For example, speakers or displays within vehicle 12 may be used to generate alarms.

[0035] Additionally, in response to the detection of alarm conditions, alarm signals or other communications can be transmitted to mobile device 94 and / or HMI 92. It is conceivable that, although a residual condition is described, other conditions can be determined based on the analysis of image data 60 and the determination of micro-vibrations in vehicle 12. For example, the sensing module 88 can be used as an optical microphone and the processor 38 can be employed to analyze the occupant's mouth area. Patterns associated with the language, volume, or intensity of the auditory signal can be applied to the image / video data and analyzed by the processor 38 to determine the level of distress of the occupant inside 18. In some embodiments, the sensing module 88 may include a temperature module 95 for detecting the current temperature in the vehicle. In this way, when a residual condition is detected, the processor 38 can receive the current temperature from the temperature module 95 to determine whether the current temperature is within a threshold (e.g., too hot or too cold) that requires intervention via vehicle system 96 (e.g., rolling down a window, heating, or cooling).

[0036] In some embodiments, processor 38 may be configured to generate communication before the vehicle 12's transmission is placed in driving mode or after the vehicle's transmission is placed in parking mode. In some embodiments, processor 38 may be configured to generate communication (e.g., with mobile device 94 or a display within vehicle 12) if an occupant is detected in interior 18 (e.g., rear compartment 52) ​​and no driver is detected within a predetermined time period. In some embodiments, processor 38 may be configured to generate communication (e.g., with mobile device 94 or a display within vehicle 12) if an occupant is detected in interior 18 (e.g., rear compartment 52) ​​and the vehicle has reached its destination. For example, if the vehicle has reached its destination but the door providing access to interior 18 has not been opened within a predetermined time period, processor 38 may be configured to generate communication. In some embodiments, processor 38 may be configured to employ a first operating mode to detect an occupant. If no occupant is detected by the first operating mode, processor 38 may be further configured to employ a second operating mode. Generally, under the principle of the first operating mode and / or the second operating mode, the processor 38 can be configured to generate communications corresponding to the detection of occupants, the absence of occupants, the cessation of detection of previously detected occupants, and other scenarios.

[0037] Incorporating a single-mode VCSEL 68 (e.g., or other single-mode lasers, such as PCSELs) for cabin monitoring may seem like an unintended or counterintuitive solution for cabin monitoring, but the detection system 10 of this disclosure can employ such a system to detect microscale movements or other minute movements within the vehicle 12. Generally, multimode lasers are preferred for such detection methods due to the smoothness of the illumination area and the higher power levels. However, the detection system 10 of this disclosure can utilize the granularity of the speckle distribution generated by a single mode. VCSEL 68 is used to efficiently track micro-vibrations within the interior 18 in a cost-effective and more compact manner. Furthermore, VCSEL 68 requires smaller packaging and exhibits a smaller divergence angle. Therefore, a more efficient and effective detection system 10 can be provided by packaging the array 24 of VCSEL 68 together with the optics 30 of this disclosure. Furthermore, since the VCSEL 68 (e.g., or other single-mode lasers, such as PCSELs) can be packaged in the array 24, fewer copies of the illumination 28 may be required to optimize performance, and the diffraction element 34 may be simplified or omitted.

[0038] It will be understood that embodiments of this disclosure described herein may include one or more conventional processors and unique stored program instructions that control one or more processors to implement some, most, or all of the functions of the display mirror assembly as described herein, together with certain non-processor circuitry. The non-processor circuitry may include, but is not limited to, signal drivers, clock circuitry, power supply circuitry, and / or user input devices. Thus, these functions can be interpreted as steps for using or constructing a classification system. Alternatively, some or all of the functions may be implemented by a state machine without the stored program instructions, or in one or more application-specific integrated circuits (ASICs), wherein each function or some combinations of certain functions are implemented as custom logic. Of course, combinations of both approaches may be used. Therefore, methods and components for these functions have been described herein. Furthermore, regardless of the considerable effort that may be required and the many design choices driven by considerations such as available time, current technology, and economic factors, it is anticipated that those skilled in the art, guided by the concepts and principles disclosed herein, will be able to readily generate such software instructions and programs, as well as ICs, with minimal experimentation.

[0039] The disclosure of this article is further summarized in the following paragraphs and is further characterized as any and all of the various aspects described herein.

[0040] According to one aspect of this disclosure, a detection system for a vehicle includes an imaging device configured to capture an image of the interior surface of the vehicle. An illumination assembly includes an array of laser diodes, each laser diode configured to project illumination, and each laser diode being configured as at least one of a single-mode laser or a vertical-cavity surface-emitting laser (“VCSEL”). Optical elements are located proximal to the laser diode array and include a collimating element for guiding the illumination to form at least one spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array and process the image of the interior surface to detect at least one of a change in the position of at least one point or a change in the speckle content.

[0041] According to another aspect, the processor is further configured to determine the presence of vehicle occupants by utilizing changes in the position of at least one point or changes in the speckle content.

[0042] On the other hand, the processor is further configured to detect the vital signs of vehicle occupants by means of changes in speckle content as a result of movement on a micrometer or microradian scale.

[0043] On the other hand, vital signs include at least one of the rate and amplitude of breathing or pulse.

[0044] According to another aspect, determining the change in speckle content at at least one point includes comparing first pixel data captured at a first time point with second pixel data captured at a second time point after the first time point.

[0045] According to another aspect, the processor is further configured to detect the movement of the vehicle occupants by capturing changes in the position of at least one point, and to infer the depth and contour of the inner surface based on the changes in the position of at least one point.

[0046] According to another aspect, the processor is further configured to detect abandoned conditions if the vehicle occupants are in the rear compartment of the vehicle and no driver is detected.

[0047] On the other hand, the processor is configured to generate an alarm after a legacy condition is detected.

[0048] According to another aspect, the temperature detection module transmits the current temperature inside the vehicle to the processor, and the processor is configured to generate a signal to the vehicle system to open the window or control at least one of the HVAC systems after detecting a residual condition and the current temperature is within a threshold.

[0049] According to another aspect, at least one light spot includes multiple light spots in a point array.

[0050] On the other hand, each laser diode in the laser diode array is a VCSEL.

[0051] On the other hand, each of the multiple laser diodes is uniformly spaced on a common substrate.

[0052] On the other hand, each laser diode in the laser diode array is a single-mode laser.

[0053] According to another aspect of this disclosure, the detection system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view using a dot array pattern. The illumination assembly includes a plurality of vertical-cavity surface-emitting laser diodes (“VCSELs”) arranged in a laser diode array and configured to project a plurality of illuminations. Optical elements are configured to collimate the plurality of illuminations into at least one spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array, process the internal image to determine the location of at least one point in the dot array pattern, and extract the depth of the surface based on the location of the at least one point.

[0054] On the other hand, the diffraction element is configured to guide and replicate illumination from the collimation element.

[0055] On the other hand, each of the multiple VCSELs is configured as a single-mode laser diode.

[0056] On the other hand, the processor is further configured to determine the presence of vehicle occupants by inferring the contour of the inner surface based on the extracted depth.

[0057] According to another aspect, the processor is configured to determine the presence of vehicle occupants and detect their vital signs by means of changes in speckle content as a result of movement on a micrometer or microradian scale.

[0058] According to another aspect of this disclosure, the detection system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view using a dot array pattern. The illumination assembly includes a plurality of single-mode lasers arranged in a laser diode array and configured to project a plurality of illuminations. Optical elements are configured to collimate the plurality of illuminations into at least one light spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode array, process the internal image to detect changes in the speckle content of at least one point in the dot array pattern, and identify the internal condition based on the detected changes in the speckle content.

[0059] On the other hand, the internal condition is detected by changes in the speckle content as a result of movement at the micrometer or microradian scale, which are vital signs of the vehicle occupants.

[0060] According to one aspect of this disclosure, a detection system for a vehicle includes an imaging device configured to capture an image of the vehicle's interior. An illumination assembly includes arrays of laser diodes, each configured to project illumination. Optical elements are located adjacent to the laser diode arrays and include a collimating element for guiding the illumination to form at least one spot. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the laser diode arrays and process the interior image to detect at least one of changes in the position of at least one spot or the content of speckle patterns.

[0061] According to another aspect of this disclosure, an illumination assembly for a vehicle detection system includes an array of light sources coupled to at least one substrate, each light source being configured to project illumination forming a dot array pattern. The dot array pattern points toward the interior of the vehicle. Optical elements are located adjacent to the array and include a collimating element for collimating the illumination and a diffraction element for diffracting the illumination to form at least one light spot.

[0062] According to another aspect of this disclosure, an illumination assembly for a vehicle detection system includes an array of light sources coupled to at least one substrate, each light source being configured to project illumination forming a dot array pattern. The dot array pattern points towards the interior of the vehicle. Optical elements are located adjacent to the array and include a collimating element for collimating the illumination to form at least one light spot.

[0063] According to another aspect of this disclosure, the detection system includes a single-mode vertical-cavity surface-emitting laser (“VCSEL”) array and optical elements for guiding light emitted from the VCSEL array into a dot array pattern. The dot array pattern includes a plurality of light spots projected onto a surface in the cabin, and each spot includes speckle content. An imaging device is provided to capture an image of at least one of the plurality of light spots, the at least one light spot including variations in speckle content in pixel data. At least one processor communicates with the imaging device and the VCSEL array and is configured to transmit commands to project the dot array pattern. The at least one processor is further configured to detect variations in the pixel data of the at least one light spot and, based on this detection, determine minute changes in the positioning of the surface.

[0064] According to another aspect of this disclosure, the detection system includes an imaging device configured to capture an image in a field of view. An illumination assembly is configured to illuminate the field of view using a dot array pattern. The illumination assembly includes a plurality of vertical-cavity surface-emitting lasers (“VCSELs”) arranged in a VCSEL array, the plurality of VCSELs being configured to project a plurality of illuminations. Optical elements are configured to collimate the plurality of illuminations and diffract each of the plurality of illuminations into at least one spot of light projected onto a surface inside the vehicle. A processor communicates with the imaging device and the illumination assembly. The processor is configured to transmit signals to operate the VCSEL array, process the image of the interior to determine the location of at least one point in the dot array pattern, and determine the depth of the surface based on the location of the at least one point.

[0065] Those skilled in the art will understand that the construction of the described disclosure and other components is not limited to any particular material. Unless otherwise described herein, other exemplary embodiments of this disclosure may be formed from a wide variety of materials.

[0066] For the purposes of this disclosure, the term "coupled" (in all its forms, including couple, coupling, etc.) generally means the direct or indirect engagement of two (electrical or mechanical) components with each other. Such engagement can be static or movable in nature. Such engagement can be achieved using two (electrical or mechanical) components and any additional intermediate member that forms a single unit with or integrally with the two components. Unless otherwise stated, such engagement can be permanent in nature, or removable or detachable in nature.

Claims

1. A detection system for a vehicle, characterized in that including: an imaging device configured to capture an image of an interior surface of the vehicle; an illumination assembly including: an array of laser diodes each configured to project illumination, each laser diode configured as at least one of a single mode laser or a vertical cavity surface emitting laser ("VCSEL"); optical elements proximate to the array of laser diodes and including a collimating element to direct the illumination to form at least one spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit signals to operate the array of laser diodes, process the image of the interior surface to detect at least one of a change in position of the at least one spot or a change in speckle content.

2. The detection system of claim 1, wherein, the processor is further configured to determine a presence of a vehicle occupant with the change in the position of the at least one spot or the change in the speckle content.

3. The detection system of claim 2, wherein, the processor is further configured to detect a vital sign of the vehicle occupant by a change in the speckle content as a result of movement on the micron or micro-arcsecond scale.

4. The detection system of claim 3, wherein, the vital sign includes at least one of a rate and amplitude of respiration or pulse.

5. The detection system of claim 2, wherein, determining the change in the speckle content of the at least one spot includes comparing first pixel data of the at least one spot captured at a first time to second pixel data of the at least one spot captured at a second time after the first time.

6. The detection system according to one of claims 2 to 5, characterized in that the processor is further configured to detect movement of the vehicle occupant by capturing the change in the position of the at least one spot and infer a depth and profile of the interior surface based on the change in the position of the at least one spot.

7. The detection system of claim 2, wherein, the processor is further configured to detect an abandonment condition if the vehicle occupant is in a rear compartment of the vehicle and no driver is detected.

8. The detection system of claim 7, wherein, the processor is configured to generate an alert after detecting an abandonment condition.

9. The detection system according to claim 7 or 8, characterized in that further including a temperature detection module to transmit a current temperature within the vehicle to the processor, wherein the processor is configured to generate a signal to a vehicle system to at least one of open a window or control an HVAC system after detecting the abandonment condition and the current temperature is within a threshold.

10. The detection system according to any one of claims 2 to 5, characterized in that, the at least one spot includes a plurality of spots in an array of spots.

11. The detection system of claim 1, wherein, each laser diode in the array of laser diodes is configured as the VCSEL.

12. The detection system of claim 9, wherein, each laser diode is uniformly spaced on a common substrate.

13. The detection system according to one of claims 2 to 5, characterized in that each laser diode in the array of laser diodes is configured as the single mode laser.

14. A detection system characterized by, including: an imaging device configured to capture an image in a field of view; an illumination assembly configured to illuminate the field of view with a pattern of an array of spots, the illumination assembly including: a plurality of vertical cavity surface emitting laser diodes ("VCSELs") arranged in an array of laser diodes and configured to project a plurality of illuminations; and optical elements configured to collimate the plurality of illuminations into at least one spot; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit signals to operate the array of laser diodes, process the image of the interior to determine a location of at least one point in the array of points, and extract a depth of a surface based on the location of the at least one point.

15. The detection system of claim 14, wherein, a diffractive element configured to direct and replicate the illumination from the collimating element.

16. The detection system according to claim 14 or 15, characterized in that Each VCSEL is configured as a single-mode laser diode.

17. The detection system of claim 14 or 15, wherein, The processor is further configured to determine a presence of a vehicle occupant by inferring a profile of a surface of the interior based on the extracted depth.

18. The detection system of claim 14 or 15, wherein, The processor is further configured to determine a presence of a vehicle occupant and detect a vital sign of the vehicle occupant by a change in speckle content as a result of movement on the micron or micro-radian scale.

19. A detection system characterized by, comprising: an imaging device configured to capture an image in a field of view; an illumination assembly configured to illuminate the field of view with an array of points, the illumination assembly comprising: a plurality of single-mode lasers arranged in an array of laser diodes and configured to project a plurality of illuminations; and optical elements configured to collimate the plurality of illuminations into at least one light point; and a processor in communication with the imaging device and the illumination assembly, the processor configured to transmit signals to operate the array of laser diodes, process the image of the interior to detect a change in speckle content of at least one point in the array of points, and identify a condition of the interior based on the detected change in speckle content.

20. The detection system of claim 19, wherein, The condition of the interior is a vital sign of a vehicle occupant detected by a change in speckle content as a result of movement on the micron or micro-radian scale.

Images