Vehicle in-cabin monitoring system with light emitters selectively operating for DMS and OMS functions

By using controllable LED light emitters and electronic control units in vehicle vision systems, the problems of hardware redundancy and high cost in the prior art are solved, flexible lighting for different functions is achieved, and system complexity is reduced.

CN119527168APending Publication Date: 2025-02-28MAGNA ELECTRONICS INC
View PDF 96 Cites 0 Cited by

Patent Information

Application Number
CN202411709278.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2021-09-03
Filing Date
2022-09-02
Publication Date
2025-02-28

AI Technical Summary

Technical Problem

When existing vehicle imaging systems implement driver and occupant monitoring functions, different lighting requirements lead to hardware redundancy, which increases cost and complexity.

Method used

A vehicle vision system is designed to selectively provide current to different LED groups through electronic control unit (ECU) control switches, thereby achieving flexible lighting for different functions.

Benefits of technology

The system can meet the different lighting needs of driver and occupant monitoring functions based on a single camera and controller, reducing the number of illuminated light sources required, and reducing system cost and complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119527168A_ABST
    Figure CN119527168A_ABST
Patent Text Reader

Abstract

A vehicle cabin monitoring system includes a lens portion adjustably attached to a mounting structure configured to be attached at an interior portion of a vehicle. The lens portion accommodates a camera and a plurality of light emitting diodes (LEDs) connected in series with each other. The switch is operable to be in an open state in which current provided by the current driver passes through each respective LED of the plurality of LEDs and a closed state in which current provided by the current driver passes through a first group of LEDs of the plurality of LEDs and bypasses a second group of LEDs of the plurality of LEDs. When the camera acquires image data for a first vehicle function, such as occupant monitoring, the switch operates to be in an open state; when the camera acquires image data for a second vehicle function, such as driver monitoring, the switch operates to be in the closed state.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with the application date of September 3, 2021, application number 202280059453.4, and invention name "Vehicle cabin monitoring system with optical transmitter selectively operated for DMS and OMS functions".

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims the benefit of U.S. Provisional Application No. 63 / 260,884, filed on September 3, 2021, the entire contents of which are incorporated herein by reference. Technical Field

[0004] The present invention generally relates to a vehicle vision system for a vehicle, and more particularly to a vehicle vision system utilizing one or more cameras on a vehicle. Background Art

[0005] The use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Patent Nos. 5,949,331; 5,670,935 and / or 5,550,677, the entire contents of which are incorporated herein by reference. Summary of the invention

[0006] A cabin monitoring system or a driver assistance system or a vision system or an imaging system for a vehicle acquires image data using one or more cameras, preferably one or more CMOS cameras. The system may include a lens head that is adjustably attached to a mounting structure or base. The mounting structure is configured to be attached to an interior portion of a vehicle. The camera is accommodated by the lens head. A plurality of light emitting diodes (LEDs) are accommodated by the lens head. The plurality of LEDs are connected in series with each other. The system includes a current driver configured to provide current to the plurality of light emitting diodes. The system includes a switch having an open state and a closed state. When the switch is in the open state, the current provided by the current driver passes through each of the plurality of LEDs. When the switch is in the closed state, the current provided by the current driver passes through a first portion or group or subgroup of the plurality of LEDs and bypasses a second portion or group or subgroup of the LEDs. The first portion of the LEDs is different from the second portion of the LEDs. The system also includes an electronic control unit (ECU) including electronic circuitry and associated software. The electronic circuitry of the ECU includes an image processor for processing image data acquired by the camera. When the camera acquires image data for a first vehicle function, the ECU places the switch in an open state. When the camera acquires image data for the second vehicle function, the ECU places the switch in a closed state.

[0007] The above and other objects, advantages, uses and features of the present invention will become more apparent after reading the following description in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a perspective view of an interior rearview mirror assembly having a driver monitoring camera and a near infrared light emitter behind a reflective element of the interior rearview mirror assembly;

[0009] Figure 2 is another perspective view of the interior rearview mirror assembly showing the driver monitoring camera and light emitter without the reflective element;

[0010] Figure 3 yes Figure 1 A schematic diagram of a lighting system of components;

[0011] Figure 4 is an exploded perspective view of the interior rearview mirror assembly;

[0012] Figure 5 is a plan view of a portion of a lens head housing near infrared light emitters, the near infrared light emitters including narrow beam emitters and wide beam emitters;

[0013] Figure 6 and Figure 7 is a plan view of the other mirror portion of the interior rearview mirror assembly;

[0014] Figure 8 is a plan view of a portion of a lens head housing a near infrared light emitter, the near infrared light emitter comprising two narrow beam emitters, one for illuminating the head of a driver of a left-hand drive vehicle and the other for illuminating the head of a driver of a right-hand drive vehicle;

[0015] Fig. 9 is a block diagram of a controller for controlling a DMS optical transmitter;

[0016] Fig.10 shows a LED control sequence diagram when the mirror assembly is installed in a left-hand drive vehicle;

[0017] Fig.11 shows a LED control sequence diagram when the mirror assembly is installed in a right-hand drive vehicle; and

[0018] Figure 12A-12E Shown are different locations of the wFOV and nFOV near IR illuminators at the head of the mirror for a single-box interior DMS rearview mirror assembly. DETAILED DESCRIPTION

[0019] The vehicle vision system, and / or driver or driver assistance system, and / or lighting system, and / or driver or occupant monitoring system operate to acquire images inside and / or outside the vehicle, and may process the acquired image data to display images and detect objects at, near, or within the vehicle for assisting the driver or other occupants of the vehicle. The vision system includes an image processor or image processing system that is operable to receive image data from one or more cameras and may provide an output to a display device for displaying an image representing the acquired image data. Optionally, the vision system may provide a display, such as a rear view display, or a top view, or a bird's eye view, or a surround view display, etc.

[0020] Referring now to the drawings and the illustrative embodiments depicted therein, in some embodiments, an interior rearview mirror assembly 10 for a vehicle includes a housing 12 and a reflective element 14 ( Figure 1 ). In the illustrated embodiment, the mirror assembly 10 is configured to be adjustably mounted to an interior portion of a vehicle (e.g., to the interior of a vehicle windshield or to an interior surface of a vehicle cabin or to a roof of a vehicle, etc.) via a mounting structure or mounting arrangement or assembly 16. The mirror reflective element may include a variable reflectivity mirror reflective element whose reflectivity varies in response to an electrical current applied to a conductive coating or layer of the reflective element.

[0021] The mirror assembly 10 includes or is associated with a driver monitoring system (DMS), and the mirror assembly also includes a driver / occupant monitoring camera 18, which is arranged at the back plate 20 behind the reflective element 14 (and views through the opening of the back plate) and views through the reflective element at least toward the driver's head area of ​​the vehicle ( Figure 2 ). The DMS includes one or more infrared (IR) or near infrared (NIR) light emitters 24, which may be arranged at the back plate 20 and may emit light through another opening of the back plate and through the reflective element.

[0022] The mirror assembly 10 includes a printed circuit board (PCB) having a control member or control unit (e.g., arranged at a circuit board or substrate in the mirror housing) including electronic circuitry including a drive circuit for controlling dimming of the mirror reflective element. The circuit board (or a separate DMS circuit board) includes a processor for processing image data acquired by the camera 18 to monitor the driver and determine, for example, driver attention and / or driver drowsiness. The driver monitoring system includes the driver monitoring camera 18 and may also include an occupant monitoring camera (or the driver monitoring camera may have a sufficiently wide field of view to observe the occupant or passenger seat of the vehicle as well as the driver area), and may provide occupant detection and / or monitoring functionality as part of an occupant monitoring system (OMS).

[0023] The mirror assembly may also include one or more light emitters (e.g., IR or NIR light emitting diodes (LEDs) or vertical cavity surface emitting lasers (VCSELs), etc.) that are arranged at the back plate 20 behind the reflective element 14 and emit near infrared light (or other invisible light) through the opening of the back plate and through the reflective element toward the driver's head area of ​​the vehicle.

[0024] The driver monitoring system and mirror assembly and NIR emitters and cameras can utilize various aspects of the driver monitoring system and rearview mirror assembly and NIR emitters and cameras described in International PCT Application No. PCT / US2022 / 072238 filed on May 11, 2022 and / or PCT Application No. PCT / US2022 / 070882 filed on March 1, 2022, the entire contents of which are incorporated herein by reference.

[0025] Thus, the interior rearview mirror may include an embedded camera, an IR / NIR illuminator, and one or more processors for processing acquired image data for driver monitoring applications. The inward-facing camera 18 and light emitter 24 may be fixed within the mirror head, and thus both components may be coupled to the mirror body. In these cases, the camera's field of view may vary from driver to driver as the mirror head is adjusted to set the driver's preferred rearward viewing angle. Alternatively, the camera and light emitter may be arranged at a fixed (non-adjustable) mounting structure of the mirror assembly, or may be arranged elsewhere within the vehicle cabin.

[0026] A camera, such as a camera located at an interior rearview mirror (e.g., camera 18), is often used for multiple functions. For example, the camera may acquire image data for an occupant monitoring system in addition to acquiring image data for a driver monitoring system. However, these different functions may have different lighting needs or requirements. For example, the functions may require different light intensities, different light directions, different light frequencies, etc. Conventional systems may provide separate systems with redundant hardware to implement these two functions, which increases costs.

[0027] Reference now Figure 3, the light emitter 24 may include a plurality of LEDs (e.g., one or more IR LEDs and / or one or more NIR LEDs) arranged, for example, at a PCB. In this example, six LEDs are connected in series, but the light emitter may include any number of LEDs 26. The LED 26 is energized by a current driver 28 that supplies current to the LED 26. When the current driver 28 supplies current to the LED 26, the LED emits light (e.g., IR light, NIR light, visible light, ultraviolet (UV) light, etc.). A controller 30, such as an ECU or MCU or other processor, controls the current driver 28 (i.e., adjusts the magnitude of the current provided by the current driver 28). The ECU 30 may enable / disable the current driver 28, thereby enabling / disabling the LED 26 (i.e., by stopping or reducing the current provided to the LED 26). The ECU 30 may control the intensity or brightness of the light emitted by the LED 26 by adjusting the magnitude of the current provided by the current driver 28.

[0028] The system also includes at least one switch 32. The switch can be any electrical / electronic switch (e.g., a solid-state switch) controlled by the ECU 30, such as a metal oxide semiconductor field effect transistor (MOSFET), a bipolar transistor, a power diode, etc. The switch 32 allows current to bypass one or more of the LEDs 26. Here, the switch 32 connects the point 34 between the third and fourth LEDs 26 to a return (e.g., ground). When the switch 32 is closed, current will flow through the first, second, and third LEDs and bypass the fourth, fifth, and sixth LEDs. In this way, the ECU 30 can open the switch 32 to provide current to the entire group of LEDs 26 so that all six LEDs are illuminated (because when the switch is open, none of the LEDs 26 are bypassed), or the ECU 30 can close the switch 32 to provide current to only the first three LEDs (and bypass the last three LEDs 26). In this way, the ECU 30 can operate the switch 32 to quickly and easily control the amount of light emitted by the group of LEDs 26 (and optionally the direction of the light or the type or color of the light).

[0029] For example, if a first function (e.g., an OMS function) requires illumination from all six LEDs 26, the ECU 30 can ensure that the switch 32 is open when the camera 18 is acquiring image data frames for the first function. The ECU 30 can synchronize the LED illumination with the camera so that the LEDs are illuminated only when the camera is acquiring image data frames to be used by the corresponding function or system (e.g., OMS). A second function (e.g., a DMS function) may require less illumination (or illumination of different areas) than the first function. For example, the second function may require illumination from only three LEDs 26 (e.g., because only the driver is required to be illuminated instead of all occupants of the vehicle). The ECU 30 can ensure that the switch 32 is closed when the camera 18 is acquiring image data frames for the second function. For example, the system can alternate between acquiring image data frames for the OMS function and for the DMS function, and the ECU 30 can open and close the switch 32 accordingly to drive the corresponding LED 24 during the acquisition of each frame of image data. Alternatively, the ECU 30 can disable all LEDs 24 (e.g., via the current driver 28) between acquiring each image data frame.

[0030] The ECU 30 can control the current of different LEDs 26 via the switches 32 to achieve purposes other than or different from intensity. For example, one or more of the LEDs 26 can be angled in different directions (e.g., more toward a particular occupant of the vehicle or more toward a particular area of ​​the vehicle) to emit light in different directions, or some of the LEDs can emit different types of light, such as some LEDs emitting visible light while other LEDs emit NIR light. The ECU 30 can control the direction or type of light emitted by controlling the switches 32.

[0031] Optionally, switch 32 is electrically connected in series with a first group or portion or group or subgroup of LEDs 26 (the first three LEDs in this example) and in parallel with a second group or portion or group or subgroup of LEDs 26 (the last three LEDs in this example). Since switch 32 is connected in series with the first group or group or subgroup of LEDs, current flows through the first portion of LEDs 26. Since switch 32 is connected in parallel with the second group or group or subgroup of LEDs 26 and the resistance of the path provided by the switch is less than the resistance of LEDs 26, current will bypass the second group or group or subgroup of LEDs 26 and flow through the closed switch 32 instead.

[0032] The system may include any number of LEDs 26 and any number of switches 32. By using a single current driver 28, multiple switches may allow the ECU to have fine control over which LEDs 26 are supplied with current and which LEDs are bypassed. Figure 3In the example of , the system may include a second switch 32 to bypass one LED, two LEDs, four LEDs, and five LEDs (i.e., based on the position of the switch along the string of LEDs 26 to which it is connected). The ECU 30 can operate each switch 32 independently to provide fine control over the intensity and / or direction and / or type of light emitted.

[0033] As the camera 30 acquires image data, the ECU 30 may energize different LEDs for different functions. For example, the camera 30 may run at a fixed rate (e.g., 30 frames per second), and a portion of the acquired frames may be used for one function, while another portion of the acquired frames may be used for another function. The ECU 30 may synchronize the operation of one or more switches 32 with the operation of the camera, so that as the camera 18 acquires a frame of image data, the appropriate LED 26 may be enabled depending on the function being used.

[0034] The system may include aspects of a driver monitoring system or an occupant monitoring system described in U.S. patent application No. 17 / 663,462 filed on May 16, 2022 and / or International PCT application No. PCT / US2022 / 072238 filed on May 11, 2022 and / or PCT application No. PCT / US2022 / 070882 filed on March 1, 2022, the entire contents of which are incorporated herein by reference.

[0035] Thus, the vision system described herein allows an ECU or other controller / processor to bypass one or more LEDs (or other illumination sources) using one or more switches. This allows the ECU to control which LEDs are illuminated via the switches, and allows the system to acquire image data for different functions with different lighting requirements using only a single camera, controller, and current driver. The system can reduce the number of illumination sources required (e.g., by reducing redundancy). Although the examples herein describe a camera included in an interior rearview mirror and IR / NIR LEDs for, for example, OMS and DMS features, the vision system can be applied to any camera, such as other interior cameras or exterior cameras (e.g., for object detection outside the vehicle), and can be applied to any type of illumination source, such as an LED (e.g., an LED that emits IR light, visible light, UV light, etc.).

[0036] The mirror assembly includes or is associated with a driver monitoring system (DMS), and the mirror assembly also includes a driver / occupant monitoring camera 18, which is arranged at the back plate 20 behind the reflective element 14 (and observes through the opening of the back plate) and observes through the reflective element at least toward the driver's head area of ​​the vehicle. The DMS includes a near infrared light emitter 24 (or other non-visible light emitter, such as an infrared light emitter), which is arranged at the back plate 20 and emits light through another opening of the back plate and through the reflective element.

[0037] When the DMS camera is arranged in the lens head, the camera moves with the lens head (which includes a mirror housing and a mirror reflective element pivoted at a pivot joint, and the pivot joint pivotally connects the lens head with the mounting structure of the interior rearview mirror assembly, and the mounting structure is mounted on the windshield or roof of the equipped vehicle) so that when the driver aligns the rearview mirror to observe the rear, the camera is aligned with the driver's line of sight. The position of the DMS camera and one or more IR LEDs at the lens head can provide the driver with an unobstructed field of view. The DMS is preferably independently included in the interior rearview mirror assembly, and can therefore be easily implemented in various vehicles, including existing vehicles and different models of the same vehicle brand (for example, implemented in BMW 3 Series models and BMW X3 models, BMW 5 Series models and BMW X5 models, and BMW 7 Series models). The driver monitoring camera can also provide the acquired image data for the occupant monitoring system (OMS), or another separate camera is arranged in the mirror assembly for the OMS function.

[0038] like Figure 4 As shown, the mirror assembly includes a printed circuit board (PCB) 31, which has a control member or control unit (arranged at a circuit board or substrate in the mirror housing) including an electronic circuit, and the electronic circuit includes a drive circuit for controlling the dimming of the mirror reflective element. The circuit board (or a separate DMS circuit board) includes a processor, which processes the image data acquired by the camera 18 for monitoring the driver and determining the driver's attention and / or driver drowsiness, etc. The driver monitoring system includes a driver monitoring camera, and may also include an occupant monitoring camera (or the driver monitoring camera may have a sufficiently wide field of view to observe the vehicle's occupants or passenger seats and driver area), and may provide occupant detection and / or monitoring functions as part of an occupant monitoring system (OMS).

[0039] The mirror assembly may also include one or more infrared (IR) or near-IR light emitters 24 (e.g., IR or near-IR light emitting diodes (LEDs) or vertical cavity surface emitting lasers (VCSELs), etc.) disposed at the back plate 20 behind the reflective element 14 and emitting near-IR light through the openings in the back plate and through the reflective element toward the vehicle driver's head area. Figure 5As shown, the IR emitting device 24 includes an IR emitter or LED printed circuit board having a first group of near infrared light emitting diodes 24a (e.g., a group of wide beam LEDs) at a portion of the LED PCB and a second group of near infrared light emitting diodes 24b (e.g., a group of narrow beam LEDs) at another portion of the LED PCB. One portion of the LED PCB is angled relative to another portion to emit light in a desired direction depending on the orientation of the mirror head. Thus, the first group of near infrared light emitting diodes may be angled toward the left side of the vehicle so as to be directed toward the driver of a left-hand drive vehicle (if the mirror assembly is installed in a left-hand drive vehicle and the first group of near infrared light emitting diodes is enabled for driver monitoring functions), while the second group of near infrared light emitting diodes may be angled toward the right side of the vehicle so as to be directed toward the driver of a right-hand drive vehicle (if the mirror assembly is installed in a right-hand drive vehicle and the second group of near infrared light emitting diodes is enabled for driver monitoring functions).

[0040] BMW, Ford, GM, Tesla, and Subaru (e.g., GM's SuperCruise TM or Ford's BlueCruise TM Conventional driver monitoring systems (DMS) in vehicles such as those described in https: / / www.consumerreports.org / car-safety / driver-monitoring-systems-ford-gm-earn-points-in-cr-tests-a6530426322) are "dual-box" DMS, i.e., (i) a camera for monitoring the driver's head / eyes and a near IR emitting light source for illuminating the driver's head / eyes are housed in a first box or module (typically located at the steering column of the equipped vehicle or in the roof area of ​​the equipped vehicle), and (ii) the electronics / software for analyzing the acquired image data to determine the driver's gaze direction or head position or eye movement or alertness or sleepiness are housed in a separate second box or module, which is located away from the first box and maintained at a certain distance from the first box, and is typically connected to the first box via a wired connection (the second box typically includes an ECU, which may be part of the host of the equipped vehicle and optionally provides other features in addition to the DMS).

[0041] The "single-box" DMS electrochromic interior rearview mirror assembly has both a camera for monitoring the driver's head / eyes and a near-IR emitting light source for illuminating the driver's head / eyes, both of which are housed by the interior rearview mirror assembly (and preferably both are housed within the lens head of the interior rearview mirror assembly). Thus, the single-box DMS electrochromic interior rearview mirror assembly allows the original equipment manufacturer (OEM) of the vehicle (e.g., VW or Toyota or Honda or GM or Ford) to equip the vehicle with such a DMS electrochromic mirror assembly, which includes: camera / illumination light source / driver monitoring software / related driver monitoring electronic circuitry, such as one or more data processing chips, memory, electronic components; one or more printed circuit boards, which include automatic dimming circuitry, one or more data processing chips, memory, electronic components; light sensors for detecting glare and ambient lighting; and a power supply, one or more electrical connectors, one or more heat sinks, mechanical components, etc. Thus, an OEM may purchase a single-box interior DMS rearview mirror assembly from an interior rearview mirror assembly manufacturer, and the OEM may install the single-box interior DMS rearview mirror assembly on a vehicle being assembled (typically mounted to a rearview mirror mounting button or similar element that is adhered to the interior side of the vehicle's windshield). To operate in an equipped vehicle, the single-box interior DMS rearview mirror assembly is connected to the vehicle's vehicle wiring harness and supplied with ignition voltage (nominal 12V DC, but may vary from 9V (6V for automatic stop / start) to approximately 16V depending on vehicle type and vehicle operating conditions) via the vehicle wiring harness. The single-box interior DMS rearview mirror assembly supplies vehicle data via the wiring harness, including vehicle data and other data supplied via a CAN bus or link (which may transmit vehicle information to the rearview mirror, and may also transmit information such as distraction alerts from the rearview mirror), or data supplied via a local area network (LIN) bus or line.

[0042] The interior DMS rearview mirror assembly provides an independent single-box DMS solution, which has a camera / near-infrared illumination source / DMS software and its related data processing chip / automatic dimming circuit / circuit for controlling the exterior electrochromic mirror reflective element as part of the outside mirror of the equipped vehicle / data processing circuit / communication circuit / memory / power supply / related electronic devices and hardware / heat sink, etc. The data processing circuit / communication circuit / memory / power supply / related electronic components and hardware / heat sink, etc. are packaged into, integrated into and accommodated by the vehicle interior rearview mirror assembly, and are preferably concealedly integrated into the lens head of the vehicle interior rearview mirror assembly, located behind the semi-transparent and semi-reflective mirror-type reflective element of the vehicle interior rearview mirror assembly (and concealed from the driver's viewing angle by the semi-transparent and semi-reflective mirror-type reflective element).

[0043] Thus, the interior rearview mirror has embedded therein a camera, an infrared illuminator, and a processor for processing the acquired image data for driver monitoring applications. The inward-facing camera 18 and the IR illuminator 24 are fixed within the mirror head, and thus both components are coupled to the mirror body. Thus, as the mirror head is adjusted to set the driver's preferred rearward viewing angle, the camera's field of view will change from driver to driver.

[0044] In the illustrated embodiment, the camera and the light emitter are arranged behind the mirror reflective element, which may include an electro-optical (e.g., electrochromic or EC) mirror reflective element or a prismatic mirror reflective element. The mirror housing may include a plastic outer ring portion that surrounds the peripheral edge of the mirror reflective element and provides an outer arcuate surface that transitions from the outer surface of the mirror housing to the flat front surface of the mirror reflective element (optionally, no portion of the plastic outer ring portion overlaps or covers the flat front surface of the mirror reflective element), so that the plastic outer ring completes the homologous edge. Optionally, the mirror reflective element may provide an exposed arcuate outer surface that transitions from the outer surface of the mirror housing to the flat front surface of the mirror reflective element.

[0045] like Figure 4 As shown, the mirror back plate 20 is adhered to the rear of the mirror reflective element 14 (e.g., via foam tape 25). A heat spreader 29 (e.g., a thin aluminum plate) can be arranged at the rear of the back plate, and a printed circuit board (PCB) 31 can be attached to the rear of the heat spreader. The heat sink / chassis and EMI field forming (FIP) gasket are arranged at the rear of the printed circuit board and are configured to be attached to a pivot element 37 (shown as a socket element) that is pivotally attached to the ball component 16a of the mirror mount 16. A thermal interface material 33 can be arranged between the circuit board 31 and the chassis 35 to enhance heat dissipation from the circuit board to the chassis and heat sink.

[0046] Optionally, the mirror back plate or attachment plate can be molded from a metal filled injection moldable material (e.g., stainless steel (SS) fiber, such as polycarbonate (PC) acrylonitrile-butadiene-styrene (ABS) and SS fiber material) to provide electromagnetic interference (EMI) mitigation (EMC shielding). Optionally, the heat sink can be formed via additive manufacturing (3D printing, etc.) to provide an additively manufactured heat sink with a capillary effect to help conduct heat more evenly and away from high power components.

[0047] The near infrared light emitter 24 includes a circuit board or element 25 attached to the chassis 35 by thermal adhesive and arranged at the opening of the back plate, and an IR long pass filter 36 is arranged between the reflective element and the near IR light emitter. The near IR light emitter 24 is located to the left of the lens head (as viewed by the driver of the vehicle on which the lens head is mounted) and is configured to illuminate the driver's head area of ​​a left-hand drive vehicle.

[0048] In the illustrated embodiment, the light emitter 24 has two groups of LEDs disposed on a circuit board, one group of LEDs 24a emitting a wider beam / wide beam of near-infrared light (e.g., four wide beam LEDs) when powered, and the other group of LEDs 24b emitting a narrower beam / narrow beam of near-infrared light (e.g., four narrow beam LEDs) when powered. The narrow beam LEDs may be powered or energized for driver monitoring functionality, while the wide beam LEDs may be powered or energized for occupant monitoring functionality (and may be intermittently powered for illuminating specific frames of acquired image data, for example by utilizing aspects of the systems described in International PCT Application No. PCT / US2022 / 072238 filed on May 11, 2022 and / or International PCT Application No. PCT / US2022 / 07088 filed on March 1, 2022, which claims U.S. Provisional Application Nos. 63 / 267, 367, filed on January 31, 2022 16. Application benefits of U.S. Provisional Application No. 63 / 262,642 filed on October 18, 2021, U.S. Provisional Application No. 63 / 260,359 filed on August 18, 2021, U.S. Provisional Application No. 63 / 201,757 filed on May 12, 2021, U.S. Provisional Application No. 63 / 201,371 filed on April 27, 2021, U.S. Provisional Application No. 63 / 200,451 filed on March 8, 2021, and U.S. Provisional Application No. 63 / 200,315 filed on March 1, 2021, all of which are incorporated herein by reference in their entirety).

[0049] The narrow beam LED 24b is angled or tilted or offset (e.g., about 10 degrees) toward the left side and therefore toward the driver of a left-hand drive vehicle, while the wide beam LED 24a is not offset toward either side. When the mirror assembly is installed in a left-hand drive vehicle, the narrow beam LED illuminates the driver's head area, while the wide beam LED illuminates the passenger area and the driver area. However, when the mirror assembly is installed in a right-hand drive vehicle, the narrow beam LED does not illuminate the driver's head area, while the wide beam LED illuminates the passenger area and the driver area.

[0050] The mirror assembly may include a near infrared light emitter configured and operable to selectively emit light toward the driver's head area when the mirror assembly is arranged in a left-hand drive vehicle (where the driver is sitting in the left driver's seat) or when the mirror assembly is arranged in a right-hand drive vehicle (where the driver is sitting in the right driver's seat). The DMS / OMS illumination provided by the system may be software configured based on the vehicle data of the country code. For example, the DMS light emitters may include two or three rows / groups / groups of independent light emitters or LEDs. One group is aligned or angled toward the left side of the vehicle and one group is aligned or angled toward the right side of the vehicle. Optionally, there is a third group that is aligned somewhere in the middle (in the illustrated example discussed below, the third group is oriented perpendicular to the mirror surface). These groups or groups may be composed of various combinations of wide and narrow LEDs or VCSELs. By knowing the country the vehicle is located in, and whether the vehicle is a left-hand drive (LHD) or right-hand drive (RHD) vehicle, software on the DMS / OMS ECU (remote from the rearview mirror or inside the rearview mirror) can be configured to actuate those LEDs for specific DMS or OMS functions and / or frameworks (e.g., by utilizing aspects of the driver / occupant monitoring system described in International PCT Application No. PCT / US2022 / 072238, filed May 11, 2022, and / or by utilizing aspects of the driver / occupant monitoring system described in International PCT Application No. PCT / US2022 / 070882, filed March 1, 2022, the entire contents of which are incorporated herein by reference). Because the controller and system are configurable via software, the mirror design can be universal across LHD / RHD vehicles and can be used worldwide.

[0051] Therefore, the DMS light emitter is provided in a mirror assembly having two sets of narrow beam LEDs, one set for illuminating a driver of a left-hand drive vehicle when the mirror assembly is installed in a left-hand drive vehicle, and the other set for illuminating a driver of a right-hand drive vehicle when the mirror assembly is installed in a right-hand drive vehicle. Figure 6-Figure 8, the mirror assembly 110 includes a camera 118 and a near IR light emitter 124, which is arranged behind the mirror reflective element 114 and to the left of the center of the mirror head. The near IR light emitter includes three groups of LEDs (e.g., each group has four LEDs), including a wide beam group LED 124a, which is arranged between a first narrow beam group LED 124b and a second narrow beam group LED 124c. The wide beam group LED 124a is centrally positioned at the light emitter PCB 125 and is not biased in either direction (i.e., its main beam axis is generally normal to the flat element of the mirror reflective element, and the beam provides illumination across greater than 100 degrees within the vehicle cabin, such as illumination across greater than 120 degrees within the vehicle cabin, such as illumination across greater than 150 degrees within the vehicle cabin), while the first narrow beam group LED 124b is arranged at the left side of the wide beam group and is biased toward the left side (e.g., tilted or angled at an angle of approximately 0 to 20 degrees, preferably 5 to 15 degrees, such as 10 degrees), and the second narrow beam group LED 124c is arranged to the left of the wide beam group LED The light emitter circuit board 125 may include three portions, a central portion parallel to the planar surface of the reflective element, and side portions angled or tilted relative to the central portion and the planar surface of the reflective element to provide a desired or selected main beam axis angle of the narrow beam group LEDs. For applications where the light emitters are arranged to the right of the center of the mirror head, the angles of the light emitters emitting narrow beams should be reversed / reversed so that the first narrow beam group LED arranged to the left of the wide beam group is biased toward the left (e.g., tilted or angled at an angle of approximately 10 to 30 degrees, preferably 15 to 25 degrees, such as 20 degrees or 22 degrees), and the second narrow beam group LED arranged to the right of the wide beam group is biased toward the right (e.g., tilted or angled at an angle of approximately 0 to 20 degrees, preferably 5 to 15 degrees, such as 10 degrees) (and each narrow beam group provides illumination across less than 100 degrees within the vehicle cabin, such as illumination across less than 80 degrees within the vehicle cabin, such as illumination across less than 60 degrees within the vehicle cabin).

[0052] Thus, when the mirror assembly is installed in a left-hand drive vehicle, the system is arranged so that the driver monitoring LEDs (LEDs that are powered when the system is acquiring image data for a driver monitoring function) include a first narrow beam group of LEDs 124b, such that during image acquisition for the driver monitoring function, the driver's head is illuminated by the near infrared radiation emitted by the LEDs 124b. Similarly, when the mirror assembly is installed in a right-hand drive vehicle, the system is arranged so that the driver monitoring LEDs include a second narrow beam group of LEDs 124b, such that during image acquisition for the driver monitoring function, the driver's head is illuminated by the near infrared radiation emitted by the LEDs 124b. The wide beam group of LEDs is the same for both left-hand drive applications or right-hand drive applications, and provides a wider illumination during image acquisition for the occupant monitoring function.

[0053] The light emitters are enabled by software such that the first or second narrow beam group of LEDs (for the driver monitoring function) is enabled depending on the type of vehicle (left-hand drive or right-hand drive) in which the mirror assembly is installed. Thus, when the mirror assembly is installed in a left-hand drive vehicle, the first narrow beam group of LEDs is enabled (for the driver monitoring function) such that when operating for the driver monitoring function, the first narrow beam group of LEDs is powered (and the second narrow beam group of LEDs is not enabled or powered). Alternatively, if the mirror assembly is installed in a right-hand drive vehicle, the second narrow beam group of LEDs is enabled (for the driver monitoring function) such that when operating for the driver monitoring function, the second narrow beam group of LEDs is powered (and the first narrow beam group of LEDs is not enabled or powered).

[0054] Thus, the driver monitoring system may control the LED control circuit to enable and energize or power the appropriate set of LEDs depending on the vehicle type and whether the system is acquiring image data for a driver monitoring function or an occupant monitoring function. Fig. 9 As shown, different groups of LEDs are energized by LED control circuits, which are provided with LED control signals from a microprocessor. The LED control circuit can be arranged at the circuit board of the light emitter, and the microprocessor can be arranged at the ECU of the lens head or at a remote ECU of the vehicle. The microprocessor controls the light emitters based on the image acquired by the DMS / OMS camera, so that appropriate areas of the vehicle cabin are illuminated by the light emitters based on the specific function (driver monitoring or occupant monitoring) for which the system is currently acquiring image data. The control sequence for actuating different groups of LEDs of the light emitter can be similar to Fig.10 (left-hand drive vehicle) or Fig.11(right hand drive vehicle) shown. Selection or activation of one of the narrow beam group LEDs may occur only once, such as when the mirror is installed at a LHD or RHD vehicle, or prior to installation and when the mirror assembly is assembled or shipped to the assembly plant, or any other time prior to normal operation of the DMS / OMS. After initial setup, the DMS will operate to energize the appropriate or selected or enabled narrow beam group for the DMS function, and will not operate or energize the unselected or unenabled narrow beam groups for the DMS function.

[0055] Thus, when the mirror assembly is installed in a vehicle (typically at a vehicle assembly line) or installed as a replacement service part, and when the vehicle is powered on, a signal or flag input (e.g., via a CAN bus signal or the like) is provided to the electronic circuitry of the mirror assembly indicating whether the vehicle is a left-hand drive vehicle or a right-hand drive vehicle. Optionally, the signal may be provided at initial vehicle startup (after the mirror assembly is installed and the vehicle is assembled) or at each ignition cycle. Optionally, a signal may be provided when the mirror assembly is assembled (e.g., at a mirror assembly plant or mirror manufacturer) and is designated for use with a left-hand drive vehicle or a right-hand drive vehicle.

[0056] The electro-optical (e.g., electrochromic (EC)) mirror reflective element subassembly transmits near infrared light and reflects visible light. Thus, the mirror reflective element (i.e., the semi-transmissive and semi-reflective mirror reflector of the mirror reflective element) effectively allows the IR emitter to emit light through the reflective element and allows the camera to "see" through the mirror reflective element, while allowing the mirror reflective element to reflect at least some of the visible light incident thereon to serve its intended rear-view purpose. The IR emitter can be actuated at least in part in response to the ambient light level in the vehicle cabin and at the driver's head area, where the light level is determined by a light sensor or by processing image data acquired by a driver monitoring camera. Although shown and described as being disposed behind the mirror reflective element and emitting light through the mirror reflective element and receiving light through the mirror reflective element, the light emitter and camera can be arranged at the lower area of ​​the mirror head (using a mounting base, which is attached to the interior portion of a left-hand drive vehicle or a right-hand drive vehicle) and below the mirror reflective element and movable in coordination with the mirror head.

[0057] like Figure 4-Figure 8As shown, the driver monitoring camera is centrally positioned in the lens head. In an RHD vehicle, the nFOV near IR LED used to monitor the driver's head is positioned toward one lateral side of the lens head and is angled at an acute angle of about 10 degrees [relative to the rear plane of the rear glass surface of the EC unit (its fourth surface)] and is viewed in a direction away from the lateral side of the lens head. In an LHD vehicle, the nFOV near IR LED illuminates the driver's head and is positioned closer to the central area of ​​the lens head (where the driver monitoring camera is arranged) and is angled at an acute angle of about 20 degrees [relative to the rear plane of the rear glass surface of the EC unit (its fourth surface)] and is viewed in a direction opposite to the other nFOV LEDs. The wFOV near IR LED that provides general cabin / occupant illumination is arranged in the lens head between the locations of the nFOV LEDs and has its primary viewing axis perpendicular to the rear plane of the rear glass flat surface of the EC unit.

[0058] Thus, the switch allows current to bypass one LED subgroup. When the switch is closed, current will flow through one LED subgroup (e.g., the driver side nFOV LED) and bypass the other LED subgroup (e.g., the passenger side nFOV LED and wFOV LED). Thus, the ECU can open the switch to provide current to the entire row of LEDs (i.e., the wFOV LEDs and both groups of nFOV LEDs) so that all LEDs are illuminated (because none of the LEDs are bypassed when the switch is open), or the ECU can close the switch to provide current only to the driver side nFOV LED (while bypassing the other LEDs). Thus, the ECU can operate the switch to quickly and easily control the amount of light (and optionally the direction of the light or the type or color of the light) emitted by the LED row. Thus, when the image data acquired by the camera is processed at the ECU for the occupant monitoring function, the plurality of LEDs will be energized to emit light; when the image data acquired by the camera is processed at the ECU for the driver monitoring function, one of the LED subgroups of the plurality of LEDs will be energized to emit light (while bypassing the other LED subgroup including the passenger side nFOV LED and wFOV LED). The driver-side nFOV LED or driver monitoring LED subgroup among the plurality of LEDs, when powered on, emits light to illuminate the driver's head area in the vehicle cabin. Another LED subgroup among the plurality of LEDs (i.e., the passenger monitoring LED or the passenger-side nFOV LED) emits light at a first angle relative to the camera when powered on, while the driver-side nFOV LED or the driver monitoring LED subgroup among the plurality of LEDs emits light at a second angle relative to the camera when powered on, wherein the first angle is different from the second angle. For example, the second subgroup of LEDs may include nFOV LEDs for illuminating the driver's head area of ​​the vehicle (e.g., the left seat area for a left-hand drive vehicle), and the first subgroup of LEDs may include nFOV LEDs for illuminating the passenger's head area of ​​the vehicle (e.g., the right seat area for a left-hand drive vehicle), and the first subgroup of LEDs may also optionally include wFOV LEDs.

[0059] Thus, when the propulsion system of the equipped vehicle (e.g., the engine in an internal combustion vehicle or the electric drive of an electric vehicle) is ignited and / or started, the single-box interior DMS rearview mirror assembly is powered on. When powered on, the DMS camera acquires frames of image data at a frame acquisition rate of at least 15 frames per second (fps), preferably at least 30 fps, and more preferably at least 60 fps. During driving, the ECU of the single-box interior DMS rearview mirror assembly can understand whether the vehicle is driving in a left-hand drive (LHD) country or a right-hand drive (RHD) country. This can be based on data provided by the equipped vehicle, which data is based on the current geographical location of the equipped vehicle determined by a GPS system, for example. In addition, when the vehicle first leaves the vehicle assembly plant, the relevant vehicle manufacturer will arrange the steering column on the left side of the front cabin area for LHD vehicles and on the right side of the front cabin area for RHD vehicles. When configured as a left-hand drive vehicle or a right-hand drive vehicle / knowing where the vehicle is being driven, image processing of image data acquired by the DMS camera is configured to process image data representing the driver's area (e.g., the left front seat area for a left-hand drive vehicle or the right front seat area for a right-hand drive vehicle) for DMS frame acquisition, and control or energize the light source to provide enhanced illumination of the driver's area for DMS frame acquisition. In a preferred embodiment, the light source of the single-box interior DMS rearview mirror assembly includes a first group of light sources (wFOV light sources) arranged between a second group of light sources (e.g., left-hand (LH) light sources) and a third group of light sources (e.g., right-hand (RH) light sources).

[0060] For a left-hand drive vehicle equipped with a single-box interior DMS rearview mirror assembly, during acquisition of a DMS group in an acquisition image data frame (for driver monitoring function), the LHD nFOV light source (preferably a plurality of near IR emitting LEDs, which include at least two LEDs, and more preferably include four or fewer LEDs) and the wFOV light source (preferably a plurality of near IR emitting LEDs, which include at least two LEDs, and more preferably include four or fewer LEDs) are energized. The illumination provided by the LHD nFOV light source and the wFOV light source are combined to provide at least 1.25 W / m 2 , more preferably at least 1.8 W / m 2 and most preferably at least 2.3 W / m 2The illumination level is irradiated to the driver's head area (sitting on the left side of the vehicle). The illumination cone / zone of the LHD nFOV near-IR light source is narrower, which surrounds / irradiates the driver's head-box area (thereby enhancing the irradiance on the driver's face). During the process of acquiring a set of DMS image data frames for the driver monitoring function, the wFOV near-IR light source is also powered, but the LHD nFOV near-IR light source is not powered. This practice of selectively powering one of the LHD and RHD light sources but not the other (taking LHD driving as an example, the LHD light source is powered and the RHD light source is not powered) avoids the wasteful generation of heat in the lens head by powering the RHD light source, because the RHD light source has little effect on the illumination of the driver sitting in the left driver's seat. However, the wFOV light source will increase the irradiance of the driver's head box area to a certain extent, and will also illuminate the area where the driver's hands are located (steering wheel, center console, etc.), so whether in LDH or RHD vehicles, the wFOV light source is powered at all times when the vehicle is powered and operated. Therefore, for DMS frame acquisition in a left-hand drive vehicle, the single-box interior DMS rearview mirror assembly will only power the LHD nFOV light source and the wFOV light source, as these light sources will illuminate the driver of the left-hand drive vehicle. The light emitted by the RHD nFOV light source does not cover any part of the LH driver when powered, so during DMS frame acquisition in a LHD vehicle, the RHD nFOV light source will not be powered. Of course, in a RHD vehicle, the situation is exactly the opposite. During DMS frame acquisition in a right-hand drive vehicle, the single-box interior DMS rearview mirror assembly will only power the RHD nFOV light source and the wFOV light source, as these light sources will illuminate the driver of the right-hand drive vehicle.

[0061] For left-hand drive vehicles or right-hand drive vehicles equipped with a single-box interior DMS rearview mirror assembly, when acquiring a set of OMS image data frames (for occupant monitoring function), all three sets of near-IR light sources (LHD nFOV and wFOV and RHD nFOV) are energized to maximize the near-IR flood lighting in the vehicle cabin, and especially illuminate the second row of rear seats or even the third row of rear seats, etc.

[0062] For a left-hand drive vehicle equipped with a single-box interior DMS rearview mirror assembly, during acquisition of an OMS group in an acquisition image data frame (for occupant monitoring or occupant detection functionality), the LHD nFOV light source, the wFOV light source, and the RHD nFOV light source (preferably a plurality of near IR emitting LEDs, including at least two LEDs, and more preferably including four or fewer LEDs) are all powered. The illumination provided by the LHD nFOV light source, the wFOV light source, and the RHD nFOV light source are combined to provide at least 0.1 W / m 2, preferably at least 0.15 W / m 2 , more preferably at least 0.2 W / m 2 The irradiance of the second row or rear row and passenger seating area is irradiated by the combined illumination provided by the wFOV light source and the RHD nFOV light source, providing at least 0.15 W / m 2 , preferably at least 0.25W / m 2 , more preferably at least 0.4 W / m 2 The irradiance is applied to the front passenger seat area.

[0063] Therefore, for DMS frame acquisition in a left-hand drive vehicle, the single-box interior DMS rearview mirror assembly will only power the LHDnFOV light source and the wFOV light source, as these light sources will illuminate the driver of the left-hand drive vehicle; while for OMS frame acquisition in a left-hand drive vehicle, the single-box interior DMS rearview mirror assembly will power the LHDnFOV light source, the wFOV light source and the RHDnFOV light source.

[0064] Similarly, for a right-hand drive vehicle equipped with a single-box interior DMS rearview mirror assembly, during acquisition of a DMS group in an acquisition image data frame (for driver monitoring function), the RHD nFOV light source (preferably a plurality of near IR emitting LEDs, which include at least two LEDs, and more preferably include four or fewer LEDs) and the wFOV light source (preferably a plurality of near IR emitting LEDs, which include at least two LEDs, and more preferably include four or fewer LEDs) are powered. The illumination provided by the RHD nFOV light source and the wFOV light source are combined to provide at least 1.25 W / m 2 , more preferably at least 1.8 W / m 2 And most preferably at least 2.3W / m 2 The irradiance of the RHD nFOV light source illuminates the driver's head area (at the right side of the vehicle). The RHD nFOV light source has a narrow illumination cone that covers the driver's head box area (and therefore can enhance the irradiance at the driver's face without increasing the input power of the RHD nFOV light source, while also reducing heat generation in the system and reducing the number of LEDs required), while the wFOV light source can increase the irradiance of the driver's head box area to some extent, but will also illuminate the area where the driver's hands are located (steering wheel, center console, etc.). Therefore, for DMS frame acquisition of right-hand drive vehicles, the single-box interior DMS rearview mirror assembly will only power the RHDnFOV light source and the wFOV light source, as these light sources will illuminate the driver of the right-hand drive vehicle. The light emitted by the LHD nFOV light source when powered does not cover any part of the RH driver, so the LHD nFOV light source will not be powered during DMS frame acquisition.

[0065] For right-hand drive vehicles equipped with a single-box interior DMS rearview mirror assembly, during acquisition of an OMS group in an acquisition image data frame (for occupant monitoring or occupant detection functions), the RHD nFOV light source, the wFOV light source, and the LHD nFOV light source (preferably a plurality of near IR emitting LEDs, including at least two LEDs, and more preferably including four or fewer LEDs) are all powered on. The illumination provided by the RHD nFOV light source, the wFOV light source, and the LHD nFOV light source are combined to provide at least 0.1 W / m 2 , preferably at least 0.15 W / m 2 , more preferably at least 0.2 W / m 2 The irradiance of the second row or rear seats and the passenger seat area is irradiated by the wFOV light source and the LHD nFOV light source combined to provide at least 0.15W / m 2 , preferably at least 0.25W / m 2 , and more preferably at least 0.4 W / m 2 of irradiance illuminates the front passenger seat area.

[0066] Therefore, for DMS frame acquisition of right-hand drive vehicles, the single-box interior DMS rearview mirror assembly will only power the RHDnFOV light source and the wFOV light source, because these light sources will illuminate the driver of the right-hand drive vehicle; while for OMS frame acquisition of right-hand drive vehicles, the single-box interior DMS rearview mirror assembly will power the RHD nFOV light source, the wFOV light source and the LHD nFOV light source.

[0067] The illumination protocols / schemes described herein may be dynamic in that they may be adjusted based on the current driving situation. For example, the illumination protocol may be adjusted based on day / night driving conditions (by day or night time); the illumination protocol may be adjusted in response to ambient illumination levels within the vehicle cabin, such as ambient illumination levels during sunny versus cloudy days, dawn versus dusk; or the illumination protocol may also be adjusted (e.g., for thermal management) to reduce illumination within the vehicle cabin for a short, limited time after ignition or starting occurs when the vehicle is parked in the sun on a hot, sunny day.

[0068] Regardless of whether the single-box interior DMS rearview mirror assembly is arranged in a LHD vehicle or a RHD vehicle, for occupant detection, the illumination range of the DMS camera is preferably able to cover the seating positions (front and rear) of the vehicle occupants. Similarly, in order to provide near-IR flood lighting to such passengers sitting in the vehicle cabin, regardless of whether the single-box interior DMS rearview mirror assembly is used in a LHD or RHD vehicle, the illumination range of the wFOV near-IR illuminator must cover the seating positions (front and rear) of the vehicle's passengers. However, in order to achieve DMS functionality, the driver's face / head / body is preferably able to receive as strong near-IR illumination as possible. Therefore, for LHD vehicles, it is desirable that the LHD nFOV near-IR illuminator be directed toward the driver of the LHD vehicle, while for RHD vehicles, it is desirable that the RHD nFOV near-IR illuminator be directed toward the driver of the RHD vehicle. Given that the central area of ​​the DMS lens head has limited space to accommodate the camera, wFOV near IR illuminator, nFOV near IR illuminator and mirror pivot joint and similar / related hardware, for practical considerations, the nFOV near IR illuminator is arranged on the left or right side of the camera.

[0069] Optionally, for practical reasons, such as manufacturing and packaging and cost reasons, it is preferred to place the nFOV near IR illuminator centrally on one side (e.g., left) or the other side (e.g., right) of the camera in the lens head, or to place the LHD nFOV near IR illuminator on one side (e.g., left) and the RHD nFOV near IR illuminator on the other side (e.g., right). Fig. 12A As shown, a single-box interior DMS rearview mirror assembly may have a camera and a wFOV near IR illuminator disposed at the center of the mirror head (where the camera is centrally located above or below the wFOV near IR illuminator), wherein one nFOV near IR illuminator (e.g., an LHD nFOV near IR illuminator) may be centrally disposed at the mirror head, wherein one nFOV near IR illuminator (e.g., an LHD nFOV near IR illuminator, which is used to illuminate the driver of an LHD vehicle) is disposed at the left side of the mirror head (located at the left side of the camera), and another nFOV near IR illuminator (e.g., an RHD nFOV near IR illuminator, which is used to illuminate the driver of an RHD vehicle) is disposed at the right side of the mirror head (located at the right side of the camera). Alternatively, it may be considered to dispose the LHD nFOV near IR illuminator at the right side of the mirror head, and dispose the RHD nFOV near IR illuminator at the left side of the mirror head.

[0070] Alternatively, the nFOV near IR illuminator may be arranged more centrally in the lens head (e.g., above or below the centrally located wFOV near IR illuminator). Fig. 12BAs shown, the wFOV near IR illuminator can be located at a central location (e.g., above or below a camera located at a central location), and the nFOV near IR illuminator can be arranged at or above (or below) the wFOV near IR illuminator. Fig. 12B As shown, one of the nFOV near IR illuminators (e.g., a LHD nFOV near IR illuminator for illuminating the driver of a LHD vehicle) is arranged at the left side of the center line of the lens head (located on the left side of the camera), and the other nFOV near IR illuminator (e.g., a RHD nFOV near IR illuminator for illuminating the driver of a RHD vehicle) is arranged at the right side of the center line of the lens head (located on the right side of the camera). Alternatively, it is contemplated that the LHD nFOV near IR illuminator is arranged at the right side of the center line of the lens head, and the RHD nFOV near IR illuminator may be arranged at the left side of the center line of the lens head. It is also contemplated that the LHD nFOV near IR illuminator and the RHD nFOV near IR illuminator are arranged vertically on the center line of the lens head, one above the other.

[0071] Alternatively, the wFOV near IR illuminator may be centrally arranged (e.g., above or below a centrally arranged camera), and two nFOV near IR illuminators may be arranged at one side or the other of the lens head. Fig. 12C As shown, the wFOV near IR illuminator is located in a central position (e.g., above or below the centrally located camera), while the LHD and RHDnFOV near IR illuminators are located on the right side of the lens head, wherein the LHD nFOV near IR illuminator is arranged closer to the central position of the lens head than the RHD nFOV near IR illuminator. Fig.12D As shown, the wFOV near IR illuminator is arranged in the center (e.g., above or below the centrally arranged camera), and the LHD and RHD nFOV near IR illuminators are arranged at the left side of the lens head, wherein the RHD nFOV near IR illuminator is arranged closer to the center of the lens head than the LHD nFOV near IR illuminator. Optionally, the wFOV near IR illuminator and / or the nFOV near IR illuminator may be arranged in the lower area of ​​the lens head (see Fig. 12C and Fig.12D ), or can be arranged in the upper area of ​​the lens head (see Fig.12E ). Therefore, if Fig.12E As shown, one or both of the nFOV near IR illuminators may be located at a higher position in the upper region of the lens head, and / or the wFOV near IR illuminator may be located at a higher position in the upper region of the lens head.

[0072] In a vehicle (whether LHD or RHD), the driver can grasp the lens head to adjust the viewing angle of the interior mirror reflective element so that the driver can see out the rear window of the equipped vehicle. The camera moves in coordination with the driver moving the lens head. In doing so, the driver moves the lens head to the position / orientation of the driver's head that the driver monitoring camera inside the lens head can see.

[0073] The wavelength of the near IR signal emitted by the LED is preferably 940nm, making it easier to be recognized by the DMS processor (because water in the atmosphere absorbs 940nm light, the ambient sunlight at this wavelength will be reduced). The DMS camera includes a filter that allows / passes light at this wavelength and attenuates other light. Therefore, the camera will operate with an enhanced 940nm signal, which enhances monitoring of the driver if the driver is wearing sunglasses. Other light in the vehicle cabin (i.e., ambient light) is filtered so that the camera focuses on the 940nm wavelength and then avoids "seeing" the reflection of the sunglasses. The DMS function can provide dynamic camera control (increase or decrease exposure time or frame acquisition rate) and LED control (increase or decrease the power of the LED and / or increase or decrease the on time) to adapt to changes in lighting and / or adapt to driver sunglasses or similar situations.

[0074] The mirror reflector may include a stack of coatings specific to needs related to three basic requirements: (i) reflect most visible light to prevent details such as a camera behind the glass from being seen (this can also be said to transmit less than 25% visible light, one-way through the glass subassembly), (ii) transmit near-infrared (NIR) light, which is emitted from the NIR LED behind the glass, reflects off the occupant and returns to the camera behind the glass (the coating targets a transmission of greater than 95% at a wavelength of 940nm), and (iii) control the color of the reflected light incident on the mirror reflective element to be neutral or on the blue side for any manufacturing variations, avoiding red and green shifts. In addition, due to fixed and variable costs, it is desirable to have a minimum number of layers in the coating and a minimum total thickness of all layers.

[0075] The system may utilize aspects of a driver monitoring system and / or a head, facial orientation and position tracking system and / or an eye tracking system and / or a gesture recognition system. Such a head, facial orientation and position tracking system and / or an eye tracking system and / or a gesture recognition system may utilize aspects of the systems described in the following documents: U.S. Patent Nos. 10,065,574; 10,017,114; 9,405,120 and / or 7,914,187, and / or U.S. Publication Nos. US-2022-0254132; US-2022-0242438; US-2022-011 1857; No.US-2021-0323473; No.US-2021-0291739; No.US-2020-0202151; No.US-2020-0320320; No.US -2020-0143560; No.US-2018-0231976; No.US-2018-0222414; No.US-2017-0274906; No.US-2017-02173 67; No.US-2016-0209647; No.US-2016-0137126; No.US-2015-0352953; No.US-2015-0296135; No.US-2 015-0294169; No.US-2015-0232030; No.US-2015-0092042; No.US-2015-0022664; No.US-2015-0015710 ; No. US-2015-0009010 and / or No. US-2014-0336876 and / or U.S. patent application No. 17 / 663,462 filed on May 16, 2022, and / or International Application No. PCT / US2022 / 072238 filed on May 11, 2022, and / or International Application No. PCT / US2022 / 070882 filed on March 1, 2022, the entire contents of which are incorporated herein by reference.

[0076] Optionally, the driver monitoring system can be integrated with the vehicle's camera monitoring system (CMS). The integrated vehicle system combines multiple inputs, such as input from the interior or driver monitoring camera and input from the front or exterior view camera, as well as input from the rear view camera and side view cameras of the CMS to provide the driver with unique collision mitigation functions based on the complete vehicle environment and driver awareness state. Image processing and detection and determination are performed in the interior rearview mirror assembly and / or the overhead console area, depending on the available space and electrical connections for the specific vehicle application. The CMS cameras and systems may utilize aspects of the systems described in U.S. Patent No. 11,242,008 and / or U.S. Publication Nos. US-2021-0162926; US-2021-0155167; US-2018-0134217 and / or US-2014-0285666, and / or International PCT Publication No. WO2022 / 150826, the entire contents of which are incorporated herein by reference.

[0077] The ECU may receive image data acquired by multiple cameras of the vehicle, such as image data acquired by multiple surround view system (SVS) cameras and multiple camera monitoring system (CMS) cameras and one or more driver monitoring system (DMS) cameras. The ECU may include a central or single ECU that processes the image data acquired by the cameras for multiple driver assistance functions and may display different video images to a video display screen in the vehicle (e.g., an interior rearview mirror assembly or a center console, etc.) for viewing by a driver of the vehicle. The system may utilize various aspects of the systems described in the following documents: U.S. Patent No. 11,242,008; No. 10,442,360 and / or No. 10,046,706 and / or U.S. Publication No. US-2021-0155167 and / or No. US-2019-0118717 and / or U.S. Publication No. US-2021-0162926 and / or International PCT Publication No. WO2022 / 150826, the entire contents of which are incorporated herein by reference.

[0078] The camera or sensor may include any suitable camera or sensor. Optionally, the camera may include a "smart camera" that includes an imaging sensor array and associated circuits and image processing circuits and electrical connectors, etc., as part of a camera module, for example, various aspects of the vision system described in U.S. Patent Nos. 10,099,614 and / or 10,071,687, the entire contents of which are incorporated herein by reference.

[0079] The system includes an image processor operable to process image data acquired by one or more cameras, for example, to detect objects or other vehicles or pedestrians, etc., in the field of view of the one or more cameras. For example, the image processor may include an image processing chip selected from the EYEQ series sold by Mobileye Vision Technologies Ltd., a company in the Jerusalem area, and may include object detection software (e.g., of the type described in U.S. Patent Nos. 7,855,755; 7,720,580 and / or 7,038,577, the entire contents of which are incorporated herein by reference), and may analyze the image data to detect vehicles and / or other objects. In response to such image processing, and when an object or other vehicle is detected, the system may issue an alert to the driver of the vehicle, and / or generate an overlay on the displayed image to highlight or enhance the display of the detected object or vehicle, thereby increasing the driver's awareness of the detected object or vehicle or dangerous conditions during driving operations of the equipped vehicle.

[0080] Alternatively, the camera may include a forward-looking camera, such as a camera arranged at a windshield electronic module (WEM) or the like. The forward-looking camera may utilize aspects of the systems described in U.S. Patent Nos. 9,896,039; 9,871,971; 9,596,387; 9,487,159; 8,256,821; 7,480,149; 6,824,281 and / or 6,690,268 and / or U.S. Patent Nos. US-2020-0039447; US-2015-0327398; US-2015-0015713; US-2014-0160284; US-2014-0226012 and / or US-2009-0295181, the entire contents of which are incorporated herein by reference.

[0081] Optionally, the vision system may include a display for displaying images acquired by one or more imaging sensors for viewing by the driver during normal driving of the vehicle. Optionally, for example, the vision system may include a video display device, such as utilizing various aspects of the video display systems described in the following documents: U.S. Patents No. 5,530,240; No. 6,329,925; No. 7,855,755; No. 7,626,749; No. 7,581,859; No. 7,446,650; No. 7,338,177; No. 7,274, 501; No.7,255,451; No.7,195,381; No.7,184,190; No.5,668,663; No.5,724,187; No.6, 690,268; No.7,370,983; No.7,329,013; No.7,308,341; No.7,289,037; No.7,249,860; No .7,004,593; No.4,546,551; No.5,699,044; No.4,953,305; No.5,576,687; No.5,632,09 2; No.5,708,410; No.5,737,226; No.5,802,727; No.5,878,370; No.6,087,953; No.6,173 ,501; No.6,222,460; No.6,513,252 and / or No.6,642,851, and / or U.S. Publication No.US-2014-0022390; No.US-2012-0162427; No.US-2006-0050018 and / or No.US-2006-0061008, the entire contents of which are incorporated herein by reference.

[0082] Therefore, a cabin monitoring system includes an interior rearview mirror assembly having a lens head adjustably attached to a mounting structure, the mounting structure being configured to be attached at an interior portion of a vehicle equipped with the cabin monitoring system. The lens head includes a mirror reflective element. A camera is housed by the lens head, and a plurality of light emitters, such as a plurality of light emitting diodes (LEDs), are housed by the lens head. A current driver is configured to provide current to the plurality of LEDs so that the plurality of LEDs are energized and emit light. An electronic switch is operable to be in an open state or a closed state. When the electronic switch is operated to be in an open state, the current provided by the current driver passes through each corresponding LED in the plurality of LEDs, and when the electronic switch is operated to be in a closed state, the current provided by the current driver bypasses at least one corresponding LED in the plurality of LEDs and passes through the remaining corresponding LEDs in the plurality of LEDs. An electronic control unit (ECU) includes an electronic circuit and associated software. The electronic circuit of the ECU includes an image processor for processing image data acquired by the camera. In the case where the mounting structure is attached at an interior portion of the vehicle, the electronic switch is operated to be in an open state when the electronic control unit (ECU) processes the image data acquired by the camera for an occupant monitoring function. In a case where the mounting structure is attached at an interior portion of a vehicle, when the electronic control unit processes image data acquired by the camera for a driver monitoring function, the electronic switch operates to be in a closed state.

[0083] The electronic switch may be connected in series with a first group of LEDs in the plurality of LEDs, and the electronic switch may be connected in parallel with a second group of LEDs in the plurality of LEDs. When the electronic switch is operated to be in a closed state, the current provided by the current driver bypasses the second group of LEDs.

[0084] The electronic switch may include a metal oxide semiconductor field effect transistor (MOSFET).

[0085] The electronic switch may be operated in response to a first signal generated by the ECU to be in an open state. The electronic switch may be operated in response to a second signal generated by the ECU to be in a closed state.

[0086] Optionally, when the image data acquired by the camera is processed at the ECU for the occupant monitoring function, the first subgroup of LEDs in the plurality of LEDs is powered on and illuminated, and when the image data acquired by the camera is processed at the ECU for the driver monitoring function, the second subgroup of LEDs in the plurality of LEDs is powered on and illuminated. The second group of LEDs in the plurality of LEDs emits light when powered on to illuminate the driver's head area in the vehicle compartment. The first subgroup of LEDs in the plurality of LEDs emits light at a first angle relative to the camera when powered on, and wherein the second subgroup of LEDs in the plurality of LEDs emits light at a second angle relative to the camera when powered on, and wherein the first angle is different from the second angle. For example, the second subgroup of LEDs may include nFOV LEDs for illuminating the driver's head area of ​​the vehicle (e.g., the left seat area of ​​a left-hand drive vehicle), and the first subgroup of LEDs may include nFOV LEDs for illuminating the passenger's head area of ​​the vehicle (e.g., the right seat area of ​​a left-hand drive vehicle), and the first subgroup of LEDs may also optionally include wFOV LEDs.

[0087] The plurality of LEDs emit near infrared light when powered on. A first subgroup of LEDs in the plurality of LEDs emits light at a first angle relative to a camera when powered on, and a second subgroup of LEDs in the plurality of LEDs emits light at a second angle relative to the camera when powered on, and wherein the first angle is different from the second angle.

[0088] When the camera is acquiring image data, the ECU enables the current driver; when the camera is not acquiring image data, the ECU disables the current driver.

[0089] The second electronic switch is operated to be in an open state or a closed state. When the second electronic switch is operated to be in a closed state, the current provided by the current driver bypasses at least one LED of the plurality of LEDs different from the at least one LED bypassed when the electronic switch is operated to be in a closed state.

[0090] When the electronic switch is operated to be in an open state, the individual LEDs of the plurality of LEDs are electrically connected in series, and when the electronic switch is operated to be in an open state, the at least one LED of the plurality of LEDs is not electrically connected in series with the remaining individual LEDs of the plurality of LEDs.

[0091] When the camera acquires image data for an occupant monitoring function, the current driver may provide a first ampere of current; when the camera acquires image data for a driver monitoring function, the current driver may provide a second ampere of current, wherein the first ampere of current is different from the second ampere of current.

[0092] The ECU may be arranged inside the lens head.

[0093] The camera and the plurality of LEDs may be arranged in the lens head and behind the mirror reflective element. The camera may observe through the mirror reflective element, and the plurality of LEDs may emit light through / through the mirror reflective element when powered on.

[0094] The vehicle compartment monitoring system includes an interior rearview mirror assembly having a lens head that is adjustably attached to a mounting structure, and the mounting structure is configured to be attached to an interior portion of a vehicle equipped with the vehicle compartment monitoring system. The lens head includes a mirror reflective element. The lens head accommodates a camera, and the lens head accommodates a plurality of light emitters, for example, a plurality of light emitting diodes (LEDs). A current driver is configured to provide current to the plurality of LEDs so that the plurality of LEDs are powered on and emit light. The plurality of LEDs emit near-infrared light when powered on and emit light. The electronic switch is operable to be in an open state or a closed state. When the electronic switch is operated to be in an open state, the current provided by the current driver passes through a first group of LEDs and a second group of LEDs in the plurality of LEDs, and when the electronic switch is operated to be in a closed state, the current provided by the current driver bypasses the first group of LEDs in the plurality of LEDs and passes through a second group of LEDs in the plurality of LEDs. An electronic control unit (ECU) includes an electronic circuit and associated software. The electronic circuit of the ECU includes an image processor for processing image data acquired by the camera. In a case where the mounting structure is attached at an interior portion of a vehicle, when an electronic control unit (ECU) processes image data acquired by a camera for an occupant monitoring function, the electronic switch is in an open state. In a case where the mounting structure is attached at an interior portion of a vehicle, when an electronic control unit processes image data acquired by a camera for a driver monitoring function, the electronic switch operates to be in a closed state.

[0095] A first subset of LEDs among the plurality of LEDs can emit light at a first angle relative to the camera when powered on, and a second subset of LEDs among the plurality of LEDs can emit light at a second angle relative to the camera when powered on, wherein the first angle is different from the second angle.

[0096] The vehicle compartment monitoring system includes an interior rearview mirror assembly having a lens head adjustably attached to a mounting structure, the mounting structure being configured to be attached to an interior portion of a vehicle equipped with the vehicle compartment monitoring system. The lens head includes a mirror reflective element. The lens head accommodates a camera, and the lens head accommodates a plurality of light emitters, for example, a plurality of light emitting diodes (LEDs). A current driver is configured to provide current to a plurality of LEDs so that the plurality of LEDs are powered on and emit light. The camera and the plurality of LEDs are arranged in the lens head and behind the mirror reflective element, the camera observes through the mirror reflective element, and the plurality of LEDs emit light through the mirror reflective element when powered on and emit light. The plurality of LEDs emit near-infrared light when powered on and emit light. A first subgroup of the plurality of LEDs emits light at a first angle relative to the mirror reflective element when powered on and emits light, and a second subgroup of the plurality of LEDs emits light at a second angle relative to the mirror reflective element when powered on and emits light, wherein the first angle is different from the second angle. The electronic switch is operable to be in an open state or a closed state. When the electronic switch is operated to be in an open state, the current provided by the current driver passes through a first subset of LEDs among the plurality of LEDs and a second subset of LEDs among the plurality of LEDs, and when the electronic switch is operated to be in a closed state, the current provided by the current driver bypasses the first subset of LEDs among the plurality of LEDs and passes through the second subset of LEDs among the plurality of LEDs. An electronic control unit (ECU) includes electronic circuits and associated software. The electronic circuits of the ECU include an image processor for processing image data acquired by a camera. In a case where the mounting structure is attached to an interior portion of a vehicle, the electronic switch is operated to be in an open state when the electronic control unit (ECU) processes image data acquired by the camera for an occupant monitoring function. In a case where the mounting structure is attached to an interior portion of a vehicle, the electronic switch is operated to be in a closed state when the ECU processes image data acquired by the camera for a driver monitoring function.

[0097] The first subgroup of LEDs may include at least one LED (e.g., two or more LEDs) configured to illuminate a passenger seating area of ​​the vehicle (e.g., at one angle relative to a camera or mirror reflective element), wherein the second subgroup of LEDs includes at least one LED (e.g., two or more LEDs) configured to illuminate a driver seating area of ​​the vehicle (e.g., at another angle relative to a camera or mirror reflective element). The first subgroup of LEDs may further include at least one LED (e.g., two or more LEDs) configured to illuminate a central cabin area of ​​the vehicle (e.g., a wider illumination area of ​​the LED than the narrower illumination areas of the other LEDs).

[0098] Changes and modifications may be made to the specifically described embodiments without departing from the principles of the invention, which will be limited only by the scope of the appended claims and interpreted in accordance with the principles of patent law (including the doctrine of equivalents).

Claims

1. A vehicle interior compartment monitoring system, the vehicle interior compartment monitoring system comprising: an interior rearview mirror assembly configured to be attached at an interior portion of a vehicle equipped with a vehicle interior cabin monitoring system, wherein the interior rearview mirror assembly includes a mirror head that is adjustable about a mounting structure, and wherein the mirror head includes a mirror reflective element; A camera housed by a lens unit; a plurality of light sources housed by the lens head; a current driver, wherein the current driver is operable to provide current to each of the plurality of light sources to electrically operate each light source to emit near infrared light; a plurality of electronic switches, wherein each individual electronic switch of the plurality of electronic switches is operable in an open state or a closed state; wherein each individual electronic switch of the plurality of electronic switches is (i) connected in parallel to a corresponding light source of the plurality of light sources, and (ii) connected in series with at least one other light source of the plurality of light sources when at least one other electronic switch of the plurality of electronic switches is operated to be in an on state; wherein, with each individual electronic switch of the plurality of electronic switches operated to be in its respective open state, a current provided by the current driver passes through each of the plurality of light sources; wherein, in a case where one of the plurality of electronic switches is operated to be in its closed state and at least one other of the plurality of electronic switches is operated to be in its open state, current bypasses the individual light source connected in parallel with the one electronic switch and passes through the at least one other light source connected in series with the one electronic switch; Electronic Control Unit (ECU), which includes electronic circuitry and associated software; Wherein, the electronic circuit of the ECU includes an image processor for processing image data acquired by the camera; and Wherein, when the interior rearview mirror assembly is attached to an interior portion of the vehicle, the vehicle interior cabin monitoring system (i) is capable of operating to detect occupants present in the vehicle interior cabin by processing image data acquired by a camera at the ECU, and (ii) is capable of operating to monitor the vehicle driver by processing image data acquired by the camera at the ECU.

2. The vehicle interior compartment monitoring system according to claim 1, wherein: Each individual electronic switch of the plurality of electronic switches includes a metal oxide semiconductor field effect transistor (MOSFET).

3. The vehicle interior compartment monitoring system according to claim 1, wherein: Each individual one of the plurality of electronic switches is operated to be in its respective open state in response to a respective first signal generated by the ECU.

4. The vehicle interior compartment monitoring system according to claim 3, wherein: Each individual one of the plurality of electronic switches is operated to be in its respective closed state in response to a respective second signal generated by the ECU.

5. The vehicle interior compartment monitoring system according to claim 1, wherein: When the camera is acquiring image data, the ECU enables the current driver, and wherein when the camera is not acquiring image data, the ECU disables the current driver.

6. The vehicle interior compartment monitoring system according to claim 1, wherein: The current driver provides a first ampere of current when the vehicle interior cabin monitoring system operates to detect the presence of an occupant within the vehicle interior cabin, and wherein the current driver provides a second ampere of current when the vehicle interior cabin monitoring system operates to monitor a vehicle driver, and wherein the first ampere of current is different from the second ampere of current.

7. The vehicle interior compartment monitoring system according to claim 1, wherein: Each individual light source of the plurality of light sources includes at least one near infrared light emitting diode.

8. The vehicle interior compartment monitoring system according to claim 1, wherein: Each individual light source of the plurality of light sources includes at least two near infrared light emitting diodes.

9. The vehicle interior compartment monitoring system according to claim 1, wherein: Each individual light source of the plurality of light sources includes at least three near infrared light emitting diodes.

10. The vehicle interior compartment monitoring system according to claim 1, wherein: With the interior rearview mirror assembly attached to an interior portion of a vehicle and with the vehicle interior cabin monitoring system operating to detect the presence of an occupant within the vehicle interior cabin, each of the plurality of electronic switches is operated to be in its corresponding on state and each of the plurality of light sources is electrically operated to emit near infrared light.

11. The vehicle interior compartment monitoring system according to claim 1, wherein: A separate light source connected in parallel to the one electronic switch emits near-infrared light at a first angle relative to the camera when electrically operated to emit near-infrared light, and wherein at least one other light source among the plurality of light sources emits near-infrared light at a second angle relative to the camera when electrically operated to emit near-infrared light, and wherein the first angle is different from the second angle.

12. The vehicle interior compartment monitoring system according to claim 11, wherein: A separate light source connected in parallel to the one electronic switch illuminates at least a driver's head area in the interior cabin of the vehicle when electrically operated to emit near infrared light.

13. The vehicle interior compartment monitoring system according to claim 12, wherein: The at least one other light source illuminates a central area of ​​the vehicle interior cabin when electrically operated to emit near infrared light.

14. The vehicle interior compartment monitoring system according to claim 12, wherein: The at least one other light source illuminates a passenger seating area of ​​the vehicle interior cabin when electrically operated to emit near infrared light.

15. The vehicle interior compartment monitoring system according to claim 1, wherein: The ECU is arranged inside the lens head.

16. The vehicle interior compartment monitoring system according to claim 1, wherein: The camera and the plurality of light sources are disposed within the lens head and behind the mirror reflective element, and wherein the camera observes through the mirror reflective element and the plurality of light sources emit near infrared light that passes through the mirror reflective element when electrically operated to emit near infrared light.

17. The vehicle interior compartment monitoring system according to claim 1, wherein: The interior portion of the vehicle includes the interior of the vehicle's windshield.

18. A vehicle interior compartment monitoring system, the vehicle interior compartment monitoring system comprising: an interior rearview mirror assembly configured to be attached at an interior portion of a vehicle equipped with a vehicle interior cabin monitoring system, wherein the interior rearview mirror assembly includes a mirror head that is adjustable about a mounting structure, and wherein the mirror head includes a mirror reflective element; A camera housed by a lens unit; a plurality of light sources housed by the lens head; Wherein, the plurality of light sources include a first light source and a second light source; a current driver, wherein the current driver is operable to provide current to each of the plurality of light sources to electrically operate each light source to emit near infrared light; wherein, in a case where the inside rearview mirror assembly is attached at an interior portion of a vehicle, when a vehicle driver adjusts a mirror portion of the inside rearview mirror assembly to set a rearward field of view of the mirror reflective element for the vehicle driver, near infrared light emitted by the first light source when electrically operated to emit near infrared light is directed at least toward a driver-side front seat of the vehicle; wherein, in a case where the inside rearview mirror assembly is attached at an interior portion of a vehicle, when a vehicle driver adjusts a mirror portion of the inside rearview mirror assembly to set a rearward field of view of the mirror reflective element for the vehicle driver, the near infrared light emitted by the second light source when electrically operated to emit the near infrared light is directed at least toward a passenger-side front seat of the vehicle; a first electronic switch operable to be in an open state or a closed state; a second electronic switch operable to be in an open state or a closed state; wherein the first electronic switch is (i) connected in parallel with the first light source and (ii) connected in series with the second light source when the second electronic switch is operated to be in its on state; wherein the second electronic switch is (i) connected in parallel with the second light source and (ii) connected in series with the first light source when the first electronic switch is operated to be in its on state; wherein, with the first electronic switch and the second electronic switch operated to be in their respective open states, the current provided by the current driver passes through the first light source and the second light source; wherein, with the first electronic switch operated to be in its closed state and the second electronic switch operated to be in its open state, the current provided by the current driver passes through the second light source and bypasses the first light source; wherein, with the first electronic switch operated to be in its open state and the second electronic switch operated to be in its closed state, the current provided by the current driver passes through the first light source and bypasses the second light source; Electronic Control Unit (ECU), which includes electronic circuitry and associated software; Wherein, the electronic circuit of the ECU includes an image processor for processing image data acquired by the camera; and Wherein, when the interior rearview mirror assembly is attached to an interior portion of the vehicle, the vehicle interior cabin monitoring system (i) is capable of operating to detect occupants present in the vehicle interior cabin by processing image data acquired by a camera at the ECU, and (ii) is capable of operating to monitor the vehicle driver by processing image data acquired by the camera at the ECU.

19. The vehicle interior compartment monitoring system according to claim 18, wherein: Each of the first electronic switch and the second electronic switch includes a metal oxide semiconductor field effect transistor (MOSFET).

20. The vehicle interior compartment monitoring system according to claim 18, wherein: Each of the first and second electronic switches operates to be in its respective open state in response to a respective first signal generated by the ECU.

21. The vehicle interior compartment monitoring system according to claim 20, wherein: Each of the first and second electronic switches is operated to be in its respective closed state in response to a respective second signal generated by the ECU.

22. The vehicle interior compartment monitoring system of claim 18, wherein: When the camera is acquiring image data, the ECU enables the current driver, and wherein when the camera is not acquiring image data, the ECU disables the current driver.

23. The vehicle interior compartment monitoring system of claim 18, wherein: With the first electronic switch and the second electronic switch operated to be in their respective on states, the first light source and the second light source are electrically connected in series.

24. The vehicle interior compartment monitoring system of claim 18, wherein: The current driver provides a first ampere of current when the vehicle interior cabin monitoring system operates to detect the presence of an occupant within the vehicle interior cabin, and wherein the current driver provides a second ampere of current when the vehicle interior cabin monitoring system operates to monitor a vehicle driver, and wherein the first ampere of current is different from the second ampere of current.

25. The vehicle interior compartment monitoring system of claim 18, wherein: The first light source comprises at least one first near infrared light emitting light emitting diode, and wherein the second light source comprises at least one second near infrared light emitting light emitting diode.

26. The vehicle interior compartment monitoring system of claim 18, wherein: The first light source includes at least two first near-infrared light emitting diodes, and wherein the second light source includes at least two second near-infrared light emitting diodes.

27. The vehicle interior compartment monitoring system of claim 18, wherein: With the interior rearview mirror assembly attached to an interior portion of a vehicle, and with the vehicle interior cabin monitoring system operating to detect the presence of an occupant within the vehicle interior cabin, the first electronic switch is operated to be in its on state and the second electronic switch is operated to be in its off state, and the first light source and the second light source are electrically operated to emit near infrared light.

28. The vehicle interior compartment monitoring system according to claim 27, wherein: With the interior rearview mirror assembly attached to an interior portion of a vehicle and with the vehicle interior cabin monitoring system operating to monitor the vehicle driver, (i) the first electronic switch is operated to be in its on state and the first light source is electrically operated to emit near-infrared light, and (ii) the second electronic switch is operated to be in its off state and the second light source is not electrically operated to emit near-infrared light.

29. The vehicle interior compartment monitoring system according to claim 28, wherein: The first light source, when electrically operated to emit near infrared light, illuminates at least a driver's head area in an interior cabin of the vehicle.

30. The vehicle interior compartment monitoring system of claim 29, wherein: The first light source emits near infrared light at a first angle relative to the camera when electrically operated to emit near infrared light, and wherein the second light source emits near infrared light at a second angle relative to the camera when electrically operated to emit near infrared light, and wherein the first angle is different from the second angle.

31. The vehicle interior compartment monitoring system of claim 29, wherein: The second light source illuminates a central area of ​​the vehicle interior cabin when electrically operated to emit near infrared light.

32. The vehicle interior compartment monitoring system of claim 18, wherein: The ECU is arranged inside the lens head.

33. The vehicle interior compartment monitoring system of claim 18, wherein: The camera and the plurality of light sources are disposed within the lens head and behind the mirror reflective element, and wherein the camera observes through the mirror reflective element and the plurality of light sources emit near infrared light that passes through the mirror reflective element when electrically operated to emit near infrared light.

34. The vehicle interior compartment monitoring system of claim 18, wherein: The interior portion of the vehicle includes the interior of the vehicle's windshield.

35. A vehicle interior compartment monitoring system, the vehicle interior compartment monitoring system comprising: an interior rearview mirror assembly configured to be attached at an interior portion of a vehicle equipped with a vehicle interior cabin monitoring system, wherein the interior rearview mirror assembly includes a mirror head that is adjustable about a mounting structure, and wherein the mirror head includes a mirror reflective element; A camera housed by a lens unit; a plurality of light sources housed by the lens head; Wherein, the plurality of light sources include a first light source, a second light source and a third light source; a current driver, wherein the current driver is operable to provide current to each of the plurality of light sources to electrically operate each light source to emit near infrared light; wherein, in a case where the inside rearview mirror assembly is attached at an interior portion of a vehicle, when a vehicle driver adjusts a mirror portion of the inside rearview mirror assembly to set a rearward field of view of the mirror reflective element for the vehicle driver, near infrared light emitted by the first light source when electrically operated to emit near infrared light is directed at least toward a driver-side front seat of the vehicle; wherein, in a case where the inside rearview mirror assembly is attached at an interior portion of a vehicle, when a vehicle driver adjusts a mirror portion of the inside rearview mirror assembly to set a rearward field of view of the mirror reflective element for the vehicle driver, the near infrared light emitted by the second light source when electrically operated to emit the near infrared light is directed at least toward a central area of ​​the vehicle; wherein, in a case where the inside rearview mirror assembly is attached at an interior portion of a vehicle, when a vehicle driver adjusts a mirror portion of the inside rearview mirror assembly to set a rearward field of view of the mirror reflective element for the vehicle driver, near infrared light emitted by the third light source when electrically operated to emit near infrared light is directed at least toward a passenger-side front seat of the vehicle; a first electronic switch operable to be in an open state or a closed state; a second electronic switch operable to be in an open state or a closed state; a third electronic switch operable to be in an open state or a closed state; wherein the first electronic switch is (i) connected in parallel with the first light source and (ii) connected in series with the second light source and the third light source when the second electronic switch and the third electronic switch are operated to be in their respective on states; wherein the second electronic switch is (i) connected in parallel with the second light source and (ii) connected in series with the first light source and the third light source when the first electronic switch and the third electronic switch are operated to be in their respective on states; wherein the third electronic switch is (i) connected in parallel to the third light source and (ii) connected in series with the first light source and the second light source when the first electronic switch and the second electronic switch are operated to be in their respective on states; wherein, with the first electronic switch, the second electronic switch and the third electronic switch operated to be in their respective open states, the current provided by the current driver passes through the first light source, the second light source and the third light source; wherein, when the first electronic switch is operated to be in a closed state and the second and third electronic switches are operated to be in their respective open states, the current provided by the current driver passes through the second and third light sources and bypasses the first light source; wherein, when the first electronic switch is operated to be in an open state and the second and third electronic switches are operated to be in their respective closed states, the current provided by the current driver passes through the first light source and bypasses the second and third light sources; Electronic Control Unit (ECU), which includes electronic circuitry and associated software; Wherein, the electronic circuit of the ECU includes an image processor for processing image data acquired by the camera; and Wherein, when the interior rearview mirror assembly is attached to an interior portion of the vehicle, the vehicle interior cabin monitoring system (i) is capable of operating to detect occupants within the vehicle interior cabin by processing image data acquired by a camera at the ECU, and (ii) is capable of operating to monitor the driver of the vehicle by processing image data acquired by the camera at the ECU.

36. The vehicle interior compartment monitoring system of claim 35, wherein: Each of the first electronic switch, the second electronic switch, and the third electronic switch includes a metal oxide semiconductor field effect transistor (MOSFET).

37. The vehicle interior compartment monitoring system of claim 35, wherein: Each of the first electronic switch, the second electronic switch, and the third electronic switch operates to be in its respective open state in response to a respective first signal generated by the ECU.

38. The vehicle interior compartment monitoring system of claim 37, wherein: In response to a respective second signal generated by the ECU, each of the first electronic switch, the second electronic switch, and the third electronic switch operates to be in its respective closed state.

39. The vehicle interior compartment monitoring system of claim 35, wherein: When the camera is acquiring image data, the ECU enables the current driver, and wherein when the camera is not acquiring image data, the ECU disables the current driver.

40. The vehicle interior compartment monitoring system of claim 35, wherein: When the first electronic switch, the second electronic switch, and the third electronic switch are operated to be in their respective on states, the first light source, the second light source, and the third light source are electrically connected in series.

41. The vehicle interior compartment monitoring system of claim 35, wherein: The current driver provides a first ampere of current when the vehicle interior cabin monitoring system operates to detect the presence of an occupant within the vehicle interior cabin, and wherein the current driver provides a second ampere of current when the vehicle interior cabin monitoring system operates to monitor a vehicle driver, and wherein the first ampere of current is different from the second ampere of current.

42. The vehicle interior compartment monitoring system of claim 35, wherein: The first light source includes at least one first near infrared light emitting light emitting diode, and wherein the second light source includes at least one second near infrared light emitting light emitting diode, and wherein the third light source includes at least one third near infrared light emitting light emitting diode.

43. The vehicle interior compartment monitoring system of claim 35, wherein: The first light source includes at least two first near-infrared light emitting diodes, and wherein the second light source includes at least two second near-infrared light emitting diodes, and wherein the third light source includes at least two third near-infrared light emitting diodes.

44. The vehicle interior compartment monitoring system of claim 35, wherein: With the interior rearview mirror assembly attached to an interior portion of a vehicle, and with the vehicle interior cabin monitoring system operating to detect the presence of an occupant within the vehicle interior cabin, the first electronic switch is operated to be in its on state, the second electronic switch is operated to be in its on state, and the third electronic switch is operated to be in its on state, and the first light source, the second light source, and the third light source are electrically operated to emit near-infrared light.

45. The vehicle interior compartment monitoring system of claim 44, wherein: With the interior rearview mirror assembly attached to an interior portion of a vehicle and with the vehicle interior cabin monitoring system operating to monitor a vehicle driver, (i) the first electronic switch is operated to be in its on state and the first light source is electrically operated to emit near-infrared light, (ii) the second electronic switch is operated to be in its off state and the second light source is not electrically operated to emit near-infrared light, and (iii) the third electronic switch is operated to be in its off state and the third light source is not electrically operated to emit near-infrared light.

46. ​​The vehicle interior compartment monitoring system of claim 45, wherein: The first light source, when electrically operated to emit near infrared light, illuminates at least a driver's head area in an interior cabin of the vehicle.

47. The vehicle interior compartment monitoring system of claim 35, wherein: The first light source emits near infrared light at a first angle relative to the camera when electrically operated to emit near infrared light, and wherein the second light source emits near infrared light at a second angle relative to the camera when electrically operated to emit near infrared light, and wherein the first angle is different from the second angle.

48. The vehicle interior compartment monitoring system of claim 35, wherein: The ECU is arranged inside the lens head.

49. The vehicle interior compartment monitoring system of claim 35, wherein: The camera and the plurality of light sources are disposed within the lens head and behind the mirror reflective element, and wherein the camera observes through the mirror reflective element and the plurality of light sources emit near infrared light that passes through the mirror reflective element when electrically operated to emit near infrared light.

50. The vehicle interior compartment monitoring system of claim 35, wherein: The interior portion of the vehicle includes the interior of the vehicle's windshield.

Citation Information

Patent Citations

  • Vehicle vision system with display

    US10017114B2

  • Interior rearview mirror assembly with full screen video display

    US10046706B2

  • Vehicle vision system with gesture determination

    US10065574B2

  • Vision system for vehicle

    US10071687B2

  • Vision system for vehicle

    US10099614B2