Monitoring system

Through the use of alternating exposure profiles of the imaging device and the use of liquid crystal filters, an effective combination of infrared and visible spectrum is achieved, solving the problem of insufficient image quality and driver monitoring accuracy in the existing monitoring system, and improving the effect of driver behavior analysis.

CN120282899APending Publication Date: 2025-07-08GENTEX CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380081711.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-11-30
Filing Date
2023-11-28
Publication Date
2025-07-08

AI Technical Summary

Technical Problem

Existing monitoring systems are difficult to effectively combine infrared and visible spectrum for driver monitoring, resulting in insufficient accuracy of image quality and driver behavior analysis.

Method used

The image forming device configuration file alternating mode is adopted, infrared or near-infrared illumination and ambient illumination are alternately switched, combined with liquid crystal filters and control systems, image capture and analysis of different spectra are achieved.

Benefits of technology

Improve image quality and driver monitoring accuracy, enhance the analytical ability of driver behavior, especially adaptability when ambient light intensity changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120282899A_ABST
    Figure CN120282899A_ABST
Patent Text Reader

Abstract

A monitoring system includes an imaging device. The imaging apparatus includes a first exposure profile and a second exposure profile. The illumination source is configured to emit at least one of infrared (IR) or near infrared (NIR) illumination. The control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to an emission of illumination from the illumination source and the second exposure profile corresponds to ambient illumination.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to a monitoring system, and more particularly, to a monitoring system utilizing different spectra. Summary of the Invention

[0002] According to one aspect of the present disclosure, a monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. A lighting source is configured to emit at least one of infrared (IR) or near-infrared (NIR) lighting. A control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to the emission of lighting from the lighting source, and the second exposure profile corresponds to ambient lighting.

[0003] According to another aspect of the present disclosure, a rearview mirror assembly includes a housing; a transmissive element that includes a reflective state, and a filter that is configured to attenuate transmission of one or more wavelength spectra. The monitoring system is at least partially located within the housing. The monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. A lighting source is configured to emit at least one of infrared (IR) or near-infrared (NIR) lighting. A control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to the emission of lighting from the lighting source. The second exposure profile corresponds to ambient lighting.

[0004] According to yet another aspect of the present disclosure, a rearview mirror assembly includes a housing, and a display located within the housing. The monitoring system is at least partially located within the housing. The monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. A lighting source is configured to emit at least one of infrared (IR) or near-infrared (NIR) lighting. A control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to the emission of lighting from the lighting source. The second exposure profile corresponds to ambient lighting.

[0005] Those skilled in the art will further understand and appreciate these and other features, advantages, and purposes of the device by studying the following specification, claims, and drawings. Brief Description of the Drawings

[0006] In the various figures:

[0007] Figure 1 is a side cross-sectional view of a monitoring system utilizing a first exposure profile according to one aspect of the present disclosure;

[0008] Figure 2A side cross-sectional view of a monitoring system utilizing a second exposure profile according to one aspect of the present disclosure;

[0009] Figure 3 A side perspective view of the interior of a vehicle incorporating a monitoring system according to one aspect of the present disclosure;

[0010] Figure 4A A side cross-sectional view of a filter in a monitoring system under a first condition according to one aspect of the present disclosure;

[0011] Figure 4B A side cross-sectional view of a filter in a monitoring system under a second condition according to one aspect of the present disclosure;

[0012] Figure 5 A schematic diagram of a control system for a monitoring system according to one aspect of the present disclosure; and

[0013] Figure 6 A flowchart of a method of using a monitoring system with a first exposure profile and a second exposure profile according to one aspect of the present disclosure.

[0014] The components in the figures are not necessarily drawn to scale, but rather emphasize the principles described herein. Detailed Description

[0015] The presently shown embodiments mainly reside in combinations of device components related to monitoring systems utilizing different spectra. Accordingly, device components and method steps have been represented by conventional symbols in the figures where appropriate, showing only those specific details relevant to understanding the embodiments of the present disclosure so as not to obscure the present disclosure, which has details that will be apparent to those skilled in the art and has the benefits described herein. Additionally, in the specification and drawings, like numbers represent like elements.

[0016] For purposes described herein, the terms "upper", "lower", "right", "left", "rear", "front", "vertical", "horizontal" and their derivatives shall relate to the disclosure as oriented in Figure 1 Unless otherwise specified, the term "front" shall refer to the surface of the element closer to the intended observer of the monitoring system, and the term "rear" shall refer to the surface of the element farther from the intended observer of the monitoring system. However, it should be understood that the present disclosure may assume various alternative orientations, except where explicitly specified to the contrary. It should also be understood that the specific devices and processes shown in the figures and described in the following specification are merely exemplary embodiments of the inventive concepts defined in the appended claims. Accordingly, unless the claims expressly state otherwise, the specific dimensions and other physical characteristics related to the embodiments disclosed herein should not be considered limiting.

[0017] The term "comprising", "including" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article or apparatus that comprises a series of elements does not include only those elements but may also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without further limitation, an element preceded by "comprising..." does not preclude the existence of additional identical elements in the process, method, article or apparatus that comprises the element.

[0018] Referring Figure 1 to FIGS. 4, the reference numeral 10 generally designates a monitoring system including an imaging device 12. The imaging device 12 includes a first exposure profile 14 ( Figure 1 ) and a second exposure profile 16 ( Figure 2 ). The illumination source 18 is configured to emit at least one of infrared (IR) or near-infrared (NIR) illumination 20. The control system 100 is configured to alternate between the first exposure profile 14 and the second exposure profile 16 according to a first mode. The first exposure profile 14 corresponds to the emission of the illumination 20 from the illumination source 18, and the second exposure profile 16 corresponds to the ambient illumination 22.

[0019] Now referring Figure 1 , the first exposure profile 14 corresponds to the emission of the illumination 20. In this way, the imaging device 12 and the illumination source 18 are synchronized. For example, the illumination source 18 is configured to emit the illumination 20 substantially during the first exposure profile 14 according to a first mode (i.e., in a blinking or pulsed mode) and not to emit the illumination 20 during the second exposure profile 16. The first exposure profile 14 produces a first image type 24. The first exposure profile 14 includes a first exposure time designated for capturing the first image type 24 in the IR and / or NIR spectra. Now referring Figure 2 , the second exposure profile 16 corresponds to the ambient illumination 22. In this way, the imaging device 12 is configured to capture a second image type 26 with the second exposure profile 16. The second exposure profile 16 includes a second exposure time designated for capturing the second image type 26 substantially in the visible spectrum.

[0020] Referring Figure 1 and Figure 2, the first exposure time and the second exposure time can be different. For example, the first exposure time operating under the principle of the IR and / or NIR spectrum can be shorter than the second exposure time operating under the principle of the visible spectrum. More specifically, the first image type 24 includes capturing the illumination 20 that has been reflected from the target surface, so it is beneficial to have a short first exposure time to reduce the influence from the ambient illumination 22. The second image type 26 includes color content (e.g., pixels), such that the imaging device 12 is configured to collect light from the ambient illumination 22 to capture the color content at a specified resolution. Therefore, it is beneficial to have a second exposure time longer than the first exposure time to collect the ambient illumination 22.

[0021] The monitoring system 10 is configured to determine the intensity of the ambient illumination 22. For example, the control system 100 can be configured to detect a quality characteristic of the second image type 26 (e.g., by examining one or more images of the second image type 26). More specifically, the control system 100 can be configured to detect that the resolution and / or color content of the second image type 26 is below a threshold quality characteristic. In some embodiments, the monitoring system 10 includes a light sensor 28( Figure 1 and Figure 2 ), and can detect (e.g., via the control system 100) the quality characteristic of the second image type 26 by communicating with the light sensor 28. For example, the light sensor 28 transmits the detected level of the ambient illumination 22 to the control system 100, and the control system 100 determines whether the level of the ambient illumination 22 is below a threshold at which the quality characteristic of the second image type 26 is no longer within the operating standard. When the control system 100 determines that the intensity of the ambient illumination 22 is below the threshold, the control system 100 is configured to alternately change between the first exposure profile 14 and the second exposure profile 16 according to the second mode. The second mode can include only the first exposure profile 14. In this way, according to the second mode, the rate of capturing images of the first image type 24 can be greater. For example, in some embodiments, the rate of capturing images of the first image type 24 in the second mode can be twice or more than twice the rate in the first mode. However, in some embodiments, the rate of capturing images of the first image type 24 in the second mode can be the same as the rate in the first mode.

[0022] Continuing to refer to Figure 1 and Figure 2, the monitoring system 10 can be configured to view a first image type 24 according to a first operation mode, view a second image type 26 according to a second operation mode, and view the first image type 24 and the second image type 26 together in a third operation mode. In the first operation mode, for example, the control system 100 can be configured to view the first image type 24 (e.g., or a series of images of the first image type 24) to determine the driving habits of the driver (i.e., driver monitoring), such as eye orientation, movement, and / or other driving habits. In the second operation mode, for example, the control system 100 can be configured to view the second image type 26 (e.g., or a series of images of the second image type 26) to obtain the same or additional driver monitoring features (e.g., by viewing changes in pixel color and / or color distribution), and / or transmit the second image type 26 locally (e.g., via the in-vehicle display 41) or remotely (e.g., using a teleconference type application). In the third operation mode, for example, the control system 100 can be configured to view the first image type 24 and the second image type 26 together. The first image type 24 and the second image type 26 can be viewed together by superimposing the image of the first image type 24 and the image of the second image type 26 or by viewing the images of the first image type 24 and the second image type 26 substantially simultaneously. In this way, the features of the first operation mode and the second operation mode can be used simultaneously, and / or the control system 100 can be configured to improve the accuracy of determination based on cross-viewing superimposition functions (e.g., driver monitoring). For example, if the driver wears glasses that substantially block the IR and / or NIR illumination 20, then the second operation mode can be used to monitor the driver's eyes.

[0023] Now refer to Figures 1 to 3 , the monitoring system 10 can be incorporated into various structures (such as the structure of the vehicle 30). For example, the imaging device 12 and the illumination source 18 can be connected to the rearview mirror assembly 32 for monitoring the occupant position 33 (e.g., the driver position) in the passenger compartment 34 of the vehicle 30. The rearview mirror assembly 32 can include a housing 36 defining an opening 38 and a transmissive element 40 within the opening 38. The transmissive element 40 includes a front surface 42 facing the occupant position 33 and a rear surface 44 generally facing away from the occupant position 33. The transmissive element 40 can include at least one electro-optical device 45 such that the transmissive element 40 can be switched to change the reflectivity between a reflective state operating as a mirror and a partial transmission state. The display 41 can be located between the housing 36 and the transmissive element 40 for displaying information to the driver (e.g., in the partial transmission state).

[0024] The display 41 can be configured to generate information (e.g., images, graphics, messages, alerts, etc.) related to the various conditions captured by the first image type 24 and the second image type 26. For example, the control system 100 can be configured to infer information related to driver or occupant activities from the first image type 24 and the second image type 26. More specifically, the control system 100 can be configured to detect unsafe driver or passenger activities, such as riding without a seatbelt, signs of driver fatigue (e.g., via posture or eye movement), unsafe movement around the interior of the vehicle 30, etc. The display 41 (e.g., via the control system 100) can generate information related to the unsafe driver or passenger activities. The electro-optical device 45 as disclosed herein can be a single-layer single-phase component, a multi-layer component, or a multi-phase component. The transmissive optical element 46 can be fixed relative to the illumination source 18 to collimate and / or diffract the illumination 20. The receiving optical element 48 can be fixed relative to the imaging device 12 to focus light in the imaging device. The housing 36 can include a connection hub 52, and the connection hub 52 can be connected to the mounting member 54. The mounting member 54 is configured to be connected to the vehicle 30 (or other environment), and the housing 36 can be moved relative to the mounting member 54 to orient the transmissive element 40 at various angles relative to the occupant position 33 (or other environmental position) so as to obtain different environmental views and / or orientations relative to the driver. In some embodiments, the illumination source 18 is configured to generate the illumination 20 in a structured light pattern. In this way, the control system 100 can be configured to operate under the principle of structured light such that the first image type 24 contains information that can be extracted into three-dimensional space.

[0025] Continuing to refer Figures 1 to 3 , the positions of the imaging device 12, the illumination source 18, and the light sensor 28 can be implemented in many different locations. For example, Figure 1 shows the imaging device 12 located outside the outer perimeter of the transmissive element 40 and the illumination source 18 located within the housing 36 behind the transmissive element 40. Figure 2 Alternatively shown is the illumination source 18 located outside the outer perimeter of the transmissive element 40 and the imaging device 12 coupled to the housing 36 behind the transmissive element 40 (e.g., located within or connected outside of the housing). However, unless otherwise specified, it should be understood that one or both of the imaging device 12 and the illumination source 18 can be located anywhere within the vehicle 30, connected to the rearview mirror assembly 32, and located within the housing 36. In a similar manner, the light sensor 28 can be connected to the rearview mirror assembly 32 or located anywhere within or outside of the vehicle 30.

[0026] Now referring Figure 1, the filter 50A according to the first configuration may be fixed relative to the imaging device 12. The filter 50A may be configured to attenuate the transmission of one or more specific wavelength spectra. For example, the filter 50A may be configured as a static filter, such as a two-passband static filter. In this way, the IR and / or NIR invisible spectra utilized by the first exposure profile 14 and the visible spectrum utilized by the second exposure profile 16 may be semi-isolated by filtering other spectra found in the ambient illumination 22 to enhance image quality.

[0027] Reference Figure 2 , Figure 4A and Figure 4B , the filter 50B according to the second configuration may be fixed relative to the imaging device 12. The filter 50B may be configured to selectively attenuate the transmission of one or more specific wavelength spectra. For example, the filter 50B may be configured as a dynamic filter, such as a filter incorporating a liquid crystal structure 74. The liquid crystal structure 74 may correspond to a chiral liquid crystal polymer that is disposed between a first substrate 76a and a second substrate 76b. The substrates 76a, 76b may correspond to glass or other substantially light-transmissive materials and may include one or more layers disposed on an inner surface 78 that is electrically connected to the liquid crystal structure 74. The layers may correspond to a conductive layer 80 and an alignment layer 82. The conductive layer 80 may correspond to a transparent conductive layer that may be formed of indium tin oxide or other conductive light-transmissive material (e.g., visible light, NIR, and IR spectra as appropriate). The alignment layer 82 may be configured to adjust the alignment of the liquid crystal structure 74 in response to a voltage applied to the conductive layer 80 by the control system 100.

[0028] Now refer to Figure 4A and Figure 4B , the first condition 70 may correspond to an open-circuit configuration, and the second condition 72 may correspond to a closed-circuit configuration. In the first condition 70, the liquid crystal structure 74 may be arranged in a neutral state, in which a helical twist structure may be formed due to the arrangement of the chiral liquid crystal polymer. The arrangement of the helical twist structure in the first condition 70 may reflect a first spectrum λ1 of the wavelength of light (i.e., IR and / or NIR) away from the imaging device 12, while a second spectrum λ VIS (i.e., at least a portion of the visible spectrum) is allowed to pass through the helical twist structure. In the second condition 72, a voltage potential may be applied across the conductive layers 80 of the first substrate 76a and the second substrate 76b. This voltage potential may cause the helical twist structure to become skewed, allowing a first range λ1 of the wavelength of light to pass through the filter 50B and be received by the imaging device 12. In some embodiments, the filter 50B may include a stack (e.g., two) of liquid crystal structures 74, with a first liquid crystal structure 74 selectively transmitting or reflecting the first spectrum λ1 and a second liquid crystal structure 74 selectively transmitting or reflecting the second spectrum λ VIS。In some embodiments, the present disclosure may be used in conjunction with a dynamic filter such as that described in U.S. Patent No. 10,547,783, which is hereby incorporated by reference in its entirety.

[0029] Now referring to Figure 5 , the control system 100 of the monitoring system 10 may include at least one electronic control unit (ECU) 102. In some embodiments, the at least one ECU 102 may include a combination of an ECU 102 associated with and indicative of the imaging device 12, an ECU 102 associated with and indicative of the illumination 18, an ECU 102 associated with and indicative of the filter 50B, and / or an ECU 102 associated with and indicative of the transmissive element 40. However, in some embodiments, it should be understood that the ECU 102 is a single ECU 102 that issues global instructions to several (e.g., all or selected) components of the monitoring system 10. Each ECU 102 may include a processor 104 and a memory 106. The processor 104 may comprise any suitable processor 104. Additionally or alternatively, each ECU 102 may include any suitable number of processors in addition to (or different from) the processor 104. The memory 106 may include a single disk or multiple disks (e.g., a hard disk drive) and includes a storage management module that manages one or more partitions within the memory 106. In some embodiments, the memory 106 may include flash memory, semiconductor (solid-state) memory, etc. The memory 106 may include random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or a combination thereof. The memory 106 may include instructions that, when executed by the processor 104, cause the processor 104 to perform at least functions associated with the components of the monitoring system 10. Thus, the imaging device 12, the illumination source 18, the light sensor 28, the transmissive element 40, and the display 41 may be controlled by the control system 100 (e.g., the at least one ECU 102 or the processor 104 associated therewith). Accordingly, the memory 106 may include software 108, first exposure profile parameter data 110, second exposure profile parameter data 112, first mode parameter data 114, second mode parameter data 116, image quality parameter data 118, and drive monitoring parameter data 120.

[0030] It should be understood that although the imaging device 12 is described as including the first exposure profile 14 and the second exposure profile 16, the first exposure profile 14 and the second exposure profile 16 may be included locally or remotely via instructions from the control system 100 (e.g., at least one ECU 102). The control system 100 may send a series of alternating instructions (e.g., per frame) for each of the first exposure profile 14 and the second exposure profile 16, or send instructions by implementing the first mode parameter data 114 or the second mode parameter data 116 as a single instruction. The first mode may be based on the frame numbers embedded in the first image type 24 and the second image type 26. For example, the first image type 24 may be associated with odd numbers, and the second image type 26 may be associated with even numbers. In some embodiments, the first mode may be associated with timing. For example, the first image type 24 may be captured at a timing rate indicated by the control system 100. In some embodiments, the first mode may include implementing the first exposure profile 14, the second exposure profile 16, and unequal rates. For example, the first mode may include capturing one or more images of the first image type 24 between capturing different numbers of images of the second image type 26. In some embodiments, the first mode may include capturing two or more images of the first image type 24 between capturing equal numbers of images of the second image type 26.

[0031] Now refer to Figure 6, a method 200 for operating a monitoring system having at least one imaging device and at least one illumination source is provided. By reference numeral 202, the imaging device operates in a first mode that includes alternating between a first exposure profile for capturing a first image type and a second exposure profile for capturing a second image type. For example, the first exposure profile may correspond to the emission of illumination (e.g., IR or NIR) from the illumination source, and the second profile may correspond to ambient illumination. The exposure time of the first exposure profile may be shorter than the exposure time associated with the second exposure profile. By reference numeral 204, the illumination source flashes illumination during the first exposure profile. By reference numeral 206, the first image type and / or the second image type is viewed in a first operating mode, a second operating mode, or a third operating mode. By reference numeral 206, the quality characteristics of the second image type are viewed. For example, the quality characteristics may be viewed within the image of the second image type or by receiving communication from a light sensor. By reference numeral 208, when it is determined that the quality characteristics are below a threshold, the first mode is changed to a second mode of imaging capture. For example, when it is determined that the intensity of the ambient illumination or the quality characteristics of the second image are below a threshold, the alternation between the first exposure profile and the second exposure profile is changed according to the second mode. In some embodiments, the second mode may include only the first exposure profile. In some embodiments, the second mode may include implementing a plurality of first exposure profiles between implementations of a periodic second exposure profile. By reference numeral 210, the second mode is maintained until the intensity of the ambient light is higher than the threshold associated with the quality characteristics, at which time the second mode is changed to the first mode.

[0032] The present disclosure is further outlined in the following paragraphs and is further characterized as a combination of any and all of the various aspects described therein.

[0033] According to one aspect of the present disclosure, a monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. The illumination source is configured to emit at least one of infrared (IR) or near-infrared (NIR) illumination. The control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to the emission of illumination from the illumination source. The second exposure profile corresponds to ambient illumination.

[0034] According to another aspect, a monitoring system includes a first exposure profile and a second exposure profile, the first exposure profile having a first exposure time and the second exposure profile having a second exposure time that is longer than the first exposure profile.

[0035] According to yet another aspect, a monitoring system includes a control system configured to determine the intensity of ambient illumination.

[0036] According to yet another aspect, a monitoring system includes a control system configured to change an imaging device to a second mode when it is determined that the intensity of ambient illumination is below a threshold.

[0037] According to another aspect, a monitoring system, wherein the second mode includes only a first exposure profile.

[0038] According to yet another aspect, a monitoring system includes a control system configured to maintain only the second mode until it is determined that the intensity of ambient illumination is above the threshold, after which the control system is configured to alternate between a first exposure profile and a second exposure profile according to a first mode.

[0039] According to another aspect, a first mode includes alternating to a first exposure profile after each second exposure profile in the second exposure profile.

[0040] According to yet another aspect, an imaging device is coupled to a rearview mirror assembly for a vehicle.

[0041] According to yet another aspect, a rearview mirror assembly includes an electro-optical device and a display, the electro-optical device defining a front surface configured to face a vehicle occupant location, the display being located on a side of the electro-optical device opposite the front surface.

[0042] According to another aspect of the present disclosure, a rearview mirror assembly includes a housing; a transmissive element that includes a reflective state, and a filter configured to attenuate transmission of one or more wavelength spectra. A monitoring system is at least partially located in the housing. The monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. A lighting source is configured to emit at least one of infrared (IR) or near-infrared (NIR) illumination. A control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to emission of illumination from the lighting source. The second exposure profile corresponds to ambient illumination.

[0043] According to another aspect, a filter is configured to attenuate at least one of an illumination spectrum from a lighting source or selected wavelengths outside of the illumination spectrum from a lighting source in ambient illumination.

[0044] According to yet another aspect, a filter includes a liquid crystal structure configured to switch between a first state in which an illumination spectrum from a lighting source is attenuated and a second state in which selected wavelengths outside of the illumination spectrum from a lighting source in ambient illumination are attenuated.

[0045] According to yet another aspect, a control system is configured to switch a filter to a first state when the imaging device is in a second exposure profile and to switch the filter to a second state when the imaging device is in a first exposure profile.

[0046] According to another aspect, a liquid crystal structure includes a chiral liquid crystal polymer disposed between a first substrate and a second substrate.

[0047] According to another aspect, a control system is further configured to determine an intensity of ambient illumination and, when determining that the intensity of the ambient illumination is below a threshold, change the imaging device to a second mode that includes only the first exposure profile.

[0048] According to yet another aspect, a first mode includes alternating to a first exposure profile after each second exposure profile in a second exposure profile.

[0049] According to yet another aspect of the present disclosure, a rearview mirror assembly includes a housing and a display located within the housing. A monitoring system is at least partially located within the housing. The monitoring system includes an imaging device. The imaging device includes a first exposure profile and a second exposure profile. A lighting source is configured to emit at least one of infrared (IR) or near-infrared (NIR) illumination. A control system is configured to alternate between the first exposure profile and the second exposure profile according to a first mode. The first exposure profile corresponds to emission of illumination from the lighting source. The second exposure profile corresponds to ambient illumination.

[0050] According to another aspect, a display is configured to generate information related to a first image type and a second image type.

[0051] According to yet another aspect, a control system is configured to detect unsafe driver or passenger activities from a first image type and a second image type, and the information generated by the display includes a notification related to the unsafe driver or passenger activities.

[0052] According to yet another aspect, a filter is configured to attenuate at least one of an illumination spectrum from a lighting source or selected wavelengths outside of the illumination spectrum from the lighting source in ambient illumination.

[0053] Those skilled in the art will appreciate that the described disclosure and the construction of other components are not limited to any particular material. Unless otherwise described herein, other exemplary embodiments of the disclosure herein described may be formed from a variety of materials.

[0054] For the purposes of this disclosure, the term "coupled" (in all its forms couple, coupling, coupled, etc.) generally means that two (electrical or mechanical) components are joined to each other either directly or indirectly. Such a joining may be stationary in nature or movable in nature. Such a joining may be accomplished using two (electrical or mechanical) components and any additional intermediate members that are formed integrally with each other or with the two components. Unless otherwise stated, such a joining may be permanent in nature or may be removable or releasable in nature.

[0055] It is also noted that the construction and arrangement of the elements of the disclosure shown in the exemplary embodiments are merely illustrative. Although only a few embodiments of the innovation have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications (e.g., variations in the sizes, dimensions, structures, shapes and proportions of various elements, parameter values, installation arrangements, use of materials, colors, orientations, etc.) may be made without materially departing from the novel teachings and advantages of the subject matter. For example, elements shown as integrally formed may be constructed of multiple parts, or elements shown as multiple parts may be integrally formed, the operation of the interfaces may be reversed or otherwise changed, the lengths or widths of the structures and / or the components or connectors or other elements of the system may be changed, and the nature or number of adjustment positions between the elements may be changed. It should be noted that the elements and / or components of the system may be constructed of any of a wide variety of materials that provide sufficient strength or durability and may be of any of a wide variety of colors, textures, and combinations. Accordingly, all such modifications are intended to be included within the scope of the innovation. Other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of the desired and other exemplary embodiments without departing from the spirit of the innovation.

[0056] The foregoing description is considered only as a description of the illustrated embodiments. Modifications may be made to the device by those skilled in the art and those making or using the device. Accordingly, it is understood that the embodiments shown in the figures and described above are for illustrative purposes only and are not intended to limit the scope of the device, which is defined by the appended claims as interpreted in accordance with the principles of patent law, including the doctrine of equivalents.

Claims

1. A monitoring system, comprising: An imaging device, the imaging device including a first exposure profile and a second exposure profile; A lighting source configured to emit at least one of infrared (IR) or near-infrared (NIR) lighting; And A control system configured to alternate between the first exposure profile and the second exposure profile according to a first mode, wherein the first exposure profile corresponds to the emission of lighting from the lighting source, and the second exposure profile corresponds to ambient lighting.

2. The monitoring system according to claim 1, wherein the first exposure profile has a first exposure time, and the second exposure profile has a second exposure time longer than the first exposure profile.

3. The monitoring system according to claim 1 or 2, wherein the control system is further configured to determine the intensity of the ambient lighting.

4. The monitoring system according to claim 3, wherein the control system is further configured to change the imaging device to a second mode when determining that the intensity of the ambient lighting is below a threshold.

5. The monitoring system according to claim 4, wherein the second mode includes only the first exposure profile.

6. The monitoring system according to claim 5, wherein the control system is further configured to maintain only the second mode until determining that the intensity of the ambient lighting is above the threshold, wherein the control system is configured to alternate between the first exposure profile and the second exposure profile according to the first mode.

7. The monitoring system according to claim 1 or 2, wherein the first mode includes alternating to the first exposure profile after each second exposure profile in the second exposure profile.

8. The monitoring system according to claim 1 or 2, wherein the imaging device is coupled to a rearview mirror assembly for a vehicle.

9. The monitoring system according to claim 8, wherein the rearview mirror assembly includes an electro-optical device and a display, the electro-optical device defining a front surface configured to face a vehicle occupant position, and the display is located on a side of the electro-optical device opposite to the front surface.

10. A rearview mirror assembly, comprising: A housing; A transmissive element including a reflective state; A filter configured to attenuate the transmission of one or more wavelength spectra; And A monitoring system at least partially located in the housing and including: An imaging device aligned with the filter and including a first exposure profile and a second exposure profile; A lighting source configured to emit at least one of infrared (IR) or near-infrared (NIR) lighting; and A control system configured to alternate between the first exposure profile and the second exposure profile according to a first mode, wherein the first exposure profile corresponds to the emission of lighting from the lighting source, and the second exposure profile corresponds to ambient lighting.

11. The rearview mirror assembly according to claim 10, wherein the filter is configured to attenuate at least one of the illumination spectrum from the illumination source or selected wavelengths outside the illumination spectrum from the illumination source in the ambient illumination.

12. The rearview mirror assembly according to claim 10 or 11, wherein the filter comprises a liquid crystal structure configured to switch between a first state and a second state, in the first state, the illumination spectrum from the illumination source is attenuated, and in the second state, selected wavelengths outside the illumination spectrum from the illumination source in the ambient illumination are attenuated.

13. The rearview mirror assembly according to claim 12, wherein the control system is further configured to switch the filter to the first state when the imaging device is in the second exposure profile, and to switch the filter to the second state when the imaging device is in the first exposure profile.

14. The rearview mirror assembly according to claim 13, wherein the liquid crystal structure comprises a chiral liquid crystal polymer disposed between a first substrate and a second substrate.

15. The rearview mirror assembly according to claim 13, wherein the control system is further configured to determine the intensity of the ambient illumination, and when determining that the intensity of the ambient illumination is below a threshold, change the imaging device to a second mode including only the first exposure profile.

16. The rearview mirror assembly according to claim 10 or 11, wherein the first mode includes alternating to the first exposure profile after each second exposure profile in the second exposure profile.

17. A rearview mirror assembly, comprising: a housing; a display located within the housing; and a monitoring system at least partially located within the housing and comprising: an imaging device including a first exposure profile for generating a first image type and a second exposure profile for generating a second image type; an illumination source configured to emit at least one of infrared (IR) or near-infrared (NIR) illumination; and a control system configured to alternate between the first exposure profile and the second exposure profile according to a first mode, wherein the first exposure profile corresponds to the emission of illumination from the illumination source, and the second exposure profile corresponds to ambient illumination.

18. The rearview mirror assembly according to claim 17, wherein the display is configured to generate information related to the first image type and the second image type.

19. The rearview mirror assembly according to claim 18, wherein the control system is further configured to detect unsafe driver or passenger activities from the first image type and the second image type, and wherein the information generated by the display includes a notification related to the unsafe driver or passenger activities.

20. The rearview mirror assembly according to claim 19, further comprising a filter configured to attenuate at least one of the illumination spectrum from the illumination source or a selected wavelength outside the illumination spectrum from the illumination source in the ambient illumination.

Citation Information

Patent Citations

  • Imaging device with switchable day and night modes

    US10547783B2