Multi-sensor inside rear-view mirror and motor vehicle with inside rear-view mirror

Abstract

The invention relates to an inside rear-view mirror device (2) and a motor vehicle (1) equipped with such a device. The interior mirror device (2) includes a color image sensor (6) and an infrared image sensor (6) provided in a region (4) of a mirror surface of the interior mirror device (2). Furthermore, the interior mirror device (2) comprises a 3D image sensor device (7, 10) and an illumination device (8) for illuminating the infrared image sensor (6) and the detection region of the 3D image sensor device (7, 10) outside the visible spectral range. The color image camera sensor (6), the infrared image sensor (6) and the 3D image sensing means (7, 10) are oriented to observe the occupant space of the motor vehicle (1) in the intended installation position of the interior mirror device (2).

Description

Technical Field

[0001] The invention relates to an interior rearview mirror device for a motor vehicle and a motor vehicle equipped with the interior rearview mirror device. Background Art

[0002] In today's cars, there are already a large number of assistance and comfort functions based on sensor data. For example, US 2019 / 0 092 242 A1 describes a tiltable interior rearview mirror for a motor vehicle, which has a tilting device for tilting the mirror surface from a normal position to a dimming position. In addition, the interior rearview mirror therein has a display element and a sensor for detecting gestures of the driver of the motor vehicle. In this case, the tilting device can be activated or the display element can be switched on and off according to the signal of the sensor.

[0003] As another example, US 9,911,050 B2 describes a safety system for a vehicle having a plurality of sensors that observe the vehicle's surroundings. In this case, image data from an image detection sensor directed forward in the longitudinal direction of the vehicle are processed for automatic headlight control, lane keeping warnings or traffic sign recognition. Image data from rearward or laterally directed image detection sensors are manipulated to form a video image for display on a corresponding screen. In order to improve the safety system, a fusion module is also provided, which detects and processes inputs from different sources. Finally, based on the processing results of the safety system, it is determined whether an object is present at the rear of the vehicle.

[0004] As another example, US 2010 / 0 289 885 A1 describes an image detection system for a vehicle having an image detection sensor and an image processor. In this case, the image detection sensor comprises an arrangement of photosensitive elements for different wavelengths. The image processor then subtracts the infrared component from the pixels of the other wavelengths to achieve a more accurate true color image display. The image detection system described therein can be used, for example, in a vehicle to detect an environment located in front of the vehicle in the direction of travel, thereby supporting the driver of the vehicle.

[0005] However, with the increasing use of sensors, especially in motor vehicles, the costs, complexity and challenges of the arrangement or positioning of the sensors in the vehicle (i.e. in the packaging) may increase disadvantageously. For example, an optimal field of view or detection area of ​​the sensors, an arrangement of the sensors that is as unobtrusive or invisible as possible, the simplest possible wiring of the sensors, the simplest possible manufacture of the vehicle and the greatest possible design freedom for other vehicle components should be achieved, which often requires compromises. Summary of the invention

[0006] The object of the present invention is to improve the functionality and the design freedom of a motor vehicle in an efficient and effective manner.

[0007] The technical problem is solved by an interior rearview mirror device for a motor vehicle. Other possible embodiments of the present invention are disclosed in the specification and the drawings. The features, advantages and possible embodiments explained within the scope of the description of one subject of the present invention are considered to be at least similar to the features, advantages and possible embodiments of other corresponding subjects of the present invention and any possible combination of the subjects.

[0008] The interior rearview mirror device according to the present invention is particularly used in motor vehicles. The interior rearview mirror device has a lens, i.e., for example, a glass or plastic lens or a mirror glass or other transparent layer, and a mirror surface arranged behind it. Therefore, the mirror surface can be an actual reflective mirror surface or a light reflecting surface, such as a metal layer or a metal foil, etc. It can be particularly completely covered by a lens that is transparent or transparent at least for visible light, especially for infrared light. When the interior rearview mirror device is in the expected installation position in the motor vehicle, the mirror surface can face the passenger compartment of the motor vehicle, especially the driver's seat. The light emitted there must first pass through the lens before it can reach the mirror surface. For example, a bracket or housing of the interior rearview mirror device, etc. can be arranged on the rear side of the mirror surface facing away from the lens.

[0009] Furthermore, the interior rearview mirror device according to the invention has a color image camera sensor and an infrared image sensor. The color image camera sensor can be an optical sensor for light of multiple wavelengths in the visible spectral range, i.e., for example, for recording color or RGB images, in particular 2D image data, in particular of the passenger compartment of a motor vehicle. The infrared image sensor can be a sensor for light in the infrared range, in particular for detecting 2D infrared images, in particular of the passenger compartment of a motor vehicle.

[0010] In the interior rearview mirror device according to the present invention, the color image camera sensor and the infrared image sensor are also arranged in the area of ​​the mirror surface behind the lens. Therefore, the color image camera sensor and the infrared image sensor can be arranged, for example, between the lens and the mirror surface, or in a groove in the mirror surface that is open to the lens, or behind a perforated area of ​​the mirror surface, or behind an area of ​​the mirror surface that is transparent to visible light wavelengths or infrared wavelengths, etc. Therefore, the color image camera sensor and the infrared image sensor can be integrated into the interior rearview mirror device in an inconspicuous manner accordingly. In this case, the color image camera sensor and the infrared image sensor can be configured as separate individual sensors, or can be combined or integrated in a unique combination or multifunctional sensor. Therefore, such a combination or multifunctional sensor can include, for example, areas or pixels that are sensitive to visible wavelengths and areas or pixels that are sensitive to infrared wavelengths.

[0011] The rearview mirror device according to the present invention further comprises at least one 3D camera or 3D image sensor device and at least one lighting device. The 3D image sensor device is a device for recording 3D images or 3D data, i.e., sensing areas, in particular, distance or depth data of the passenger space of the corresponding motor vehicle. The lighting device is configured to illuminate the detection area of ​​the infrared image sensor and the 3D image sensor device outside the visible spectrum range. In other words, the detection area can be illuminated or illuminated by means of the lighting device, for example, by light or electromagnetic radiation with a wavelength greater than 800nm, in particular infrared light or infrared laser. To this end, the lighting device can include, for example, at least one surface emitter or VCSEL (vertical cavity surface emitting laser) and / or one or more LEDs, in particular infrared LEDs. Therefore, the light emitted by the lighting device and reflected in the corresponding detection area can be detected by the infrared image sensor or the 3D image sensor device to generate corresponding data.

[0012] According to the invention, in the intended installation position of the interior rearview mirror device in the respective motor vehicle, the color image camera sensor, the infrared image sensor and the 3D image sensor device are arranged or oriented for observing or imaging the passenger space of the motor vehicle, in particular the driver or the driver's position or the driver's seat. In other words, the color image camera sensor, the infrared image sensor and the 3D image sensor device can thus be configured and arranged to detect electromagnetic radiation of the respective wavelength passing through the lens in the direction of the mirror surface from the interior space of the respective motor vehicle in the intended installation position of the interior rearview mirror device.

[0013] As described for the color image camera sensor and the infrared image sensor, the 3D image sensing device may include one or more separate or individual sensors. Likewise, one or more sensors of the 3D image sensing device may be combined or integrated with the color image camera sensor and / or the infrared image sensor. Thus, the interior rearview mirror device may include, for example, three separate sensors or a combined color image camera and infrared image sensor, and an additional 3D sensor for the 3D image sensing device, or a combined or integrated color image camera and infrared image and 3D sensor.

[0014] By integrating various sensors and associated lighting devices into the interior rearview mirror device, in particular at least partially behind the lens, as proposed herein, a higher integration density, reduced packaging costs and greater design freedom for other components or surfaces in the passenger space of the motor vehicle can be achieved. In addition, the various sensors or lighting devices may be less visible or less obvious to the occupants, in particular the driver of the motor vehicle, or even at least substantially invisible. Thus, in general, an attractive aesthetic can be achieved in the motor vehicle, as well as the possibility of reduced distraction or visual interference or excessive visual stimulation. By combining or integrating different sensors and lighting devices into the interior rearview mirror device, installation space required for other components can be saved at other locations, which cannot be actually integrated into the interior rearview mirror device. In addition, different sensors can be used for the same above-mentioned functions, and at least partially require the same or similar data processing steps for their sensor data, because they are all provided for detecting the passenger space and / or occupants of the motor vehicle. Thus, corresponding data processing or corresponding control of the lighting device cooperating with at least the infrared image sensor and the 3D image sensing device can be achieved in a particularly effective, efficient and space-saving manner. Thus, for example, a single data processing device or electronic device or a single controller etc. can be used for a plurality or all sensors of an interior rearview mirror device or a lighting device. Compared to other or decentralized arrangements of sensors in a motor vehicle, this can save corresponding data processing devices or controllers and corresponding wiring, thereby saving installation space, costs and complexity. By minimizing or standardizing the electronic components for data processing and / or control in this way, weight and operating energy can also be saved, and correspondingly less waste heat can be generated during operation.

[0015] Due to the arrangement of the various sensors proposed here, the invention enables a particularly simple, reliable and uniform or consistent detection of the passenger space or of the occupants or at least of the driver of the respective motor vehicle. Thus, the interior rearview mirror device according to the invention can be used particularly effectively and efficiently for various image-based functions, for example in the field of driver monitoring for various driver assistance systems or driver assistance functions, for occupant recognition, for activating or controlling safety systems (e.g. restraint devices, etc.), for infotainment functions and / or the like. In this case, due to their different types or functions, the various sensors can provide a broad spectrum of data or information and can provide sensor data in different situations or under different brightness or lighting conditions in the passenger space, which can allow a robust and reliable execution of the various functions.

[0016] The rearview mirror device according to the invention can be designed and used not only as an interior rearview mirror for a motor vehicle, but can also be used for other applications, such as for the most unobtrusive possible image or video monitoring in or around buildings or outdoor areas, for example for security purposes or personal protection purposes, etc.

[0017] In a possible embodiment of the present invention, the 3D image sensor device and / or the lighting device are arranged next to the mirror surface. In particular, the 3D image sensor device and / or the lighting device are arranged above the mirror surface in the vertical direction of the vehicle in the intended installation position of the interior rearview mirror in the motor vehicle. By the arrangement adjacent to the mirror surface proposed here, damage to the mirror function can be avoided. In addition, the interior rearview mirror device can be manufactured more easily and more economically than, for example, the 3D image sensor device and / or the lighting device are arranged on, inside or behind the mirror surface itself. In addition, the arrangement of the lighting device adjacent to the mirror surface can especially achieve a particularly effective illumination of the detection area of ​​the 3D image sensor device and the infrared image sensor, because, for example, compared with the arrangement behind the mirror surface, etc., the attenuation of the light emitted by the lighting device can be avoided or reduced. In addition, in the vertical direction of the vehicle, the arrangement above the mirror surface can be particularly inconspicuous or slightly distracting to the driver of the corresponding motor vehicle. Here, the lens can extend beyond the mirror surface in the main extension plane of the lens and the mirror surface so as to also cover the 3D image sensor device and / or the lighting device arranged next to the mirror surface. Thus, the 3D image sensing device and / or the lighting device can be arranged behind the lens but close to the mirror surface. Likewise, the size or range of the lens can at least substantially correspond to the size or range of the mirror surface. Thus, the 3D image sensing device and / or the lighting device arranged next to the mirror surface can also be arranged next to the lens. For example, this can avoid the attenuation of the radiation that hits the 3D image sensing device or its sensor and / or the radiation emitted by the lighting device through the lens. For example, the 3D image sensing device and / or the lighting device arranged next to the lens can be covered by an additional cover. Then, this additional cover can in particular have properties different from the lens, that is, it can be optimized specifically for its function of covering the 3D image sensing device and / or the lighting device. For example, this can mean or include an optimization of the visibility of the 3D image sensing device and / or the lighting device to an observer, in particular a driver of a motor vehicle, and / or the transmittance of the respective relevant wavelengths.

[0018] In a possible improved design of the present invention, the interior rearview mirror device has a visual shielding element, which is arranged next to the mirror surface, especially above the mirror surface in the vertical direction of the vehicle in the predetermined installation position of the interior rearview mirror device. In this case, the visual shielding element covers the 3D image sensing device and / or the lighting device that are optionally arranged next to the mirror surface. In other words, the 3D image sensing device and / or the lighting device can therefore be arranged behind the visual shielding element. The visual shielding element can, for example, be adjacent to the lens or at least extend substantially in the main extension plane of the lens. The visual shielding element can be or include, for example, an element or component that is darkened or at most partially transparent in the visible spectrum. For example, the visual shielding element can be made of smoked glass or dark gray or black glass or corresponding dark plastics, etc., or can be or have a component coated with a corresponding dark color or at least partially or at least mainly a layer or film that is opaque in the visible spectrum, such as a glass or plastic lens, or a glass or plastic plate, etc. The visual blocking element can be or have, for example, a whole-surface or continuous component or element for covering a 3D image sensor device and / or an illumination device (arranged next to a mirror surface if necessary), or the visual blocking element can be or have, for example, a corresponding grid surface or mesh surface. For infrared radiation, in particular for the wavelength used by the infrared image sensor and / or the 3D image sensor device, the visual blocking element can be in particular completely transparent or at least partially or at least mainly transparent.

[0019] If necessary, the 3D image sensor device and / or lighting device arranged next to the mirror surface is covered by a visual shielding element or arranged behind the visual shielding element, which can particularly mean that in the expected installation position of the interior rearview mirror device in the corresponding motor vehicle, the visual shielding element faces the vehicle occupant, in particular the driver or the driver's seat of the corresponding motor vehicle. In other words, from the perspective of the vehicle occupant, in particular from the driver's seat of the motor vehicle, the 3D sensor arranged behind it or the lighting device arranged behind it is hidden by the visual shielding element. Therefore, the 3D image sensor device and / or lighting device arranged next to the mirror surface can be at least substantially invisible to the vehicle occupant through the visual shielding element, or at least less clear or less easily visible or recognizable than in the absence of the visual shielding element. Therefore, the visual shielding element can present a uniform surface, which can avoid or reduce the visual distraction or overstimulation of the vehicle occupant. At the same time, the visual shielding element can protect the 3D image sensor device and / or lighting device optionally arranged behind it, for example, to prevent dirt or scratches, etc.

[0020] In another possible embodiment of the present invention, the 3D image sensor device and / or the lighting device - as long as they are not arranged behind the visual blocking element mentioned elsewhere - are also arranged behind the lens in the area of ​​the mirror surface. In other words, the 3D image sensor device or its 3D sensor and / or lighting device can therefore be arranged between the lens and the mirror surface or behind the mirror surface, or can be embedded in the mirror surface, etc. The embodiment of the present invention proposed here can achieve a particularly compact structure of the interior rearview mirror device, that is, a particularly small structural space requirement. In addition, the corresponding sensor or lighting device can therefore be particularly inconspicuous to the observer, that is, in particular the corresponding vehicle occupant, thereby avoiding corresponding visual distractions. Similarly, the embodiment of the present invention proposed here can achieve the same or particularly similar viewing angles or detection angles of different sensors and / or particularly accurately corresponding or corresponding illumination angles or lighting angles of the lighting device. Therefore, shadows or shadow projections of the 3D image sensor device and / or the infrared image sensor can be avoided or reduced.

[0021] In another possible embodiment of the invention, the lighting device comprises a plurality of individual light sources arranged on different sides of the infrared image sensor and / or the 3D image sensor device. Thus, when viewed in the main extension plane of the lens and / or the mirror surface, i.e., when viewed in its longitudinal and / or vertical or transverse direction, at least one of the individual light sources can be arranged on the left and right side of the infrared image sensor and / or the 3D image sensor device and / or above or below the infrared image sensor device and / or the 3D image sensor device. For example, when viewed in the longitudinal direction of the rearview mirror device, the infrared image sensor and / or the 3D image sensor device or its 3D sensor can be arranged in the central area of ​​the lens or the mirror surface, and in each case, at least one of the individual light sources can be arranged in the lateral end area or outer area of ​​the lens or the mirror surface or the rearview mirror device. The individual light sources can comprise, for example, infrared LEDs or surface emitters, etc. However, the various individual light sources can be connected or coupled to each other. Thus, for example, the individual light sources can be switched or controlled, for example, jointly or bundled, by a central switch or control device or an electronic device of the lighting device or the rearview mirror device, etc. The configuration and arrangement of the lighting device or individual light sources proposed here can provide particularly reliable, complete and low-shadow illumination for infrared image sensors and / or 3D image sensor devices. Therefore, they can correspondingly and reliably provide particularly accurate and detailed or comprehensive sensor data.

[0022] In another possible embodiment of the invention, the 3D image sensing device is or comprises a TOF camera (TOF: Time of Flight). Thus, for example, various distances of an object to the interior rearview mirror device or the 3D image sensing device can be measured. This can be used, for example, to recognize whether a seat in the respective motor vehicle is empty or occupied, or whether a vehicle occupant is located there. Similarly, a TOF camera can realize, for example, an estimation of the height of an occupant, facial recognition of an occupant, recognition of the sitting posture of an occupant, recognition of gestures of an occupant, etc. This can be realized with relatively low expenditure or relatively low complexity of data processing or corresponding software. In addition, a TOF camera can provide particularly fast measurement or recognition, i.e. particularly low reaction or response times, and works reliably under different ambient light conditions.

[0023] In another possible embodiment of the invention, the 3D image sensing device comprises a 3D scanner operating with structured light. Thus, the lighting device can be particularly arranged to emit or project a predetermined light pattern into the detection area of ​​the 3D scanner, i.e. in the respective motor vehicle, in particular in the intended installation position of the interior rearview mirror device in its interior space. The 3D scanner can then detect distortions or apparent deformations of the original emitted light pattern caused by three-dimensional contours in the passenger space or the detection area. Based on this, the corresponding three-dimensional contours in the detection area can then be identified. To this end, the light pattern can be or include a predetermined arrangement of, for example, strips and / or dots and / or other geometric shapes, etc. The identification or detection of three-dimensional geometric shapes using structured light or based on structured light proposed here can, for example, achieve particularly compact, i.e. space-saving 3D recognition with particularly high distance or depth recognition or measurement accuracy.

[0024] In another possible embodiment of the present invention, the 3D image sensing device includes at least two 3D sensors based on different functional principles. For example, the 3D image sensing device herein may include a TOF camera mentioned elsewhere and a 3D scanner based on structured light operation mentioned elsewhere. A single 3D sensor may be arranged, for example, behind a lens, particularly in the region of a mirror. Similarly, one or more or all 3D sensors may be arranged next to a mirror, such as behind a visual occlusion element mentioned elsewhere. These two different 3D sensors may be used, for example, for different functions or applications, in which case the strengths or advantages of the 3D sensor that is more suitable for the corresponding function or application may be utilized. Similarly, 3D sensors may be used in combination with each other. For example, their sensor data may be fused with each other. Therefore, by using several different 3D sensors to three-dimensionally identify or detect the passenger space of the corresponding motor vehicle or the vehicle occupants that may be located therein, a particularly accurate and reliable or robust identification or detection of the interior space and / or the vehicle occupants may be achieved. Therefore, the functions or applications based on it may work particularly reliably and accurately accordingly.

[0025] In another possible embodiment of the present invention, the rearview mirror device has a housing. The mirror surface is arranged on one side of the housing. The electronic device is arranged in the housing for automatically processing or evaluating sensor data from a color image camera sensor and an infrared image sensor and a 3D image sensing device or at least one 3D sensor of the 3D image sensing device, and for automatically controlling the lighting device. For example, the housing can be covered or closed by a mirror surface or a lens on one side or toward one side at least in large part, that is, for example, completely or on the entire surface, or except for a frame or corresponding edge around the mirror surface, etc. Therefore, the interior of the housing accommodating the electronic device can be arranged behind the mirror surface. The electronic device can also be configured to generate and output control signals according to the sensor data of various sensors. To this end, the rearview mirror device can have, for example, corresponding connections or corresponding data or signal transmission interfaces. In addition, the rearview mirror device can be connected or coupled to the on-board electrical system of the corresponding motor vehicle, for example. Therefore, according to the design or requirements, the electronic device can only pre-process or fully process the sensor data, that is, for example, the corresponding images or image data of various sensors, or convert them into control signals for auxiliary systems or actuators for motor vehicles, etc. Due to the arrangement of the electronics in the housing of the interior rearview mirror arrangement proposed here, the various sensors can be connected to the electronics in a particularly simple manner or over a particularly short path, i.e. via particularly short and therefore particularly light and cost-effective electrical cables. Furthermore, since generally no space is required behind the mirror, i.e. for example at the intended installation location between the rear side of the mirror and the inside of the motor vehicle windshield, a particularly efficient packaging of the motor vehicle can be achieved overall, i.e. a particularly good utilization of the installation space. This can also achieve corresponding design or design freedom in other areas of the motor vehicle.

[0026] The invention also relates to a motor vehicle equipped with the interior rearview mirror device according to the invention. Thus, the motor vehicle according to the invention can in particular be a motor vehicle described in conjunction with the interior rearview mirror device according to the invention or correspond to this motor vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Further features of the invention can be derived from the following description of the figures and the drawings. The features and feature combinations mentioned in the above description and the features and feature combinations shown below individually in the description of the figures and / or in the drawings can be used not only in the combination specified in each case but also in other combinations or alone without departing from the scope of the invention.

[0028] In the attached picture:

[0029] Figure 1 A schematic diagram of a section of a front area of ​​a passenger compartment of a motor vehicle having a multi-sensor interior rearview mirror device in a first variant is shown;

[0030] Figure 2A schematic diagram showing an interior rearview mirror device in a second variation;

[0031] Figure 3 A schematic diagram showing an interior rearview mirror device in a third variation;

[0032] Figure 4 A schematic diagram showing an interior rearview mirror device in a fourth modification; and

[0033] Figure 5 A schematic perspective view of an interior rearview mirror arrangement is shown.

[0034] In the figures, identical or functionally identical elements are provided with the same reference numerals. For the sake of clarity, only a representative selection of identical or similar elements occurring multiple times are at least partially explicitly marked in the figures. DETAILED DESCRIPTION

[0035] Figure 1 A schematic partial view of the front area of ​​the passenger compartment of a motor vehicle 1 is shown. In particular, an interior rearview mirror device arranged on the inside of the windshield of the motor vehicle is shown here. The interior rearview mirror device 2 comprises a housing 3, and a mirror area 4 facing the passenger space is arranged in or on the housing 3. For example, a glass or plastic lens can be arranged in the mirror area, which can cover, for example, a metallized or metalized mirror surface. A visual shielding element 5 as part of the interior rearview mirror device 2 is located above the mirror area 4 in the vertical direction of the vehicle. This can be, for example, another component adjacent to the mirror area 4 or the housing 3, or a shaped or extended portion of the lens of the mirror area 4. However, in particular, unlike the lens in the mirror area 4, the visual shielding element can be darkened, or at least substantially opaque to visible light.

[0036] In order to realize various comfort and auxiliary functions of the motor vehicle, the sensor device is also integrated into the interior rearview mirror device. The sensor device includes a color image camera, namely an RGB image sensor and an infrared image sensor, which are integrated or combined in the multifunctional sensor 6 in the variant shown here. The sensor device also includes a 3D sensor, which is designed as an independent sensor in the variant shown here and is arranged to be separated from the multifunctional sensor. In this case, the multifunctional sensor 6 is located in or on the mirror area 4, in particular behind the lens there. On the other hand, the 3D sensor 7 is located behind the visual blocking element 5. At least the infrared image sensor, but in particular the 3D sensor can be configured to detect light outside the visible spectrum range, in particular infrared light. To support this, the interior rearview mirror device 2 also includes an illumination device 8. The illumination device 8 is arranged to actively emit infrared light into the passenger space of the motor vehicle 1, in particular into the detection area of ​​the infrared image sensor and the 3D sensor 7. To this end, the illumination device 8 includes a plurality of separate light sources 9 here, which can be, for example, infrared LEDs or VCSELs. Here, the respective light sources 9 are also arranged behind the vision blocking element 5 and on both sides of the 3D sensor 7 .

[0037] The sensor system or other components of the interior mirror system 2 may be arranged, for example, not visible here, behind the vision-blocking element 5 and / or behind the mirror region 4 , in particular in the housing 3 .

[0038] Figure 2 A partial schematic diagram of the rearview mirror device 2 in the second variant is shown. Here, as an example, Figure 1 The 3D sensor 7 or its functionality is also integrated into the multifunctional sensor 6 together with the RGB image sensor and the infrared image sensor. In this case, the multifunctional sensor 6 is also arranged, for example, in or on the mirror area 4, but can also be arranged, for example, behind the vision blocking element 5. Figure 1 Compared to the variant shown, a slightly different configuration of the lighting device 8 with more individual light sources 9 is also shown here. Here, the vision-blocking element 5 can also be at least substantially centrally located when viewed in the longitudinal direction of the interior rearview mirror device 2, wherein the individual light sources are also arranged adjacent to each other. Due to appropriate symmetry, this can be or allow a configuration that is particularly less distracting for the driver of the motor vehicle 1.

[0039] Figure 3 1 shows a schematic partial view of an interior rearview mirror device 2 in a third variant. In this case, the lighting device 8 or its separate light source 9 is also arranged in or on the mirror area 4, in particular behind the lens there. As an example, it can be configured in the same manner as in Figure 1Thus, the RGB image sensor and the infrared image sensor can be combined in the multifunctional sensor, and the 3D sensor 7 can be arranged separately from them. However, in the third embodiment shown, the 3D sensor 7 is also arranged in or on the mirror area 4, in particular behind the lens there, like the multifunctional sensor 6. However, it is also possible to use, for example, Figure 2 The multifunctional sensor 6 of the second variant shown in FIG. Since the various sensors and the lighting devices 8 or their individual light sources 9 are arranged in or on the mirror area 4, the visual blocking element 5 can be omitted. This can allow a particularly compact design of the interior rearview mirror device 2.

[0040] Figure 4 A partial schematic diagram of an interior rearview mirror device 2 in a fourth variant is shown. Here, as an example, the sensor device and the lighting device 8 or their individual light sources 9 are also arranged in or on the mirror area 4. However, instead of a single 3D sensor 7, the interior rearview mirror device 2 or the sensor device integrated therein comprises a 3D image sensor device 10 having a TOF sensor 11 and a 3D scanning sensor 12. In this case, the 3D scanning sensor 12 is provided in combination with the lighting device 8 for 3D detection by means of structured light. For this purpose, a corresponding predetermined structured light pattern can be emitted into the passenger space of the motor vehicle 1 by means of the lighting device 8, and its distortion or perspective deformation, etc. can then be detected by means of the 3D scanning sensor 12. On the other hand, for 3D detection by means of the TOF sensor 11, the lighting device 8 can emit, for example, a predetermined sequence of infrared light pulses. Based on the time differences between the emission of these infrared light pulses and their respective detection by the TOF sensor 11, a three-dimensional shape or contour in the passenger space of the motor vehicle 1 can also be recognized or reconstructed.

[0041] The detailed features provided in the various variants of the rearview mirror device can also be combined with each other in a different way than shown here, so as to realize other variants of the rearview mirror device. For example, the 3D image sensor device 10 can be arranged behind the vision blocking element 5 or the like, instead of in or on the mirror area 4. The optionally provided single 3D sensor 7 can be operated, for example, according to the TOF principle or by detecting a predetermined structured light pattern or according to a different functional principle.

[0042] Figure 5A schematic perspective view of a portion of an interior rearview mirror device 2 is shown. It can be seen here that the housing extends behind the mirror area 4 in such a way that it forms or encloses a receiving space or an interior space. For example, the electronic device schematically shown here can be arranged therein. The electronic device 13 can be configured to detect and process sensor data from various sensors and to control the lighting device 8. The corresponding processing or preprocessing results can be provided by the electronic device, for example, to one or more auxiliary systems of the motor vehicle, for example via the on-board electrical system of the motor vehicle or a corresponding bus connection or the like.

[0043] The sensor data of the RGB image sensor, i.e. the optical camera color image, can be used, for example, for video telephony, object recognition, providing portrait acquisition, etc. The infrared image sensor can be used, for example, for head position detection, eye state detection, i.e., for example, for detecting longer periods of closed eyes, for viewing direction detection, for identifying objects, in particular in the dark, typically for night photography, etc. For example, the 3D sensor 7 or the 3D image sensing device 10 can be used for measuring the distance of an occupant of the motor vehicle 1 from the interior rearview mirror device 2, gesture recognition, body size estimation, facial recognition or occupant recognition, seat position recognition, presence recognition of an occupant of the motor vehicle 1, etc.

[0044] Overall, the described examples show how a multi-sensor interior camera can be integrated into a rearview mirror, in particular an interior rearview mirror of a vehicle, in a particularly unobtrusive or at least substantially invisible manner.

[0045] Reference numerals list

[0046] 1 Motor Vehicle

[0047] 2 Interior rearview mirror device

[0048] 3 Housing

[0049] 4 Mirror Area

[0050] 5 Visual Occlusion Elements

[0051] 6 Multifunctional Sensors

[0052] 7 3D Sensor

[0053] 8 lighting fixtures

[0054] 9 Single light source

[0055] 10 3D image sensing device

[0056] 11. TOF Sensor

[0057] 12 3D scanning sensors

[0058] 13 Electronic devices.

Claims

1. An interior rearview mirror device (2) for a motor vehicle (1), comprising a lens, a mirror surface arranged behind the lens, a color image camera sensor (6) and an infrared image sensor (6), wherein - the color image camera sensor (6) and the infrared image sensor (6) are both arranged in the region (4) of the mirror surface behind the lens, - the interior rearview mirror device (2) further comprises a 3D image sensing device (7, 10) and an illumination device (8), wherein the illumination device (8) is used to illuminate the detection area of ​​the infrared image sensor (6) and the 3D image sensing device (7, 10) outside the visible spectrum range, - At the intended installation position of the interior rearview mirror device (2), the color image camera sensor (6), the infrared image sensor (6) and the 3D image sensor device (7, 10) are oriented to observe the passenger space of the motor vehicle (1).

2. The rearview mirror device (2) according to claim 1, It is characterized in that The 3D image sensor device (7, 10) and / or the lighting device (8) are arranged beside the mirror surface, in particular, above the mirror surface in the vertical direction of the vehicle in the expected installation position.

3. The rearview mirror device (2) according to claim 2, It is characterized in that The interior rearview mirror device (2) has a vision blocking element (5), which is arranged next to the mirror surface, in particular, arranged above the mirror surface in the vertical direction of the vehicle in the expected installation position, wherein the vision blocking element (5) covers a 3D image sensor device (7, 10) and / or a lighting device (8) arranged next to the mirror surface.

4. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The 3D image sensor device (7, 10) and / or the lighting device (8) are arranged in the area (4) of the mirror surface behind the lens, if they are not arranged behind the vision blocking element (5).

5. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The lighting device (8) comprises a plurality of individual light sources, which are arranged on different sides of the infrared image sensor (6) and / or the 3D image sensing device (7, 10).

6. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The 3D image sensing device (7, 10) comprises a TOF camera (11).

7. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The 3D image sensing device (7, 10) comprises a 3D scanner (12) which works by using structured light.

8. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The 3D image sensing device (7, 10) comprises two 3D sensors (11, 12) based on different working principles.

9. An interior rearview mirror device (2) according to any one of the preceding claims, It is characterized in that The interior rearview mirror device (2) has a housing (3), wherein a mirror surface is arranged on one side of the housing (3), and an electronic device (13) is arranged in the housing (3) for processing sensor data from a color image camera sensor (6), an infrared image sensor (6) and a 3D imaging system (7, 10) and for controlling a lighting device (8).

10. A motor vehicle (1) comprising an interior rearview mirror device (2) according to any one of the preceding claims.

Images