Intelligent streaming media rearview mirror system and working method

Abstract

The present invention provides an intelligent streaming media rearview mirror system and working method, including an off-cabin rearview camera, an in-cabin camera, and a streaming media rearview mirror. The streaming media rearview mirror is integrated with a streaming media rearview mirror ECU; the in-cabin camera is arranged at the lower jaw of the streaming media rearview mirror and communicates with the streaming media rearview mirror ECU via a MIPI interface. It is used to collect image signals from the vehicle and transmit the signals to an ECU equipped with a DMS / OMS algorithm to implement a driver / passenger monitoring function; the off-cabin rearview camera collects image signals from the rear of the vehicle and transmits the signals to the ECU. After receiving the image signal, the ECU performs ISP processing and related algorithm analysis, and transmits the processed signal to the streaming media rearview mirror display screen. The above integrated design reduces the impact of the camera on the interior, reduces project costs and the weight of the entire vehicle, and at the same time, the DMS / OMS function can be modularized to improve the convenience of configuration on the vehicle.

Description

Technical Field

[0001] The present invention relates to the field of automobile rearview mirrors, and in particular to an intelligent streaming media interior rearview mirror system and a working method thereof. Background Art

[0002] With the continuous development of smart car technology, driver and passenger monitoring functions have become key components to ensure driving safety and improve cabin comfort. Existing driver monitoring systems (DMS) and occupant monitoring systems (OMS) usually rely on physical rearview mirrors or other locations in the cabin for integration. The cameras of these systems are generally placed at the A-pillar or steering column position of the cabin, and rely on video signal lines to transmit image data to the vehicle host for processing. For example, the physical rearview mirror products produced by Magna have been mass-produced on Volkswagen models. Its DMS camera is integrated under the screen and only has DMS functions. However, the existing solutions face some challenges: (1) The current DMS and OMS systems usually use two independent cameras to monitor the driver and passengers respectively, which not only increases the complexity of the power harness and video harness layout, but also increases the system cost. (2) Although the camera is placed on the A-pillar, although this method can cover the driver's face, it occupies part of the space of the A-pillar and requires drilling holes in the A-pillar, which in turn affects the strength of the A-pillar and increases production costs. (3) If the camera is placed on the steering column, although it can save space on the A-pillar, this arrangement may affect the driver's field of view, especially the observation of the instrument screen. At the same time, the accuracy of the DMS may also be affected because the relative angle between the camera position and the driver's face is relatively fixed and cannot be flexibly adjusted according to the driver's different postures. In addition, most existing technologies require the camera signal to be connected to the cockpit central control host through a video harness for processing, relying on the computing power of the central control host to run and calculate the driver / passenger monitoring behavior algorithm. This will put pressure on the vehicle's computing resources and there will be computing delay problems. Summary of the Invention

[0003] In view of the defects in the prior art, the present invention aims to provide an intelligent streaming media rearview mirror system and working method.

[0004] In order to achieve the above technical effects, the present invention adopts the following technical solutions:

[0005] According to a first aspect of the present invention, an intelligent streaming media rearview mirror system is provided, comprising an exterior rearview camera, an interior camera, and a streaming media rearview mirror. The streaming media rearview mirror is integrated with a streaming media rearview mirror ECU, which can run DMS and OMS algorithms. The streaming media rearview mirror ECU exchanges information and communicates with other ECUs via a CAN bus. The ECU supports an Ethernet interface and can be connected to a central gateway in the vehicle to push the video of the interior camera in real time to other ECUs connected to the central gateway controller. The interior camera is located under the chin of the streaming media rearview mirror and is connected to the streaming media rearview mirror ECU via MIPI signals. It can collect image signals from the vehicle and transmit the signals to the streaming media rearview mirror ECU to implement driver / passenger monitoring functions.

[0006] The outboard rearview camera is connected to the streaming media rearview mirror ECU via a Fakra video interface, and is capable of collecting real-time image signals from behind the vehicle and transmitting the signals to the streaming media rearview mirror ECU;

[0007] The streaming media rearview mirror ECU is equipped with a DMS / OMS algorithm and supports both IR (infrared) and RGB (visible light) operating modes. The IR mode is used to implement driver monitoring, while the RGB mode is used to implement occupant monitoring. The ECU receives image signals from the in-cabin camera and the exterior rearview camera, performs ISP processing and DMS / OMS algorithm analysis, and then sends the processed signals to the central control unit (CDC) via the CAN bus for display.

[0008] The streaming media rearview mirror also includes a combined display screen, a main PCBA, a camera PCBA and a connector system. The combined display screen is made of a glass cover plate and an LCD display screen fully bonded together with OCA glue. The main PCBA and the camera PCBA are the main components of the streaming media rearview mirror ECU. The camera PCBA integrates an image sensor and a signal processing unit, which is responsible for collecting image data from the in-cabin camera and the out-cabin rearview camera, and transmitting the image signal to the main PCBA for processing. The main PCBA can integrate an image signal processing (ISP) function, which is responsible for processing the image signals collected by the out-cabin and in-cabin cameras, and pushing the processed data to the LCD display screen for display.

[0009] Preferably, the driver monitoring function monitors the driver's status through an in-cabin camera, mainly including facial recognition, fatigue detection, distraction detection and abnormal behavior detection. It can identify the driver's identity, monitor fatigue or distracted driving behavior, and issue warnings for abnormal behaviors such as smoking, drinking water, and making phone calls to ensure that the driver focuses on driving.

[0010] Preferably, the occupant monitoring function monitors the occupants in the car through an in-cabin camera. The functions include photo and video recording, object detection, gesture recognition and child abandonment monitoring, which are respectively used to record emergency events, detect whether there are objects left by passengers in the car, control the functions in the car through gesture recognition, and detect whether there are children left in the car, so as to ensure the safety of the occupants and the cleanliness of the car.

[0011] Preferably, the streaming media rearview mirror ECU can perform OTA (Over-The-Air) firmware upgrades via Ethernet to ensure that the streaming media rearview mirror system can be updated at any time.

[0012] Preferably, the streaming media rearview mirror ECU can realize the linkage function of the streaming media rearview mirror display screen and the cabin instrument screen, central control screen, and HUD screen through the CAN bus and Ethernet communication protocol between the central control unit (CDC).

[0013] Preferably, the streaming media interior rearview mirror ECU can transmit and interact with the central gateway (CCU) via Ethernet or CAN communication, thereby realizing the control and setting of the rearview mirror.

[0014] Preferably, a light shield is provided below the combined display screen of the streaming media interior rearview mirror to reduce the reflection of external light sources on the display screen.

[0015] Preferably, the streaming media rearview mirror also includes an LED lighting part responsible for controlling the streaming media rearview mirror, providing uniform backlight for the streaming media rearview mirror surface, and ensuring image clarity in low light environments.

[0016] Preferably, the connector system includes a power connector, a video connector and an Ethernet connector, which can provide power and data transmission interfaces for the streaming media rearview mirror.

[0017] According to a second aspect of the present invention, a method for operating an intelligent streaming media rearview mirror system is provided, which uses the intelligent streaming media rearview mirror system and specifically includes the following steps:

[0018] Step S1. The rearview camera outside the cabin collects image data of the vehicle's rear view in real time, while the camera inside the cabin collects image data of the driver and passengers' facial features and behaviors to monitor the driver and passengers;

[0019] Step S2: The data from the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data from the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface;

[0020] Step S3: The ECU receives image signals from the external and internal cameras and performs image signal processing (ISP) on the image signals. It also uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the internal and external cameras to perform fatigue detection, distracted driving detection, facial recognition, and left-behind detection functions.

[0021] Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen via the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or alarm system.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] 1. The intelligent streaming media rearview mirror system provided by this invention integrates an in-cabin camera into the streaming media rearview mirror, eliminating the need for camera installation holes in the vehicle, minimizing the impact on the interior and achieving a simpler and neater interior design. By eliminating unnecessary cameras and components, the vehicle's weight is reduced, improving fuel efficiency or the range of electric vehicles, while also enhancing maneuverability.

[0024] 2. The intelligent streaming media rearview mirror system provided by the present invention integrates multiple functional modules, reduces the use of cameras and video harnesses, simplifies hardware connections, and reduces the overall cost of the project.

[0025] 3. The intelligent streaming media rearview mirror system provided by the present invention modularizes the driver monitoring (DMS) and occupant monitoring (OMS) functions, so that it can be flexibly configured according to the requirements of different vehicle models, improving the convenience of getting on the vehicle and simplifying the production process. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Other features, objects and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments with reference to the following drawings:

[0027] Figure 1 Schematic diagram of the structure of the streaming media rearview mirror and the in-cabin camera described in the first embodiment;

[0028] Figure 2 This is an exploded structural diagram of the streaming media rearview mirror described in the first embodiment;

[0029] Figure 3 This is a flowchart of the steps of the working method of the intelligent streaming media rearview mirror system described in the second embodiment.

[0030] The figure shows:

[0031] 1-Combination display

[0032] 2- Lens hood

[0033] 3-Front shell

[0034] 4- Main PCBA

[0035] 5-Lens bracket

[0036] 6-Camera PCBA

[0037] 7-Ball head base

[0038] 8-Ball Head Cover

[0039] 9-Back cover

[0040] 10-Ball Head

[0041] 11-Connector DETAILED DESCRIPTION

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Generally, the components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations.

[0043] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for protection, but merely represents selected embodiments of the present application. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the present application without creative work are within the scope of protection of the present application.

[0044] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined or explained in subsequent figures. In addition, all directional indications in this application (such as up, down, left, right, front, back, bottom...) are only used to explain the relative position relationship, movement, etc. between the components under a specific posture (as shown in the figures). If the specific posture changes, the directional indication will also change accordingly. Furthermore, the descriptions of "first", "second", etc. in the application are for descriptive purposes only and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features.

[0045] First embodiment

[0046] like Figure 1 Figure 2 As shown, this embodiment provides an intelligent streaming media rearview mirror system, including an off-cabin rearview camera, an in-cabin camera and a streaming media rearview mirror, and a streaming media rearview mirror ECU is integrated in the streaming media rearview mirror. This system provides high-definition rearview images, driver and passenger monitoring, and intelligent linkage functions through efficient hardware design, intelligent algorithms and advanced communication protocols. The in-cabin camera is integrated into the streaming media rearview mirror to realize the driver / passenger monitoring function. The off-cabin rearview camera is mainly used to provide a real-time video stream behind the vehicle and display the rearview image for the streaming media rearview mirror. The streaming media rearview mirror ECU (electronic control unit) is the core control unit of the streaming media rearview mirror, which is responsible for receiving and processing image data from off-cabin and in-cabin cameras, and integrates multiple functions such as image signal processing (ISP), DMS / OMS algorithm processing, and display control.

[0047] like Figure 1 As shown, the in-cabin camera is positioned below the chin of the streaming media rearview mirror, located at position Y0 within the entire streaming media rearview mirror structure. This differs from traditional DMS / OMS arrangements, which require holes near the A-pillar, steering column, and dome light for camera installation, impacting the interior's aesthetics and structural integrity. In this embodiment, the in-cabin camera is integrated into the streaming media rearview mirror, effectively capturing the driver and passengers' facial features and behavior while also avoiding the need for holes or structures in the interior to house the camera, thus preserving the interior's integrity and simplicity. In terms of hardware, the in-cabin camera and the streaming media rearview mirror's ECU are integrated into the same module. The in-cabin camera utilizes OV's OX05B1S IR / RGB dual-mode camera, connected to the streaming media rearview mirror ECU via board-side MIPI signals to ensure efficient data transmission. The ECU, equipped with the DMS / OMS algorithm, processes image data captured by the in-cabin camera in real time, supporting both IR (infrared) and RGB (visible light) operating modes. The IR mode is used by the Driver Monitoring System (DMS), which analyzes the driver's eye movements, facial expressions, and other features. In addition to Face ID recognition, it can also determine safety hazards such as fatigued or distracted driving (supporting monitoring for smoking, drinking, and phone calls). It also automatically adjusts the air conditioning vents based on the driver's occupant. The RGB mode is used by the Occupant Monitoring System (OMS), which takes photos and videos of occupants and monitors their facial expressions, gestures, and other behaviors, such as detecting any objects left behind by passengers or checking for child safety. The streaming media rearview mirror ECU receives image signals from the in-cabin and exterior rearview cameras, performs ISP processing and DMS / OMS algorithm analysis, and then sends the processed data to the central control unit (CDC) via the CAN bus for display.

[0048] The exterior rearview camera, located at the rear of the vehicle, captures real-time images from behind. It connects to the streaming rearview mirror ECU via an LVDS cable harness or Fakra video interface, transmitting a high-definition video signal. The ECU then performs ISP processing and transmits the signal to the streaming rearview mirror display. Furthermore, the streaming rearview mirror ECU and the CDC central control unit communicate and exchange data via an integrated CAN communication module, enabling control and configuration of the rearview mirror.

[0049] The streaming rearview mirror ECU exchanges information and communicates with other ECUs via the CAN bus. The ECU also supports an Ethernet interface, allowing it to connect to the vehicle's central gateway. This allows it to stream in-cabin camera video in real time to other ECUs connected to the central gateway controller, enabling communication between the streaming rearview mirror and other cabin control domains. This significantly expands the functionality of other streaming rearview mirrors. The CAN bus and Ethernet communication protocols between the streaming rearview mirror ECU and the central control unit (CDC) enable linkage between the streaming rearview mirror display and the cabin instrument panel, center console, and HUD. The ECU also supports OTA (Over-The-Air) firmware upgrades via Ethernet, ensuring the mirror system can be updated at any time to enhance functionality and performance.

[0050] As can be seen, this technical solution utilizes a computing ECU in the media rearview mirror and an IR / RGB dual-mode camera for driver and occupant monitoring. This enables the streaming media rearview mirror to independently process algorithms while also driving the streaming media rearview camera and displaying the streaming rearview image, achieving standard ECU software. The in-cabin camera uses OV's OX05B1S IR / RGB dual-mode camera, which is connected to the streaming media rearview mirror ECU via board-side MIPI signals. The out-cabin rearview camera is connected to the streaming media rearview mirror ECU via an LVDS wiring harness. The driver monitoring, occupant monitoring, and streaming media rearview mirror video signals are hardware-isolated to prevent interference.

[0051] like Figure 2As shown, in addition to the in-cabin camera, the streaming media rearview mirror also includes a combined display screen 1, a light shield 2, a front shell 3, a rear shell 9, an LED-PCBA, a main PCBA (4), a heat sink, a camera PCBA (6), a lens bracket 5, a ball head base 7 and a ball head cover 8, etc. Among them, the combined display screen 1 is made of a glass cover plate and an LCD display screen fully bonded by OCA glue, which is responsible for displaying the image output of the streaming media rearview mirror and providing high-definition rearview images and other vehicle information. The light shield 2 is used to reduce the reflection of external light sources on the display screen, optimize the display effect, and ensure that the image is clearly displayed even in strong light. The front shell 3 and the rear shell 9 serve as the external protection structure of the streaming media rearview mirror, protecting the internal electronic components from external impact, and fixing the entire structure through the bayonet to ensure the overall stability of the product. The LED-PCBA is responsible for controlling the LED lighting part of the streaming media rearview mirror, providing a uniform backlight for the mirror surface, and ensuring the clarity of the image in low-light environments. The main PCBA (4) and the camera PCBA (6) are the main components of the streaming media rearview mirror ECU. The main PCBA (4) is the core circuit board, which integrates the image signal processing (ISP) function and is responsible for processing the image signals collected by the external and internal cameras, and pushing the processed data to the LCD screen for display. The heat sink provides heat dissipation for the main PCBA and other high-power electronic components, maintaining stable operation of the system and preventing overheating. The camera PCBA (6) is an integrated image sensor and signal processing unit, which is responsible for collecting image data from the internal camera and the external rearview camera, and transmitting the image signal to the main PCBA for processing. The lens bracket 5 is used to fix the lens and sensor board of the camera, ensuring that the camera is stable and accurately captures the image. The ball head base 7 and the ball head cover 8 are fixed by screws, providing an adjustable installation method for the streaming media rearview mirror, allowing the rearview mirror to adjust its angle according to the driver's needs. The connector 11 includes a power connector, a video connector and an Ethernet connector, which are installed on the ball head rod 10 by snaps, and is responsible for providing power and data transmission interface for the streaming media rearview mirror.The assembly process includes the following steps: (1) the ball head cover 8 is fixed to the ball head base 7 by screws; (2) the ball head rod 10 is inserted into the ball head base 7, and the ball head base 7 is reversely fixed to the back shell 9 by screw columns, and the lower jaw structure protruding from the back shell 9 is used to install the cabin camera; the power connector, video connector and Ethernet connector are installed on the ball head rod 10 by snaps; (3) the glass cover is fully bonded to the display screen by OCA glue to form a combined display screen 1, and the main PCBA (4) is fixed to the display screen and the display screen by screws. The screen and glass become an integrated assembly; (4) the heat sink is fixed to the main PCBA (4) by screws; (5) the glass assembly is fixed to the front shell 3 by glue, and the light shield 2 is clamped to the front shell 3 by a bayonet; (6) the front cabin camera is fixed to the camera bracket 5 by AA glue, the IR light board and the camera sensor board are fixed to the camera bracket 5 by screws, and the camera bracket 5 is fixed to the rear shell 9 by screws in reverse; (7) the front shell 3 and the rear shell 9 are clamped by a bayonet to complete the assembly of the entire rearview mirror structure.

[0052] Second embodiment

[0053] like Figure 3 As shown, this embodiment provides a working method of an intelligent streaming media rearview mirror system, which adopts the intelligent streaming media rearview mirror system described in the first embodiment and specifically includes the following steps:

[0054] Step S1. The rearview camera outside the cabin collects image data of the vehicle's rear view in real time, while the camera inside the cabin collects image data of the driver and passengers' facial features and behaviors to monitor the driver and passengers;

[0055] Step S2: The data from the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data from the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface;

[0056] Step S3: The ECU receives image signals from the external and internal cameras and performs image signal processing (ISP) on the image signals. It also uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the internal and external cameras to perform fatigue detection, distracted driving detection, facial recognition, and left-behind detection functions.

[0057] Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen via the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or alarm system.

[0058] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the scope of the technical concept of this invention.

Claims

1. An intelligent streaming media rearview mirror system, characterized in that: It includes an exterior rearview camera, an interior camera, and a streaming rearview mirror. The streaming rearview mirror is integrated with a streaming rearview mirror ECU; the ECU can run DMS and OMS algorithms. The streaming media rearview mirror ECU exchanges information and communicates with other ECUs via the CAN bus. The ECU also supports an Ethernet interface, allowing it to connect to the vehicle's central gateway and stream the in-cabin camera's video in real time to other ECUs connected to the central gateway controller. The in-cabin camera, located under the mirror's jaw, is linked to the mirror's ECU via MIPI signals, capturing image signals from within the vehicle and transmitting them to the ECU for driver / passenger monitoring. The outboard rearview camera is connected to the streaming media rearview mirror ECU via a Fakra video interface, and is capable of collecting real-time image signals from behind the vehicle and transmitting the signals to the streaming media rearview mirror ECU; The streaming media rearview mirror ECU is equipped with a DMS / OMS algorithm and supports both IR (infrared) and RGB (visible light) operating modes. The IR mode is used to implement driver monitoring, while the RGB mode is used to implement occupant monitoring. The ECU receives image signals from the in-cabin camera and the exterior rearview camera, performs ISP processing and DMS / OMS algorithm analysis, and then sends the processed signals to the central control unit (CDC) via the CAN bus for display. The streaming media rearview mirror also includes a combined display screen, a main PCBA, a camera PCBA and a connector system. The combined display screen is made of a glass cover plate and an LCD display screen fully bonded together with OCA glue. The main PCBA and the camera PCBA are the main components of the streaming media rearview mirror ECU. The camera PCBA integrates an image sensor and a signal processing unit, which is responsible for collecting image data from the in-cabin camera and the out-cabin rearview camera, and transmitting the image signal to the main PCBA for processing. The main PCBA can integrate an image signal processing (ISP) function, which is responsible for processing the image signals collected by the out-cabin and in-cabin cameras, and pushing the processed data to the LCD display screen for display.

2. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The driver monitoring function monitors the driver's status through the in-cabin camera, mainly including facial recognition, fatigue detection, distraction detection and abnormal behavior detection. It can identify the driver's identity, monitor fatigue or distracted driving behavior, and issue warnings for abnormal behaviors such as smoking, drinking water, and making phone calls to ensure that the driver is focused on driving.

3. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The occupant monitoring function monitors the occupants in the car through the in-cabin camera. The functions include taking photos and recording videos, detecting objects left behind, gesture recognition and monitoring children left behind. They are used to record emergency events, detect whether there are objects left behind by passengers in the car, control the functions in the car through gesture recognition, and detect whether there are children left behind in the car, ensuring the safety of the occupants and the cleanliness of the car.

4. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media rearview mirror ECU can perform OTA (Over-The-Air) firmware upgrades via Ethernet, ensuring that the streaming media rearview mirror system can be updated at any time.

5. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media rearview mirror ECU can realize the linkage function of the streaming media rearview mirror display screen and the instrument screen, central control screen and HUD screen in the cabin through the CAN bus and Ethernet communication protocol between it and the central control unit (CDC).

6. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media interior rearview mirror ECU can transmit and interact with the central gateway (CCU) via Ethernet or CAN communication, thereby realizing the control and setting of the rearview mirror.

7. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: A sunshade is provided below the combined display screen of the streaming media rearview mirror to reduce the reflection of external light sources on the display screen.

8. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media rearview mirror also includes an LED lighting part responsible for controlling the streaming media rearview mirror, providing uniform backlight for the streaming media rearview mirror surface to ensure image clarity in low-light environments.

9. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The connector system includes a power connector, a video connector and an Ethernet connector, which can provide power and data transmission interfaces for the streaming media rearview mirror.

10. A method for operating an intelligent streaming media rearview mirror system, characterized in that: The intelligent streaming media rearview mirror system according to any one of claims 1 to 9 is used, and specifically comprises the following steps: Step S1. The rearview camera outside the cabin collects image data of the vehicle's rear view in real time, while the camera inside the cabin collects image data of the driver and passengers' facial features and behaviors to monitor the driver and passengers; Step S2: The data from the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data from the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface; Step S3: The ECU receives image signals from the external and internal cameras and performs image signal processing (ISP) on the image signals. It also uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the internal and external cameras to perform fatigue detection, distracted driving detection, facial recognition, and left-behind detection functions. Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen via the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or alarm system.

Images