Intelligent streaming media inside rear-view mirror system and working method

Through the intelligent streaming media rearview mirror system, integrated intracabin camera and streaming media rearview mirror ECU, the complexity and cost of multi-camera systems in the existing technology are solved, and simple and efficient driver and occupant monitoring functions are achieved.

CN119705280AActive Publication Date: 2025-03-28JIANGLING MOTORS

Patent Information

Application Number
CN202411852730.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-16
Publication Date
2025-03-28
Estimated Expiration
2044-12-16

AI Technical Summary

Technical Problem

Existing driver and occupant monitoring systems require multiple independent cameras, increasing system complexity and cost, and the camera arrangement affects the vehicle's internal design and driver's field of view.

Method used

It adopts an intelligent streaming media rearview mirror system, integrates the cabin camera and streaming media rearview mirror ECU, and uses the CAN bus and Ethernet interface to communicate information to realize the driver and occupant monitoring functions.

Benefits of technology

It reduces the impact on the interior design, reduces the system cost and weight, improves fuel efficiency and handling, and realizes a multi-functional modular monitoring system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119705280A_ABST
    Figure CN119705280A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent streaming media inside rear-view mirror system and a working method, the intelligent streaming media inside rear-view mirror system comprises an out-cabin rear-view camera, an in-cabin camera and a streaming media inside rear-view mirror, and a streaming media inside rear-view mirror ECU is integrated in the streaming media inside rear-view mirror; the in-cabin camera is arranged at the lower jaw of the streaming media inside rear-view mirror, communicates with the ECU of the streaming media inside rear-view mirror through an MIPI (Mobile Industry Processor Interface), and is used for acquiring an image signal in a vehicle and transmitting the signal to the ECU carrying a DMS / OMS (Distributed Management System / Optical Management System) algorithm to realize a driver / passenger monitoring function; the outboard rearview camera collects image signals behind the vehicle and transmits the signals to the ECU. And after receiving the image signal, the ECU performs ISP processing and related algorithm analysis, and transmits the processed signal to a streaming media inside rear-view mirror display screen. According to the integrated design, the influence of the camera on the interior trim is reduced, the project cost and the whole vehicle weight are reduced, meanwhile, the DMS / OMS function can be modularized, and the convenience of configuration and loading is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of automobile rearview mirrors, and in particular to an intelligent streaming media interior rearview mirror system and a working method thereof. Background Art

[0002] With the continuous development of smart car technology, driver and occupant monitoring functions have become a key component to ensure driving safety and improve cabin comfort. Existing driver monitoring systems (DMS) and occupant monitoring systems (OMS) usually rely on physical rearview mirrors or other locations in the cabin for integration. The cameras of these systems are generally arranged at the A-pillar or steering column of the cabin, and rely on video signal lines to transmit image data to the vehicle host for processing. For example, the physical rearview mirror products produced by Magna have been mass-produced on Volkswagen models. Its DMS camera is integrated under the screen and only has DMS functions. However, existing solutions face some challenges: (1) Current DMS and OMS systems usually use two independent cameras to monitor the driver and occupants respectively, which not only increases the complexity of the layout of the power harness and video harness, but also increases the system cost. (2) Although the camera is arranged on the A-pillar, although this method can cover the driver's face, it occupies part of the space of the A-pillar and requires drilling holes on the A-pillar, which in turn affects the strength of the A-pillar and increases production costs. (3) If the camera is placed on the steering column, although it can save space on the A-pillar, this arrangement may affect the driver's field of view, especially the observation of the instrument screen. At the same time, the accuracy of the DMS may also be affected because the relative angle between the camera position and the driver's face is relatively fixed and cannot be flexibly adjusted according to the different postures of the driver. In addition, most existing technologies require the camera signal to be connected to the cockpit central control host through a video harness for processing, and rely on the computing power of the central control host to run and calculate the driver / passenger monitoring behavior algorithm, which will put pressure on the vehicle's computing resources and there will be computing delay problems. Summary of the invention

[0003] In view of the defects in the prior art, the present invention aims to provide an intelligent streaming media rearview mirror system and working method

[0004] In order to achieve the above technical effects, the present invention adopts the following technical solutions:

[0005] According to a first aspect of the present invention, there is provided an intelligent streaming media rearview mirror system, comprising an outboard rearview camera, an in-cabin camera and a streaming media rearview mirror, wherein a streaming media rearview mirror ECU is integrated in the streaming media rearview mirror, and the ECU can run DMS and OMS algorithms; the streaming media rearview mirror ECU exchanges information and communicates with other ECUs via a CAN bus, and the ECU supports an Ethernet interface, and can be connected to a central gateway in the vehicle to push the video of the in-cabin camera to other ECUs connected to the central gateway controller in real time; the in-cabin camera is arranged at the lower jaw of the streaming media rearview mirror, and is connected to the streaming media rearview mirror ECU via a MIPI signal, and can collect image signals in the vehicle and transmit the signals to the streaming media rearview mirror ECU, thereby realizing a driver / passenger monitoring function;

[0006] The outboard rearview camera is connected to the streaming media rearview mirror ECU via a Fakra video interface, and can collect real-time image signals from the rear of the vehicle and transmit the signals to the streaming media rearview mirror ECU;

[0007] The streaming media rearview mirror ECU is equipped with a DMS / OMS algorithm and supports two working modes: IR (infrared) and RGB (visible light); wherein the IR mode is used to realize the driver monitoring function, and the RGB mode is used to realize the occupant monitoring function; after receiving the image signals from the in-cabin camera and the out-cabin rearview camera, the ECU performs ISP processing and DMS / OMS algorithm analysis, and sends the processed signals to the central controller (CDC) through the CAN bus for display;

[0008] The streaming media rearview mirror also includes a combined display screen, a main PCBA, a camera PCBA and a connector system, wherein the combined display screen is formed by fully bonding a glass cover plate and an LCD display screen by OCA glue; the main PCBA and the camera PCBA are the main components of the streaming media rearview mirror ECU, and the camera PCBA integrates an image sensor and a signal processing unit, which is responsible for collecting image data from the in-cabin camera and the out-cabin rearview camera, and transmitting the image signal to the main PCBA for processing; the main PCBA can integrate an image signal processing (ISP) function, which is responsible for processing the image signals collected by the out-cabin and in-cabin cameras, and pushing the processed data to the LCD display screen for display.

[0009] Preferably, the driver monitoring function monitors the driver's status through an in-cabin camera, mainly including facial recognition, fatigue detection, distraction detection and abnormal behavior detection. It can identify the driver's identity, monitor fatigue or distracted driving behavior, and issue warnings for abnormal behaviors such as smoking, drinking, and making phone calls to ensure that the driver concentrates on driving.

[0010] Preferably, the occupant monitoring function monitors the occupants in the car through an in-cabin camera. The functions include photo and video recording, object detection, gesture recognition and child abandonment monitoring, which are respectively used to record emergency events, detect whether there are objects left by occupants in the car, control the functions in the car through gesture recognition, and detect whether there are children left in the car, so as to ensure the safety of the occupants and the cleanliness of the car.

[0011] Preferably, the streaming media rearview mirror ECU can perform OTA (Over-The-Air) firmware upgrades via Ethernet, ensuring that the streaming media rearview mirror system can be updated at any time.

[0012] Preferably, the streaming media rearview mirror ECU can realize the linkage function of the streaming media rearview mirror display screen and the instrument screen, central control screen and HUD screen in the cabin through the CAN bus and Ethernet communication protocol between the central control unit (CDC).

[0013] Preferably, the streaming media interior rearview mirror ECU can transmit and interact with the central gateway (CCU) via Ethernet or CAN communication, thereby realizing the control and setting of the rearview mirror.

[0014] Preferably, a sunshade is provided below the combined display screen of the streaming media interior rearview mirror to reduce reflection of external light sources on the display screen.

[0015] Preferably, the streaming media rearview mirror also includes an LED lighting part responsible for controlling the streaming media rearview mirror, providing a uniform backlight for the streaming media rearview mirror surface to ensure image clarity in low-light environments.

[0016] Preferably, the connector system includes a power connector, a video connector and an Ethernet connector, which can provide power and data transmission interface for the streaming media rearview mirror.

[0017] According to a second aspect of the present invention, a working method of an intelligent streaming media rearview mirror system is provided, using the above-mentioned intelligent streaming media rearview mirror system, specifically comprising the following steps:

[0018] Step S1. The rear-view camera outside the cabin collects image data of the rear view of the vehicle in real time, while the camera inside the cabin collects image data of the facial features and behaviors of the driver and passengers to monitor the driver and passengers;

[0019] Step S2: The data of the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data of the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface;

[0020] Step S3: The ECU receives image signals from the cameras outside and inside the cabin and performs image signal processing (ISP) on the image signals and uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the cameras inside and outside the cabin to perform fatigue detection, distracted driving detection, face recognition, and leftover object detection functions;

[0021] Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen through the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or the alarm system.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] 1. The intelligent streaming media rearview mirror system provided by the present invention integrates the in-cabin camera into the streaming media rearview mirror, avoiding the need to open a hole in the vehicle to install the camera, reducing the impact on the interior, and making the interior design more concise and neat. By reducing unnecessary cameras and components, the weight of the vehicle is reduced, the fuel efficiency or the endurance of the electric vehicle is improved, and the maneuverability is improved.

[0024] 2. The intelligent streaming media rearview mirror system provided by the present invention integrates multiple functional modules, reduces the use of cameras and video harnesses, simplifies hardware connections, and reduces the overall cost of the project.

[0025] 3. The intelligent streaming media rearview mirror system provided by the present invention modularizes the driver monitoring (DMS) and occupant monitoring (OMS) functions, so that it can be flexibly configured according to the requirements of different vehicle models, improves the convenience of getting on the vehicle, and simplifies the production process. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0027] Figure 1 It is a schematic diagram of the structure of the streaming media rearview mirror and the in-cabin camera described in the first embodiment;

[0028] Figure 2 It is an exploded structural diagram of the streaming media rearview mirror described in the first embodiment;

[0029] Figure 3 This is a flowchart of the steps of the working method of the intelligent streaming media rearview mirror system described in the second embodiment.

[0030] The figure shows:

[0031] 1-Combined display screen

[0032] 2- Lens hood

[0033] 3-Front shell

[0034] 4- Main PCBA

[0035] 5-Lens bracket

[0036] 6-Camera PCBA

[0037] 7-Ball head base

[0038] 8-Ball Head Cover

[0039] 9-Back shell

[0040] 10-Ball head

[0041] 11-Connector DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0043] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0044] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in the subsequent figures. In addition, all directional indications in this application (such as up, down, left, right, front, back, bottom...) are only used to explain the relative position relationship, movement, etc. between the components under a certain specific posture (as shown in the figures). If the specific posture changes, the directional indication will also change accordingly. Furthermore, the descriptions involving "first", "second", etc. in the application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated.

[0045] First Embodiment

[0046] like Figure 1 Figure 2 As shown, this embodiment provides an intelligent streaming media rearview mirror system, including an outside rearview camera, an inside camera and a streaming media rearview mirror, and a streaming media rearview mirror ECU is integrated in the streaming media rearview mirror. This system provides high-definition rearview images, driver and passenger monitoring, and intelligent linkage functions through efficient hardware design, intelligent algorithms and advanced communication protocols. The inside camera is integrated on the streaming media rearview mirror to realize the driver / passenger monitoring function. The outside rearview camera is mainly used to provide a real-time video stream behind the vehicle and display the rearview image for the streaming media rearview mirror. The streaming media rearview mirror ECU (electronic control unit) is the core control unit of the streaming media rearview mirror, which is responsible for receiving and processing image data from outside and inside cameras, and integrates multiple functions such as image signal processing (ISP), DMS / OMS algorithm processing, and display control.

[0047] like Figure 1 As shown, in terms of appearance, the in-cabin camera is arranged at the lower jaw of the streaming media rearview mirror, at the Y0 position of the entire streaming media rearview mirror structure. Different from the traditional DMS / OMS arrangement, the traditional solution requires opening holes near the A-pillar, steering wheel column, and ceiling light to install the camera, which will affect the beauty and structural integrity of the interior. In this embodiment, the in-cabin camera is integrated into the streaming media rearview mirror, which can not only effectively capture the facial features and behaviors of the driver and passengers in the cabin, but also effectively avoid opening holes and making some structures on the interior to place the camera, thereby not affecting the integrity and simplicity of the interior. In terms of hardware, the in-cabin camera and the ECU of the streaming media rearview mirror are integrated in the same module. The in-cabin camera uses OV's OX05B1S IR / RGB dual-mode camera, which is connected to the streaming media rearview mirror ECU through the board-side MIPI signal to ensure efficient data transmission. The ECU is equipped with a DMS / OMS algorithm, which can process the image data collected by the in-cabin camera in real time and supports two working modes: IR (infrared) and RGB (visible light). Among them, the IR mode is used for the driver monitoring system (DMS), which mainly analyzes the driver's eye movements, facial expressions and other features. In addition to recognizing the face ID, it can also determine whether there are safety hazards such as fatigue driving or distracted driving (supporting smoking, drinking, and phone call monitoring), and can also automatically adjust the air conditioning vents according to the person. The RGB mode is used for the occupant monitoring system (OMS), which takes photos and videos of the occupants, monitors the facial expressions, gestures and other behaviors of the occupants in the car, such as detecting whether there are any objects left by the occupants or detecting the safety of children. After receiving the image signals from the in-cabin camera and the out-cabin rearview camera, the streaming media rearview mirror ECU performs ISP processing and DMS / OMS algorithm analysis, and sends the processed signals to the central controller (CDC) through the CAN bus for display.

[0048] The rearview camera outside the cabin is set at the rear of the vehicle, responsible for collecting real-time images behind the vehicle, and connected to the streaming media rearview mirror ECU through the LVDS harness or Fakra video interface to transmit high-definition video signals to it. After receiving the video signal, the ECU performs ISP processing and transmits the signal to the streaming media rearview mirror display. In addition, the streaming media rearview mirror ECU and the CDC central control host can transmit and interact with data through the integrated CAN communication module, thereby realizing the control and setting of the rearview mirror.

[0049] The streaming media rearview mirror ECU exchanges information and communicates with other ECUs through the CAN bus, and the ECU supports an Ethernet interface, which can be connected to the central gateway in the car, and the video of the camera in the cabin can be pushed to other ECUs connected to the central gateway controller in real time, so as to realize the communication between the streaming media rearview mirror and other control domains in the cockpit, so that the functions of the streaming media rearview mirror can be greatly expanded compared with other streaming media rearview mirrors. The CAN bus and Ethernet communication protocol between the streaming media rearview mirror ECU and the central control unit (CDC) realizes the linkage function between the streaming media rearview mirror display screen and the instrument screen, central control screen, and HUD screen in the cabin. At the same time, the ECU supports OTA (Over-The-Air) firmware upgrades through Ethernet to ensure that the rearview mirror system can be updated at any time to enhance functions and performance.

[0050] It can be seen that this technical solution uses an ECU with computing power on the media rearview mirror and an IR / RGB dual-mode camera to realize the driver / passenger monitoring function, so that the streaming media rearview mirror can have the ability to process algorithms independently, and can also drive the streaming media rearview camera to display the streaming media rearview picture, realizing a standard ECU software. The in-cabin camera uses OV's OX05B1S IR / RGB dual-mode camera, which is connected to the streaming media rearview mirror ECU through the board-side MIPI signal, and the out-cabin rearview camera is connected to the streaming media rearview mirror ECU through the LVDS wiring harness; the driver monitoring, passenger monitoring and streaming media rearview mirror rearview camera video signals are isolated in hardware and do not interfere with each other.

[0051] like Figure 2As shown, in addition to the in-cabin camera, the streaming media rearview mirror also includes a combined display screen 1, a hood 2, a front shell 3, a rear shell 9, an LED-PCBA, a main PCBA (4), a heat sink, a camera PCBA (6), a lens bracket 5, a ball head base 7 and a ball head cover 8, etc., wherein the combined display screen 1 is formed by fully bonding a glass cover plate and an LCD display screen by OCA glue, and is responsible for displaying the image output of the streaming media rearview mirror, providing high-definition rearview images and other vehicle information. The hood 2 is used to reduce the reflection of external light sources on the display screen, optimize the display effect, and ensure that the image is clearly displayed even under strong light. The front shell 3 and the rear shell 9 serve as the external protection structure of the streaming media rearview mirror, protecting the internal electronic components from external impact, and fixing the entire structure through the bayonet to ensure the overall stability of the product. The LED-PCBA is responsible for controlling the LED lighting part of the streaming media rearview mirror, providing a uniform backlight for the mirror surface, and ensuring the clarity of the image in a low-light environment. The main PCBA (4) and the camera PCBA (6) are the main components of the streaming media rearview mirror ECU. The main PCBA (4) is a core circuit board with an integrated image signal processing (ISP) function, which is responsible for processing the image signals collected by the external and internal cameras, and pushing the processed data to the LCD display for display. The heat sink provides heat dissipation for the main PCBA and other high-power electronic components, keeps the system running stably, and prevents overheating. The camera PCBA (6) is an integrated image sensor and signal processing unit, which is responsible for collecting image data from the internal camera and the external rearview camera, and transmitting the image signal to the main PCBA for processing. The lens bracket 5 is used to fix the lens and sensor board of the camera, ensuring that the camera is stable and accurately captures the image. The ball head base 7 and the ball head cover 8 are fixed by screws, providing an adjustable installation method for the streaming media rearview mirror, allowing the rearview mirror to adjust its angle according to the driver's needs. The connector 11 includes a power connector, a video connector and an Ethernet connector, which are installed on the ball head rod 10 by snaps, and is responsible for providing power and data transmission interface for the streaming media rearview mirror.The assembly process includes the following steps: (1) the ball head cover 8 is fixed to the ball head base 7 by screws; (2) the ball head rod 10 is inserted into the ball head base 7, and the ball head base 7 is reversely fixed to the rear shell 9 by screws, and the protruding jaw structure under the rear shell 9 is used to install the in-cabin camera; the power connector, the video connector and the Ethernet connector are installed on the ball head rod 10 by buckles; (3) the glass cover plate is fully bonded to the display screen by OCA glue to form a combined display screen 1, and the main PCBA (4) is fixed to the display screen and the display screen by screws. The screen and the glass form an integrated assembly; (4) the heat sink is fixed to the main PCBA (4) by screws; (5) the glass assembly is fixed to the front shell 3 by gluing, and the sunshade 2 is clamped to the front shell 3 by a bayonet; (6) the front cabin camera is fixed to the camera bracket 5 by AA glue, the IR light board and the camera sensor board are fixed to the camera bracket 5 by screws, and the camera bracket 5 is reversely fixed to the rear shell 9 by screws; (7) the front shell 3 and the rear shell 9 are clamped by a bayonet to complete the assembly of the entire rearview mirror structure.

[0052] Second Embodiment

[0053] like Figure 3 As shown, this embodiment provides a working method of an intelligent streaming media rearview mirror system, using the intelligent streaming media rearview mirror system described in the first embodiment, specifically including the following steps:

[0054] Step S1. The rear-view camera outside the cabin collects image data of the rear view of the vehicle in real time, while the camera inside the cabin collects image data of the facial features and behaviors of the driver and passengers to monitor the driver and passengers;

[0055] Step S2: The data of the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data of the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface;

[0056] Step S3: The ECU receives image signals from the cameras outside and inside the cabin and performs image signal processing (ISP) on the image signals and uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the cameras inside and outside the cabin to perform fatigue detection, distracted driving detection, face recognition, and leftover object detection functions;

[0057] Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen through the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or the alarm system.

[0058] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the technical concept of the present invention.

Claims

1. An intelligent streaming media rearview mirror system, characterized in that: It includes an external rearview camera, an in-cabin camera and a streaming media rearview mirror. The streaming media rearview mirror is integrated with a streaming media rearview mirror ECU. The DMS and OMS algorithms can be run on the ECU. The streaming media rearview mirror ECU exchanges information and communicates with other ECUs via the CAN bus, and the ECU supports an Ethernet interface, which can be connected to the central gateway in the vehicle, and pushes the video of the in-cabin camera to other ECUs connected to the central gateway controller in real time; the in-cabin camera is set at the lower jaw of the streaming media rearview mirror, and is connected to the streaming media rearview mirror ECU via MIPI signals, which can collect image signals in the vehicle and transmit the signals to the streaming media rearview mirror ECU, realizing the driver / passenger monitoring function; The outboard rearview camera is connected to the streaming media rearview mirror ECU via a Fakra video interface, and can collect real-time image signals from the rear of the vehicle and transmit the signals to the streaming media rearview mirror ECU; The streaming media rearview mirror ECU is equipped with a DMS / OMS algorithm and supports two working modes: IR (infrared) and RGB (visible light); wherein the IR mode is used to realize the driver monitoring function, and the RGB mode is used to realize the occupant monitoring function; after receiving the image signals from the in-cabin camera and the out-cabin rearview camera, the ECU performs ISP processing and DMS / OMS algorithm analysis, and sends the processed signals to the central controller (CDC) through the CAN bus for display; The streaming media rearview mirror also includes a combined display screen, a main PCBA, a camera PCBA and a connector system, wherein the combined display screen is formed by fully bonding a glass cover plate and an LCD display screen by OCA glue; the main PCBA and the camera PCBA are the main components of the streaming media rearview mirror ECU, and the camera PCBA integrates an image sensor and a signal processing unit, which is responsible for collecting image data from the in-cabin camera and the out-cabin rearview camera, and transmitting the image signal to the main PCBA for processing; the main PCBA can integrate an image signal processing (ISP) function, which is responsible for processing the image signals collected by the out-cabin and in-cabin cameras, and pushing the processed data to the LCD display screen for display.

2. The intelligent streaming media rearview mirror system according to claim 1 is characterized in that: The driver monitoring function monitors the driver's status through the in-cabin camera, mainly including facial recognition, fatigue detection, distraction detection and abnormal behavior detection. It can identify the driver's identity, monitor fatigue or distracted driving behavior, and issue warnings for abnormal behaviors such as smoking, drinking water, and making phone calls to ensure that the driver focuses on driving.

3. The intelligent streaming media rearview mirror system according to claim 1 is characterized in that: The occupant monitoring function monitors the occupants in the car through the in-cabin camera. The functions include photo and video recording, object detection, gesture recognition and child abandonment monitoring, which are used to record emergency events, detect whether there are objects left by occupants in the car, control the functions in the car through gesture recognition, and detect whether there are children left in the car, so as to ensure the safety of the occupants and the cleanliness of the car.

4. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media rearview mirror ECU can perform OTA (Over-The-Air) firmware upgrades via Ethernet, ensuring that the streaming media rearview mirror system can be updated at any time.

5. The intelligent streaming media rearview mirror system according to claim 1 is characterized in that: The streaming media rearview mirror ECU can realize the linkage function of the streaming media rearview mirror display screen and the instrument screen, central control screen and HUD screen in the cabin through the CAN bus and Ethernet communication protocol between the central control unit (CDC).

6. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media interior rearview mirror ECU can transmit and interact with the central gateway (CCU) via Ethernet or CAN communication, thereby realizing the control and setting of the rearview mirror.

7. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: A sunshade is provided below the combined display screen of the streaming media interior rearview mirror to reduce the reflection of external light sources on the display screen.

8. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The streaming media rearview mirror also includes an LED lighting part responsible for controlling the streaming media rearview mirror, providing uniform backlight for the streaming media rearview mirror surface to ensure image clarity in low-light environments.

9. The intelligent streaming media rearview mirror system according to claim 1, characterized in that: The connector system includes a power connector, a video connector and an Ethernet connector, which can provide power and data transmission interfaces for the streaming media rearview mirror.

10. A working method of an intelligent streaming media rearview mirror system, characterized in that: The intelligent streaming media rearview mirror system according to any one of claims 1 to 9 is used, and specifically comprises the following steps: Step S1. The rear-view camera outside the cabin collects image data of the rear view of the vehicle in real time, while the camera inside the cabin collects image data of the facial features and behaviors of the driver and passengers to monitor the driver and passengers; Step S2: The data of the in-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the MIPI signal, and the data of the out-cabin camera is transmitted to the ECU of the streaming media rearview mirror via the Fakra video interface; Step S3: The ECU receives image signals from the cameras outside and inside the cabin and performs image signal processing (ISP) on the image signals and uses DMS (driver monitoring system) and OMS (occupant monitoring system) algorithms to analyze the data collected by the cameras inside and outside the cabin to perform fatigue detection, distracted driving detection, face recognition, and leftover object detection functions; Step S4: The ECU controls the display screen of the streaming media rearview mirror to display the rear image, driver status or occupant monitoring information based on the processed image data; the ECU sends a warning message to the central control screen through the CAN bus based on the monitored driver status to remind the driver to pay attention to safety; based on the monitored occupant status, if the in-cabin camera detects any objects left in the car or child safety issues, a reminder is given through the display screen or the alarm system.

Citation Information

Patent Citations

  • Streaming media rearview mirror system

    CN110789454A

  • Display method and device of vehicle-mounted streaming media rearview mirror

    CN117002387A

  • Inside rear-view mirror with multiple system integration

    CN2792873Y

  • Interior rearview mirror assembly with driver monitoring system

    US20210323473A1

Cited By

  • In-cabin rearview mirror acquisition and in-cabin image detection method

    CN121404133A