System for monitoring passengers in automobile cabin based on OMS camera

Abstract

The utility model relates to a passenger monitoring system in an automobile cabin based on an OMS camera, which comprises an OMS camera assembly installed near an inner rearview mirror, and the OMS camera assembly comprises a camera shell, a front panel, a rear cover, an OMS lens, an LED lamp and a PCBA board. The PCBA board is also integrated with an alarm module, a remnant monitoring and searching module, an alarm processing module, an RGB-IR module, and an ISP determination module. The PCBA board comprises an image sensor, an image processor, an encoder, a lamp driving module, a connector and a power supply which are arranged on a circuit board; the automobile safety monitoring system has the advantages that the safety performance of an automobile is further improved by monitoring the sensing data of passengers in the cabin, an alarm is given for reminding if dangerous behaviors occur, and remnant objects in the automobile can be monitored, so that pets and children left in the automobile can obtain safety prompts.

Description

Technical Field

[0001] The utility model relates to the technical field of automobile safety assisted driving, in particular to an automobile cabin occupant monitoring system based on an OMS camera and adopting RGB-IR. Background Art

[0002] To ensure the safety of drivers and passengers, vehicles are often equipped with an Occupant Monitoring System (OMS) to assist drivers in assessing their own status. An extension of the DMS, the OMS (Occupant Monitoring System) further enhances vehicle safety by monitoring passenger sensory data within the cabin and issuing alerts if dangerous behavior occurs. The OMS relies on camera image input and utilizes deep learning algorithms to perform real-time facial recognition, fatigue monitoring, attention monitoring, and behavioral monitoring of the driver and passengers. Image quality is crucial for the entire in-cabin visual monitoring system. In normal vehicle use, low lighting conditions often result in poor image quality. Accurately and in real time, capturing visibility within the vehicle cabin under these conditions is a pressing issue. Furthermore, the functionality of currently available OMS systems is relatively simple. Utility Model Content

[0003] In view of the above problems, the purpose of the present invention is to provide an automobile cabin occupant monitoring system based on an OMS camera, which uses RGB-IR technology and can simultaneously capture RGB color images and IR images through a single sensor device, that is, it has visibility capabilities both during the day and at night, so as to overcome the shortcomings of the above-mentioned existing technologies.

[0004] The utility model provides an automobile cabin occupant monitoring system based on an OMS camera, comprising: an OMS camera assembly installed near the interior rearview mirror, the OMS camera assembly comprising: a camera housing, a front panel, a rear cover, an OMS lens, an LED light, and a PCBA board. The PCBA board also integrates an alarm module, a leftover monitoring and search module, an alarm processing module, an RGB-IR module, and an ISP determination module;

[0005] The camera housing is provided with two front mounting cavities and one rear mounting cavity, the OMS lens and the LED light are embedded in the two front mounting cavities, the front panel is installed at the front end of the camera housing, and two avoidance holes are provided on the front panel corresponding to the positions of the OMS lens and the LED light;

[0006] The PCBA board is embedded in the rear mounting cavity, and the rear cover is installed at the rear end of the camera housing and seals the PCBA board in the camera housing;

[0007] The PCBA board includes: an image sensor, an image processor, an encoder, a light driving module, a connector, and a power supply installed on the circuit board. The image sensor is connected to the OMS lens and is used to capture images. The image processor is connected to the image sensor, the encoder, and the light driving module respectively. The image processor is used to receive image information from the image sensor and process and identify it. The encoder is used to compile and convert the data processed by the image processor into a communication signal. The connector is used to transmit the communication signal processed by the encoder to the outside. The light driving module is used to drive the LED light. The power supply is used to power the circuit board.

[0008] The RGB-IR module is used to capture an RGB color image and an IR infrared image through an image sensor and output the RGB color image and the infrared image to an image processor;

[0009] The ISP determination module is used to identify and determine the brightness of the image captured by the image sensor, and automatically switch the RGB-IR module's RGB color image output or IR infrared image output according to the image brightness. In the case of relatively low light, the IR image output is switched to the IR image output, and in the case of sufficient light, the RGB color image output is switched to the RGB color image output.

[0010] The alarm module is used to determine whether the driver and passengers have dangerous behaviors and issue an alarm when dangerous behaviors occur; dangerous behaviors of passengers include whether they are wearing seat belts or whether their limbs are stretched out of the window; the alarm reminder includes one or more of the following methods, including: voice reminder, steering wheel vibration reminder, instrument panel display reminder, seat belt vibration reminder;

[0011] The left-behind monitoring and search module is used to monitor and search for left-behind items and creatures in the vehicle. The identified creatures include pets and children, and the identified left-behind items include handbags, keys, documents, etc.

[0012] The alarm processing module is used for users to receive biological left-behind alarms and to cancel biological left-behind alarms; wherein, the user receives the biological left-behind alarm in the car in the following ways: when the owner turns off the engine, locks the car and leaves the car, the vehicle automatically detects whether there are any biological left in the car and detects the danger, and uses the APP or CallCenter to notify the owner of the possible biological left-behind danger alarm, prompting the owner to return to the car as soon as possible to handle it; wherein, the user cancels the biological left-behind alarm in the following ways: after the owner receives the biological left-behind alarm, the owner returns and completes the processing, or the owner remotely processes it on the App (opens the car window) and clicks to cancel the alarm, or calls the CallCenter to confirm the cancellation of the alarm.

[0013] As a preferred embodiment of the present invention, the FOV viewing angle range of the OMS camera assembly is: 130 degrees horizontal viewing angle and 96 degrees vertical viewing angle.

[0014] The beneficial effects of the utility model are as follows:

[0015] 1. This utility model further improves the safety performance of the car by monitoring the sensory data of passengers in the cabin. If dangerous behavior occurs, an alarm will be issued to remind you. It can also monitor objects left in the car, so that pets and children left in the car can receive safety reminders.

[0016] 2. This utility model can detect whether the driver and passengers are engaging in dangerous behavior and issue an alarm when such behavior occurs. In addition, the alarm module has multiple alarm reminder modes to further enhance safety performance.

[0017] 3. This camera uses RGB-IR technology, which uses the ISP to determine image brightness and automatically switches to IR image output in low-light conditions, enhancing the reality effect. Using RGB-IR technology, a single sensor device can capture both RGB and IR images, providing both daytime and nighttime viewing capabilities. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] By referring to the following description in conjunction with the accompanying drawings, and with a more comprehensive understanding of the present invention, other objects and results of the present invention will become more clear and easy to understand. In the accompanying drawings:

[0019] Figure 1 This is a schematic diagram of the overall structure of Example 1.

[0020] Figure 2 This is the circuit block diagram of this embodiment 1.

[0021] Description of the drawings: camera housing 1, front panel 2, back cover 3, OMS lens 4, LED light 5, PCBA board 6, image sensor 7, image processor 8, encoder 9, light driver module 10, connector 11, power supply 12, memory 13, resetter 14. DETAILED DESCRIPTION

[0022] See Figure 1-2As shown, the embodiment provides an automobile cabin occupant monitoring system based on an OMS camera, comprising: an OMS camera assembly installed near the interior rearview mirror, the FOV viewing angle range of the OMS camera assembly: 130 degrees horizontal viewing angle, 96 degrees vertical viewing angle. The OMS camera assembly comprises: a camera housing 1, a front panel 2, a rear cover 3, an OMS lens 4, an LED light 5 and a PCBA board 6, the PCBA board 6 also integrating an alarm module, a leftover monitoring and search module, an alarm processing module, an RGB-IR module, and an ISP determination module; the camera housing 1 is provided with two front mounting cavities and one rear mounting cavity, the OMS lens 4 and the LED light 5 are embedded in the two front mounting cavities, the front panel 2 is installed at the front end of the camera housing 1 and two avoidance holes are provided on the front panel 2 corresponding to the positions of the OMS lens 4 and the LED light 5; the PCBA board 6 is embedded in the rear mounting cavity, the rear cover 3 is installed at the rear end of the camera housing 1 and seals the PCBA board 6 in the camera housing 1; the PCBA board comprises: an image sensor 7, an image processor 8, an encoder 9, a light driving module 10, and a connector 11 installed on the circuit board. , power supply 12, memory 13, and resetter 14, the image sensor 7 is connected to the OMS lens 4 and is used to capture images, the image processor 8 is respectively connected to the image sensor 7, encoder 9 and lamp driving module 10, the image processor 8 is used to receive image information of the image sensor 7 and process and identify it, the encoder 9 is used to compile and convert the data processed by the image processor 8 into a communication signal, the connector 11 is used to transmit the communication signal processed by the encoder 9 to the outside, the lamp driving module 10 is used to drive the LED lamp 5, the power supply 12 is used to power the circuit board and the components on the circuit board, and the memory 13 is used to store the processing information of the above components; wherein, the image sensor 7 adopts Sensor-SC2331AT, the image processor 8 adopts ISP-FH8322, and the encoder 9 adopts Serializer-DS90UB935-Q1.

[0023] The RGB-IR module in this embodiment is used to capture RGB color images and IR infrared images through the image sensor 7 and output the RGB color images and infrared images to the image processor 8. The RGB-IR module adopts RGB-IR technology. RGB-IR technology allows one sensor to capture RGB color images and infrared images simultaneously, which provides dual visibility capabilities during the day and at night, and enhances image quality under different lighting conditions.

[0024] The ISP determination module in this embodiment is used to identify and determine the brightness of the image captured by the image sensor 7, and automatically switch the RGB-IR module's RGB color image output or IR infrared image output according to the brightness of the image. In particular, in low light conditions, the module switches to IR image output, and in sufficient light conditions, the module switches to RGB color image output. The ISP determination module adopts ISP determination technology.

[0025] The alarm module in this embodiment is used to determine whether the driver and passengers have dangerous behaviors and issue an alarm when dangerous behaviors occur; dangerous behaviors of passengers include whether they are wearing seat belts or whether their limbs are stretched out of the window; the alarm reminder includes one or more of the following methods, including: voice reminder, steering wheel vibration reminder, instrument panel display reminder, seat belt vibration reminder;

[0026] The left-behind monitoring and search module in this embodiment is used to monitor and search for left-behind items and creatures in the vehicle. The identified creatures include pets and children, and the identified left-behind items include handbags, keys, documents, etc.

[0027] The alarm processing module in this embodiment is used for users to receive biological left-behind alarms and for users to cancel biological left-behind alarms; wherein, the user receives the biological left-behind alarm in the car in the following ways: when the owner turns off the engine, locks the car and leaves the car, the car automatically detects whether there are any biological left in the car and detects the danger, and uses the APP or CallCenter to notify the owner of the possible biological left-behind danger alarm, prompting the owner to return to the car as soon as possible to handle it; wherein, the user cancels the biological left-behind alarm in the following ways: after the owner receives the biological left-behind alarm, the owner returns and completes the processing, or the owner remotely processes it on the App (opens the car window) and clicks to cancel the alarm, or calls the CallCenter to confirm the cancellation of the alarm.

[0028] The working principle includes the following steps:

[0029] Step S1: Utilizing the RGB-IR method on the OMS camera assembly, the ISP determines image brightness and automatically switches to IR image output in low-light conditions, enhancing the reality effect. Using RGB-IR technology, a single sensor device can simultaneously capture both RGB color and IR images, enabling both daytime and nighttime visibility. The RGB-IR method allows a single sensor to capture both RGB color and infrared images, providing dual daytime and nighttime visibility and enhancing image quality under varying lighting conditions.

[0030] Step S2: Using the alarm module to determine whether the driver and passengers have dangerous behaviors, and issuing an alarm reminder when dangerous behaviors occur; wherein, dangerous behaviors of passengers include whether they are wearing seat belts or whether their limbs are extended out of the window, and the alarm reminder includes one or more of the following methods: voice reminder, steering wheel vibration reminder, instrument panel display reminder, seat belt vibration reminder;

[0031] Step S3: using the left-behind monitoring and search module to monitor and search for left-behind items and creatures in the vehicle, wherein the identified creatures include pets and children, and the identified left-behind items include handbags, keys, and documents;

[0032] Step S4: using the alarm processing module to notify the user of receiving the biological left-in-car alarm and the user canceling the biological left-in-car alarm; wherein, the user receiving the biological left-in-car alarm includes autonomously detecting whether there are any biological left in the car and detecting the danger after the owner turns off the engine, locks the car and leaves the car, and notifying the owner of the possible biological left-in danger alarm by using the APP or CallCenter, prompting the owner to return to the car as soon as possible to handle it; wherein, the user canceling the biological left-in alarm includes: after the owner receives the biological left-in alarm, the owner returns and completes the processing, or the owner remotely processes it on the App (opens the car window) and clicks to cancel the alarm, or calls the CallCenter to confirm the cancellation of the alarm.

[0033] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. An automobile cabin occupant monitoring system based on an OMS camera, characterized in that: include: The OMS camera assembly, installed near the rearview mirror, includes a camera housing, a front panel, a rear cover, an OMS lens, an LED light, and a PCBA board. The PCBA board also integrates an alarm module, a left-behind monitoring and search module, an alarm processing module, an RGB-IR module, and an ISP determination module. The camera housing is provided with two front mounting cavities and one rear mounting cavity, the OMS lens and the LED light are embedded in the two front mounting cavities, the front panel is installed at the front end of the camera housing, and two avoidance holes are provided on the front panel corresponding to the positions of the OMS lens and the LED light; The PCBA board is embedded in the rear mounting cavity, and the rear cover is installed at the rear end of the camera housing and seals the PCBA board in the camera housing; The PCBA board includes: an image sensor, an image processor, an encoder, a light driving module, a connector, and a power supply installed on the circuit board. The image sensor is connected to the OMS lens and is used to capture images. The image processor is connected to the image sensor, the encoder, and the light driving module respectively. The image processor is used to receive image information from the image sensor and process and identify it. The encoder is used to compile and convert the data processed by the image processor into a communication signal. The connector is used to transmit the communication signal processed by the encoder to the outside. The light driving module is used to drive the LED light. The power supply is used to power the circuit board. The RGB-IR module is used to capture an RGB color image and an IR infrared image through an image sensor and output the RGB color image and the infrared image to an image processor; The ISP determination module is used to identify and determine the brightness of the image captured by the image sensor, and automatically switch the RGB-IR module's RGB color image output or IR infrared image output according to the image brightness. In the case of relatively low light, the IR image output is switched to the IR image output, and in the case of sufficient light, the RGB color image output is switched to the RGB color image output. The alarm module is used to determine whether the driver and passengers have dangerous behavior, and to issue an alarm reminder when dangerous behavior occurs; the alarm reminder includes one or more of the following methods, including: voice reminder, steering wheel vibration reminder, instrument panel display reminder, seat belt vibration reminder; The left-behind monitoring and searching module is used to monitor and search for left-behind items and creatures in the vehicle; The alarm processing module is used for users to receive biological left-behind alarms and to cancel biological left-behind alarms; wherein, the user receives the biological left-behind alarm in the car in the following ways: when the owner turns off the engine, locks the car and leaves the car, the vehicle automatically detects whether there are any biological left in the car and detects the danger, and uses the APP or CallCenter to notify the owner of the possible biological left-behind danger alarm, prompting the owner to return to the car as soon as possible to handle it; wherein, the user cancels the biological left-behind alarm in the following ways: after the owner receives the biological left-behind alarm, the owner returns and completes the processing, or the owner remotely processes it on the App and clicks to cancel the alarm, or calls the CallCenter to confirm the cancellation of the alarm.

2. The vehicle cabin occupant monitoring system based on an OMS camera according to claim 1, characterized in that: The FOV viewing angle range of the OMS camera assembly is: 130 degrees horizontal viewing angle and 96 degrees vertical viewing angle.

Images