Automobile light state automatic detection system and method

Abstract

The invention discloses an automobile light state automatic detection system and method. The automobile light state automatic detection system comprises a control module, a sensor module, an image acquisition module and a reminding module, the sensor module is used for detecting operation actions of a driver on a vehicle, the output end of the sensor module is connected to the control module, the image acquisition module is used for acquiring vehicle light image information corresponding to the operation actions of the driver, and the output end of the image acquisition module is connected to the control module; the control module judges whether the vehicle lamp corresponding to the current operation action of the driver is normal or not based on the collected vehicle light image information. The method has the advantages that the lamplight state is detected in an image recognition and logic control mode, the fault state of vehicle lamplight can be effectively detected, meanwhile, cost is low, and operation is convenient.

Description

Technical Field

[0001] The present invention relates to the field of automotive lighting detection, and particularly to an automatic automotive lighting status detection system and method. Background Art

[0002] With the rapid development of the automotive industry, the safety and reliability of automobiles have received increasing attention. As an important part of ensuring driving safety, the normal operation of the automotive lighting system is directly related to the driver's vision and the warning effect on other road users. However, in actual use, automotive lighting may malfunction due to various reasons such as bulb aging, circuit failure, and switch damage, such as lights not turning on, insufficient brightness, abnormal flickering, etc. If these lighting faults cannot be detected and repaired in time, it will pose a serious hidden danger to driving safety.

[0003] Currently, the detection of automotive lighting status mainly relies on the driver's observation and regular vehicle maintenance, but this method has problems such as untimely detection, inaccuracy, and low efficiency. There are also solutions in the prior art to detect the lighting status by adding sensors. For example, a motor vehicle brake light fault reminder system with a patent application number of 202110937582.6 detects changes in the load data of the power supply circuit by adding a load detection module to determine whether the brake light has a fault. This method realizes the detection and judgment of faults by modifying the brake light circuit and adding a detection module. Although it can, to a certain extent, achieve the fault judgment of the brake light, it requires adding a hardware module to the power supply circuit, modifying the brake light power supply circuit, increasing the hardware cost and complicating the brake light, and can only judge the brake light and cannot judge the other lights. Summary of the Invention

[0004] The purpose of the present invention is to overcome the deficiencies of the prior art and provide an automatic automotive lighting status detection system and method. By detecting the lighting status through image recognition and logical control, it can effectively detect the fault status of vehicle lighting, while having low cost and convenient operation.

[0005] To achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0006] An automatic automotive lighting status detection system includes a control module, a sensor module, an image acquisition module, and a reminder mode; the sensor module is used to detect the driver's operation actions on the vehicle, and its output end is connected to the control module. The image acquisition module is used to acquire the vehicle lighting image information corresponding to the driver's operation actions, and its output end is connected to the control module; the control module determines whether the vehicle lights corresponding to the current driver's operation actions are normal based on the acquired vehicle lighting image information.

[0007] The sensor module includes vehicle-mounted sensors for detecting operation action information for triggering vehicle headlights.

[0008] The image acquisition module includes a vehicle-mounted camera, which is a 360-degree camera for vehicle light image data after the vehicle headlights are lit.

[0009] The reminder module is a vehicle-mounted display module for displaying detection results and sending detection reminder information.

[0010] The system further includes a storage module for storing image data and corresponding detection results during the detection process, and its output end is connected to the control module; external devices access the control module through the vehicle network or access the control module based on the in-vehicle USB interface to obtain the stored detection data.

[0011] The detection system further includes a detection start switch connected to the control module. After the detection start switch is triggered to start the detection, the control module monitors the user's operation actions in real time, acquires the vehicle light image information corresponding to the driver's operation actions, and determines whether the headlights corresponding to the current actions are normal.

[0012] The detection system further includes a light detection module for detecting the ambient light intensity, and the output end of the light detection module is connected to the control module; after the detection start switch is triggered to start, the control module determines whether the current environment meets the detection environment conditions based on the light detection module and gives a reminder.

[0013] A detection method for an automatic vehicle light status detection system includes, after starting the light detection process, the control module monitoring the user's operation actions in real time and acquiring the vehicle light image information corresponding to the driver's operation actions; the control module determines whether the acquired vehicle light image information matches the driver's operation actions based on image analysis. If it matches, the headlights corresponding to the driver's operation actions are normal, otherwise it is determined that the headlights corresponding to the driver's operation actions are faulty.

[0014] Judge whether to start the light detection process according to the open / close state of the detection start switch.

[0015] After starting the light detection process, send detection prompt information and detection result information through the display module.

[0016] The advantages of the present invention are as follows: By detecting the lighting state through image recognition and logical control, the fault state of vehicle lights can be effectively detected, while the cost is low and the operation is convenient. By setting a specific "Automatic Detection of Vehicle Lighting State" button on the vehicle's large screen and combining with the vehicle's own sensors, cameras and other devices, rapid, accurate and automated detection of the vehicle lighting state can be achieved without the participation of professional personnel, improving the detection efficiency and convenience. At the same time, it also helps to promptly discover lighting faults and ensure driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The following briefly describes the content expressed in each drawing of the specification of the present invention and the marks in the drawings:

[0018] Figure 1 It is a schematic flow chart of the working principle of the detection system of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] The following further details the specific embodiments of the present invention by describing the optimal embodiments with reference to the drawings.

[0020] The purpose of the present invention is to provide a method and system for automatically detecting the vehicle lighting state. By setting a specific "Automatic Detection of Vehicle Lighting State" button on the vehicle's large screen and combining with the vehicle's own sensors, cameras and other devices, rapid, accurate and automated detection of the vehicle lighting state can be achieved without the participation of professional personnel, improving the detection efficiency and convenience. At the same time, it also helps to promptly discover lighting faults and ensure driving safety; users can operate by themselves to detect the fault state of the vehicle lights, and the hardware part involved in the detection can reuse the vehicle hardware, with lower cost. There is no need to add new hardware, and only software needs to be updated to realize the detection function for existing vehicle models, which is convenient for popularization and use. The specific scheme is introduced as follows:

[0021] As Figure 1 shown, an automatic vehicle lighting state detection system provided in this embodiment includes a control module, a sensor module, an image acquisition module, and a reminder mode; the sensor module is used to detect the operation actions of the driver on the vehicle, and its output end is connected to the control module. The image acquisition module is used to acquire the vehicle lighting image information corresponding to the driver's operation actions, and its output end is connected to the control module; the control module determines whether the vehicle lights corresponding to the current driver's operation actions are normal based on the acquired vehicle lighting image information.

[0022] In this application, the sensor module includes vehicle-mounted sensors for detecting operation action information for triggering automotive headlights, including but not limited to brake sensors, switch state sensors of each headlight, etc. The sensors reuse the sensors or controllers inside the vehicle to obtain the driver's operation actions on the vehicle lights, for detecting the driving state of the vehicle and the driver's operation actions, and providing necessary trigger signals for light detection. Taking the brake light as an example, the brake operation action of the driver is detected through the brake sensor, and the corresponding headlight of the brake operation action is the brake light. At this time, the brake sensor can reuse the existing sensors inside the vehicle such as the brake pedal sensor, etc., which can reduce the addition of hardware costs while accurately obtaining data. Similarly, for turn signals, position lights, fog lights, and hazard lights, etc., vehicle-mounted sensors or BCM controllers can be reused. Since these lights are all controlled by the BCM, after the headlight switch is turned on, the corresponding BCM controls the headlight to light up. At this time, there is the driver's operation action on the headlight in the BCM. Therefore, the controller can directly read the headlight state existing in the BCM to collect and obtain the required signals, with low cost and reduced addition of hardware.

[0023] The image acquisition module includes a vehicle-mounted camera. The vehicle-mounted camera is a 360-degree camera for vehicle light image data after the vehicle headlights are lit. Since it is necessary to verify whether the headlights are normal, this solution uses the method of image acquisition and recognition for judgment. Because the light data of the images collected before and after the headlights are turned on and off is different. If it is detected that the light image data collected before and after the driver's operation action at the same position is inconsistent, it can indicate that the light is normal at this time. Therefore, the vehicle light image can be acquired through the vehicle-mounted camera. In this solution, the vehicle-mounted 360-degree camera is reused to collect the corresponding image data.

[0024] The reminder module includes a vehicle-mounted display module for displaying the detection results and sending detection reminder information. To save hardware costs, the vehicle-mounted display module is implemented by using the instrument or the central control large screen, for presenting the prompt information and detection results during the detection process to the user to achieve the reminder for the user.

[0025] In a preferred embodiment, a storage module is provided. The storage module is used for storing the image data and corresponding detection results during the detection process, and its output end is connected to the control module; the external device accesses the control module through the vehicle network or accesses the control module based on the in-vehicle USB interface to obtain the stored detection data. It is used for storing information such as image data and detection results during the detection process for subsequent analysis and query. This module can be implemented by using storage devices such as memory cards and hard disks.

[0026] In this embodiment, a detection start switch is provided. The detection start switch is connected to the control module. After the detection start switch is triggered to start the detection, the control module monitors the user's operation actions in real time, collects the vehicle light image information corresponding to the driver's operation actions, and determines whether the vehicle lights corresponding to the current actions are normal. The detection start switch is integrated in the in-vehicle touch screen in the form of a soft switch, which is used to implement the automatic detection function of the vehicle lights, so as to realize the start function.

[0027] In another preferred solution of this embodiment, since the method of image acquisition is used to compare and judge whether the lights are normal in this solution, if the ambient light intensity is relatively large during detection, such as detecting in the sun, then due to the large ambient light intensity, the vehicle light cannot have more influence on the light intensity, resulting in that the images before and after the driver's operation actions do not differ due to the turning on of the vehicle lights, and there is no area between the photos taken before and after, which affects the reliability of the detection. Therefore, after the detection process is started, it is also necessary to perform light detection to determine whether the detection conditions are met. An ambient light detection module is provided, which is used to detect the ambient light intensity. The output end of the light detection module is connected to the control module; after the detection start switch is triggered to turn on, the control module determines whether the current environment meets the detection environment conditions based on the light detection module and gives a reminder. When the detected ambient light intensity is greater than the set light intensity threshold, the current environment does not meet the environmental conditions for light detection at this time, and a reminder is sent through the display screen to remind that the current environment does not meet the detection conditions. When the ambient light intensity is less than the set light intensity threshold, the current environment meets the environmental conditions for light detection at this time, and the operation action information of the user and the image information before and after can be detected and compared to determine whether the lights are normal.

[0028] The working principle of the automatic detection system for the vehicle light state of this solution includes:

[0029] After starting the light detection process, the control module monitors the user's operation actions in real time and collects the vehicle light image information corresponding to the driver's operation actions; the control module determines whether the collected vehicle light image information matches the driver's operation actions based on image analysis. If they match, the vehicle lights corresponding to the driver's operation actions are normal, otherwise it is determined that the vehicle lights corresponding to the driver's operation actions are faulty.

[0030] It is judged whether to start the light detection process according to the opening and closing state of the detection start switch. When the detection start switch is turned on, the light detection process is entered, otherwise the light detection process is not entered. After starting the light detection process, detection prompt information and detection result information are sent through the display module, which is convenient for the driver to obtain the detection reminder information and the detection result.

[0031] The detection start switch can be set in the touch screen in a soft-switching manner. After clicking the switch in the touch screen, the detection process is started. After starting the detection process, the vehicle's environment is monitored to determine whether the current vehicle environment meets the environmental conditions required for the detection process. If it does not meet the requirements, a reminder signal is sent through the in-vehicle display large screen to remind the user that the current vehicle environment does not meet the detection process and the detection is exited. If the environmental requirements of the detection process are met, the sequential headlight detection process is entered.

[0032] The environmental conditions required to meet the detection process include: when the vehicle is in a stationary state and the detected environmental light intensity is lower than the set light intensity threshold, it is determined at this time that the environmental conditions are met and the sequential headlight detection process is entered; otherwise, the detection process is exited and a reminder to exit the detection process is sent through the in-vehicle large screen. Since this solution judges whether the headlights are normal by comparing the images taken before and after the headlights are turned on, if the vehicle is in a running state, the comparison will fail, increasing the probability of misjudgment and affecting driving safety. And the light intensity is also one of the factors to be considered. Because if the light intensity is large, such as in sunlight, the brightness of the headlights at this time cannot cover the sunlight brightness, resulting in a very low or even no difference in light between the front and rear images, which will also cause the failure to detect headlight faults. Therefore, this solution needs to set environmental conditions to judge whether to enter the sequential headlight detection process.

[0033] The sequential headlight detection process includes:

[0034] 1. Call the in-vehicle 360 camera to take the ground image at the corresponding position of each headlight of the vehicle;

[0035] 2. Display reminder information through the large screen to sequentially remind the driver to operate the turn-on of each headlight and remind the user to turn off the headlight after it is turned on;

[0036] The detection logic for one of the headlights includes: during the process of reminding the driver to operate the headlight switch, the action state of the headlight is monitored in real time. After the headlight is turned on, the camera is called to take the corresponding ground image after the headlight is turned on; then the driver is reminded through the in-vehicle large screen to turn off the headlight. When it is detected that the headlight is turned off, the detection logic for the next headlight is entered.

[0037] After the detection of one headlight is completed, the image data of the ground corresponding to the position of the headlight taken before it is turned on is obtained. The two image data are compared. If the two images are the same, it is judged that the headlight is faulty; otherwise, it is judged that the headlight is normal. For each headlight, the driver is reminded by the in-vehicle large screen to operate the turn-on and turn-off of the headlight, and then the 360 camera is controlled to collect images. Whether the headlight is faulty is judged by the images during the turn-on and turn-off operations of each headlight.

[0038] When comparing whether the front and rear images are the same, since the main difference between the images before and after turning on the vehicle lights is due to the different lighting, the control module can compare the grayscale values of the images when performing image comparison to determine whether the grayscale images of the two pictures are the same. If they are the same, it indicates that there is no change before and after, and there is no influence of lighting, which means the vehicle light is faulty; otherwise, it means the vehicle light is normal. The results of the image comparison are all sent as reminders through the in-vehicle large screen to inform the user. At the same time, the image data captured before and after and the detection results judged accordingly are all temporarily stored in the storage module to provide basic data support for subsequent traceability, inspection, and analysis.

[0039] The purpose of the present invention is to provide an automatic detection method and system for vehicle light states. By setting a specific "Automatic Detection of Vehicle Light States" button on the large screen of the vehicle and combining devices such as the vehicle's own sensors and cameras, it realizes fast, accurate, and automated detection of vehicle light states without the participation of professional personnel, improving the detection efficiency and convenience. At the same time, it also helps to promptly detect light faults and ensure driving safety. The automatic detection system for vehicle light states in this solution mainly includes the following parts:

[0040] 1. Control module: As the core of the entire system, it is responsible for coordinating and controlling the work of each module, including receiving and processing user operation instructions, controlling image acquisition, analyzing detection results, etc. This module can be implemented using a high-performance microprocessor or microcontroller.

[0041] 2. Image acquisition module: It is mainly composed of image acquisition devices such as the existing 360 cameras on the vehicle, and is used to acquire image information of the vehicle lights. These cameras are distributed at different positions of the vehicle and can comprehensively and accurately obtain the working status of the vehicle lights.

[0042] 3. Display module: That is, the large screen of the vehicle, which is used to display detection results and prompt information. This module can be implemented using technologies such as liquid crystal displays or touch screens, facilitating users to intuitively understand the light state.

[0043] 4. Sensor module: It includes a brake sensor, an accelerator sensor, etc., and is used to detect the driving state of the vehicle and the operation actions of the driver, providing necessary trigger signals for light detection.

[0044] 5. Storage module: It is used to store information such as image data and detection results during the detection process for subsequent analysis and query. This module can be implemented using storage devices such as memory cards and hard disks.

[0045] Taking the light detection of the vehicle's front headlights, rear headlights, turn signals, and brake lights as an example, the detection control logic of this solution is introduced as follows:

[0046] 1. When the driver clicks the "Automatic Detection of Vehicle Lighting Status" button on the vehicle's large screen, the system starts the detection process.

[0047] 2. After entering the process, it is necessary to determine whether the environmental conditions are met. The environmental conditions refer to when the current vehicle is stationary and the ambient light intensity is less than the threshold, then the environmental conditions are met, and only then is it allowed to enter the vehicle lamp detection process; otherwise, it does not enter, and a reminder is sent through the in-vehicle large screen. At the same time, it should also be ensured that the vehicle is in the startup state. The system first detects the power status of the vehicle to ensure that the vehicle is in the normal startup state. If the vehicle is not started, the driver is prompted to start the vehicle.

[0048] 3. The system sequentially detects the main vehicle lights such as the front headlights, rear headlights, turn signals, and brake lights.

[0049] 4. When detecting the front headlights, the screen prompts the driver to turn on the front headlight switch. The vehicle retrieves the 360 camera images and determines whether the front headlights are normally lit through an image comparison algorithm. If normal, the screen feedbacks "The front headlight function is normal"; otherwise, the corresponding fault information is prompted.

[0050] 5. When detecting the rear headlights, the screen prompts the driver to turn on the rear headlight switch. At the same time, the vehicle determines whether it is necessary to turn on the rear fog lights according to the vehicle driving status detected by the sensor module. If necessary, the driver is prompted to turn on the rear fog lights. The vehicle retrieves the 360 camera images and determines whether the rear headlights and rear fog lights are normally lit through an image comparison algorithm. If normal, the screen feedbacks "The rear headlights and rear fog lights function is normal"; otherwise, the corresponding fault information is prompted.

[0051] 6. When detecting the turn signals, the screen prompts the driver to turn on the left turn signal and the right turn signal in sequence. The vehicle retrieves the 360 camera images and determines whether the flashing frequency and brightness of the turn signals are normal through an image comparison algorithm. If normal, the screen feedbacks "The turn signal function is normal"; otherwise, the corresponding fault information is prompted.

[0052] 7. When detecting the brake lights, the screen prompts the driver to step on the brake. The vehicle retrieves the 360 camera images according to the brake signal detected by the brake sensor and determines whether the brake lights are normally lit through an image comparison algorithm. If normal, the screen feedbacks "The brake light function is normal"; otherwise, the corresponding fault information is prompted.

[0053] Image processing for comparing the states of vehicle lights before and after a fault, which includes: First, preprocess the captured light image, including operations such as denoising and enhancement, to improve the quality and readability of the image. Then, extract the feature information in the image, such as the shape, color, and brightness of the light. Compare the extracted feature information with the pre-stored standard feature information to determine whether there are differences. If there are differences, determine whether the light is working properly based on the degree and characteristics of the differences. If the differences are small, it may be due to environmental factors or shooting angles, etc., and can be regarded as normal; if the differences are large, it is determined that the light is faulty.

[0054] The vehicle headlight detection of this solution can utilize the existing 360 cameras, touch switches, in-vehicle large screens, etc. of the vehicle. Only need to develop the corresponding software program and install it in the control module to achieve headlight detection. And the control module can also be implemented through the normal cockpit domain controller, or the vehicle's overall controller can be reused, greatly reducing the hardware cost of this solution, facilitating promotion and use, and enabling rapid detection of headlights such as rear taillights that are not visible. The detection results are accurate, providing intelligent and automated headlight detection for drivers, improving the degree of intelligence and user experience.

[0055] Obviously, the specific implementation of the present invention is not limited by the above methods. As long as various non-substantive improvements are made by adopting the method concept and technical solution of the present invention, they are all within the protection scope of the present invention.

Claims

1. An automatic detection system for automobile lighting status, characterized in that: It includes a control module, a sensor module, an image acquisition module and a reminder mode; the sensor module is used to detect the driver's operation of the vehicle, and its output end is connected to the control module; the image acquisition module is used to collect the vehicle light image information corresponding to the driver's operation, and its output end is connected to the control module; The control module determines whether the vehicle lights corresponding to the current driver's operation action are normal based on the collected vehicle light image information.

2. The automatic detection system for automobile lighting status as claimed in claim 1, characterized in that: The sensor module includes a vehicle-mounted sensor for detecting operation action information for triggering vehicle lights.

3. The automatic detection system for automobile lighting status as claimed in claim 1, characterized in that: The image acquisition module includes a vehicle-mounted camera, which is a 360-degree camera used for capturing vehicle light image data after the vehicle lights are turned on.

4. The automatic detection system for automobile lighting status as claimed in claim 1, characterized in that: The reminder module is a vehicle-mounted display module, which is used to display the test results and issue test reminder information.

5. An automatic detection system for automobile lighting status as described in any one of claims 1 to 4, characterized in that: The system also includes a storage module, which is used to store image data and corresponding detection results during the detection process, and its output end is connected to the control module; the external device accesses the control module through the Internet of Vehicles or accesses the control module based on the vehicle-mounted USB interface to obtain the stored detection data.

6. An automatic detection system for automobile lighting status as claimed in any one of claims 1 to 4, characterized in that: The detection system also includes a detection start switch, which is connected to the control module. After the detection start switch is triggered to start the detection, the control module monitors the user's operating actions in real time and collects vehicle lighting image information corresponding to the driver's operating actions and determines whether the vehicle lights corresponding to the current action are normal.

7. The automatic detection system for automobile lighting status as claimed in claim 6, characterized in that: The detection system also includes a light detection module, which is used to detect the ambient light intensity. The output end of the light detection module is connected to the control module. After the detection start switch is triggered to turn on, the control module determines whether the current environment meets the detection environment conditions based on the light detection module and gives a reminder.

8. A detection method of an automatic detection system for automobile lighting status according to any one of claims 1 to 7, characterized in that: After starting the light detection process, the control module monitors the user's operation actions in real time and collects the vehicle light image information corresponding to the driver's operation actions; The control module determines whether the collected vehicle light image information matches the driver's operating action based on image analysis. If so, the vehicle light corresponding to the driver's operating action is normal; otherwise, it is determined that the vehicle light corresponding to the driver's operating action is faulty.

9. A detection method for an automatic detection system for automobile lighting status as claimed in claim 8, characterized in that: Whether to start the light detection process is determined based on the on / off state of the detection start switch.

10. The detection method of the automobile lighting status automatic detection system as claimed in claim 8, characterized in that: After starting the light detection process, the detection prompt information and detection result information are issued through the display module.

Images