Method for automatically adjusting brightness of display module

Abstract

The invention provides a method for automatically adjusting the brightness of a display module. The method comprises the following steps: providing a CMS display module and at least one DMS camera; at least one DMS camera is arranged in a cockpit, and an acquisition end of the at least one DMS camera corresponds to a driver and is used for acquiring a fixation point of the driver; sending the data of the fixation point of the driver to a CMS system, and analyzing the data of the fixation point and the CMS system; according to the method, the data of the fixation point are analyzed through the CMS system, and if the fixation point of the driver coincides with the position of the CMS display module, the CMS display module is adjusted to preset brightness; if the fixation point of the driver is separated from the position of the CMS display module, the CMS display module can reduce the brightness.

Description

Technical Field

[0001] The present application belongs to the technical field of automobiles, and in particular relates to a method for automatically adjusting the brightness of a display module. Background Art

[0002] In the prior art, the current CMS displays the outward field of view of the vehicle body, and the display image does not need to be viewed all the time during driving. In this case, the display module is continuously at normal brightness, and the driver's eyes are exposed to strong screen light and blue light radiation for a long time, including the combined influence of other display modules in the cockpit, causing more serious damage to the human eyes.

[0003] To address the above problems, no effective solution has been proposed yet.

[0004] It should be noted that the above introduction to the technical background is only for the convenience of providing a clear and complete description of the technical solutions of the present invention and for the convenience of understanding by those skilled in the art. It cannot be considered that the above technical solutions are well known to those skilled in the art simply because these solutions are described in the background technology section of the present invention. Summary of the invention

[0005] The purpose of this application is to provide a method for automatically adjusting the brightness of a display module to solve the above problems.

[0006] The present application provides a method for automatically adjusting the brightness of a display module, comprising:

[0007] Provide a CMS display module and at least one DMS camera;

[0008] At least one of the DMS cameras is arranged in the cockpit, and a collection end of at least one of the DMS cameras corresponds to the driver, and is used to collect the driver's gaze point;

[0009] Sending the data of the driver's gaze point to a CMS system, and analyzing the data of the gaze point with the CMS system;

[0010] When the driver's gaze point coincides with the position of the CMS display module, the CMS display module is adjusted to a preset brightness; when the driver's gaze point separates from the position of the CMS display module, the CMS display module reduces the brightness.

[0011] Preferably, the CMS display module is arranged on a CMS electronic rearview mirror.

[0012] Preferably, the DMS camera is configured as a high-resolution camera.

[0013] Preferably, in the step of "collecting the driver's gaze point", the driver's gaze point is analyzed by capturing the driver's facial feature points.

[0014] Preferably, the driver's gaze area is determined by a visual algorithm.

[0015] Preferably, in the step of "adjusting the CMS display module to a preset brightness", the CMS display module includes an instrument panel and a central control screen.

[0016] Preferably, in the process of "capturing the driver's gaze point", the image captured by the DMS camera is preprocessed.

[0017] Preferably, the driver's face is detected by a convolutional neural network.

[0018] Preferably, the sight direction is estimated by the relative position relationship between the iris center and the eye corner of the driver.

[0019] Preferably, the sight angle is calculated by analyzing the relationship between the light reflection point on the cornea and the pupil center.

[0020] Compared with the prior art, the present invention has the following beneficial effects:

[0021] 1. The present invention analyzes the gaze point data through the CMS system. If the driver's gaze point coincides with the position of the CMS display module, the CMS display module is adjusted to a preset brightness; if the driver's gaze point is separated from the position of the CMS display module, the CMS display module can reduce the brightness.

[0022] 2. The present invention can make the images captured by the DMS camera clearer by setting a high-resolution camera, thereby making the analysis of the driver's gaze point more accurate.

[0023] 3. The present invention can make the facial features of the collected driver's facial image more obvious by setting the image for preprocessing, thereby making the judgment of the gaze point more accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0025] Figure 1It is an overall flow chart of a method for automatically adjusting the brightness of a display module provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0027] In the description of the present invention, it should be noted that the orientations or positional relationships indicated by the terms "upper", "middle", "lower", "inner", "outer", "front", "back", etc. are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or component referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. The terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances. The following describes an implementation method of the present invention based on its overall structure.

[0028] Reference Figure 1 As shown, the embodiment of the present application provides a method for automatically adjusting the brightness of a display module, comprising:

[0029] Provide a CMS display module and at least one DMS camera;

[0030] At least one DMS camera is arranged in the cockpit, and a collection end of at least one DMS camera corresponds to the driver, so as to collect the driver's gaze point;

[0031] Send the driver's gaze point data to the CMS system, and analyze the gaze point data with the CMS system;

[0032] Among them, when the driver's gaze point coincides with the position of the CMS display module, the CMS display module is adjusted to a preset brightness; when the driver's gaze point is separated from the position of the CMS display module, the CMS display module reduces the brightness.

[0033] According to the above process, those skilled in the art can analyze the driver's driving condition through at least one DMS camera and a CMS system, thereby completing the adjustment of the brightness of the CMS display module.

[0034] It is understandable that those skilled in the art install at least one DMS camera in the cockpit, and the DMS camera is set to correspond to the position of the driver, so that the facial features of the driver can be accurately captured.

[0035] Specifically, at least one DMS camera may be set to collect the driver's facial features, then analyze the gaze points in the facial features, and send the data of the driver's gaze points to the CMS system, which then analyzes the data of the gaze points.

[0036] After the CMS system analyzes the gaze point data, if the driver's gaze point coincides with the position of the CMS display module, the CMS display module adjusts to the preset brightness; if the driver's gaze point is separated from the position of the CMS display module, the CMS display module can reduce the brightness.

[0037] In the above analysis, those skilled in the art can set the CMS system to adjust the brightness when the driver's gaze point moves from one component to another in the CMS display module. The above setting can achieve the adaptive adjustment of the brightness when the driver is looking at the CMS display module, thereby improving the driver's safety while driving.

[0038] In the above arrangement, preferably, the CMS display module is arranged on the CMS electronic rearview mirror. That is, the CMS display module may include a portion of the CMS electronic rearview mirror used for electronic display.

[0039] According to the above settings, when the driver's gaze point coincides with the CMS display module on the CMS electronic rearview mirror, the CMS system can automatically adjust the brightness of the CMS display module on the CMS electronic rearview mirror, thereby making it easier for the driver to observe the CMS electronic rearview mirror.

[0040] In the above-mentioned embodiment, those skilled in the art may install at least one DMS camera in the cockpit, and the position of the DMS camera corresponds to the position of the driver, so as to facilitate the collection of the driver's facial features. In this embodiment, preferably, the DMS camera is set as a high-resolution camera. By setting a high-resolution camera, the image collected by the DMS camera can be clearer, so that the analysis of the driver's gaze point can be more accurate.

[0041] Preferably, in the step of "collecting the driver's gaze point", the driver's facial feature points are captured to analyze the driver's gaze point. In the above embodiment, the DMS camera can collect detailed images of the driver's face, especially the eye area.

[0042] In the above-mentioned embodiment, the DMS camera collects a detailed image of the driver's eye area, so that the driver's gaze point can be collected, and then the position of the driver's gaze can be determined to adjust the brightness of the CMS display module.

[0043] Furthermore, in this embodiment, preferably, the driver's gaze area can be determined by a visual algorithm. The visual algorithm can quickly analyze the driver's facial features after collecting them, and can accurately obtain the required data, thereby improving the accuracy of the CMS display module brightness adjustment.

[0044] It is understandable that in the above-mentioned embodiment, the CMS display module can be set on the electronic rearview mirror. In this embodiment, in the step of "adjusting the CMS display module to a preset brightness", the CMS display module includes an instrument panel and a central control screen. That is, when the driver's gaze point is on the instrument panel, the brightness of the instrument panel can be adjusted, and the brightness of the central control screen can be reduced. When the driver's gaze point coincides with the central control screen, the brightness of the central control screen can be adjusted, and the brightness of the instrument panel can be reduced.

[0045] In the above-mentioned implementation, those skilled in the art set the DMS camera to collect images of the driver's facial features. Preferably, in the process of "collecting the driver's gaze point", the images collected by the DMS camera are preprocessed.

[0046] Specifically, those skilled in the art may perform grayscale processing on the captured image, that is, convert the color image into a grayscale image, so as to simplify the subsequent processing process.

[0047] After the image is grayed out, the obtained gray image is subjected to noise removal, that is, a filter is used to reduce the noise in the gray image. Specifically, Gaussian filtering or median filtering can be used to remove the noise.

[0048] After removing the noise, those skilled in the art may continue to enhance the contrast of the grayscale image. Specifically, the contrast of the image may be increased by a histogram equalization method, thereby making the facial features of the driver more obvious.

[0049] Through the above-mentioned image preprocessing process, the facial features of the collected driver's facial image can be made more obvious, thereby making the judgment of the gaze point more accurate.

[0050] In the above settings, after the image is processed, face detection and positioning can be performed through the image. Among them, those skilled in the art can set a Haar cascade classifier. It is understandable that the Haar cascade classifier is a strong classifier composed of a series of weak classifiers trained based on the Adaboost algorithm, which can quickly find the position of the face in the image.

[0051] In this embodiment, face detection can also be performed through a deep learning model. Preferably, the driver's face is detected through a convolutional neural network. That is, training is performed through a large amount of labeled data, thereby improving the sensitivity of face detection.

[0052] In the process of detecting and locating the eyes to determine the driver's gaze point, those skilled in the art can set template matching, that is, use a predefined eye shape as a template to find the best matching position in the facial area. Then perform local feature point detection, and use local feature descriptions such as SIFT, SURF or ORB to identify key points around the eyes.

[0053] In this embodiment, the specific coordinates of the eyes can also be detected through deep learning technology, that is, a small CNN network specially trained for eye features is used to directly predict the specific coordinates of the eyes from the facial image.

[0054] In the process of analyzing the gaze point, it is necessary to track the eyes and estimate the line of sight. Those skilled in the art can determine it by geometric methods, preferably, estimating the line of sight direction by the relative position relationship between the driver's iris center and the eye corner.

[0055] Furthermore, eye tracking and line of sight estimation can be achieved through reflected light analysis. Preferably, the line of sight angle is calculated by analyzing the relationship between the light reflection point on the cornea and the pupil center.

[0056] Furthermore, eye tracking and gaze estimation can be performed through a deep learning model. That is, eye tracking and gaze estimation can be performed accurately by outputting a gaze vector through input images.

[0057] Through the above process, the driver's gaze point can be analyzed, so that the position of the gaze point can be matched and analyzed through the CMS system, and then the brightness of the CMS display module can be adjusted.

[0058] It is understandable that, in the above process, the driver's distraction and fatigue level can also be detected by monitoring the driver.

[0059] The above-mentioned distraction can be used to judge whether the driver is distracted based on the degree and duration of the line of sight away from the road ahead, and the fatigue level can be estimated by combining parameters such as blinking frequency and eye closure time to assess the driver's fatigue level. If distraction and fatigue driving occur, those skilled in the art can set a sound prompt or vibrate the seat for feedback.

[0060] Although different specific embodiments are mentioned in the content of this application, this application is not limited to the situations described in the industry standards or embodiments, etc. Some industry standards or slightly modified implementation plans based on the implementation of the custom methods or embodiments can also achieve the same, equivalent or similar, or predictable implementation effects after deformation of the above embodiments. The embodiments of data acquisition, processing, output, judgment methods, etc. after these modifications or deformations can still fall within the scope of the optional implementation plans of this application.

[0061] Although the present application has been described through embodiments, those skilled in the art will appreciate that there are many modifications and changes to the present application without departing from the spirit of the present application. It is intended that the attached embodiments include these modifications and changes without departing from the present application.

Claims

1. A method for automatically adjusting the brightness of a display module, characterized in that: The following steps are involved: Provide a CMS display module and at least one DMS camera; At least one of the DMS cameras is arranged in the cockpit, and a collection end of at least one of the DMS cameras corresponds to the driver, and is used to collect the driver's gaze point; Sending the data of the driver's gaze point to a CMS system, and analyzing the data of the gaze point through the CMS system; When the driver's gaze point coincides with the position of the CMS display module, the CMS display module is adjusted to a preset brightness; when the driver's gaze point separates from the position of the CMS display module, the CMS display module reduces the brightness.

2. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: The CMS display module is arranged on the CMS electronic rearview mirror.

3. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: The DMS camera is configured as a high-resolution camera.

4. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: In the step of "collecting the driver's gaze point", the driver's gaze point is analyzed by capturing the driver's facial feature points.

5. The method for automatically adjusting the brightness of a display module according to claim 4, characterized in that: The driver's gaze area is determined by a visual algorithm.

6. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: In the step of "adjusting the CMS display module to a preset brightness", the CMS display module includes an instrument panel and a central control screen.

7. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: In the process of "collecting the driver's gaze point", the image collected by the DMS camera is preprocessed.

8. The method for automatically adjusting the brightness of a display module according to claim 1, characterized in that: The driver's face is detected by a convolutional neural network.

9. The method for automatically adjusting the brightness of a display module according to claim 4, characterized in that: The sight direction is estimated according to the relative position relationship between the driver's iris center and eye corner.

10. The method for automatically adjusting the brightness of a display module according to claim 9, characterized in that: The line of sight angle is calculated by analyzing the relationship between the light reflection point on the cornea and the center of the pupil.

Images