Method and system for automatically adjusting brightness of automobile screen, electronic equipment and automobile

Abstract

The invention belongs to the field of automobiles, and discloses an automobile screen brightness automatic adjusting method and system, electronic equipment and a vehicle, and the method comprises the steps: collecting face image information, positioning pupil positions based on the face image information, and constructing a head and eye position model; calculating a sight line direction and a sight line focus based on the eye position model, and judging whether the sight line focus position is within a screen range; acquiring ambient illumination intensity by using a light sensor, and converting the ambient illumination intensity into an electric signal as ambient illumination information for adjusting the screen brightness; and automatically adjusting the screen brightness according to the sight focus position and the environment illumination information. The human eye position and angle data of the driver are obtained through face recognition and eye movement tracking, so that the screen brightness adjustment of the instrument and the central control screen focus is automatically completed, and the driving safety of the driver is facilitated.

Description

Technical Field

[0001] The present invention belongs to the field of automobiles, and in particular relates to a method, system, electronic equipment and vehicle for automatically adjusting the brightness of an automobile screen. Background Art

[0002] There are many types of vehicle screens or car screens in the car, such as the vehicle's central control screen, instrument screen, etc. When the vehicle is driving, the driver usually needs to set the appropriate screen brightness according to the external light conditions or his own visual perception to avoid excessive light in the cabin that interferes with driving and affects the driving experience and driving safety.

[0003] The existing market already has models that can adjust screen brightness through soft and hard buttons, and most of them are adjusted by users themselves. However, these operations usually rely on the driver's active judgment and manual intervention, and the degree of automation is not high. This increases the driver's operating burden to a certain extent, and may distract their attention and reduce driving safety. Summary of the invention

[0004] In view of the deficiencies in the prior art, the present invention discloses a method, a system, an electronic device and a vehicle for automatically adjusting the brightness of a car screen.

[0005] The present invention is achieved through the following technical solutions:

[0006] In a first aspect, a method for automatically adjusting the brightness of a car screen comprises:

[0007] Collect facial image information, locate pupil position based on the facial image information and build a head and eye position model;

[0008] Calculating the sight direction and sight focus based on the eye position model, and determining whether the sight focus position is within the screen range;

[0009] The light sensor is used to obtain the ambient light intensity and convert it into an electrical signal as the ambient light information for adjusting the screen brightness;

[0010] Automatically adjust screen brightness according to the sight focus position and ambient lighting information.

[0011] In some embodiments, collecting facial image information includes:

[0012] The dynamic video is recorded by the in-vehicle camera, the key image is obtained by intercepting the dynamic video, and the key image is identified by face recognition technology to obtain face image information.

[0013] In some embodiments, locating the pupil position based on the facial image information includes:

[0014] The illumination position of the light source on the pupil of the human eye in the face image information is captured, and the pupil position is located through the visible reflection pattern.

[0015] In some embodiments, collecting facial image information further includes:

[0016] Preprocessing the face image obtained by the in-vehicle camera includes grayscale conversion and histogram equalization.

[0017] In some embodiments, constructing a head and eye position model includes:

[0018] Extract the 3D facial point distribution of the preprocessed face image and build the head and eye position model.

[0019] In some embodiments, the sight direction is extended to obtain a sight focus.

[0020] In some embodiments, as the distance between the focus position and the screen range increases, the screen brightness decreases step by step;

[0021] As the distance between the focus position and the screen range decreases, the screen brightness increases step by step;

[0022] When the focus position is within the screen, the screen brightness is adjusted to the brightness most suitable for the human eye according to the ambient lighting information.

[0023] In a second aspect, a system for automatically adjusting the brightness of a car screen includes:

[0024] Face recognition module, sight line processing module, light sensing module and brightness adjustment module;

[0025] The face recognition module is used to recognize the face information in the image collected by the in-vehicle camera and construct the head and eye position model according to the 3D points of the face;

[0026] The sight line processing module is used to obtain the sight line direction and sight line focus, and determine whether the sight line focus position is within the screen range;

[0027] The light sensing module is used to convert the acquired ambient light intensity into ambient light information for adjusting the screen brightness through the light sensor;

[0028] The brightness adjustment module is used to automatically adjust the screen brightness according to the sight focus position and ambient lighting information.

[0029] In a third aspect, an electronic device comprises: a processor and a memory, wherein the processor and the memory are connected via a communication bus; wherein the processor is used to call and execute a program stored in the memory; and the memory is used to store a program, wherein the program is used to implement the automatic adjustment method for the brightness of a car screen as described above.

[0030] In a fourth aspect, a vehicle is provided, characterized in that it comprises the above-mentioned electronic device, wherein the electronic device is used to execute the above-mentioned method for automatically adjusting the brightness of a car screen.

[0031] Compared with the prior art, the present invention has the following advantages:

[0032] 1. Screen brightness adjustment based on the driver's line of sight can always maintain appropriate brightness under different line of sight focus and light conditions, reducing interference to the driver's line of sight, thereby improving driving safety;

[0033] 2. Ensure that the screen is always in the best visual state for the driver according to the environment, avoid visual fatigue caused by uncomfortable screen brightness, and improve driving experience and comfort;

[0034] 3. You can lower the brightness at the appropriate time to reduce energy consumption and achieve energy saving and environmental protection.

[0035] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or be understood by implementing the present use information. The purpose and other advantages of the present invention can be realized and obtained by the structures pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0037] Figure 1 This is a schematic diagram of a method for automatically adjusting the brightness of a car screen according to this embodiment.

[0038] Figure 2 It is a schematic diagram of collecting the eye position and sight direction of a person by the in-vehicle camera of this embodiment.

[0039] Figure 3 It is a schematic diagram of matching the screen brightness with the driver's eye position and line of sight direction in this embodiment.

[0040] Figure 4 This is a schematic diagram of an automatic brightness adjustment system for a car screen according to this embodiment.

[0041] Figure 5 It is a schematic diagram of an electronic device of this embodiment. DETAILED DESCRIPTION

[0042] The drawings are only for illustrative purposes and cannot be construed as limiting the present invention. To better illustrate the present embodiment, some parts of the drawings may be omitted, enlarged, or reduced, and do not represent the size of the actual product. For those skilled in the art, it is understandable that some well-known structures and their descriptions may be omitted in the drawings. The positional relationships described in the drawings are only for illustrative purposes and cannot be construed as limiting the present invention.

[0043] like Figure 1 The method for automatically adjusting the brightness of a car screen is applied to the automatic adjustment of the brightness of two large screens such as the instrument and the central control in the common settings in the cockpit, and specifically includes the following steps:

[0044] S1. Collect facial image information, locate the pupil position based on the facial image information and build a head and eye position model.

[0045] Specifically, face recognition technology is used to detect images captured by the in-vehicle camera, and based on the collection and comparison of facial features, line of sight recognition and authentication, the corresponding driver's face image information is extracted from the image.

[0046] Furthermore, the dynamic video data collected by the in-vehicle camera is captured and the image information is extracted. Facial recognition is performed on the image information based on the driver's facial image information, the position of the light source irradiating the human pupil is captured, and the pupil position is located through the visible reflection pattern. In addition, the captured image is preprocessed, including grayscale and histogram equalization, to facilitate detection and identification of the eye area, thereby extracting the 3D point distribution of the face, and constructing a head and eye position model to locate the position of the eyes.

[0047] S2. Calculate the sight direction and sight focus based on the eye position model, and determine whether the sight focus position is within the screen range.

[0048] Specifically, the eye position and sight focus are located according to the eye position model, and the sight direction is calculated using a threshold-based projection method or a minimum neighborhood mean filtering method. The calculation formula for collecting the eye position and sight direction of a person by an in-vehicle camera is usually based on the following formula: sight direction = eye position / eye area, wherein the eye position is obtained by locating the eye position model, the eye area is the number of pixels in the eye area in the image, and in addition, the position of the sight focus is obtained based on the extension of the sight direction.

[0049] In some embodiments, after the driver gets in the car and adjusts the seat position, Figure 2 As shown in the figure, the eye position and sight direction are obtained based on the image captured by the in-car camera, and the sight focus is calculated. Figure 3The two in-car screens shown in the figure are respectively positioned by the X1Y1 axis and the X2Y2 axis to locate the position of the line of sight focus, where the small black dot at the intersection of the X1Y1 axis and the X2Y2 axis represents the line of sight focus. If the line of sight focus is within the plane where the in-car screen is located, the screen brightness is adjusted to a brightness suitable for observation as the current optimal screen brightness. If the line of sight focus moves, the XY axis of the line of sight focus position and the plane where the screen is located are judged. When the line of sight focus leaves the screen range, the screen brightness reduction effect is triggered; when the line of sight focus enters the screen range, the light sensor is combined to calculate the screen brightness that is most suitable for human eye observation in the current environment for brightness adjustment.

[0050] S3. Use a light sensor to obtain the ambient light intensity and convert it into an electrical signal as a control signal for adjusting the screen brightness.

[0051] Specifically, the light sensor includes a projector and a light receiver. When the line of sight enters the screen range, the light sensor receives a signal and automatically starts working to measure the light intensity of the surrounding environment. The projector focuses the collected light through a lens, thereby transmitting the light to the light receiver lens. After amplification, comparison and filtering by the light receiver, the light signal is converted into an electrical signal as a control signal for adjusting the screen brightness, thereby realizing intelligent control of the screen light.

[0052] S4. Automatically adjust screen brightness according to the sight focus position and ambient lighting information.

[0053] Specifically, the screen brightness changes according to the distance between the focus on the XY axis and the screen, and is adjusted to the brightness most suitable for human eye observation based on environmental factors through a light sensor. When the distance between the focus on the XY axis and the screen range increases, the screen brightness decreases step by step, and vice versa, until it reaches the brightness most suitable for the human eye.

[0054] In some embodiments, Figure 4 The automatic brightness adjustment system of a car screen shown includes: a face recognition module, a sight line processing module, a light sensing module and a brightness adjustment module.

[0055] Specifically, the face recognition module is used to identify face information in images captured by the in-vehicle camera and construct a head and eye position model based on the 3D points of the face.

[0056] The sight line processing module is used to obtain the sight line direction and sight line focus, and determine whether the sight line focus is within the screen range.

[0057] The light sensing module is used to convert the acquired ambient light intensity into a control signal for adjusting the screen brightness through a light sensor.

[0058] The brightness adjustment module is used to automatically adjust the screen brightness according to the sight focus and ambient light information.

[0059] An embodiment of the present invention provides an electronic device, such as Figure 5 As shown, the electronic device includes a processor and a memory, which stores program code and data for storing a method for automatically adjusting the brightness of a car screen. The processor calls the program instructions in the memory to execute the steps shown in the method for automatically adjusting the brightness of a car screen in the above embodiment.

[0060] An embodiment of the present invention provides a vehicle, which includes the electronic device provided by the above-mentioned embodiment of the present application, and the electronic device is used to execute the method for automatically adjusting the brightness of the car screen disclosed in the embodiment of the present application.

[0061] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for automatically adjusting the brightness of a car screen, characterized in that: include: Collect facial image information, locate pupil position based on the facial image information and build a head and eye position model; Calculating the sight direction and sight focus based on the eye position model, and determining whether the sight focus position is within the screen range; The light sensor is used to obtain the ambient light intensity and convert it into an electrical signal as the ambient light information for adjusting the screen brightness; Automatically adjust screen brightness according to the sight focus position and ambient lighting information.

2. The method for automatically adjusting the brightness of a car screen according to claim 1, characterized in that: Collect facial image information, including: The dynamic video is recorded by the in-vehicle camera, the key image is obtained by intercepting the dynamic video, and the key image is identified by face recognition technology to obtain face image information.

3. The method for automatically adjusting the brightness of a car screen according to claim 1, characterized in that: Locating pupil position based on face image information, including: The illumination position of the light source on the pupil of the human eye in the face image information is captured, and the pupil position is located through the visible reflection pattern.

4. The method for automatically adjusting the brightness of a car screen according to claim 2, characterized in that: Collecting facial image information also includes: Preprocessing the face image obtained by the in-vehicle camera includes grayscale conversion and histogram equalization.

5. The method for automatically adjusting the brightness of a car screen according to claim 4, characterized in that: Construct the head and eye position model, including: Extract the 3D facial point distribution of the preprocessed face image and build the head and eye position model.

6. The method for automatically adjusting the brightness of a car screen according to claim 1, characterized in that: The sight direction is extended to obtain a sight focus.

7. The method for automatically adjusting the brightness of a car screen according to claim 1, characterized in that: As the distance between the focus position and the screen range increases, the screen brightness decreases step by step; As the distance between the focus position and the screen range decreases, the screen brightness increases step by step; When the focus position is within the screen, the screen brightness is adjusted to the brightness most suitable for the human eye according to the ambient lighting information.

8. An automatic adjustment system for automobile screen brightness, characterized in that: include: Face recognition module, sight line processing module, light sensing module and brightness adjustment module; The face recognition module is used to recognize the face information in the image collected by the in-vehicle camera and construct the head and eye position model according to the 3D points of the face; The sight line processing module is used to obtain the sight line direction and sight line focus, and determine whether the sight line focus position is within the screen range; The light sensing module is used to convert the acquired ambient light intensity into ambient light information for adjusting the screen brightness through the light sensor; The brightness adjustment module is used to automatically adjust the screen brightness according to the sight focus position and ambient lighting information.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the processor and the memory are connected via a communication bus; wherein the processor is used to call and execute a program stored in the memory; The memory is used to store a program, and the program is used to implement the automatic adjustment method of the car screen brightness as described in any one of claims 1-7.

10. A vehicle, characterized in that: It includes the electronic device described in claim 9, which is used to execute the automatic adjustment method of the car screen brightness described in any one of claims 1-7.

Images