Intelligent electric sunshade system based on DMS camera and control method thereof

Abstract

The invention discloses an intelligent electric sunshade system based on a DMS camera and a control method thereof, the intelligent electric sunshade system comprises the camera, a processing unit, a sunshade component and an electric sunshade actuator, the electric sunshade actuator is in communication connection with the processing unit, receives a sunshade control signal and drives the sunshade component to perform local shielding, and the camera is connected with the processing unit. Therefore, the interference of incident strong light on the sight of a driver is eliminated or weakened. The intelligent electric sun-shading system is based on glare judgment and positioning of eyeball visual features, whether glare is occurring or not is directly judged by analyzing eyeball images, the specific position of the eyeball images acting on a driver is accurately locked, and a sun-shading component is controlled to achieve accurate shading.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of sun visor adjustment for vehicles, in particular to an intelligent electric sun visor system based on a DMS camera and a control method thereof. BACKGROUND

[0002] Current sun visor products on the market include: 1. Traditional manual sun visor: is the standard configuration of all current cars, its use completely relies on manual operation of the driver, and cannot cope with dynamically changing sunlight; 2. Simple light-sensitive automatic sun visor: exists in some car after-market or DIY products, a light-sensitive resistor is installed on the sun visor, and when strong light is detected, an LCD sheet inside the sun visor is automatically darkened. There is no flipping mechanical structure, and the detection accuracy is low, which is easy to trigger (such as entering a tunnel). 3. Built-in adjustable light glass (light film), mainly applied to sunroofs, side windows and rearview mirrors of some high-end cars. There are few applications in sun visor areas. In addition, the traditional sun visor needs to be manually operated by the driver, and in critical moments such as high-speed driving, reaching out to flip and adjust the sun visor will distract attention and increase safety hazards; 2. The simple light-sensitive scheme in the after-market cannot distinguish between "environmental light" and "directly shining light into the eyes". For example, when driving under a bridge on a sunny day, the environmental light becomes weak, and the sun visor may be incorrectly retracted, and then directly hit by sunlight as soon as it comes out of the shadow; 3. In the morning or evening, the sunlight angle changes quickly, and the sunlight direction changes constantly when the vehicle turns, goes uphill or downhill. The sun visor at a fixed position or the partially darkened area may not be able to timely and accurately cover the new glare position, and the driver needs to frequently manually adjust it. SUMMARY The present application aims to solve the technical problem in the prior art that the sun visor cannot timely and accurately cover the new glare position, and the driver needs to frequently manually adjust it. To this end, the present application provides an intelligent electric sun visor system based on a DMS camera and a control method thereof.

[0003] According to an intelligent electric sun visor system based on a DMS camera according to a first aspect of an embodiment of the present application, comprising: a camera, arranged in front of the driver in the vehicle, for capturing image data containing the driver's eyes and face in real time; a processing unit, in communication connection with the camera, configured to: receive the image data; based on the image data, calculate the illumination parameters of the incident strong light in the driver's eye area, the illumination parameters including the illumination position and / or the illumination angle; based on the illumination parameters, generate a corresponding sun visor control signal; a sun visor component; The electric sunshade actuator is in communication connection with the processing unit, configured to receive the sunshade control signal and drive the sunshade component to perform local shielding to eliminate or weaken the interference of the incident strong light on the driver's line of sight.

[0004] According to the intelligent electric sunshade system based on the DMS camera according to the embodiments of the present application, at least the following beneficial effects are achieved: The intelligent electric sunshade system determines and locates glare based on eye visual features, directly determines whether glare is occurring by analyzing the eye image itself, accurately locks the specific position of the glare acting on the driver, controls the sunshade component to achieve “precise shielding”, and automatically, accurately and effectively reduces the glare of sunlight without affecting the driving safety, solves the problems of low sensing accuracy, inability to accurately shield strong light, distraction of the driver, high cost and the like, improves the intelligent degree of the cabin and improves the user experience.

[0005] According to some embodiments of the present application, the processing unit is further configured to: At least one of the pupil position in the driver's eye image, the brightness distribution and pixel value change around the pupil, the shadow area formed by the eye socket contour and the highlight reflection point on the iris is analyzed by a preset algorithm to deduce the path of the incident light and the direction of the light source.

[0006] According to some embodiments of the present application, the processing unit is further configured to: When the local area of the eye detected based on the image data appears a continuous highlight and high-contrast light spot, and the light spot position is relatively fixed with the eye, it is preliminarily determined as a “sunlight direct glare event”; And / or in combination with the vehicle turn signal and GPS orientation information to determine whether there is sunlight direct; When it is determined that there is sunlight direct, the generation of the sunshade control signal is controlled.

[0007] According to some embodiments of the present application, the intelligent electric sunshade system further comprises an ambient light sensor in communication connection with the processing unit; the processing unit is further configured to: in combination with the ambient light sensor data and the image data of the camera, comprehensively judge whether the incident strong light is from the sunlight direct or the opposite vehicle high beam, and adjust the response strategy of the sunshade control signal accordingly.

[0008] According to some embodiments of the present application, the processing unit is further configured to: Based on the pre-stored geometric optical model with geometric mapping relationship, the spatial coordinates of the eye and the direction of the light source are mapped into the rotation angle of the sunshade component in real time, and the corresponding sunshade control signal is generated according to the rotation angle of the sunshade component.

[0009] According to some embodiments of the present application, the intelligent electric sunshade system further comprises an angle sensor configured to obtain a rotation angle of the sunshade component, and the processing unit is further configured to: obtain the rotation angle of the angle sensor; judge that the sunshade component performs a shielding action based on the obtained rotation angle; when it is judged that the sunshade component performs a shielding action, continuously monitor the eye region brightness value; based on the eye region brightness value being below a preset brightness threshold for a preset time, and based on vehicle motion state data judging that the vehicle has left the driving scene causing glare, automatically generate a sunshade plate retracting instruction signal and control the sunshade component to retract.

[0010] According to the control method of the intelligent electric sunshade system based on the DMS camera according to the second aspect of the embodiments of the present application, which is applied to the intelligent electric sunshade system based on the DMS camera described above, the control method comprises: obtaining image data of the driver's eyes and face captured by the camera; determining the illumination parameters of the incident strong light on the driver's eye region based on the image data of the driver's eyes and face; generating a sunshade control signal based on at least the illumination parameters; controlling the electric sunshade actuator to perform a local shielding action according to the sunshade control signal.

[0011] According to some embodiments of the present application, the determination of the illumination parameters of the incident strong light on the driver's eye region comprises: identifying eye feature points of the image data; analyzing the highlight area, shadow distribution and eye three-dimensional coordinates in the eye feature points; based on the highlight area, shadow distribution and eye three-dimensional coordinates, backstepping calculation of the direction and angle of the incident light.

[0012] According to some embodiments of the present application, the generation of the sunshade control signal based on at least the illumination parameters comprises: based on the pre-stored geometric optical model with geometric mapping relationship, by mapping the spatial coordinates of the eyes and the direction of the incident strong light into a unique rotation angle of the sunshade component, a corresponding sunshade control signal is generated according to the rotation angle of the sunshade component.

[0013] According to some embodiments of the present application, the intelligent electric sunshade system further comprises an angle sensor configured to obtain a rotation angle of the sunshade component; The control method further comprises: obtaining the rotation angle of the angle sensor; Determine whether the sunshade component performs a shielding action based on the acquired rotation angle; When it is determined that the sunshade component performs a shielding action, the brightness value of the eye region monitored by the camera is continuously acquired, and vehicle motion state data is acquired; When it is determined that the brightness value of the eye region monitored by the camera is continuously lower than the preset brightness threshold for a preset time, and the glare threat is determined to be removed in combination with the vehicle motion state, a sunshade component retracting control signal is generated and executed.

[0014] Other features and advantages of the present application will be described in the following description, and some will become apparent from the description, or will be understood from the practice of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0015] The present application will be further described below in conjunction with the accompanying drawings and examples, in which: Figure 1 A control method of an intelligent electric sunshade system based on a DMS camera. DETAILED DESCRIPTION

[0016] The embodiments of the present application will be described in detail below, examples of which are shown in the accompanying drawings, in which the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as a limitation of the present application.

[0017] In the description of the present application, it should be understood that the orientation description, such as the orientation or position relationship indicated by up, down, etc. is based on the orientation or position relationship shown in the drawings, and is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation of the present application.

[0018] In the description of the present application, the plural refers to two or more. If there is a description of first, second, etc., it is only for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated or the sequence of technical features indicated.

[0019] In the description of the present application, unless otherwise explicitly limited, the words such as setting, installing, connecting, etc. should be broadly understood, and the person skilled in the art can reasonably determine the specific meaning of the above words in the present application in combination with the specific content of the technical solution.

[0020] The technical solutions of the present application will be described below in conjunction with the accompanying drawings, which are clear and complete. Obviously, the following described embodiments are part of the embodiments of the present application, not all embodiments.

[0021] The application discloses a DMS camera-based intelligent electric sunshade system, which comprises a camera, a processing unit, a sunshade component and an electric sunshade actuator, the camera is arranged in front of a driver in a vehicle and is used for capturing image data containing the driver's eyes and face in real time; the processing unit is in communication connection with the camera, the camera captures the image data containing the driver's eyes and face in real time, the processing unit receives the image data, calculates the irradiation parameters of incident strong light on the driver's eye area based on the image data, the irradiation parameters comprise an irradiation position and / or an irradiation angle, the processing unit generates corresponding sunshade control signals based on the irradiation parameters; the electric sunshade actuator is in communication connection with the processing unit, receives the sunshade control signals and drives the sunshade component to perform local shielding, so as to eliminate or weaken the interference of the incident strong light on the driver's line of sight. In the embodiment, the driver can also be understood as an occupant in a front passenger seat, that is, the application can be used for preventing glare for the driver in a main driver seat or for the occupant in a front passenger seat.

[0022] The intelligent electric sunshade system determines glare and locates the glare based on eyeball visual features, directly determines whether glare is occurring by analyzing the eyeball image itself, accurately locks the specific position of the glare acting on the driver, controls the sunshade component to realize precise shielding, automatically, accurately and effectively reduces the glare of sunlight, does not affect the driving safety, solves the problems of low sensing accuracy, inability to accurately shield strong light, distraction of the driver, high cost and the like, improves the intelligent degree of the cabin and improves the user experience.

[0023] The camera continuously captures a high-frame-rate video stream containing the driver's face area in operation, the number of the cameras can be multiple, the processing unit receives image information provided by the multiple cameras to improve the detection accuracy. An auxiliary camera can be additionally arranged, the 3D positions of the eyeball and the sun are more accurately triangulated by using the stereoscopic vision technology, and the angle calculation is more accurate.

[0024] Meanwhile, in order to improve the integration and save the cost, the camera is multiplexed or integrated with an existing driver state monitoring camera of the vehicle.

[0025] The processing unit can be multiplexed with an existing electronic control unit (ECU) in the vehicle, such as a body controller or a higher-level body domain controller or a cabin domain controller, so as to realize cost optimization and system integration.

[0026] The processing unit is further configured to back-calculate the path of the incident light and the position of the light source by analyzing at least one of the pupil position, the brightness distribution and pixel value changes around the pupil, the shadow area formed by the eye socket contour, and the highlight reflection points on the iris in the driver's eye image when calculating the irradiation parameter. Specifically, the processing unit can accurately locate the three-dimensional coordinates of the driver's facial contour, eye socket, and eyeball (pupil) in the vehicle cabin space in real time through built-in computer vision algorithms.

[0027] The processing unit is further configured to: When the local area of the eyeball detected based on the image data appears a high-brightness and high-contrast light spot that is relatively fixed in position, it is preliminarily determined as a "sunlight direct glare event"; And / or in combination with the vehicle turn signal, GPS position information to determine whether there is sunlight direct; When it is determined that there is sunlight direct, the generation of the sunshade control signal is controlled. Vehicle turn signal, GPS position information and other data play a supplementary judgment role, which can be combined with vehicle data to predict the change of sunlight incidence angle and enhance the accuracy of judgment. For example, when the vehicle is about to turn right, the system can predict in advance the glare risk that may occur on the co-driver side.

[0028] The system further comprises an ambient light sensor in communication connection with the processing unit; the processing unit is further configured to: in combination with the ambient light sensor data and the camera data, comprehensively judge whether the incident strong light is from the direct sunlight or the opposite vehicle high beam, and adjust the response strategy of the sunshade control signal accordingly.

[0029] Through infrared / ultraviolet spectrum recognition, specific wavebands (such as ultraviolet light rich in sunlight or specific infrared light) are detected in the sensor. The system only responds to strong light that meets the characteristics of the sunlight spectrum, which can effectively filter out the interference of vehicle headlights and other artificial light sources The processing unit is further configured to: based on a pre-stored geometric optical model with geometric mapping relationship, map the spatial coordinates of the eye and the direction of the light source into the rotation angle of the sunshade component in real time, and generate a corresponding sunshade control signal according to the rotation angle of the sunshade component.

[0030] The processing unit calculates the optimal sunshade plate rotation angle required to block light in a specific direction in real time through a pre-installed geometric optical model based on the real-time three-dimensional coordinates of the eyeball and the approximate direction of the strong light source (sun) in the image recognized by the camera. Ensure that the edge of the sunshade plate forms a shadow in front of the driver's line of sight after it is turned down, which can block glare and minimize the obstruction to the forward view.

[0031] The intelligent electric sunshade system further comprises an angle sensor for obtaining the rotation angle of the sunshade component, and the processing unit is further configured to: acquire the rotation angle of the angle sensor; determine whether the sunshade component performs a shielding action based on the acquired rotation angle; When it is determined that the sunshade component performs a shielding action, the eye region brightness value is continuously monitored; When the eye region brightness value is below the preset brightness threshold for a preset time, and it is determined that the vehicle has left the driving scene causing glare based on the vehicle motion state data, an automatic sun visor retracting instruction signal is generated, and the sunshade component is controlled to retract.

[0032] The camera continuously monitors, and when it is detected that the brightness value of the eyeball region has stably fallen below the threshold value, and in combination with the vehicle motion state, such as having driven away from the sunlight direct road section, it is determined that the glare threat has been eliminated, the processing unit issues a sun visor retracting instruction.

[0033] The processing unit receives the "eyeball coordinates" and "glare feature signal" from the sensing module, and performs fusion analysis with the vehicle bus signals (such as turn signal, GPS heading, slope sensor, etc.), sets a dynamic threshold, and not all strong light triggers an action. The system needs to distinguish between sunlight direct and opposite vehicle high beam, ground reflected light, tunnel entrance strong light, etc. Only when the high brightness signal lasts for a certain time, moves synchronously with the eyeball position, and meets the sun azimuth angle logic, it is finally confirmed as an effective trigger condition.

[0034] The sunshade component is one or a combination of the following: a physical shield that can translate or rotate along a certain track; a plurality of miniature louvers that can independently adjust the angle; a polymer dispersed liquid crystal film that controls the light transmittance of a specific area by applying an electric field.

[0035] The sunshade component in this embodiment is a miniature louver array. The array is composed of dozens or even hundreds of tiny, horizontally or vertically arranged independent blades, which are installed side by side in a frame with a size comparable to a traditional sun visor, replacing the original sun visor. Each miniature blade can independently rotate around its own rotation axis. The electric sunshade actuator is an array of miniature electromagnetic actuators, and the rotation of all blades is driven by a set of miniature electromagnetic actuator arrays.

[0036] The processing unit calculates the specific area that needs to be shielded, one or more discrete glare points.

[0037] The processing unit sends a control signal to the electromagnetic actuator array, which is a bitmap pattern.

[0038] The actuator array independently controls the rotation angle of each miniature blade according to the pattern.

[0039] By precise programming, a portion of the louvers in the array can be closed to block light, while other portions of the louvers remain open to maintain the field of view. For example, one or more "sunshade patches" can be formed in the middle of the array, precisely corresponding to multiple glare sources, such as multiple light spots passing through the gaps between the leaves, while the rest of the array remains transparent.

[0040] The advantage of this embodiment is that the partial shading is extremely precise, with minimal impact on the overall field of view, achieving a similar "pixel-level" sunshade control. That is, a segmented or "zoned" physical sunshade is used, which itself is composed of multiple independently movable leaves or segments. When the system identifies glare, instead of flipping down the entire sunshade, only one or two specific leaves are driven to rotate by a certain angle, forming a smaller, targeted local shadow area on the sunshade.

[0041] According to some embodiments of the present application, the electric sunshade actuator comprises a motor drive circuit, a micro motor, and a sunshade component. The motor drive circuit is used to receive a sunshade control signal; the micro motor is electrically connected to the motor drive circuit; and the sunshade component is mechanically connected to the micro motor and can at least one of extend, retract, rotate, or regionally darken under the drive thereof.

[0042] In addition, the motor drive circuit is multiplexed with the motor drive circuit in the vehicle body control module or domain controller of the vehicle; and the processing unit sends instructions to the vehicle body control module or domain controller through the vehicle bus to generate the sunshade control signal.

[0043] In some embodiments, the sunshade component is a sunshade panel. The electric sunshade actuator comprises a motor drive circuit that is multiplexed with the BCM or domain controller to output a control signal; a small, low-noise DC motor; a reduction gear set; and an angle sensor, such as a potentiometer or a Hall encoder, which constitute the driving core of the sunshade panel.

[0044] Workflow: The sunshade control signal sent by the processing unit is received, and the control signal contains a target angle.

[0045] The motor is started, and the sunshade panel is driven to rotate through the gear set.

[0046] The angle sensor feeds back the current position of the sunshade panel in real time, forming a closed-loop control to ensure that it moves precisely and smoothly to the calculated target angle.

[0047] When the retracting instruction is received, the motor is reversed to reset the sunshade panel to the stowed position.

[0048] The sunshade panel can be a segmented sunshade panel composed of several leaves, each of which can be independently controlled to form a smaller shadow area and precisely block the sun's radiation to the eyeball.

[0049] The embodiment is based on personalized shielding of eyeball positioning, realizes the effect of "pointing to shooting", and avoids the disadvantages of large-area shielding of the view by the traditional sun visor. Through multi-source information fusion and intelligent decision algorithm, false triggering is effectively prevented, and the system behavior is closer to the subjective judgment of human drivers. The existing in-vehicle hardware (camera, domain controller) is fully utilized, the cost of new hardware is greatly reduced, and mass production of technology is possible. And the automatic response mechanism liberates the driver from manual operation, so that he can always focus on driving and improve driving safety.

[0050] Referring to Figure 1 According to the control method of the intelligent electric sunshade system based on the DMS camera according to the second aspect of the embodiment of the present application, the control method is applied to the intelligent electric sunshade system based on the DMS camera in any of the above, and the control method comprises the following steps: Step S100: acquiring image data of the driver's eyes and face captured by the camera; Step S200: determining the illumination parameter of the incident strong light in the driver's eye area based on the image data of the driver's eyes and face; Step S300: generating a sunshade control signal based on at least the illumination parameter; Step S400: controlling the electric sunshade actuator to perform a local shielding action according to the sunshade control signal.

[0051] In some embodiments, determining the illumination parameter of the incident strong light in the driver's eye area comprises: identifying eye feature points of the image data; analyzing the highlight area, shadow distribution and eye three-dimensional coordinates in the eye feature points; based on the highlight area, shadow distribution and eye three-dimensional coordinates, the direction and angle of the incident light are calculated by back calculation.

[0052] According to some embodiments of the present application, generating a sunshade control signal based on at least the illumination parameter comprises: based on the pre-stored geometric optical model with geometric mapping relationship, the spatial coordinates of the eyes and the direction of the incident strong light are mapped into a unique sunshade component rotation angle, and the corresponding sunshade control signal is generated according to the sunshade component rotation angle.

[0053] According to some embodiments of the present application, the intelligent electric sunshade system further comprises an angle sensor for acquiring the rotation angle of the sunshade component; The control method further comprises: acquiring the rotation angle of the angle sensor; judging the shielding action of the sunshade component based on the acquired rotation angle; When it is judged that the sunshade component performs the shielding action, the brightness value of the eye region monitored by the camera is continuously acquired, and the vehicle motion state data is acquired; When it is monitored that the brightness value of the eye region is continuously lower than the preset brightness threshold value for the preset time, and the glare threat is judged to be removed in combination with the vehicle motion state, the sunshade component retracting control signal is generated and executed.

[0054] The pre-stored geometric mapping relationship maps the spatial coordinates of the eyeball and the light source direction into a unique sunshade plate rotation angle. The geometric optical model defines a line-of-sight vector formed by connecting the spatial coordinates of the eyeball and the light source direction with the rotation center of the sunshade plate as the origin; the target angle of the sunshade plate is the angle required for the lower edge of the sunshade plate to fall into the line-of-sight vector. The pre-stored geometric mapping relationship is specifically implemented as a lookup table or a parameterized function. The mapping relationship plays a role in quickly obtaining the rotation angle of the control sunshade component.

[0055] The embodiment of the application also provides a vehicle, including a memory, a processor and a program stored in the memory and executable on the processor, and the program is executed by the processor to realize a control method of the intelligent electric sunshade system based on the DMS camera.

[0056] The processor can be implemented in the form of a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., for executing related programs to implement the technical solutions provided by the embodiments of the application.

[0057] The memory can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM), etc. The memory can store an operating system and other application programs, and when the technical solutions provided by the embodiments of the specification are implemented by software or firmware, the related program codes are saved in the memory and executed by the processor to execute the method of the embodiments of the application.

[0058] The vehicle also includes the control method of the intelligent electric sunshade system based on the DMS camera. Specifically, the vehicle can be a private car, such as a sedan, an SUV, an MPV, or a pickup truck, etc. The vehicle can also be an operating vehicle, such as a van, a bus, a small truck, or a large trailer, etc. The vehicle can be a gasoline car or a new energy car. When the vehicle is a new energy car, it can be a hybrid car or a pure electric car.

[0059] A computer readable storage medium according to an embodiment of the present application, which stores a computer program, the program being executed by a processor to implement the control method of the smart electric sun-shading system based on the DMS camera.

[0060] The computer readable storage medium according to an embodiment of the present application can adopt any combination of one or more computer readable media. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any suitable combination of the above. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In an embodiment of the present application, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus or device.

[0061] The computer readable signal medium can include a data signal conveyed in a baseband or as part of a carrier wave transporting the computer readable program code. Such a data signal can take any of a variety of forms, including but not limited to electro-magnetic, optical, or any suitable combination thereof. The computer readable signal medium can be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate or transport program for use by or in connection with an instruction execution system, apparatus, or device.

[0062] Program code contained on a computer readable medium can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the above.

[0063] It should be understood that parts of the present application can be implemented in hardware, software, firmware or combinations thereof. In the above embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, and as in another embodiment, any one or combination of the following technologies known in the art can be used: discrete logic circuitry having logic gates for implementing logic functions on data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

[0064] In the description of the specification, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the specification, the exemplary description of the above terms does not necessarily mean the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0065] The embodiments of the present application are described above in detail with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the spirit of the present application.

Claims

1. A DMS camera-based intelligent electric sunshade system, characterized in that, The application relates to a smart electric sunshade system based on a DMS camera, which comprises the following components: a camera arranged in front of a driver in a vehicle for capturing image data containing the driver's eyes and face in real time; a processing unit in communication connection with the camera and configured to: receive the image data; calculate, based on the image data, an irradiation parameter of incident strong light on the driver's eye area, the irradiation parameter comprising an irradiation position and / or an irradiation angle; generate a corresponding sunshade control signal based on the irradiation parameter; a sunshade component; an electric sunshade actuator in communication connection with the processing unit and configured to receive the sunshade control signal and drive the sunshade component to perform local shielding to eliminate or weaken the interference of the incident strong light on the driver's line of sight.

2. The intelligent motorized shading system of claim 1, wherein, When calculating the irradiation parameter, the processing unit is further configured to: deduce the path of incident light and the position of a light source by analyzing at least one of the pupil position in the driver's eye image, the brightness distribution and pixel value change around the pupil, the shadow area formed by the eye socket contour and the highlight reflection point on the iris through a preset algorithm.

3. The intelligent motorized shading system of claim 1, wherein, The processing unit is further configured to: when a local area of the eyeball detected based on the image data has a high-brightness and high-contrast light spot and the position of the light spot is relatively fixed relative to the eyeball, preliminarily determine that a "sunlight direct glare event" exists; and / or judge whether sunlight direct incidence exists in combination with the vehicle turning signal and GPS position information; when it is judged that sunlight direct incidence exists, control the generation of the sunshade control signal.

4. The intelligent power shading system of claim 1, wherein, The smart electric sunshade system further comprises an ambient light sensor in communication connection with the processing unit; and the processing unit is further configured to: comprehensively judge whether the incident strong light is from sunlight direct incidence or an opposite vehicle high beam in combination with the ambient light sensor data and the image data of the camera, and adjust the response strategy of the sunshade control signal accordingly.

5. The intelligent power shading system of claim 1, wherein, The processing unit is further configured to: based on a pre-stored geometric optical model with a geometric mapping relationship, map the spatial coordinates of the eye and the direction of the light source into a rotation angle of the sunshade component in real time, and generate a corresponding sunshade control signal according to the rotation angle of the sunshade component.

6. The intelligent power shading system of claim 1, wherein, The smart electric sunshade system further comprises an angle sensor for acquiring the rotation angle of the sunshade component, and the processing unit is further configured to: acquire the rotation angle of the angle sensor; judge whether the sunshade component performs a shielding action based on the acquired rotation angle; when it is judged that the sunshade component performs a shielding action, continuously monitor the brightness value of the eye area; when the brightness value of the eye area is below a preset brightness threshold for a preset time and it is judged based on vehicle motion state data that the vehicle has left the driving scene causing glare, automatically generate a sunshade plate retracting instruction signal and control the sunshade component to retract.

7. A control method of a DMS camera-based intelligent electric sunshade system, characterized in that, The application relates to a control method applied to the smart electric sunshade system based on a DMS camera according to any one of claims 1 to 6, and the control method comprises the following steps: acquiring image data of a driver's eyes and face captured by a camera; determining an irradiation parameter of incident strong light on the driver's eye area based on the image data of the driver's eyes and face; generating a sunshade control signal based on at least the irradiation parameter; According to the sunshade control signal, an electric sunshade actuator is controlled to perform a local shielding action.

8. The control method according to claim 7, characterized by, The determination of the irradiation parameter of the incident strong light on the eye region of the driver includes: Identifying eye feature points of the image data; Analyzing the highlight area, shadow distribution and eye three-dimensional coordinates in the eye feature points; Based on the highlight area, shadow distribution and eye three-dimensional coordinates, the direction and angle of the incident light are back calculated.

9. The control method according to claim 7, characterized by, The generation of the sunshade control signal based on at least the irradiation parameter includes: Based on a pre-stored geometric optical model with a geometric mapping relationship, the spatial coordinates of the eye and the direction of the incident strong light are mapped into a unique sunshade component rotation angle, and a corresponding sunshade control signal is generated according to the sunshade component rotation angle.

10. The control method according to claim 7, characterized by, The intelligent electric sunshade system further includes an angle sensor for acquiring the rotation angle of the sunshade component. The control method further includes: Acquiring the rotation angle of the angle sensor; Judging whether the sunshade component performs a shielding action based on the acquired rotation angle; When it is judged that the sunshade component performs a shielding action, the eye region brightness value monitored by the camera is continuously acquired, and vehicle motion state data is acquired; When it is monitored that the eye region brightness value is continuously lower than a preset brightness threshold for a preset time, and the glare threat is judged to be removed in combination with the vehicle motion state, a sunshade component retracting control signal is generated and executed.

Images