Sunshade processing method and device, electronic equipment and storage medium

Abstract

The invention provides a shading processing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a face image of a driver, and carrying out the recognition of the face image, and obtaining a recognition result; if the recognition result indicates that the driver does not wear the sunglasses, determining eye positions of the driver according to the face image; acquiring an irradiation angle of sunlight to the driver, and determining a target position according to the irradiation angle and the human eye position; and controlling the sunshade device according to the target position so as to enable the target position of the sunshade device to shade the driver. According to the method and the device, the target position of the projection position corresponding to the light of the sunlight irradiating the eyes of the driver on the sunshade device of the vehicle can be controlled, meanwhile, the sunshade effect on the driver and the clear view of the driver are guaranteed, and then the driving safety is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and more specifically, to a sunshade processing method, device, electronic device and storage medium. Background Art

[0002] With the development of vehicle technology, the sun visor applied to vehicles can effectively prevent the sun from interfering with driving judgment and reduce traffic accidents by adjusting the sun's exposure to the eyes. However, the sun visor itself will block the driver's vision and require the driver to adjust it manually, which may cause traffic accidents during driving. How to shade the driver while ensuring a clear field of vision has become a problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, the embodiments of the present application propose a sunshade processing method, device, electronic device and storage medium to improve the above-mentioned problems.

[0004] According to the first aspect of an embodiment of the present application, a method for determining the posture of a vehicle is provided, the method comprising: obtaining a facial image of a driver, and identifying the facial image to obtain a recognition result; if the recognition result indicates that the driver is not wearing sunglasses, determining the eye position of the driver based on the facial image; obtaining the angle of sunlight irradiation on the driver, and determining a target position based on the angle of sunlight irradiation and the eye position, wherein the target position is a projection position corresponding to the light of sunlight irradiating the driver's eyes on a sunshade device of the vehicle; and controlling the sunshade device based on the target position so that the target position of the sunshade device shades the driver.

[0005] According to a second aspect of an embodiment of the present application, a sunshade processing device is provided, the device comprising: a recognition module, used to obtain a facial image of a driver, and recognize the facial image to obtain a recognition result; an eye position determination module, used to determine the eye position of the driver according to the facial image if the recognition result indicates that the driver is not wearing sunglasses; a target position determination module, used to obtain the irradiation angle of sunlight on the driver, and determine the target position according to the irradiation angle and the eye position, wherein the target position is the projection position corresponding to the light of sunlight irradiating the driver's eyes on the vehicle's sunshade device; a sunshade processing module, used to control the sunshade device according to the target position, so that the target position of the sunshade device shades the driver.

[0006] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising: a processor; a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the sunshade processing method as described above is implemented.

[0007] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor, the sunshade processing method as described above is implemented.

[0008] In the scheme of the present application, the recognition result is obtained by recognizing the acquired facial image of the driver. When the recognition result indicates that the driver is not wearing sunglasses, the position of the driver's eyes is determined based on the facial image, so that the target position of the projection position corresponding to the light of the sunlight irradiating the driver's eyes on the vehicle's sunshade device can be determined based on the acquired sunlight irradiation angle and eye position, so that the sunshade device can be controlled according to the target position to achieve sunshade for the driver through the target position. In the scheme of the present application, automatic sunshade is performed by controlling the target position of the projection position corresponding to the light of the sunlight irradiating the driver's eyes on the vehicle's sunshade device, while ensuring the sunshade effect on the driver and the clarity of the driver's field of vision, thereby ensuring driving safety.

[0009] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0011] Figure 1 It is a flow chart of a sunshade treatment method according to an embodiment of the present application.

[0012] Figure 2 It is a flow chart of a sunshade treatment method according to another embodiment of the present application.

[0013] Figure 3 It is a schematic diagram of the angle between the human eye and the sunshade device according to an embodiment of the present application.

[0014] Figure 4 It is a flow chart of a sunshade treatment method according to another embodiment of the present application.

[0015] Figure 5 It is a flow chart of a sunshade treatment method according to another embodiment of the present application.

[0016] Figure 6 It is a flow chart of a sunshade treatment method according to another embodiment of the present application.

[0017] Figure 7 It is a block diagram of a sunshade processing device according to an embodiment of the present application.

[0018] Figure 8 It is a hardware structure diagram of an electronic device according to an embodiment of the present application.

[0019] The above-mentioned drawings have shown clear embodiments of the present invention, which will be described in more detail hereinafter. These drawings and textual descriptions are not intended to limit the scope of the present invention in any way, but to illustrate the concept of the present invention to computer technicians in this field through specific embodiments. DETAILED DESCRIPTION

[0020] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0021] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0022] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the present application.

[0023] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices. The flowcharts shown in the accompanying drawings are merely exemplary and do not necessarily include all the contents and operations / steps, nor do they necessarily have to be executed in the order described. For example, some operations / steps may be further decomposed, while some operations / steps may be combined or partially combined, so the actual execution order may change according to the actual situation.

[0024] See also Figure 1 , Figure 1 The sunshade processing method provided by an embodiment of the present application is shown. In a specific embodiment, the sunshade processing method can be applied to Figure 7 The sunshade processing device 600 and the electronic device 700 equipped with the sunshade processing device 600 ( Figure 8 ). The specific process of this embodiment will be described below. Of course, it can be understood that the method can be executed by a cloud server with computing processing capabilities. Figure 1 The process shown is described in detail, and the sunshade treatment method may specifically include the following steps:

[0025] Step 110, obtaining a facial image of the driver, and identifying the facial image to obtain a recognition result.

[0026] As a method, the driver's facial image can be collected by the vehicle's onboard camera, which can be a driving recorder. Optionally, the facial image can be recognized by a facial recognition model to obtain a recognition result. The facial recognition model can be composed of a recurrent neural network, a convolutional neural network, a short-term memory neural network, etc., and the structure of the facial recognition model can be set according to actual needs, which is not specifically limited here.

[0027] Optionally, the recognition result may be the result of whether the driver is wearing sunglasses, and may also include the driver's facial parameters, which may be used to determine whether the corresponding driver's facial parameters are stored. If the recognition result indicates that the corresponding facial parameters are stored, the driver's eye position information can be directly obtained.

[0028] Step 120: If the recognition result indicates that the driver is not wearing sunglasses, determine the eye position of the driver based on the facial image.

[0029] As a method, when it is determined based on the recognition result that the driver is not wearing sunglasses, it can be determined that the sunshade device of the vehicle can be adjusted at present. Optionally, the driver's gaze point and gaze line are determined in the face image based on eye tracking technology. For example, by performing image processing technology on the face image, the driver's pupil position is located to obtain the coordinates of the driver's eyes in the image, and the position of the driver's eyes in the vehicle coordinate system is determined through the conversion relationship between the image coordinate system, the camera coordinate system (i.e., the image acquisition device) and the vehicle coordinate system.

[0030] Step 130, obtaining the angle of sunlight irradiating the driver, and determining a target position according to the irradiation angle and the eye position, wherein the target position is a projection position corresponding to the light of sunlight irradiating the driver's eyes on the vehicle's sunshade device.

[0031] As a method, after determining the position of the driver's eyes, in order to accurately shade the driver's eyes, the area where the eyes are located can be projected onto the vehicle's sunshade device based on the position of the eyes in the vehicle coordinate system and the angle of the eyes' light on the driver, so as to determine the target position. Optionally, different angles of sunlight on the driver result in different projection positions, so a photosensor can be set on the vehicle, and the angle of sunlight on the driver can be obtained through the photosensor. Optionally, the photosensor can be set on the vehicle's driving recorder or at other locations on the vehicle, which is not specifically limited here.

[0032] Step 140: Control the sunshade device according to the target position so that the target position of the sunshade device provides sunshade for the driver.

[0033] As a method, after the target position is determined, the pixels of the target position of the sunshade device can be adjusted so that the target position of the sunshade device can be adjusted to achieve a sunshade effect on the driver's eye position.

[0034] Optionally, after determining the target position, the liquid crystal panel driving circuit of the sunshade device can be controlled according to the target position, driving the pixels of the liquid crystal panel of the sunshade device in the area corresponding to the target position to be energized, making the area dark and opaque, just blocking the human eyes from being exposed to sunlight; while all other areas of the liquid crystal panel of the sunshade device are still in a light-transmitting state because they are not energized, and do not affect the driver's line of sight.

[0035] In an embodiment of the present application, a recognition result is obtained by recognizing the acquired facial image of the driver. When the recognition result indicates that the driver is not wearing sunglasses, the position of the driver's eyes is determined based on the facial image, so that the target position of the projection position corresponding to the light of the sunlight irradiating the driver's eyes on the vehicle's sunshade device can be determined based on the acquired sunlight irradiation angle and eye position, so that the sunshade device can be controlled according to the target position to achieve sunshade for the driver through the target position. In the scheme of the present application, automatic sunshade is performed by controlling the target position of the projection position corresponding to the light of the sunlight irradiating the driver's eyes on the vehicle's sunshade device, while ensuring the sunshade effect on the driver and the clarity of the driver's field of vision, thereby ensuring driving safety.

[0036] See also Figure 2 , Figure 2 The sunshade processing method provided by an embodiment of the present application is shown. Figure 2 The process shown is described in detail, and the sunshade treatment method may specifically include the following steps:

[0037] Step 210, obtaining a facial image of the driver, and recognizing the facial image to obtain a recognition result.

[0038] Step 220: If the recognition result indicates that the driver is not wearing sunglasses, determine the eye position of the driver based on the facial image.

[0039] Step 230, obtaining the angle of sunlight shining on the driver and determining the distance from the sunshade device to the human eye.

[0040] As a method, the distance from the sun shading device to the human eye can be the vertical distance between the sun shading device and the horizontal line corresponding to the center of the pupil of the human eye, or it can be the vertical distance between the sun shading device and the center of both eyes of the human eye, and then based on the vertical distance and the angle of sunlight on the driver, the target position of the human eye in the sun shading device can be determined.

[0041] Step 240: Determine the target coordinate value of the driver's eye in the coordinate system corresponding to the sunshade device according to the illumination angle, the distance and the eye position.

[0042] As a method, after determining the angle of sunlight on the driver, the distance from the sunshade device to the human eye, and the position of the driver's human eye, the target coordinate value of the human eye at the coordinate corresponding to the sunshade device can be determined based on the two-dimensional coordinate information of the human eye in the image and the conversion relationship between the image coordinate system and the camera coordinate system (image acquisition device). Optionally, the conversion relationship between the image coordinate system and the camera coordinate system can be calibrated before the vehicle leaves the factory, and the calibration information of the image acquisition device can be directly obtained to determine the conversion relationship between the image coordinate system and the camera coordinate system, and then the target coordinate value of the human eye at the coordinate corresponding to the sunshade device can be determined based on the relative position relationship between the sunshade device and the image acquisition device.

[0043] As another method, the position of the human eye corresponding to the sunlight and the face image can be determined according to the illumination angle, and the angle between the sunlight illumination angle and the horizontal viewing angle of the human eye and the angle between the sunlight illumination angle and the vertical viewing angle of the human eye can be determined, such as Figure 3 As shown, based on the formula To determine the target coordinate value of the driver's eyes in the coordinate system corresponding to the sunshade device, where (x, y, z) is the target coordinate value of the driver's eyes in the coordinate system corresponding to the sunshade device, d p is the distance from the sunshade to the human eye, θ is the angle between the sunlight irradiation angle and the horizontal viewing angle of the human eye determined by the position of the human eye corresponding to the sunlight and the face image; β is the angle between the sunlight irradiation angle and the vertical viewing angle of the human eye.

[0044] Step 250: Determine the target position corresponding to the target coordinate value based on a first mapping relationship, wherein the first mapping relationship includes a correspondence between a plurality of coordinate values ​​and a plurality of positions on the sunshade device.

[0045] As a method, the user can pre-set the position information of the sunshade area corresponding to the sunshade device of different human eye coordinates based on the actual experience in the cab, so as to generate a first mapping relationship including the correspondence between the coordinate values ​​of different human eyes at multiple positions on the sunshade device. Optionally, the first mapping relationship can be expressed in a mapping table, in which, as shown in Table 1, Dp is the distance from the sunshade device to the human eye in the first mapping relationship, θ is the angle between the sunlight irradiation angle and the horizontal viewing angle of the human eye determined by the human eye position corresponding to the sunlight and the face image; β is the angle between the sunlight irradiation angle and the vertical viewing angle of the human eye, M is the horizontal coordinate area of ​​the target position of the sunshade device, and N is the vertical coordinate area of ​​the target position of the sunshade device, wherein the sunshade coordinate system corresponding to the sunshade device takes the center of the sunshade device as the origin, and the vehicle travel direction is the coordinate system corresponding to the positive direction of the y-axis.

[0046] Table 1 Correspondence between multiple coordinate values ​​and multiple positions on the sunshade device

[0047] Dp θ β M N X1 Y1 Z1 M1 N1 X2 Y2 Z2 M2 N2 …… …… …… …… …… Xn Y Zn Mn N

[0048] Step 260: Control the sunshade device according to the target position so that the target position of the sunshade device provides sunshade for the driver.

[0049] The specific step descriptions of steps 210 to 220 and step 260 may refer to steps 110 to 120 and step 140, which will not be repeated here.

[0050] In this embodiment, the distance from the sunshade device to the human eye is first determined, and then the target coordinate value of the driver's eye in the coordinate system corresponding to the sunshade device is determined according to the acquired sunlight irradiation angle on the driver, the distance from the sunshade device to the human eye and the position of the human eye. In this way, the target position on the sunshade device can be determined according to the target coordinate value and the first mapping relationship, thereby ensuring that the sunshade device can be used to shade the driver at the target position, thereby ensuring the accuracy of shading the driver and driving safety.

[0051] See also Figure 4 , Figure 4 The sunshade processing method provided by an embodiment of the present application is shown. Figure 4 The process shown is described in detail. In this embodiment, the sunshade device includes a liquid crystal panel, and the sunshade processing method may specifically include the following steps:

[0052] Step 310, obtaining a facial image of the driver, and recognizing the facial image to obtain a recognition result.

[0053] Step 320: If the recognition result indicates that the driver is not wearing sunglasses, determine the eye position of the driver based on the facial image.

[0054] Step 330, obtaining the angle of sunlight irradiating the driver, and determining a target position based on the angle of sunlight irradiating the driver's eyes, wherein the target position is a projection position corresponding to the light of sunlight irradiating the driver's eyes on the vehicle's sunshade device.

[0055] The specific step descriptions of step 310 to step 330 may refer to steps 110 to 130 and will not be repeated here.

[0056] Step 340 , obtaining a first target light shielding intensity, and determining a target brightness value corresponding to the target position of the liquid crystal panel according to the first target light shielding intensity.

[0057] As a method, the first target shading intensity can be a shading intensity set by the user. Since different people's eyes and the sunlight intensity at different times have different shading intensity requirements, the user can set a suitable shading intensity. Optionally, different shading intensities correspond to different brightness values ​​on the liquid crystal panel. The higher the shading intensity, the lower the corresponding brightness value.

[0058] Step 350: adjusting the brightness of the target position according to the target brightness value so that the target position provides shade for the driver.

[0059] As a method, after determining the target brightness value, the transmittance of the liquid crystal panel is determined according to the target brightness value, so that the pixels of the target position of the liquid crystal panel can be adjusted according to the transmittance, so that the target position becomes opaque, and its opacity corresponds to the target brightness value, so that the driver's eyes can be shaded by the opaque target position, and the other positions of the liquid crystal panel except the target position remain transparent, ensuring the clarity of the driver's vision.

[0060] In some embodiments, before step 340, the method also includes: obtaining a current sunlight intensity value; determining a target illumination intensity interval corresponding to the current sunlight intensity value based on a second mapping relationship, wherein the second mapping relationship includes a correspondence between multiple sunlight intensity values ​​and multiple illumination intensity intervals; and determining a first target shading intensity corresponding to the target illumination intensity interval.

[0061] As a method, different illumination intensity intervals can be set in advance according to different sunlight intensities to obtain a second mapping relationship. In addition, in the second mapping relationship, different illumination intensity intervals have corresponding shading intensities, which makes it easier to determine the corresponding first target shading intensity based on the current sunlight intensity value.

[0062] Optionally, the thresholds of different illumination intensity intervals are continuous, for example, the maximum value of the first illumination intensity interval is the minimum value of the second illumination intensity interval, thereby ensuring the accuracy of adjusting the liquid crystal panel according to the first target shading intensity.

[0063] Optionally, the second mapping relationship can be in the form of a mapping table, and the mapping table includes different illumination intensity values, different illumination intensity intervals and shading intensities, as shown in Table 2, L is the illumination intensity value, Lx is the minimum value corresponding to the illumination intensity value interval, Ly is the maximum value corresponding to the illumination intensity value interval, and O is the shading intensity.

[0064] Table 2 Correspondence between multiple sunlight intensity values ​​and multiple sunlight intensity intervals

[0065]

[0066] In this embodiment, the target brightness value of the LCD panel is determined according to the acquired first target shading intensity, so that the brightness value of the target position of the LCD panel can be adjusted according to the determined target brightness value, so that the driver is shaded according to the target position after the brightness value is adjusted, thereby ensuring shading for the driver and improving driving convenience.

[0067] See also Figure 5 , Figure 5 The sunshade processing method provided by an embodiment of the present application is shown. Figure 5 The process shown is described in detail. In this embodiment, the sunshade device includes a plurality of sunshade panels with adjustable angles. The sunshade processing method may specifically include the following steps:

[0068] Step 410, obtaining a facial image of the driver, and recognizing the facial image to obtain a recognition result.

[0069] Step 420: If the recognition result indicates that the driver is not wearing sunglasses, determine the eye position of the driver based on the facial image.

[0070] Step 430, obtaining the angle of sunlight irradiating the driver, and determining a target position based on the angle of sunlight irradiating the driver's eyes, wherein the target position is a projection position corresponding to the light of sunlight irradiating the driver's eyes on the vehicle's sunshade device.

[0071] The specific step descriptions of step 410 to step 430 may refer to steps 110 to 130 and will not be repeated here.

[0072] Step 440, obtaining a second target shading intensity.

[0073] As a method, the second target shading intensity can be a shading intensity customized by the user, which is different from the shading intensity requirements of different people's eyes and the sunlight intensity at different times. Therefore, the user can customize the appropriate shading intensity.

[0074] Optionally, different shading intensities correspond to different angle values ​​at target positions on the liquid crystal panel. The higher the shading intensity, the larger the corresponding angle value, and the larger the corresponding position on the driver's face that can be shaded.

[0075] Step 450: Determine the angle to be adjusted of at least one of the sunshade panels corresponding to the target position according to the second target shading intensity.

[0076] As a method, since the sunshade panel can change the size of the position where it can provide shade by adjusting the angle, after determining the second target shading intensity, the angle to be adjusted of the sunshade panel can be determined according to the first target shading intensity.

[0077] Optionally, the target angle of at least one sunshade panel corresponding to the target position can be determined based on the second target shading intensity, and then the current angle of the sunshade panel can be obtained, and the target angle can be subtracted from the current angle to obtain the angle to be adjusted of at least one sunshade panel corresponding to the target position.

[0078] As another method, a target sunshade area of ​​the face set by the user may be obtained, and then the angle to be adjusted of at least one sunshade panel at the target position is determined according to the target sunshade area of ​​the face.

[0079] Step 460: Adjust at least one of the sunshade panels corresponding to the target position according to the angle to be adjusted, so that the at least one sunshade panel corresponding to the target position provides sunshade for the driver.

[0080] As a method, after determining the angle to be adjusted, the driving voltage of at least one sunshade panel at the target position is determined according to the angle to be adjusted to adjust the angle of at least one sunshade panel at the target position, so that at least one sunshade panel corresponding to the target position provides shade for the driver.

[0081] As another way, after determining the second target shading intensity, the driving voltage of at least one sunshade panel at the target position can be determined according to the second target shading intensity, so that the driving circuit can be controlled according to the driving voltage to adjust the at least one sunshade panel corresponding to the target position. If the second target shading intensity is smaller, the corresponding driving voltage is also smaller, so that the deflection angle of at least one sunshade panel at the target position is also smaller.

[0082] In this embodiment, the angle to be adjusted of at least one sunshade panel at the target position is determined according to the acquired second target shading intensity, so that the angle of at least one sunshade panel at the target position can be adjusted according to the determined angle to be adjusted, so that the driver is shaded according to the target position after the adjustment, thereby ensuring sunshade for the driver and improving driving convenience.

[0083] See also Figure 6 , Figure 6 The sunshade processing method provided by an embodiment of the present application is shown. Figure 6 The process shown is described in detail. In this embodiment, the sunshade device includes a liquid crystal dimming film, and the liquid crystal dimming film is adhered to the windshield of the vehicle. The sunshade processing method may specifically include the following steps:

[0084] Step 510, obtaining a facial image of the driver, and identifying the facial image to obtain a recognition result.

[0085] Step 520: If the recognition result indicates that the driver is not wearing sunglasses, determine the eye position of the driver based on the facial image.

[0086] Step 530, obtaining the angle of sunlight irradiating the driver, and determining a target position based on the angle of sunlight irradiating the driver's eyes, wherein the target position is a projection position corresponding to the light of sunlight irradiating the driver's eyes on the vehicle's sunshade device.

[0087] The specific step descriptions of step 510 to step 530 may refer to steps 110 to 130 and will not be repeated here.

[0088] Step 540: Obtain a third target shading intensity, and determine a target brightness value according to the third target shading intensity.

[0089] As a method, the third target shading intensity can be a shading intensity set by the user. Since different people's eyes and the sunlight intensity at different times have different shading intensity requirements, the user can set a suitable shading intensity. Optionally, different shading intensities correspond to different brightness values ​​on the liquid crystal panel. The higher the shading intensity, the lower the corresponding brightness value.

[0090] Step 550: adjusting the brightness value corresponding to the target position of the liquid crystal dimming film to the target brightness value, so that the target position can shade the driver.

[0091] As a method, after determining the target brightness value, the transmittance of the liquid crystal dimming film is determined according to the target brightness value, so that the pixels of the target position of the liquid crystal dimming film can be adjusted according to the transmittance, so that the target position becomes opaque, and its opacity corresponds to the target brightness value, so that the driver's eyes can be shaded by the opaque target position, and the liquid crystal dimming film remains transparent at other positions except the target position, ensuring the clarity of the driver's vision.

[0092] In this embodiment, the target brightness value of the liquid crystal dimming film is determined according to the obtained third target shading intensity, so that the brightness value of the target position of the liquid crystal dimming film can be adjusted according to the determined target brightness value, so that the driver can be shaded according to the target position after the brightness value is adjusted, thereby ensuring sunshade for the driver and improving driving convenience.

[0093] In some embodiments, after 510, the method further includes: if the recognition result indicates that the driver is wearing sunglasses, determining that the sunshade device is in a semi-sunshade mode; obtaining sunshade parameters of the sunshade device in the semi-sunshade mode, and adjusting the sunshade device according to the sunshade parameters, so that the sunshade device shades the driver based on the sunshade parameters.

[0094] As a way, since the driver's face needs to be shaded even when wearing sunglasses to improve the driver's driving experience, a semi-sunshading mode can be pre-set for the sunshade device. In the semi-sunshading mode, the sunshade parameters of the sunshade device can be adjusted so that the sunshade device can partially absorb or reflect sunlight, thereby reducing the light in the cab and achieving a semi-sunshading effect.

[0095] Optionally, when it is determined that the sunshade device is in the semi-sunshade mode, it can be determined first whether the sunshade parameters for the semi-sunshade mode are stored locally. The sunshade parameters can be sunshade parameters customized by the user. If it is determined that the sunshade parameters for the semi-sunshade mode are stored locally, the sunshade parameters can be directly obtained; if it is determined that the sunshade parameters for the semi-sunshade mode are not stored locally, the default sunshade parameters are obtained to adjust the sunshade device according to the default sunshade parameters.

[0096] Optionally, when it is determined that there is no shading parameter in the semi-shading mode stored locally, a prompt message may be generated, and the user may be prompted whether to use the default shading parameter to adjust the shading device. When the user chooses to use the default shading parameter to adjust the shading device, the shading device is adjusted according to the default shading parameter; if the user chooses not to use the default shading parameter to adjust the shading device, the user is prompted to set the shading parameter. Optionally, the shading parameter may be a brightness value of a liquid crystal panel of the shading device, etc.

[0097] Figure 7 is a block diagram of a sunshade processing device according to an embodiment of the present application, such as Figure 7 As shown, the sunshade processing device 600 includes: an identification module 610 , a human eye position determination module 620 , a target position determination module 630 and a sunshade processing module 660 .

[0098] The recognition module 610 obtains the driver's facial image and recognizes the facial image to obtain a recognition result; the eye position determination module 620 determines the driver's eye position based on the facial image if the recognition result indicates that the driver is not wearing sunglasses; the target position determination module 630 obtains the angle of sunlight irradiation on the driver, and determines the target position based on the irradiation angle and the eye position, wherein the target position is the corresponding projection position of the sunlight irradiating the driver's eyes on the vehicle's sunshade device; the sunshade processing module 640 controls the sunshade device according to the target position so that the target position of the sunshade device shades the driver.

[0099] In some embodiments, the target position determination module 630 includes: a distance determination unit, used to obtain the irradiation angle of sunlight on the driver and determine the distance from the sunshade device to the human eye; a target coordinate value determination unit, used to determine the target coordinate value of the driver's human eye in the coordinate system corresponding to the sunshade device according to the irradiation angle, the distance and the human eye position; a target position determination unit, used to determine the target position corresponding to the target coordinate value based on a first mapping relationship, wherein the first mapping relationship includes a correspondence between multiple coordinate values ​​and multiple positions on the sunshade device.

[0100] In some embodiments, the sunshade device includes a liquid crystal panel; the sunshade processing module 660 includes: a target brightness value determination unit, used to obtain a first target shading intensity, and determine the target brightness value corresponding to the target position of the liquid crystal panel according to the first target shading intensity; a first sunshade processing unit, used to adjust the brightness of the target position according to the target brightness value so that the target position shades the driver.

[0101] In some embodiments, the shading processing module 660 also includes: a first acquisition unit, used to obtain the current sunlight intensity value; a target illumination intensity interval determination unit, used to determine the target illumination intensity interval corresponding to the current sunlight intensity value based on a second mapping relationship, wherein the second mapping relationship includes a correspondence between multiple sunlight intensity values ​​and multiple illumination intensity intervals; a first target shading intensity determination unit, used to determine the first target shading intensity corresponding to the target illumination intensity interval.

[0102] In other embodiments, the sunshade device includes a plurality of sunshade panels with adjustable angles, and the sunshade processing module 660 includes: a second acquisition unit, used to acquire a second target shading intensity; an adjusted angle determination unit, used to determine the adjusted angle of at least one of the sunshade panels corresponding to the target position according to the second target shading intensity; and a second sunshade processing submodule, used to adjust at least one of the sunshade panels corresponding to the target position according to the adjusted angle, so that the at least one sunshade panel corresponding to the target position shades the driver.

[0103] In some other embodiments, the sunshade device includes a liquid crystal dimming film, which is adhered to the windshield of the vehicle, and the sunshade processing module 660 includes: a target brightness value determination unit, which is used to obtain a third target shading intensity and determine a target brightness value based on the third target shading intensity; a third sunshade processing sub-module, which is used to adjust the brightness value corresponding to the target position of the liquid crystal dimming film to the target brightness value, so that the target position shades the driver.

[0104] In some embodiments, the sunshade processing device 600 also includes: a determination module, used to determine that the sunshade device is in a semi-sunshade mode if the recognition result indicates that the driver is wearing sunglasses; a sunshade adjustment module, used to obtain sunshade parameters of the sunshade device in the semi-sunshade mode, and adjust the sunshade device according to the sunshade parameters, so that the sunshade device shades the driver based on the sunshade parameters.

[0105] According to one aspect of the embodiments of the present application, an electronic device is also provided, such as Figure 8 As shown, the vehicle 700 includes a processor 710 and one or more memories 720. The one or more memories 720 are used to store program instructions executed by the processor 710. When the processor 710 executes the program instructions, the above-mentioned sunshade processing method is implemented.

[0106] Furthermore, the processor 710 may include one or more processing cores. The processor 710 runs or executes instructions, programs, code sets or instruction sets stored in the memory 720, and calls data stored in the memory 720. Optionally, the processor 710 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 710 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor, but may be implemented separately through a communication chip.

[0107] According to one aspect of the present application, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments; or may exist independently without being assembled into the electronic device. The above computer-readable storage medium carries computer-readable instructions, and when the computer-readable storage instructions are executed by a processor, the method in any of the above embodiments is implemented.

[0108] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0109] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0110] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0111] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0112] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A sunshade treatment method, characterized in that: The method comprises: Acquire a facial image of the driver, and recognize the facial image to obtain a recognition result; If the recognition result indicates that the driver is not wearing sunglasses, determining the eye position of the driver according to the facial image; Obtaining the irradiation angle of sunlight on the driver, and determining a target position according to the irradiation angle and the position of the human eye, wherein the target position is a projection position corresponding to the light of sunlight irradiating the human eye of the driver on the sunshade device of the vehicle; The sunshade device is controlled according to the target position so that the target position of the sunshade device provides sunshade for the driver.

2. The method according to claim 1, characterized in that The obtaining of the irradiation angle of sunlight on the driver and determining the target position according to the irradiation angle and the position of the human eye include: Obtaining the angle of sunlight shining on the driver and determining the distance from the sunshade device to the human eye; Determine the target coordinate value of the driver's eye in the coordinate system corresponding to the sunshade device according to the illumination angle, the distance and the eye position; Based on a first mapping relationship, a target position corresponding to the target coordinate value is determined, wherein the first mapping relationship includes a correspondence between a plurality of coordinate values ​​and a plurality of positions on the sunshade device.

3. The method according to claim 1, characterized in that The sunshade device includes a liquid crystal panel; and the sunshade device is controlled according to the target position so that the target position of the sunshade device shades the driver, including: Acquiring a first target shading intensity, and determining a target brightness value corresponding to the target position of the liquid crystal panel according to the first target shading intensity; The brightness of the target position is adjusted according to the target brightness value so that the target position provides shade for the driver.

4. The method according to claim 3, characterized in that Before obtaining the first target shading intensity and determining the target brightness value corresponding to the target position of the liquid crystal panel according to the target shading intensity, the method includes: Get the current sunlight intensity value; Based on a second mapping relationship, determining a target illumination intensity interval corresponding to the current sunlight illumination intensity value, wherein the second mapping relationship includes a correspondence relationship between a plurality of sunlight illumination intensity values ​​and a plurality of illumination intensity intervals; A first target shading intensity corresponding to the target illumination intensity interval is determined.

5. The method according to claim 1, characterized in that The sunshade device comprises a plurality of sunshade panels with adjustable angles, and the sunshade device is controlled according to the target position so that the target position of the sunshade device shades the driver, including: Obtaining a second target shading intensity; Determining, according to the second target shading intensity, an angle to be adjusted of at least one of the sunshade panels corresponding to the target position; At least one of the sunshade panels corresponding to the target position is adjusted according to the angle to be adjusted, so that the at least one sunshade panel corresponding to the target position provides sunshade for the driver.

6. The method according to claim 1, characterized in that The sunshade device includes a liquid crystal dimming film, and the liquid crystal dimming film is adhered to the windshield of the vehicle. The sunshade device is controlled according to the target position so that the target position of the sunshade device shades the driver, including: Acquire a third target shading intensity, and determine a target brightness value according to the third target shading intensity; The brightness value corresponding to the target position of the liquid crystal dimming film is adjusted to the target brightness value, so that the target position can shade the driver.

7. The method according to any one of claims 1 to 6, characterized in that: After acquiring the driver's facial image and identifying the facial image to obtain the identification result, the method further includes: If the recognition result indicates that the driver is wearing sunglasses, determining that the sunshade device is in a semi-sunshade mode; The sunshade device is in a semi-sunshade mode and has sunshade parameters obtained, and the sunshade device is adjusted according to the sunshade parameters, so that the sunshade device shades the driver based on the sunshade parameters.

8. A sunshade treatment device, characterized in that: The device comprises: The recognition module is used to obtain the driver's facial image and recognize the facial image to obtain a recognition result; an eye position determination module, configured to determine the eye position of the driver according to the face image if the recognition result indicates that the driver is not wearing sunglasses; A target position determination module, used to obtain the irradiation angle of sunlight on the driver, and determine the target position according to the irradiation angle and the human eye position, wherein the target position is the corresponding projection position of the light of sunlight irradiating the human eye of the driver on the sunshade device of the vehicle; The sunshade processing module is used to control the sunshade device according to the target position so that the target position of the sunshade device can shade the driver.

9. An electronic device, characterized in that: The electronic device comprises: processor; A memory having computer-readable instructions stored thereon, wherein when the computer-readable instructions are executed by the processor, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 7.

Images