Sun visor system, control method, electronic apparatus, vehicle, and storage medium

Abstract

A sun visor system (100), which is used for a vehicle (1000). The sun visor system (100) comprises: a sun visor (10), a projection device (20) and a controller (30), wherein the projection device (20) is arranged on the sun visor (10); and the controller (30) is configured to recognize the positions of eyeballs on the basis of a facial image and adjust the position of the sun visor on the basis of the positions of the eyeballs, so that the projection device projects an image to a field-of-view area of the eyeballs.

Description

Sun visor system, control method, electronic device, vehicle, and storage medium

[0001] Priority information

[0002] This application claims priority and benefits of patent application No. 2024101552169 filed with the State Intellectual Property Office of China on January 31, 2024, and the entire text of which is incorporated herein by reference. Technical Field

[0003] The present application relates to the field of sun visors, and in particular to a sun visor system, a control method, an electronic device, a vehicle, and a storage medium. Background Art

[0004] In the related art, a projection device can be provided on the sun visor of a vehicle to increase the function of the sun visor. When the vehicle is stopped, the projection device can project an image to the eyes, that is, the movie can be viewed through the sun visor, and the sun visor has an added entertainment function.

[0005] However, the posture may change during viewing, causing the position of the image projected by the projection device to deviate from the field of view of the eyeball, resulting in a poor viewing experience. Summary of the Invention

[0006] This application aims to address at least one of the technical problems existing in the prior art. To this end, this application provides a sun visor system comprising a sun visor, a projection device, and a controller. The projection device is disposed on the sun visor. The controller is configured to identify the position of an eyeball based on a facial image and adjust the position of the sun visor based on the eyeball position so that the projection device projects an image into the eyeball's field of view.

[0007] Thus, in the sun visor system provided in the embodiments of the present application, the controller can adjust the position of the sun visor according to the position of the eyeball, so that the projection device disposed on the sun visor projects the image into the field of view of the eyeball. Even if the posture changes during viewing, the projection device can still project the image directly into the field of view of the eyeball, thereby improving the viewing experience.

[0008] In some embodiments, the sun visor system includes a camera. The sun visor system includes a camera, and the camera is configured to obtain the face image.

[0009] In some embodiments, the controller is configured to control the adjustment direction of the sun visor according to the movement direction of the position of the eyeball.

[0010] In some embodiments, the controller is specifically configured to: control the sun visor to swing along the front and rear directions of the vehicle according to the up and down movement of the position of the eyeball; and / or control the sun visor to swing along the left and right directions of the vehicle according to the left and right movement of the position of the eyeball.

[0011] In this way, when the head is raised or lowered, the position of the eyeball changes. The controller can determine the head-up action based on the recognized eyeball position, and further determine the up and down movement of the eyeball position. Based on the head-up action, the controller controls the sun visor to swing in the front-to-back direction of the vehicle, so that the projection device installed on the sun visor projects the image into the field of view area of ​​the eyeball.

[0012] When the head is turned left or right, the position of the eyeball changes. The controller can determine the left-right movement of the eyeball based on the recognized eyeball position and control the sun visor to swing in the left-right direction of the vehicle so that the projection device disposed on the sun visor projects an image into the field of view of the eyeball.

[0013] In some embodiments, the controller is further configured to recognize eye movements based on the facial image, and control the projection device to turn on or off based on the eye movements.

[0014] In this way, the projection device can be turned on or off by eye movements without manual operation, which increases the convenience of operation.

[0015] In some embodiments, the sun visor system includes a drive motor, and the controller is configured to control the drive motor to adjust the position of the sun visor according to the position of the eyeball.

[0016] In this way, the drive motor can drive the connecting structure provided on the sun visor to move the sun visor, thereby changing the position of the sun visor, so that the projection device provided on the sun visor projects the image to the field of view of the eyeball in real time.

[0017] In some embodiments, the sun visor system includes an optical waveguide module, the projection device is configured to determine a real information image based on an optical signal received by the optical waveguide module, and the projection device is configured to project the real information image.

[0018] In this way, when the projection device enters the working state, the incident light carrying the real information image can enter the optical waveguide module, and the projection device can project the real information image according to the incident light carrying the real information image.

[0019] In some embodiments, the projection device includes an image generation module, the image generation module is configured to generate a virtual image, the image generation module is configured to fuse the real information image and the virtual image to obtain a fused image, and the projection device is configured to project the fused image.

[0020] In this way, the image generation module can generate a virtual image. The image generation module can also generate a corresponding real image based on the optical signal received by the optical waveguide module. The projection device can project the virtual image generated by the image generation module or the generated real image.

[0021] In some embodiments, the sun visor system includes a sun visor, and the projection device further includes an image generation module, wherein the image generation module is configured to generate a virtual image, and when the sun visor isolates the light wave signal received by the optical waveguide module, the projection device is configured to project the virtual image.

[0022] In this way, the light shield can cover the coupling grating of the optical waveguide module, preventing ambient incident light from entering the coupling grating. The image generation module cannot generate a corresponding real information image based on the light wave signal received by the optical waveguide module. In this case, the image projected by the projection device can be a virtual image generated by the image generation module.

[0023] The control method provided in the embodiment of the present application is used for a vehicle, including: identifying the position of the eyeball based on a facial image; adjusting the position of the sun visor of the vehicle according to the position of the eyeball so that the projection device provided on the sun visor projects the image onto the field of view area of ​​the eyeball.

[0024] In some embodiments, adjusting the position of the sun visor according to the position of the eyeball includes: controlling the adjustment direction of the sun visor according to the moving direction of the position of the eyeball.

[0025] In some embodiments, adjusting the position of the sun visor according to the position of the eyeball includes: controlling the sun visor to swing along the front-to-back direction of the vehicle according to the up and down movement of the position of the eyeball; and / or controlling the sun visor to swing along the left-to-right direction of the vehicle according to the left-to-right movement of the position of the eyeball.

[0026] In some embodiments, the control method further includes: recognizing eye movements based on the facial image; and controlling the projection device to turn on or off based on the eye movements.

[0027] The electronic device provided in the embodiments of the present application includes a memory and a processor, wherein the memory is used to store a computer program, and the processor implements the control method of any one of the above embodiments when executing the computer program.

[0028] The vehicle provided in the embodiments of the present application includes the sun visor system or electronic device of any one of the above embodiments.

[0029] The computer-readable storage medium provided in the embodiments of the present application is used to store a computer program, and the computer program implements the control method of any of the above embodiments when executed by a processor.

[0030] The embodiments of the present application provide a sun visor system, a control method, an electronic device, a vehicle, and a storage medium. The vehicle includes a sun visor system. The sun visor system includes a sun visor, a projection device, and a controller. The projection device is disposed on the sun visor. The controller is configured to identify the position of the eyeball based on a facial image and adjust the position of the sun visor based on the position of the eyeball so that the projection device projects the image onto the field of view of the eyeball. The controller can adjust the position of the sun visor based on the position of the eyeball so that the projection device disposed on the sun visor projects the image onto the field of view of the eyeball. Even if the posture changes during viewing, the projection device can project the image directly onto the field of view of the eyeball, thereby improving the viewing experience.

[0031] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0033] FIG1 is a schematic diagram of a sun visor system and a vehicle according to certain embodiments of the present application;

[0034] FIG2 is a schematic structural diagram of a sun visor and a vehicle according to certain embodiments of the present application;

[0035] FIG3 is a flow chart of a control method according to certain embodiments of the present application;

[0036] FIG4 is a schematic diagram of the working process of a projection device according to certain embodiments of the present application;

[0037] FIG5 is a schematic plan view of the structure of a sun visor system according to certain embodiments of the present application;

[0038] FIG6 is a schematic diagram of a projection device according to certain embodiments of the present application.

[0039] Reference numerals: sun visor system 100 , vehicle 1000 , sun visor 10 , projection device 20 , optical waveguide module 21 , image generation module 22 , controller 30 , camera 40 , drive motor 50 . DETAILED DESCRIPTION

[0040] The following describes in detail embodiments of the present application, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0041] In the related art, a projection device can be provided on the sun visor of a vehicle to increase the function of the sun visor. When the vehicle is stopped, the projection device can project an image to the eyes, that is, the movie can be viewed through the sun visor, and the sun visor has an added entertainment function.

[0042] However, the posture may change during viewing, causing the position of the image projected by the projection device to deviate from the field of view of the eyeball, resulting in a poor viewing experience.

[0043] 1 , an embodiment of the present application provides a sun visor system 100 and a vehicle 1000 .

[0044] In certain embodiments, a vehicle 1000 includes a sun visor system 100. The sun visor system 100 includes a sun visor 10, a projection device 20, and a controller 30. The projection device 20 is disposed on the sun visor 10. The controller 30 is configured to identify the position of the eyeballs based on a facial image and adjust the position of the sun visor 10 based on the eyeball position so that the projection device 20 projects an image into the eyeball's field of view.

[0045] The controller 30 can adjust the position of the projection device according to the eye position so that the projection device 10 projects the image into the eye field area. Even if the posture changes during viewing, the projection device 10 can still project the image into the eye field area, improving the viewing experience.

[0046] The eyeball field of view area can be an area within the eyeball's line of sight, for example, an area directly opposite the eyeball's line of sight. When the projection device 10 projects an image, assuming that the projected image is an image set on a plane A, the projection of the eyeball along the line of sight on plane A is the orthographic projection of the eyeball on virtual plane A.

[0047] 2 , the sun visor 10 is disposed on the roof of the vehicle 1000, i.e., above the driver's seat of the vehicle 1000. The sun visor 10 can be used to block light directed toward the driver's eyes, thereby preventing sunlight or light outside the vehicle from irradiating the driver's eyes.

[0048] The sun visor 10 is provided with a projection device 20. When the vehicle 1000 stops, the projection device 20 can project images such as videos and movies to the eyes, that is, the movie can be watched through the sun visor 10, and the sun visor 10 has an entertainment function.

[0049] In some embodiments, the visor system 100 includes a camera 40 configured to capture an image of a person's face.

[0050] Specifically, the camera 40 is disposed on the sun visor 10, and the controller 30 is configured to identify the position of the eyeballs based on the facial image. For example, the camera 40 can capture a real-time image of the driver's seat of the vehicle 1000. When the driver is seated in the driver's seat of the vehicle 1000, the camera 40 can capture the driver's facial image in real time and obtain the driver's facial image based on the facial image of the driver.

[0051] Controller 30, mounted on vehicle 1000, is in communication with camera 40. Camera 40 can transmit facial images to controller 30. Controller 30 can use image recognition methods to identify the facial images and determine the position of the eyeballs. Controller 30 can adjust the position of sun visor 10 based on the eyeball position, allowing projection device 20 mounted on sun visor 10 to project images into the eyeball's field of view in real time.

[0052] Furthermore, the sun visor 10 may be provided with a connecting structure. By providing the connecting structure on the sun visor 10, the sun visor 10 can be movably connected to the vehicle 1000 via the connecting structure. The connecting structure can be a connecting bracket, one end of which is connected to the sun visor 10 via a nut or a rotating shaft, and the other end of which is connected to the roof of the vehicle 1000 via a nut or a rotating shaft. This allows the sun visor 10 to be folded when sun protection is not required and extended when needed.

[0053] The controller 30 can adjust the connection structure provided on the sun visor 10 according to the position of the eyeball, and thereby adjust the position of the sun visor 10. The sun visor 10 can prevent the sun visor 10 from blocking the line of sight, and when the projection device 20 is projecting, the projection can be directly into the eyes, thereby improving the viewing experience.

[0054] After the sun visor system 100 is opened, the sun visor 10 is lowered and the projection device 20 is opened. The sun visor 10 and the projection device 20 are automatically adjusted to an initial target position. The initial target position is a pre-set position that can be determined based on the position of the sun visor system 100 and the driving position of the vehicle 1000. In the target position, the projection device 20 disposed on the sun visor system 100 is directly facing the driving position of the vehicle 1000.

[0055] After the sun visor 10 and the projection device 20 are adjusted to the initial target position, the controller 30 can further control the drive motor 50 according to the identified position of the eyeball, so that the drive motor 50 drives the position change of the sun visor system 100, so that the sun visor system 100 projects the image to the field of view area of ​​the eyeball in real time, thereby improving the viewing experience.

[0056] 3 , the present application also provides a control method. The control method includes:

[0057] Step S100: identifying the position of the eyeballs according to the face image;

[0058] Step S200 : adjusting the position of the sun visor 10 of the vehicle 1000 according to the position of the eyeball so that the projection device 20 provided on the sun visor 10 projects an image to the field of view of the eyeball.

[0059] Specifically, in step S100, the controller 30 provided on the vehicle 1000 is in communication with the camera 40. The camera 40 can send a facial image to the controller 30. The controller 30 can use an image recognition method to recognize the facial image to determine the position of the eyeballs.

[0060] By identifying the driver's face image, the ROI (point of interest) region of the facial image can be cut to obtain a specific image. When it is necessary to obtain an eye image, the left and right eye images can be obtained based on the eyeball location region of the facial image. The left and right eye images can be used to determine the eyeball location.

[0061] Furthermore, the position of the eyeball can be the position of the pupil center of the eyeball, or the position of other points in the eyeball image. The position of the pupil center of the left eye and the position of the pupil center of the right eye, that is, the position of the eyeball, can be determined based on the left eye image and the right eye image.

[0062] After obtaining the facial image, the facial image may be subjected to binarization processing and operations such as corrosion and dilation to reduce or eliminate noise in the acquired facial image, thereby making the position information of the recognized eyeballs more accurate.

[0063] In some embodiments, the sun visor system 100 includes a drive motor 50 , and the controller 30 is configured to control the drive motor 50 to adjust the position of the sun visor 10 according to the position of the eyeball.

[0064] Specifically, the driving motor 50 can drive the connecting structure provided on the sun visor 10 to move the sun visor 10, thereby changing the position of the sun visor 10.

[0065] In step S200, the controller 30 can send a corresponding control signal to the drive motor 50 according to the identified position of the eyeball to control the running direction of the drive motor 50, and then adjust the position of the sun visor 10. The sun visor 10 can prevent the sun visor 10 from blocking the line of sight, and when the projection device 20 is projecting, it can project the image into the field of view area of ​​the eyeball, thereby improving the viewing experience.

[0066] The present application also provides an electronic device including a memory and a processor, wherein the memory is used to store a computer program, and the processor implements the control method of the above embodiment when executing the computer program.

[0067] Specifically, a processor can be composed of chips or circuits with data processing capabilities, such as a CPLD (Complex Programmable Logic Device), an FPGA (Field Programmable Gate Array), an MCU (Microcontroller Unit), a PLC (Programmable Logic Controller), and a CPU (Central Processing Unit). Memory can be one or more of ROM (Read Only Memory), RAM (Random Access Memory), a magnetic disk, or an optical disk.

[0068] The control method can be implemented by an electronic device. The electronic device can be the controller 30 of the above embodiment, that is, the controller 30 can be used to implement the control method. The controller 30 can be an ECU (electronic control unit) in the vehicle 1000, or a domain controller 30 integrated with multiple ECUs.

[0069] Of course, in other embodiments, the control method may be implemented by other devices or equipment, and is not limited to being implemented by the controller 30. The controller 30 may not be dedicated to implementing the control method of the embodiment of the present application, but may implement other functions and methods.

[0070] Furthermore, in some embodiments, the controller 30 is configured to control the adjustment direction of the sun visor 10 according to the movement direction of the eyeball.

[0071] In some embodiments, adjusting the position of the sun visor 10 according to the position of the eyeball includes: controlling the adjustment direction of the sun visor 10 according to the moving direction of the position of the eyeball.

[0072] Furthermore, in some embodiments, the controller 30 is specifically configured to: control the sun visor 10 to swing along the front and rear directions of the vehicle 1000 according to the up and down movement of the position of the eyeball; and / or control the sun visor 10 to swing along the left and right directions of the vehicle 1000 according to the left and right movement of the position of the eyeball.

[0073] In some embodiments, controlling the adjustment direction of the sun visor 10 according to the movement direction of the eyeball position includes: controlling the sun visor 10 to swing along the front and rear direction of the vehicle 1000 according to the up and down movement of the eyeball position; and / or controlling the sun visor 10 to swing along the left and right direction of the vehicle 1000 according to the left and right movement of the eyeball position.

[0074] When the head is raised or lowered, the position of the eyeball changes. The controller 30 can determine the raising action based on the recognized eyeball position, and further determine the change in the eyeball position. Based on the raising action, the controller 30 controls the sun visor 10 to swing forward and backward in the vehicle 1000, so that the projection device 20 provided on the sun visor 10 projects an image in real time into the eyeball's field of view.

[0075] Specifically, the connection structure provided on the sun visor 10 can drive the sun visor 10 to swing along the front-rear direction of the vehicle 1000. The drive motor 50 can drive the connection structure provided on the sun visor 10 to drive the sun visor 10 to swing along the front-rear direction of the vehicle 1000, thereby adjusting the sun visor 10 to move upward or downward.

[0076] If the user looks up while watching a movie, their eyeballs will move upward. The controller 30 can detect this upward eye movement based on the facial image. The controller 30 can then output a control signal to the drive motor 50 to swing the sun visor 10 backward along the vehicle 1000. This causes the drive motor 50 to drive the connecting structure on the sun visor 10 to swing backward along the vehicle 1000. As the sun visor 10 swings backward along the vehicle 1000, the sun visor 10 moves upward, enabling the projection device 20 mounted on the sun visor 10 to project images into the eye's field of view.

[0077] If the user looks up while watching a movie, their eyeballs will move downward. At this point, the controller 30 can detect the downward eyeball movement based on the facial image. The controller 30 can output a control signal to the drive motor 50 to swing the sun visor 10 forward along the vehicle 1000. This causes the drive motor 50 to drive the connecting structure beneath the sun visor 10 to swing the sun visor 10 forward along the vehicle 1000. As the sun visor 10 swings forward along the vehicle 1000, the sun visor 10 moves downward, enabling the projection device 20 beneath the sun visor 10 to project images into the eye's field of view.

[0078] When the head is turned left or right, the position of the eyeball changes. The controller 30 can determine the head turning action based on the recognized eyeball position, and further determine the change in the eyeball position. Based on the head turning action, the controller 30 controls the sun visor 10 to swing left and right of the vehicle 1000, so that the projection device 20 provided on the sun visor 10 projects an image in real time into the eyeball's field of view.

[0079] Specifically, the connection structure provided on the sun visor 10 can drive the sun visor 10 to swing along the left and right directions of the vehicle 1000. The drive motor 50 can drive the connection structure provided on the sun visor 10 to drive the sun visor 10 to swing along the left and right directions of the vehicle 1000, thereby adjusting the sun visor 10 to move left or right.

[0080] If the user turns their head to the left while watching a movie, their eyeballs will shift to the left. At this point, the controller 30 can detect the leftward movement of the eyeballs based on the facial image. The controller 30 can then output a control signal to the drive motor 50 to swing the sun visor 10 to the left along the vehicle 1000. This causes the drive motor 50 to drive the connecting structure on the sun visor 10 to swing the sun visor 10 to the left along the vehicle 1000. As the sun visor 10 swings to the left along the vehicle 1000, the position of the sun visor 10 shifts to the left, enabling the projection device 20 mounted on the sun visor 10 to project an image into the eye's field of view.

[0081] If a user turns their head to the right while watching a movie, their eyeballs will shift rightward. At this point, the controller 30 can detect rightward eye movement based on the facial image. The controller 30 can then output a control signal to the drive motor 50 to swing the sun visor 10 rightward along the vehicle 1000. This causes the drive motor 50 to drive the connecting structure beneath the sun visor 10 to swing the sun visor 10 rightward along the vehicle 1000. As the sun visor 10 swings rightward along the vehicle 1000, the position of the sun visor 10 shifts rightward, enabling the projection device 20 beneath the sun visor 10 to project an image into the eye's field of view.

[0082] In some embodiments, the controller 30 is further configured to recognize eye movements based on a facial image, and control the projection device 20 to turn on or off based on the eye movements.

[0083] In some embodiments, the control method further includes: recognizing eye movements based on the face image; and controlling the projection device 20 to turn on or off based on the eye movements.

[0084] The projection device 20 can be turned on or off by controlling the movement of the eyeballs, without the need for manual operation to control the projection device 20 to turn on or off, thereby increasing the convenience of operation.

[0085] Specifically, the controller 30 can determine eye movements based on the face image and judge the operation intention based on the eye movements. Eye movements such as gazing, eye saccades, eye movements, looking left, looking forward, looking right, or blinking can be executed to control the projection device 20 to turn on or off.

[0086] For example, the projection device 20 can be shut down by eye movement. When the eye is outside the projection screen of the projection device 20 or the eyes are closed, the controller 30 can determine that the eye is outside the projection screen or closed based on the recognized eye position. In this case, it can be assumed that the user is not viewing a movie, and the controller 30 can control the projection device 20 to stop working and shut down, thus avoiding wasted power.

[0087] Furthermore, the controller 30 may also determine the time to perform the eye movement according to the identified eye position. If the time to perform the eye movement is long enough, the controller 30 may control the power on or off of the projection device 20 based on the performed eye movement.

[0088] For example, when the eyeball is outside the projection screen of the projection device 20 or when the eyes are closed, the controller 30 will not immediately control the projection device 20 to shut down. If the eyeball is outside the projection screen of the projection device 20 or when the eyes are closed for 10 seconds, the controller 30 controls the projection device 20 to shut down.

[0089] The workflow of the projection device 20 according to the embodiment of the present application can be shown in FIG4 . The sun visor system 100 can be started by an input device, which can be a button or a voice recognition module provided on the sun visor system 100 , and can be controlled to start by touching the button or issuing a power-on voice command.

[0090] After the sun visor system 100 is opened, the sun visor 10 is lowered and the projection device 20 is opened. The sun visor 10 and the projection device 20 are automatically adjusted to an initial target position. The initial target position is a pre-set position that can be determined based on the position of the sun visor system 100 and the driving position of the vehicle 1000. In the target position, the projection device 20 disposed on the sun visor system 100 is directly facing the driving position of the vehicle 1000.

[0091] After the sun visor 10 and the projection device 20 are adjusted to the initial target position, the controller 30 can further control the drive motor 50 according to the identified position of the eyeball, so that the drive motor 50 drives the position change of the sun visor system 100, so that the sun visor system 100 projects the image to the field of view area of ​​the eyeball in real time, thereby improving the viewing experience.

[0092] When the controller 30 detects based on the facial image that the eyeball is outside the projection screen of the projection device 20 or the eyes are closed, the controller 30 will not immediately control the projection device 20 to shut down. If the eyeball is outside the projection screen of the projection device 20 or the eyes are closed for 10 seconds, the controller 30 controls the projection device 20 to shut down.

[0093] 5 , in some embodiments, the sun visor system 100 includes an optical waveguide module 21 , the projection device 20 is configured to determine a real information image based on an optical signal received by the optical waveguide module 21 , and the projection device 20 is configured to project the real information image.

[0094] Specifically, the optical waveguide module 21 can be a diffraction optical waveguide. The optical waveguide module 21 can include an incoupling grating, a waveguide substrate, and an outcoupling grating. When the projection device 20 is in operation, incident light enters the incoupling grating, is transmitted or reflected by the incoupling grating, enters the waveguide substrate, is transmitted to the outcoupling grating, and is coupled out by the outcoupling grating to enter the eye.

[0095] Vehicle 1000 is also equipped with a corresponding visual sensor that can identify road conditions ahead and capture images of the vehicle's surroundings, known as real-world information images. Incident light carrying the real-world information image is projected onto the incoupling grating, where it is transmitted or reflected into the waveguide substrate. It is then transmitted to the outcoupling grating and coupled out by the outcoupling grating before entering the eye.

[0096] 6 , in some embodiments, the projection device 20 includes an image generation module 22 , which is configured to generate a virtual image. The image generation module 22 is configured to fuse the real information image and the virtual image to obtain a fused image, and the projection device 20 is configured to project the fused image.

[0097] Specifically, the image generation module 22 may include a graphics processing unit (GPU), and the image generation module 22 may be used to generate images required for projection.

[0098] The image generation module 22 can generate a virtual image. The image generation module 22 can also generate a corresponding real image based on the optical signal received by the optical waveguide module 21. The projection device 20 can project the virtual image generated by the image generation module 22, or the generated real image.

[0099] Augmented reality (AR) technology integrates virtual information with the real world, enabling precise integration of virtual interactive images with real-world scenes. Image generation module 22 can also fuse real-world information images and virtual images based on AR technology to produce a fused image. This fused image has special animation rendering effects, allowing the driver to directly see a three-dimensional (3D) image of the vehicle 1000's surroundings, with the image clearly projected to their eyes.

[0100] In some embodiments, the sun visor system 100 includes a sun visor, and the projection device 20 also includes an image generation module 22, which is configured to generate a virtual image. When the sun visor isolates the light wave signal received by the optical waveguide module 21, the projection device 20 is configured to project the virtual image.

[0101] Specifically, the light shield can be used to isolate the lightwave signals received by the optical waveguide module 21. The light shield can cover the coupling grating of the optical waveguide module 21, preventing ambient light from entering the coupling grating. The image generation module 22 cannot generate a corresponding real information image based on the lightwave signals received by the optical waveguide module 21. In this case, the image projected by the projection device 20 can be a virtual image generated by the image generation module 22.

[0102] An embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program is executed by a processor, it implements the control method of any of the above embodiments.

[0103] Specifically, the storage medium may be any medium that can store computer programs, such as a ROM (Read Only Memory), a RAM (Random Access Memory), a magnetic disk, or an optical disk.

[0104] In the description of this specification, the descriptions with reference to the terms "particularly", "further", "particularly", "understandably", etc. are intended to mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms are not intended to refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0105] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0106] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A sun visor system for a vehicle, comprising: Sun visor; a projection device, the projection device being arranged on the sun visor; A controller is configured to identify the position of an eyeball according to a facial image and adjust the position of the sun visor according to the position of the eyeball so that the projection device projects an image onto a field of view area of the eyeball.

2. The sun visor system according to claim 1, wherein: The sun visor system includes a camera configured to acquire the facial image.

3. The sun visor system according to claim 1, wherein: The controller is configured to control an adjustment direction of the sun visor according to a movement direction of the position of the eyeball.

4. The sun visor system according to claim 3, wherein: The controller is specifically configured as follows: Controlling the sun visor to swing along the front-rear direction of the vehicle according to the up-and-down movement of the position of the eyeball; and / or The sun visor is controlled to swing along the left and right directions of the vehicle according to the left and right movement of the position of the eyeball.

5. The sun visor system according to claim 1, wherein: The controller is further configured to recognize the movement of the eyeball according to the facial image, and control the projection device to turn on or off according to the movement of the eyeball.

6. The sun visor system according to claim 1, wherein: The sun visor system includes a driving motor, and the controller is configured to control the driving motor to adjust the position of the sun visor according to the position of the eyeball.

7. The sun visor system according to claim 1, wherein: The sun visor system includes an optical waveguide module, the projection device is configured to determine a real information image according to an optical signal received by the optical waveguide module, and the projection device is configured to project the real information image.

8. The sun visor system according to claim 7, wherein: The projection device includes an image generation module, the image generation module is configured to generate a virtual image, the image generation module is configured to fuse the real information image and the virtual image to obtain a fused image, and the projection device is configured to project the fused image.

9. The sun visor system according to claim 7, wherein: The sun visor system includes a sun visor, and the projection device further includes an image generation module, which is configured to generate a virtual image. When the sun visor isolates the light wave signal received by the optical waveguide module, the projection device is configured to project the virtual image.

10. A control method for a vehicle, wherein: The control method includes: Identify the position of the eyeballs based on a face image; The position of the sun visor of the vehicle is adjusted according to the position of the eyeball so that the projection device arranged on the sun visor projects the image to the field of view area of the eyeball.

11. The control method according to claim 10, wherein: The adjusting the position of the sun visor according to the position of the eyeball comprises: The adjustment direction of the sun visor is controlled according to the moving direction of the position of the eyeball.

12. The control method according to claim 11, wherein: Controlling the adjustment direction of the sun visor according to the movement direction of the eyeball position includes: Controlling the sun visor to swing along the front-rear direction of the vehicle according to the up-and-down movement of the position of the eyeball; and / or The sun visor is controlled to swing along the left and right directions of the vehicle according to the left and right movement of the position of the eyeball.

13. The control method according to claim 10, wherein: The control method further includes: recognizing eye movements based on the facial image; The projection device is controlled to be turned on or off according to the movement of the eyeball.

14. An electronic device, wherein: The electronic device includes a memory and a processor, the memory is used to store a computer program, and the processor implements the control method according to any one of claims 10 to 13 when executing the computer program.

15. A vehicle, wherein: The vehicle comprises the sun visor system according to any one of claims 1 to 9, or the electronic device according to claim 14.

16. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, and when the computer program is executed by a processor, the control method according to any one of claims 10 to 13 is implemented.

Images